Simple movement like HJKL should not be recorded in jump history for Ctrl-O and Ctrl-I

[gstggsstt]

I usually use Ctrl-O and Ctrl-I to jump back or forward while coding. But simple movements such as HJKL are recorded in the queue, which real vim does not. It always takes a lot efforts to goto the code I want. I would appreciate it if you could fix this problem.
Best wishes, thank you so much.