I guess now you learned that waves get much scarier when they can 'feel'
the bottom. So conditions far out at sea which aren't much can be
worrisome close in.

I don't think your strategy of not looking around after seeing a wave
which scared you is a tactic that will assure you a long life at sea.
Most of them will 'pass under' the boat as you put it. You may as well
get used to the sight of waves which look taller than you standing on
your deck. This isn't uncommon but likewise, as long as you are afloat,
isn't fatal.