If the average is always seemingly low, is there always people below the average?

yes, perhaps the people getting the really crappy score are not bragging about them. Also, maybe some schools make everyone take the test, and that includes some learning disabled students or even kids who bomb it on purpose because they don't want to take it. That would bring the average scores down.