The average for neurology is above 180K according to the MGMA data I have seen (more like 250k), but you are correct that we average less than surgical subspecialties and many medical subspecialties.
In my opinion, it boils down to lack of procedures (we are primarily a cognitive field like primary care), and that what procedures we do have are often also performed by other specialties like pulmonology and physiatry (and the market for these services gets split with other folks). EEGs do not really reimburse that much. The imaging that we so prolifically order is all swept up by radiologists (it is rare for neurologists to complete neuroimaging fellowships, own their own MRI/CT scanners, or bill in any way for interpretation of radiological studies). EMG reimbursements have recently been cut by about 50% (!), and home sleep testing (which will continue to grow in usage) is much cheaper than in-lab sleep testing. Bottom line? Salary is often based on income generation, and a neurosurgeon in the OR can make more in twenty minutes than we make all day.
However, the supply/demand ratio for neurologists strongly favors us in the job market, and this has resulted in more recent salary increases than what has traditionally been the norm. Other specialties are increasingly clueless about neurological medicine because they consult like crazy in their training programs, and hospitals need us for accreditation for their "centers of excellence" in epilepsy, stroke, etc.