I'm sure you drag many of your county's stats down a lot. But you do help increase the "Assholes per Square Mile" stat.
The same issues you mention for your county is what pulls SC's stats down.... most of our counties are rural, and many in the "lowcountry" are very poor. The demographics just aren't in their favor.
Of course we have Columbia, Greenville/Spartanburg, and the Charleston area as our nice areas, all with universities, industry, all the modern amenities, etc. And the best part... nowhere near as many assholes as Maryland!