power througt the ground?

hey last nigh i was messin around with my new stereo stuff, and when i hit my switches it bumps my speakers real hard... and i also have a small amount of power comin through my ground wire.. or i guess that what it is. i can hook up a test light and it lights it up but extremely dim. any ideas?