No you dont NEWB...
You can have a 5" drop in back as long as you take out your bump stops, and you will still have plenty of clearance.. If you bounce hard it will bottom out on the frame..
Before I bagged my toyota I had a 4.5" all around.. and it was fine