In my opinion the biggest drawback to psychedelic usage could be a withdrawal from society....but just as often they reconnect you to society.  The danger I believe arises when you start waking up while simultaneously realizing that the society you live in is very much asleep.  The goal then is to not become so disgusted with your society that you want no part in it....I have danced on that border a few times myself.  The remedy however is dead simply...discontinue usage for while.

Good Luck...be safe.