There have been two major studies into the hepatoxicity of nutmeg.  They have focused on two major elements, saffrole and myristicin.  Saffrole is definitely not something you want to drink straight; it has been shown to have toxic effects in animal studies.  However myristicin has been shown to be hepaprotective.  So it's possible that the net effect will be zero (unconfirmed), or at least modulated and less bad than drinking saffrole.  Not something for every day, but occasional use I'm comfortable with.