I think, basically people just underestimate mushrooms, and then they suddenly find themselves in the middle of something that totally dwarfs LSD in every way. With ayahuasca, people probably know that it might be very unwordly or intense.