There's always more to say on the subject, but here's a previous thread with an answer from u/Roggenroll that may be helpful. Basically, it was almost entirely due to xenophobia, with very little consideration given to the drug's actual (non-exaggerated) effects.