I have never traveled, but the thought of it is in my mind, also i'm losing my ears..so is it ever possible?

Recently i've gotten alot of ear damages, clogging and ear drum ruptures. anyways, so that's oen thing why i feel i cannot travel. But also, i'm not affluent, don't have money don't have goodjob. and i feel like people in the country i would visit, are so mean and would hate me and not accept me. I'm 26 with almost no travel experience, i never go out of my city, except about 3 times to mexico whn i was a kid. In the back of my mind i feel i would like to visit japan or something in asia, but i don't know. i feel i'm not worthy.