my late father was a Holocaust survivor, I don't think I could go to a concentration camp, but I have been to the Holocaust museum in DC and like you said it was very sobering. I also went to the register office there to find out if they had any info on my father. He was a displaced person after the war. At first the man couldn't find anything and I was slowly walking away when he came after me and found some papers about my father. I was thrilled, it made me feel like I still had contact with my father. He was not in a concentration camp, but he did spend time in Russia in one of their prisons, which wasn't any picnic.
I also don't know if I could bear it. My grandfather (German-American Jew) served in the Army and helped with the liberation of Buchenwald. I remember having pictures of his family and my grandmother's family at their house, but never hearing anything about them. I actually didn't find out my grandfather even served in the Army until after he died. My father brought it up when my sister was being an idiot (dating a Holocaust denier). I know we originally came from Germany and Poland, but that's about it. I think there's definitely a reason why this isn't something we talked about, and I'm pretty sure the answer isn't any good. I can't even talk about the Holocaust without shedding tears.
I do think every non-Jew must visit Auschwitz.