What is he asking? Why does Neil think that something is on the verge of crumbling away?

He straightens, appearing exhausted. "It was...difficult. To talk to those guys," he gives quietly. "It was harder hearing the possibility that I could be this brand of human sexuality. I'm suddenly wondering if all of that was unnecessary."