From what I gather, it is a sacred symbol to these religions. I wonder how they felt when they started to see it pop up and used in a pretty hateful manner.
For the most part, I've never seen them as being deeply troubled. I've traveled extensively in India and on encountering the swastika, I felt the same negative reaction that any Westerner would. For Indians, they do not have such a relationship to the symbol as it has always been a part of their culture.
Secondarily, I think you might be surprised to know that much of the world is fascinated by Hitler. By that I mean, he's treated as a person of great interest and historical curiosity and not as the absolute representation of evil as is so ingrained in the West. While walking on the streets of South Asia I've seen many book sellers with copies of Mein Kampf. I would not take that as an endorsement of Hitler or anything of that sort, but rather as a sense of 'who was this man.' You will find a few instances of Bollywood actresses saying, for instance, that she admired Adolph Hitler and also a Swastika restaurant modeled on Nazi design in Mumbai.