Why do people assume that in accordance to the golden rule that...?

The way I treat others is not how I would like to be treated? I treat people coldly and ignore them because I want to be treated the same way and ignored so that I may be left in peace to go about my daily life. Some people assume that I am 'cruel' or 'evil' but I follow the golden rule perfectly. I treat others as I would like to be treated. So what's the problem?