Shashi Tharoor says he never deviated from the party line