Imran Khan was deeply disappointed when the government was removed