Cabinet minister Mark Harper has said it was “a bit odd” that MP Diane Abbott was not called to speak at Prime Minister’s Questions (PMQs) when the racism row centred on her was raised.