A controversial loophole which allows PSNI officers to retire while facing misconduct investigations could be closed, the Justice Minister has said.