Sir Keir Starmer said he has “long believed in borrowing to invest”, which can act as a “catalyst” for private investment.