The Reserve Bank's governor acknowledged borrowers would likely be disappointed but warned of a "harder" alternative.