Letting borrowers off the hook could be bad for the whole market.