Low-income workers who aren’t able to choose their work schedules are especially hard hit. And that has a cost of its own.