The social and cultural expectations around work vary from place to place. In Europe, for example, it’s thought of as normal to need time away from your job, to place a high value on family, so that expectation is built into the work culture in a way that many Americans see as “being coddled.” On the other hand, the generous allotment of vacation time and social supports for taking it help them rank high in happiness.
Here in America, the expectation is that people who value family or time off just aren’t working hard enough, and if you just work harder you will take care of your family better. Also, since the expectation of time off isn’t really built into the culture the same way, you could easily be replaced by someone who feels stronger about working hard. If you are competing against people who will come in earlier, stay later, and work more days for even less pay, the pressure is on to do the same just to be seen as too valuable to replace. The cultural norms shape this.
In Japan, it’s even worse. See KarÅshi.