I worked on a farm for five years. It was primarily produce, but they kept hens for eggs as well. They were big advocates of “barn-raised” chickens (as opposed to free-range or cage-raised).
They also carried (from local farms) grass-fed beef and fresh turkeys that were hand-fed and treated better than most of the elderly in America.
I’m also a bit of a foodie and I will tell you that, without a doubt, the eggs, beef, and bird tasted much better than their average, supermarket counterparts.
So, with regard to taste — I care.
But here’s the thing: those perfectly pampered animal products cost a far too much for your average family and, as @Seek said, I like to eat every day.
So in actual practice — no, I cannot afford to care.