Scott Sumner suggests utilitarian stories drive our moral intuitions:
One of the most common strategies of the anti-utilitarian position is to assume some societal set-up which shocks our sensibilities, and then assume that it would satisfy the utilitarian criterion of maximizing aggregate happiness. Thus we might be asked to imagine a scenario where the total pleasures of the slave-owner exceed the suffering of the slaves … Bryan has an even more shocking example where the benefits to Nazi’s from the Holocaust exceeded the suffering to the Jews. … At the end of these thought experiments we are told that unless we are willing to embrace the society envisioned in the thought experiment, we must, on logical grounds, give up on utilitarianism.
I have several interrelated objections to this style of philosophical inquiry. I’d like to start with Richard Rorty’s assertion that the narrative arts (novels and film) produce liberal values. … So if Rorty is correct, how do we know that slavery was so awful? Because we have been exposed to accounts of slavery in the arts which vividly showed how the suffering of slaves was immeasurably greater that the frivolous pleasures of the slave-owner. Can we then turn around and use an imaginary slave-owning society that passes the utilitarian test as an argument against utilitarianism? I’m not sure that we can, unless one can show that our initial visceral reaction against slavery is based on non-utilitarian grounds, i.e. based on some abstract philosophical principle. And that’s much harder than many people might imagine.
This seems to me a powerful argument. What data could test it?
Added 9pm: As I understand it, the argument isn't that we can't now imagine compelling stories of, e.g., non-utilitarian-maxing slavery. The argument, I think, is more that we overgeneralize from the stories where we first picked up our morals. For example, we first hear stories where slave owners gain less than slaves lose, and then come to see all slavery as bad.
As a utilitarian, i get annoyed by the rather constant attacks on my morality of choice(tm). So being the type to over think things, i generally feels there's three major complaints against utilitarianism.
1) Almost every moral philosophy [b]will[/b] make an "Appeal to utilitarianism", namely the idea that there philosophy will be somehow better for everyone if followed and if you pull on that string you can very likely reduce the philosophy into a form of rules based utilitarianism. Utilitarianism can subsume practically any other system into itself, people don't want there pet ideology being an aspect of a bigger ideology.2) It reduces morality to a math problem, and people don't seem to want to accept the idea that all choice is really just a bunch of complex math problems. So morality is one of the places they more firmly sit on "This clearly isn't math."3) Utilitarianism, is, hard. It judges based on consequence which means there's no easy answer of "Will this be right or wrong." you literally can't know until after the fact(And since that action causes other actions.....), it also means everyone literally everyone fails to live up to it, and most people don't want to accept they aren't just and moral people.
Behold my bias, assuming not being a utilitarian is born of your bias.
"...reaching for the Holocaust as your example of evil every time strikes me as a kind of intellectual laziness."
Paul, I agree with those who criticize Godwin's Law. "Intellectual laziness" is useful shorthand when people want to discuss evil in some context without discussing endlessly what evil is:
1st guy: "Suppose you had this evil guy. An abortionist".2nd guy: "Wait, I don't find abortionists evil."
1st guy: "Suppose you had this evil guy. A politician".2nd guy: "Not all politicians are evil. Take for example my favorite..."
1st guy: "Suppose you had this evil guy. A murderer.".2nd guy: "What do you mean by murder? Killing is sometimes defensible..."
1st guy: "Suppose you had this evil guy. Like Hitler".2nd guy: "Ok. Go on."