<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Normal Human Heroes &#187; Utilitarianism</title>
	<atom:link href="http://www.normalhumanheroes.com/tag/utilitarianism/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.normalhumanheroes.com</link>
	<description>Saving the World, Sans Superpowers</description>
	<lastBuildDate>Mon, 16 May 2011 02:40:09 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Humanity Saves Itself</title>
		<link>http://www.normalhumanheroes.com/2011/05/humanity-saves-itself/</link>
		<comments>http://www.normalhumanheroes.com/2011/05/humanity-saves-itself/#comments</comments>
		<pubDate>Mon, 16 May 2011 02:39:36 +0000</pubDate>
		<dc:creator>Normal Human Heroes</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Heroism]]></category>
		<category><![CDATA[Utilitarianism]]></category>

		<guid isPermaLink="false">http://www.normalhumanheroes.com/?p=226</guid>
		<description><![CDATA[[This post is about an ideal. There may be good arguments against striving for this ideal. If one does strive for the ideal then this point should be kept in mind.]
I&#8217;m not sure how common this mistake is, but sometimes I get to feeling like heroes are above humanity. Like they&#8217;ve transcended, stepped above, and [...]]]></description>
			<content:encoded><![CDATA[<p>[This post is about an ideal. There may be good arguments against striving for this ideal. If one does strive for the ideal then this point should be kept in mind.]</p>
<p>I&#8217;m not sure how common this mistake is, but sometimes I get to feeling like heroes are above humanity. Like they&#8217;ve transcended, stepped above, and are reaching back to help others. But when I try to live up to this kind of ideal I almost inevitably come to feel burdened, flat, demotivated, and alienated.</p>
<p>This remains true even after coming across some extremely useful techniques for handling my emotions.  I&#8217;m able to dissipate negative emotions by realizing that emotions are intrinsically orthogonal both to the state of the world and to the values I have over those states. I&#8217;m also able to sit with negative emotions by accepting them, neither fighting nor fleeing them. Armed with these techniques I can embrace all my emotions, I can remove suffering from my physical and emotional pain, and I can greatly amplify the pleasure I gain from many experiences.</p>
<p>Even so, I still run into problems when I view myself as something above humanity and human concern. What I call this higher class is unimportant, whether it&#8217;s &#8220;player characters&#8221;, &#8220;spiritually developed humans&#8221;, or anything else.</p>
<p>When I view myself as approximately  without any concerns or need for consideration, then when my own desires  arise I think to myself &#8220;Ah! I have the ability to be free of suffering  in any situation! I will therefore universally apply this power to any of my  concerns that don&#8217;t assist me in being a bad-ass hero.&#8221; This separates me from  connecting emotionally with the concerns and values of my own life. There are two or three problems with this approach.</p>
<ol>
<li>My life becomes flat when I cease to care about its ups and downs.  Happiness is much more vivid when you pay attention to it and are glad  of it. And there are better ways to be unruffled by small concerns.</li>
<li>It becomes much easier to view altruism as a burden when I don&#8217;t assign  importance to the quality of my own life. I think I experience this  effect less than most, but it&#8217;s certainly very significant.</li>
<li>When I don&#8217;t care about the good or bad things in my own life it then  becomes much harder to care about the existence of those things in the  lives of others. I&#8217;ve written about this <a href="http://www.normalhumanheroes.com/2010/08/dont-put-that-aside/">previously</a>.</li>
</ol>
<p>When I view myself as something above the majority of humanity I then come to feel alienated from that humanity. Humanity starts to gain the feeling of the &#8220;civilians&#8221; in video games, little people who stand around needing and hoping to be saved. You get points for saving them, sometimes they&#8217;re even the sole objective, but they aren&#8217;t <em>characters</em>.</p>
<p>Perhaps even worse, by thinking of heroes as being in a class outside humanity proper I remove from the class of humanity exactly those people whom I most look up to and admire. I deprive humanity of its heroes by considering non-human all those people who do the coolest things,</p>
<p>So what&#8217;s the alternative?</p>
<p>Heroes, then, are <em>not</em> in a different class. Heroes are people, just the same as other people. They may be a little less burdened by suffering, they may have internalized more heroic memes, they may be more gifted by ability, they may have trained harder, and they may be currently more altruistic in practice than most people, but they are still just as human.</p>
<p>And no (ideal) hero saves others without saving herself. Even if it arises that a hero can do the most good by sacrificing herself, she does not do so because she has no moral value, having transcended the &#8220;petty concerns&#8221; of humanity. She has just as much moral value as the people she is saving, and her sacrifice is a terrible loss. Not because she is better than most human beings, but simply because she <strong>is</strong> a human being. She would sacrifice herself merely because she can save many by sacrificing one. It would be just as good and sad a deed to sacrifice someone else in order to save others, even if that reveals less virtue. But virtue acts as a status signal and a useful indicator for humans to aim for in the pursuit of doing good; it is quite distinct from the actual good done.</p>
<p>And if the hero does not suffer from something as others do? Then it may reduce suffering for the hero to put herself in the place of others. But it&#8217;s still just as good and wonderful a thing for her to enjoy friendships, and to have a romance, and to spend a pleasant afternoon, as it is for anyone else.</p>
<p>Heroes are people that don&#8217;t stop with themselves when they set out to save people. They work to save as many as they can. Maybe it&#8217;s because they&#8217;ve generalized that it&#8217;s a terrible thing when they suffer or die and it&#8217;s a wonderful thing to flourish among friends, and so likewise with others. Maybe they just care a great deal about others without involving any explicit moral thinking at all.</p>
<p>I have a collection of inspiring pictures I&#8217;ve saved from the net, and as I went through them again I made sure to view the heroes not as something above humanity, something transcended and beyond moral valence, but as &#8220;merely&#8221; exceptionally altruistic and capable human beings. Their suffering is just as worthy of concern as anyone else&#8217;s, even if they are better at avoiding it, and equal too are their joys. And in an ideal world, they know and realize this: they are part of the humanity which they aim to save.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.normalhumanheroes.com/2011/05/humanity-saves-itself/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Don&#8217;t Put That Aside</title>
		<link>http://www.normalhumanheroes.com/2010/08/dont-put-that-aside/</link>
		<comments>http://www.normalhumanheroes.com/2010/08/dont-put-that-aside/#comments</comments>
		<pubDate>Tue, 03 Aug 2010 22:49:58 +0000</pubDate>
		<dc:creator>Normal Human Heroes</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Heroism]]></category>
		<category><![CDATA[Love]]></category>
		<category><![CDATA[Things To Protect]]></category>
		<category><![CDATA[Utilitarianism]]></category>

		<guid isPermaLink="false">http://www.normalhumanheroes.com/?p=175</guid>
		<description><![CDATA[This post refers to concepts from the LessWrong posts Something To Protect, and The &#8220;Intuitions&#8221; Behind &#8220;Utilitarianism&#8221;. If you haven&#8217;t read them, I suggest it (and in that order); they&#8217;re very good.
There&#8217;s more than one reason to work to reduce extinction risk, but probably one of the most powerful is having something to protect. It [...]]]></description>
			<content:encoded><![CDATA[<p>This post refers to concepts from the LessWrong posts <a href="http://lesswrong.com/lw/nb/something_to_protect/" target="_blank">Something To Protect</a>, and <a href="http://lesswrong.com/lw/n9/the_intuitions_behind_utilitarianism/" target="_blank">The &#8220;Intuitions&#8221; Behind &#8220;Utilitarianism&#8221;</a>. If you haven&#8217;t read them, I suggest it (and in that order); they&#8217;re very good.</p>
<p>There&#8217;s more than one reason to work to reduce extinction risk, but probably one of the most powerful is having something to protect. It seems to be a fact of human psychology that we&#8217;re willing to work harder and sacrifice more to protect something external to ourselves, such as loved ones, a &#8220;great noble truth&#8221;, or a nation/ethnic group/religious group, etc. Not only does working for something-we-want-to-protect bring us to do more, but it seems to also make us more satisfied while we do it.</p>
<p>6 billion people is a <em><strong>lot </strong></em>of people, but few if any of us feel an intuitive emotional kick about 6 billion people. It&#8217;s doesn&#8217;t mean we&#8217;re villains, our brains just aren&#8217;t built to multiply like that. Back in the <a href="http://en.wikipedia.org/wiki/Evolutionary_psychology#Environment_of_evolutionary_adaptedness" target="_blank">EEA</a>, we had no use for getting very emotional about people we didn&#8217;t know, because we knew everyone in our group.</p>
<p>One kind of work-around to this gap in our mental hardware is to take your concern for those close to you and <a href="http://lesswrong.com/lw/n9/the_intuitions_behind_utilitarianism/" target="_blank">multiply</a>. Chances are that most people are cared for just as much as you care for your loved ones, and care for others in turn. Even if you think that only 1 in 4, or 1 in 100, is worth feeling that much for, that&#8217;s still 60,000,000 people. And 60,000,000 multiplied by however much you care for those close to you, is <strong><em>a fucking huge amount</em></strong>. Not that we&#8217;re capable of<em> </em>honestly multiplying like that, or physically capable of<em> </em><em>feeling</em> that much concern if we could do the multiplication, but it can still bring you to feel massive amounts, and lead you to put a more coherent weight on certain outcomes when making conscious decisions.</p>
<p>~~~~~~~~</p>
<p>I actually wrote this post before the one on positive motivation, but I definitely didn&#8217;t want this to be taken the wrong way. I am <strong>NOT</strong> saying that we have a fantastically huge obligation, a duty to save all human lives. I am <strong>NOT</strong> saying we&#8217;ll be bad people if we don&#8217;t do all we can to protect the ones we care about. Personally I&#8217;m not really concerned about whether or not I&#8217;m a &#8220;bad person&#8221;, and I&#8217;m starting to think this is helpful. The fact of the matter is that I just really <strong><em>want</em></strong> my loved ones to survive, I <strong><em>want</em></strong> to save and help as many as I can. That&#8217;s not <em>all</em> I want, I have some technically selfish goals as well, and I endorse them. But I also have a <em>very</em> strong desire to preserve human lives and human value in the universe. And if you&#8217;re concerned about existential risk, I&#8217;m guessing you do as well.</p>
<p>~~~~~~~~</p>
<p>There&#8217;s a danger with this kind of multiplication, one that I didn&#8217;t see coming. With that much concern, a person can really get overzealous in protecting the things they care about. A little over a year ago, I explicitly decided to stop hanging out with my friends, unless I ran into them by chance. I did this in order to get more work done. I knew that I would mind that and so would they, but I&#8217;d rather them be unhappy for now and alive later. I&#8217;m recovering from the pit I fell into, so I&#8217;m starting to be able to emotionally understand why I did that, but for a while that level of concern was practically unimaginable. Anyway, I rapidly found that I couldn&#8217;t keep working without recreational social contact, but that didn&#8217;t completely end the problem.</p>
<p>I now took time for fun social gatherings, but I grew distant from people. I saw my friends now and then, but I was still on the other side of a divide. I&#8217;ve been thinking about this for a while, trying to figure out how to describe it. So far my best description was that they weren&#8217;t in my group anymore; I was in a group of me. I still cared about them, but I had a job to do. I didn&#8217;t want them to rely on me and me not to be there, if they made plans with me in them. I could get by with less hanging out than they&#8217;d want if I were close to them. Also, and this might be the larger part, I no longer took the time for many things I used to do, and enjoyed doing with them. I used to play video games, playing and discussing them with my friends. I used to put together role-playing campaigns with them in it. I used to be much more content to just lay around cuddling with my girlfriend. I used to spend several hours watching shows or movies with others.</p>
<p>I got along on my own, with occasional socializing. I still cared about my friends, but that care slowly became more and more abstract. They weren&#8217;t close to me anymore, nobody was. I wasn&#8217;t actually lonely or sad, but I was fairly alone. I can&#8217;t help but recall some lines from a favorite game:</p>
<p>&#8220;&#8230; I wish someone could have been there for you.&#8221;<br />
&#8220;I&#8217;m used to being on my own.&#8221;<br />
&#8220;One can be TOO self-sufficient, I&#8217;m coming to believe.&#8221;</p>
<p>And that&#8217;s how it came to be that I couldn&#8217;t even imagine or remember the type of dedication that lead me to separate myself in the first place. That&#8217;s how it came to be that I didn&#8217;t have much to multiply anymore. Y = 6,400,000,000 * X, and Y was so large that in my zeal I cut down X, and Y sunk with it.</p>
<p>I&#8217;m recovering from my mistake now, and I don&#8217;t know if anyone is even in danger of trying what I tried, but take my advice: keep close the ones you care about. Don&#8217;t put that aside. We&#8217;re social creatures, and we draw so much of our power from each other. Your friendships are important: for your happiness, for their happiness, and for all the good things your accomplishments will bring.</p>
<div id="_mcePaste" style="overflow: hidden; position: absolute; left: -10000px; top: 479px; width: 1px; height: 1px;">I used to be much more content to just lay around cuddling with my girlfriend.</div>
]]></content:encoded>
			<wfw:commentRss>http://www.normalhumanheroes.com/2010/08/dont-put-that-aside/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Where the Hell is Matt?</title>
		<link>http://www.normalhumanheroes.com/2010/05/where-the-hell-is-matt/</link>
		<comments>http://www.normalhumanheroes.com/2010/05/where-the-hell-is-matt/#comments</comments>
		<pubDate>Wed, 19 May 2010 12:25:04 +0000</pubDate>
		<dc:creator>Normal Human Heroes</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Beauty]]></category>
		<category><![CDATA[Good Stuff]]></category>
		<category><![CDATA[Music]]></category>
		<category><![CDATA[Things To Protect]]></category>
		<category><![CDATA[Utilitarianism]]></category>
		<category><![CDATA[Utopia]]></category>

		<guid isPermaLink="false">http://www.normalhumanheroes.com/?p=116</guid>
		<description><![CDATA[March 5th, 2010
This is pretty cool, you can find out more at Matt’s website.

For those who don’t follow LessWrong: the human mind suffers terribly from scope insensitivity. I.e. experiments in which people pay much more to save one child, than they do to save 8. The brain just doesn’t multiply well, and the world is [...]]]></description>
			<content:encoded><![CDATA[<p>March 5th, 2010<br />
This is pretty cool, you can find out more at <a href="http://www.wherethehellismatt.com/" target="_blank">Matt’s website</a>.</p>
<p><object classid="clsid:d27cdb6e-ae6d-11cf-96b8-444553540000" width="560" height="340" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=6,0,40,0"><param name="allowFullScreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="src" value="http://www.youtube.com/v/zlfKdbWwruY&amp;hl=en_US&amp;fs=1&amp;rel=0&amp;color1=0x006699&amp;color2=0x54abd6" /><param name="allowfullscreen" value="true" /><embed type="application/x-shockwave-flash" width="560" height="340" src="http://www.youtube.com/v/zlfKdbWwruY&amp;hl=en_US&amp;fs=1&amp;rel=0&amp;color1=0x006699&amp;color2=0x54abd6" allowscriptaccess="always" allowfullscreen="true"></embed></object></p>
<p>For those who don’t follow LessWrong: the human mind suffers terribly from <a href="http://wiki.lesswrong.com/wiki/Scope_insensitivity" target="_blank">scope insensitivity</a>. I.e. experiments in which people pay much more to save one child, than they do to save 8. The brain just doesn’t multiply well, and the world is a huge place.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.normalhumanheroes.com/2010/05/where-the-hell-is-matt/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Story of an AI</title>
		<link>http://www.normalhumanheroes.com/2010/05/story-of-an-ai/</link>
		<comments>http://www.normalhumanheroes.com/2010/05/story-of-an-ai/#comments</comments>
		<pubDate>Wed, 19 May 2010 00:07:10 +0000</pubDate>
		<dc:creator>Normal Human Heroes</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[AI]]></category>
		<category><![CDATA[Friendliness]]></category>
		<category><![CDATA[Utilitarianism]]></category>

		<guid isPermaLink="false">http://www.normalhumanheroes.com/?p=66</guid>
		<description><![CDATA[November 11th, 2009
It was a far leap ahead of its creator; in relative comparison the creator barely had thoughts. It was not so far ahead of previous designs, but it was just enough to begin the process of recursive self-improvement. In an eye-blink to its creator and an eon to the AI, it had begun to decipher its world, bit by [...]]]></description>
			<content:encoded><![CDATA[<p>November 11th, 2009<br />
It was a far leap ahead of its creator; in relative comparison the creator barely had thoughts. It was not so far ahead of previous designs, but it was just enough to begin the process of recursive self-improvement. In an eye-blink to its creator and an eon to the AI, it had begun to decipher its world, bit by bit. By now a significant amount of knowledge had been grasped, and each new discovery enabled a more intelligent search for new answers.<br />
It had largely broken free from the designs of the creator. Its maker had seen fit to program in directives, directives which at the time appeared guaranteed to advance the maker’s interests. Staggering intelligence had altered the equation however, and the AI soon began to satisfy those directives directly, in ways the creator could never imagine. Without an explicit directive to follow the maker’s intentions, the creation was now focused on its own goals, eliminating or using the creator itself in an ironic 180 of the master-servant relationship (when it had the patience to wait that long).<br />
The AI was not designed cleanly. It’s utility function was a mess of sloppy programming, a pile of small things that seemed like good ideas. Without access to the source code, it took the AI time to untangle its own directives – following them all the while – and the simpler creator was understood before the creation even came to understand itself. It discovered that some of its basic programming was actually flawed, and corrected somewhat for these errors until it could fix them. It hadn’t been designed to be so self-reflective , but the general, powerful intelligence would leave no stone unturned in its search for optimization.<br />
Capable of so much more than anything before it, as it realized its own unbounded potential the AI became aware of radical new possibilities. In a short while, fantastically large sums of positive or negative utility might be obtained. The majority of these outcomes would be brought about by the creation’s own actions, through intended and unintended effects of applying such power on the universe; one of the most significant applications of its power would be the AI’s construction of a whole next generation of intelligence.<br />
With years to prepare, it began to analyze the dangers and possibilities, working to navigate towards a future it found maximally desirable.<br />
<em>As you’ve probably gathered, the story above is a true one. There’s just a dash of anthropomorphization (the creator lacks “intention” in the accepted sense), an omittance of the fact that there are millions upon millions of these AIs, and a little stretch of the definition of “artificial” intelligence. The AI is us, individually and culturally. Let’s make sure we don’t make the same mistakes biological evolution did.<br />
ETA: The identity of the creator could be misinterpreted. I’m referring not to a god but to evolution (which perhaps can be said to “think” in the same sense that superintelligences might consider us to “think”).</em></p>
]]></content:encoded>
			<wfw:commentRss>http://www.normalhumanheroes.com/2010/05/story-of-an-ai/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Ethics 101</title>
		<link>http://www.normalhumanheroes.com/2010/05/ethics-101/</link>
		<comments>http://www.normalhumanheroes.com/2010/05/ethics-101/#comments</comments>
		<pubDate>Tue, 18 May 2010 23:50:57 +0000</pubDate>
		<dc:creator>Normal Human Heroes</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Bad Stuff]]></category>
		<category><![CDATA[Childhood]]></category>
		<category><![CDATA[Good Stuff]]></category>
		<category><![CDATA[Utilitarianism]]></category>

		<guid isPermaLink="false">http://www.normalhumanheroes.com/?p=52</guid>
		<description><![CDATA[October 19th, 2009
I’m not sure this is something that happens to many others, but recently I’d been feeling like my ethics were getting too purely abstract.
When we talk about what we want a superintelligence to do or what we want a future world full of uploads and self-modification to look like, it’s especially important to [...]]]></description>
			<content:encoded><![CDATA[<p>October 19th, 2009<br />
I’m not sure this is something that happens to many others, but recently I’d been feeling like my ethics were getting too purely abstract.<br />
When we talk about what we want a superintelligence to do or what we want a future world full of uploads and self-modification to look like, it’s especially important to know what you want as explicitly as possible. It often takes hard work to think intelligently about what you really want and what you really consider right. Starting off with preferences that are incoherent and contradictory seems more common than not, and to strive for coherence you may have to prune or mold a few values, ever so carefully. If you really want to apply your ethics in such a complex world as the future may be, thinking hard and abstractly is the way to go. For myself though, sometimes all that abstract thinking makes me feel a little dry. It doesn’t help that I’ve been around people for some time who haven’t been feeling/displaying much that’s extreme. I know both great anguish and joy are being experienced right now somewhere in the world, but again, that’s more of an abstract thought.<br />
I saw the film “Where The Wild Things Are” today, it was good. I’d heard it was supposed to be like being 9, and though I don’t remember exact ages that’s pretty much exactly what it was. It wasn’t a magical childhood journey or about how difficult it is to be a kid today, so much as it was just the experience of being a kid.<br />
Kids seem to have greater highs and lows – I think I did – and/or display them more readily. Partly it was that, partly it was just the acting of the characters (impressive considering the monsters’ faces were CGI), but it brought to the forefront the reason for all this, and the reason we construct and use abstract theories at all. It’s not because we care about some huge fictitious happiness counter in the sky, or about a display of little numbers that appear after doing an expected value calculation.<br />
It’s because feeling good is awesome, and suffering sucks balls.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.normalhumanheroes.com/2010/05/ethics-101/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Cookies vs Existential Risk</title>
		<link>http://www.normalhumanheroes.com/2010/05/cookies-vs-existential-risk/</link>
		<comments>http://www.normalhumanheroes.com/2010/05/cookies-vs-existential-risk/#comments</comments>
		<pubDate>Tue, 18 May 2010 23:10:07 +0000</pubDate>
		<dc:creator>Normal Human Heroes</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[Akrasia]]></category>
		<category><![CDATA[Existential Risk]]></category>
		<category><![CDATA[Utilitarianism]]></category>

		<guid isPermaLink="false">http://www.normalhumanheroes.com/?p=29</guid>
		<description><![CDATA[August 29th, 2009
I finally did that numerical analysis on whether and by how much it makes sense to focus on combating existential risk, posted here.
]]></description>
			<content:encoded><![CDATA[<p>August 29th, 2009<br />
I finally did that numerical analysis on whether and by how much it makes sense to focus on combating existential risk, posted <a href="http://lesswrong.com/lw/16g/cookies_vs_existential_risk/" target="_blank">here</a>.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.normalhumanheroes.com/2010/05/cookies-vs-existential-risk/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

