<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0"
    xmlns:dc="http://purl.org/dc/elements/1.1/"
     xmlns:admin="http://webns.net/mvcb/"
     xmlns:content="http://purl.org/rss/1.0/modules/content/"
     xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#">
	<channel> 

	<title>Comments on: ITAPPMONROBOT</title>
	<link>http://www.metafilter.com/67557/ITAPPMONROBOT/</link>
	<description>Comments on MetaFilter post ITAPPMONROBOT</description>
	<pubDate>Tue, 18 Dec 2007 14:29:24 -0800</pubDate>
	<lastBuildDate>Tue, 18 Dec 2007 14:29:24 -0800</lastBuildDate>
	<language>en-us</language>
	<docs>http://blogs.law.harvard.edu/tech/rss</docs>
	<ttl>60</ttl>

	<item>
		<title>ITAPPMONROBOT</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT</link>	
		<description>&lt;a href="http://thedailywtf.com/Articles/ITAPPMONROBOT.aspx"&gt;&quot;So, at our meeting earlier, you suggested building a robot.&lt;/a&gt; Is that something we can really do?&quot; &lt;br /&gt;&lt;br /&gt;Somewhat related: &lt;a href=&quot;http://www.youtube.com/watch?v=qIMNCdjb9Qw&quot;&gt;Robot cat feeder.&lt;/a&gt;</description>
		<guid isPermaLink="false">post:www.metafilter.com,2007:site.67557</guid>
		<pubDate>Tue, 18 Dec 2007 14:14:41 -0800</pubDate>
		<dc:creator>CrunchyFrog</dc:creator>		<category>robot</category>		<category>computer</category>		<category>admin</category>
	</item>	<item>
		<title>By: quin</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950568</link>	
		<description>I heard of a similar trick being used by someone who needed to leave town for a couple of days and couldn&apos;t find anyone to feed his fish, so he quickly fashioned a slightly sloping rigid plastic sheet over the tank, on which he laid a bunch of food. He then attached an old pager with the vibration alert active. 

Whenever he needed to feed the fish, he just dialed the pager and the vibration shook a bit of the food into the tank. 

Like the hack in the article, it is simple, elegant, and will probably work for ages if no one messes with it.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950568</guid>
		<pubDate>Tue, 18 Dec 2007 14:29:24 -0800</pubDate>
		<dc:creator>quin</dc:creator>
	</item>	<item>
		<title>By: CynicalKnight</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950574</link>	
		<description>I weep machine screw tears for ITAPPMONROBOT</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950574</guid>
		<pubDate>Tue, 18 Dec 2007 14:33:48 -0800</pubDate>
		<dc:creator>CynicalKnight</dc:creator>
	</item>	<item>
		<title>By: ericb</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950577</link>	
		<description>&lt;em&gt;Somewhat related: Robot cat feeder.&lt;/em&gt;

Of course, a nerd overthought it. 

&lt;a href=&quot;http://www.petsmart.com/product/index.jsp?productId=2751244&amp;cp=2767033.2769003&amp;numResultsPerPage=40&amp;fbx=0&amp;fbn=Taxonomy%7CAutomatic+Feeders+%26+Waterers&amp;f=Taxonomy%2FPET%2F2769003&amp;fbc=1&amp;parentPage=family&amp;keepsr=1&quot;&gt;Let gravity do the work&lt;/a&gt;! 

My &quot;&lt;a href=&quot;http://www.petsmart.com/product/index.jsp?productId=2751255&amp;cp=2767033.2769003&amp;numResultsPerPage=40&amp;fbx=0&amp;fbn=Taxonomy%7CAutomatic+Feeders+%26+Waterers&amp;f=Taxonomy%2FPET%2F2769003&amp;fbc=1&amp;parentPage=family&amp;keepsr=1&quot;&gt;Circuit Party Feeders&lt;/a&gt;&quot;&lt;sup&gt;*&lt;/sup&gt; work just fine.

* - &lt;small&gt;For those long weekends when one is away in Miami, Palm Springs, etc.&lt;small&gt;&lt;/small&gt;&lt;/small&gt;</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950577</guid>
		<pubDate>Tue, 18 Dec 2007 14:34:57 -0800</pubDate>
		<dc:creator>ericb</dc:creator>
	</item>	<item>
		<title>By: xorry</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950579</link>	
		<description>*BIG GRIN*</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950579</guid>
		<pubDate>Tue, 18 Dec 2007 14:35:23 -0800</pubDate>
		<dc:creator>xorry</dc:creator>
	</item>	<item>
		<title>By: pompomtom</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950581</link>	
		<description>&lt;i&gt;reaching in vain for the restart button that it&apos;d never touch again.&lt;/i&gt;

*sniff* it&apos;s so sad....</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950581</guid>
		<pubDate>Tue, 18 Dec 2007 14:38:05 -0800</pubDate>
		<dc:creator>pompomtom</dc:creator>
	</item>	<item>
		<title>By: mrzarquon</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950592</link>	
		<description>On a somewhat related note (old robots, cuteness, etc.) &lt;a href=&quot;http://vids.myspace.com/index.cfm?fuseaction=vids.individual&amp;VideoID=24170442&quot;&gt;New wall-e trailer is up.&lt;/a&gt;</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950592</guid>
		<pubDate>Tue, 18 Dec 2007 14:48:20 -0800</pubDate>
		<dc:creator>mrzarquon</dc:creator>
	</item>	<item>
		<title>By: delmoi</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950602</link>	
		<description>The Daily WTF used to be funny, but now it&apos;s just annoying.

There was one a while ago where someone was complaining that someone had written a bunch of &quot;frameworks&quot; for their code, and so it was hard to figure out.  Well, that&apos;s basically what you&apos;re &lt;i&gt;supposed&lt;/i&gt; to do on huge projects, otherwise they become impossible to manage. You create a bunch of APIs that you call in your main program.

I dunno, once funny now dull.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950602</guid>
		<pubDate>Tue, 18 Dec 2007 14:57:35 -0800</pubDate>
		<dc:creator>delmoi</dc:creator>
	</item>	<item>
		<title>By: pupdog</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950609</link>	
		<description>Andy Ihnatko tells a great story about building a telepresence setup with a motion-sensing webcam and an animatronic Darth Vader to scare his cats off the desk.

MacGyver may have diffused bombs, but he had a whole team of scriptwriters behind him, these guys are making things happen FOR REALS...</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950609</guid>
		<pubDate>Tue, 18 Dec 2007 15:03:45 -0800</pubDate>
		<dc:creator>pupdog</dc:creator>
	</item>	<item>
		<title>By: caddis</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950616</link>	
		<description>&lt;a href=&quot;http://v3.espacenet.com/textdoc?DB=EPODOC&amp;IDX=GB1426698&amp;F=0&quot;&gt;Robotic Cat Flap Control and 1,000 Megaton, Earth-Orbital, Peace-Keeping Bomb&lt;/a&gt; from the quirky &lt;a href=&quot;http://www.patent.freeserve.co.uk/pedrick.html&quot;&gt;Arthur Paul Pedrick&lt;/a&gt;, a man with too much time on his hands.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950616</guid>
		<pubDate>Tue, 18 Dec 2007 15:10:28 -0800</pubDate>
		<dc:creator>caddis</dc:creator>
	</item>	<item>
		<title>By: Kid Charlemagne</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950617</link>	
		<description>But did you cry when HAL 9000 died?

Uh, the second time.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950617</guid>
		<pubDate>Tue, 18 Dec 2007 15:12:00 -0800</pubDate>
		<dc:creator>Kid Charlemagne</dc:creator>
	</item>	<item>
		<title>By: everichon</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950619</link>	
		<description>McGuyver never diffused a bomb. He could well have defused a bomb or two.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950619</guid>
		<pubDate>Tue, 18 Dec 2007 15:14:22 -0800</pubDate>
		<dc:creator>everichon</dc:creator>
	</item>	<item>
		<title>By: mattoxic</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950620</link>	
		<description>The Daily WTF used to be funny, but now it&apos;s just annoying.

Sometimes it&apos;s good Delmoi, annoying when it recirculates posts.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950620</guid>
		<pubDate>Tue, 18 Dec 2007 15:14:44 -0800</pubDate>
		<dc:creator>mattoxic</dc:creator>
	</item>	<item>
		<title>By: loquacious</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950631</link>	
		<description>That Daily WTF reminded me of something I&apos;ve always wanted:

Someone needs to invent a PSU or PC-AT power switch that&apos;s robotic and network-aware.

A nice little embedded industrial linux widget. Stable, low power, has a TCP/IP stack and script to check to see if it&apos;s host server is actually up and running, awake, and responding to the appropriate pings or server requests. Build it right into the PSU, power switch or motherboard - or, heck, make it an inline plug for your ATX plugs. You could ping it remotely to do a reset, or allow it to reset as programmed.

Such a thing would save so much money, gas, time and shoe leather it&apos;s ridiculous.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950631</guid>
		<pubDate>Tue, 18 Dec 2007 15:23:20 -0800</pubDate>
		<dc:creator>loquacious</dc:creator>
	</item>	<item>
		<title>By: odinsdream</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950640</link>	
		<description>loquacious, most servers now come with &lt;a href=&quot;http://en.wikipedia.org/wiki/Out-of-band_management&quot;&gt;Out of Band Management&lt;/a&gt; built in. XServes call it Lights-Out Management, and the utility allows you to remotely start a server as long as it&apos;s physically plugged in to the wall. It does need to be configured, of course.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950640</guid>
		<pubDate>Tue, 18 Dec 2007 15:31:17 -0800</pubDate>
		<dc:creator>odinsdream</dc:creator>
	</item>	<item>
		<title>By: aubilenon</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950641</link>	
		<description>I&apos;ve used the same CD-eject trick to punch a coworker, who was too close to my computer.

I really should get going on that USB Robotic Boxing Glove.  I&apos;ve been meaning to make on ever since working at AOL (we needed it to better interface with the users).</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950641</guid>
		<pubDate>Tue, 18 Dec 2007 15:31:28 -0800</pubDate>
		<dc:creator>aubilenon</dc:creator>
	</item>	<item>
		<title>By: adamrice</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950651</link>	
		<description>Loquacious: Google &quot;phidget&quot; -- robotics kit parts. You could have a servomotor driver with a USB interface.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950651</guid>
		<pubDate>Tue, 18 Dec 2007 15:41:01 -0800</pubDate>
		<dc:creator>adamrice</dc:creator>
	</item>	<item>
		<title>By: dacoit</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950668</link>	
		<description>I had the same problem a few years ago, with a server that would crash, that I couldn&apos;t always be there to reset.  Finally I came up with a great solution (though less quirky for sure).  I got a telephone-control X10 module -- the kind that you can get at Radio Shack, that lets you call your house and turn your lights on and off, etc. using touch tones.  Whenever the server would crash, I would call in and send the command to turn it off, then on again.  It was set to auto-restart in case of a &quot;power faliure&quot;.  Just took a few seconds.  The system worked perfectly and let me run my company while traveling in China, Thailand, France, Argentina, and so on.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950668</guid>
		<pubDate>Tue, 18 Dec 2007 15:54:40 -0800</pubDate>
		<dc:creator>dacoit</dc:creator>
	</item>	<item>
		<title>By: Kikkoman</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950669</link>	
		<description>Close, but this doesn&apos;t quite meet the requirements of a device that will allow us to punch people over the internet.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950669</guid>
		<pubDate>Tue, 18 Dec 2007 15:55:02 -0800</pubDate>
		<dc:creator>Kikkoman</dc:creator>
	</item>	<item>
		<title>By: aubilenon</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950675</link>	
		<description>Kikkoman: I&apos;m working on it!</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950675</guid>
		<pubDate>Tue, 18 Dec 2007 16:03:36 -0800</pubDate>
		<dc:creator>aubilenon</dc:creator>
	</item>	<item>
		<title>By: pupdog</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950704</link>	
		<description>&lt;em&gt;McGuyver never diffused a bomb. He could well have defused a bomb or two.&lt;/em&gt;

touch&#233;</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950704</guid>
		<pubDate>Tue, 18 Dec 2007 16:35:10 -0800</pubDate>
		<dc:creator>pupdog</dc:creator>
	</item>	<item>
		<title>By: itchylick</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950738</link>	
		<description>&lt;em&gt;New wall-e trailer is up.&lt;/em&gt;

Hey Astro Zombie .... get the Kleenex ready.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950738</guid>
		<pubDate>Tue, 18 Dec 2007 17:01:43 -0800</pubDate>
		<dc:creator>itchylick</dc:creator>
	</item>	<item>
		<title>By: you</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950755</link>	
		<description>At the local ISP where I used to work, we had a spare web camera pointed at a cheap LCD thermometer in the server room. One of my coworkers hacked together a PHP script to grab a frame from the camera every minute, &quot;read&quot; the display and graph it.

I miss that place.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950755</guid>
		<pubDate>Tue, 18 Dec 2007 17:26:42 -0800</pubDate>
		<dc:creator>you</dc:creator>
	</item>	<item>
		<title>By: mattoxic</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950764</link>	
		<description>&lt;a href=&quot;http://thedailywtf.com/Articles/A_True_Ninja_Hacker_Is_Like_The_Wind.aspx&quot;&gt;A good story from wtf, sorta similar lines&lt;/a&gt;</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950764</guid>
		<pubDate>Tue, 18 Dec 2007 17:40:12 -0800</pubDate>
		<dc:creator>mattoxic</dc:creator>
	</item>	<item>
		<title>By: Deathalicious</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950786</link>	
		<description>Waaaaah. I can even picture it, the CD drive mechanism slowly grinding to a halt, the small lever struggling to perform its now Quixotic&lt;sup&gt;*&lt;/sup&gt; function.

My reaction to this story reminded me of the  &lt;a href=&quot;http://www.youtube.com/watch?v=I07xDdFMdgw&quot;&gt;IKEA lamp commercial&lt;/a&gt;.

&lt;small&gt;* OMG, spelled it right on my first try&lt;/small&gt;</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950786</guid>
		<pubDate>Tue, 18 Dec 2007 18:03:59 -0800</pubDate>
		<dc:creator>Deathalicious</dc:creator>
	</item>	<item>
		<title>By: MrMoonPie</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950818</link>	
		<description>Metafilter: used to be funny, but now it&apos;s just annoying.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950818</guid>
		<pubDate>Tue, 18 Dec 2007 18:27:38 -0800</pubDate>
		<dc:creator>MrMoonPie</dc:creator>
	</item>	<item>
		<title>By: RobotVoodooPower</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950882</link>	
		<description>I once heard of a data center whose servers had chronic memory leaks. They decided the cost of finding the leak was too large -- vs. staffing interns 24/7 to walk around and push the reset button on the servers at prescribed intervals.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950882</guid>
		<pubDate>Tue, 18 Dec 2007 19:32:57 -0800</pubDate>
		<dc:creator>RobotVoodooPower</dc:creator>
	</item>	<item>
		<title>By: hattifattener</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950917</link>	
		<description>This is more of a hack than a WTF. You have critical infrastructure which is failing but you can&apos;t repair because of a budget freeze (that&apos;s not a WTF, that&apos;s standard business practice), so you kludge up the simplest possible solution to the problem. (Okay, the simpler solution is to find a different employer.)

odinsdream: Wow, the Wikipedia article you linked is one of the most buzzword-laden wikipedia articles I&apos;ve ever seen. It&apos;s amazing how this industry can make such a big deal out of &quot;you can reboot it from the serial console&quot;.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950917</guid>
		<pubDate>Tue, 18 Dec 2007 20:01:21 -0800</pubDate>
		<dc:creator>hattifattener</dc:creator>
	</item>	<item>
		<title>By: A dead Quaker</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950938</link>	
		<description>Somehow I was expecting a story more like &lt;a href=&quot;http://www.monkeybagel.com/shit.html&quot;&gt;this one&lt;/a&gt;.  But it was pretty cool anyway.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950938</guid>
		<pubDate>Tue, 18 Dec 2007 20:21:56 -0800</pubDate>
		<dc:creator>A dead Quaker</dc:creator>
	</item>	<item>
		<title>By: xthlc</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1950950</link>	
		<description>I still like TDWTF. True, they&apos;ve gotten a lot more preachy of late as Alex tries to tie all the horrible things they dig up into a series of moral lessons about how to do good software development, but the stories serve as an effective check on my own megalomaniacal tendencies when doing architecture. Good software tends to be a happy medium between the lazy hackery and ridiculous over-abstraction that gets featured on TDWTF; I think of their posts as &lt;a href=&quot;http://en.wikipedia.org/wiki/William_Hogarth&quot;&gt;William Hogarth engravings&lt;/a&gt; for programmers.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1950950</guid>
		<pubDate>Tue, 18 Dec 2007 20:29:00 -0800</pubDate>
		<dc:creator>xthlc</dc:creator>
	</item>	<item>
		<title>By: barc0001</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1951068</link>	
		<description>Along RobotVoddooPower&apos;s lines, I used to work at a place where the whole monstrous site was written in VB.  They brought me in to handle upgrading the network side of things, and we threw a whole bunch of money at hardware to help the load, but even after the big hardware spend, the webserver front-ends would intermittently lock up and need a restart.  Rather than fix the root of the problem (the site&apos;s code itself), they hired students from the community college to come in and do their studying on 4 hour shifts nights and weekends.  While the students were there doing their homework/studies, they&apos;d glance up at a monitor that had one window for each webserver, and if any of the browsers couldn&apos;t connect, they&apos;d get up and reboot the corresponding webserver.

This was a &quot;temporary&quot; fix while the site redesign was done.  The site was still being &quot;redesigned&quot; 18 months after I left that asylum for better pastures.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1951068</guid>
		<pubDate>Tue, 18 Dec 2007 23:29:47 -0800</pubDate>
		<dc:creator>barc0001</dc:creator>
	</item>	<item>
		<title>By: Spire</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1951106</link>	
		<description>McGuyver never defused a bomb. MacGyver could well have defused a bomb or two.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1951106</guid>
		<pubDate>Wed, 19 Dec 2007 01:31:56 -0800</pubDate>
		<dc:creator>Spire</dc:creator>
	</item>	<item>
		<title>By: GuyZero</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1951202</link>	
		<description>&lt;i&gt;Someone needs to invent a PSU or PC-AT power switch that&apos;s robotic and network-aware.&lt;/i&gt;

Yeah, they have &apos;em... &lt;a href=&quot;http://en.wikipedia.org/wiki/Dell_DRAC&quot;&gt;Dell DRAC cards&lt;/a&gt; and whatever other vendors call &apos;em. Very useful.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1951202</guid>
		<pubDate>Wed, 19 Dec 2007 06:26:08 -0800</pubDate>
		<dc:creator>GuyZero</dc:creator>
	</item>	<item>
		<title>By: hincandenza</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1951764</link>	
		<description>&lt;blockquote&gt;&lt;b&gt;RobotVoodooPower:&lt;/b&gt; &lt;i&gt;I once heard of a data center whose servers had chronic memory leaks. They decided the cost of finding the leak was too large -- vs. staffing interns 24/7 to walk around and push the reset button on the servers at prescribed intervals.&lt;/i&gt;&lt;/blockquote&gt;See, that&apos;s not a hack, or even inefficient, except for having humans do it.  It&apos;s actually a smart way to run things, insects vs. mammals.  Instead of naming individual servers like we do our pets, and treating them like we do our closest friends and family- individually irreplaceable and invaluable- better to have more cheap servers, basically homogenous, and treat them like insects in a swarm.  So long as the swarm survives, the death of a few don&apos;t matter- and you can replace physically failed servers easily.  Have say 5% more than you need in physical assets, and cycle them regularly.  If individual servers are so broken they just don&apos;t work, drop them out of use altogether until the next regular weekly swap out.  Replace the bad ones with spares, and you have a week to idly investigate the physically failed servers.

If it&apos;s not a memory leak, it&apos;ll be a bug that only creeps up after time due to a weird counting issue, or race condition.  Or failed hardware.  Or an OS crash.  Or a hotfix problem.  Or... hell, you can&apos;t anticipate every way a machine will fail, so why try?  Just make sure that collectively, the swarm of servers fulfilling a function is up 99.99% of the time and you&apos;ll be in good shape.  If you automate the removing a server from active rotation, cycling it, sanity testing it, and returning it to rotation before moving on to the next server, you can achieve insanely good uptimes with even the buggiest of old, rickety code and the crashiest of OSes.  That&apos;s... smart, isn&apos;t it?


I work for a large online travel company, and last year there was some memory leak causing servers to fail every ~24 hours.  Operations eventually had someone just cycle the servers every day at the same time, whoever was on duty.  I suggested they automate that further: cycle the servers regularly in a constant rolling routine, whether they need it or not on the principle that if the code was making it through 72 hour stress tests without major errors, then surely it would keep running fine if no individual server was up more than ~4 hours to even encounter those edge cases/memory leaks/etc.  They... didn&apos;t listen.  I believe the stat I&apos;d also heard was the previous year had some 10 days of unplanned downtime.  Not &quot;10 days with incidents&quot;, but ~240 hours of unplanned downtime.  Eh... some people just don&apos;t get what their jobs *really* are...</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1951764</guid>
		<pubDate>Wed, 19 Dec 2007 13:13:52 -0800</pubDate>
		<dc:creator>hincandenza</dc:creator>
	</item>	<item>
		<title>By: odinsdream</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1951937</link>	
		<description>&lt;em&gt;odinsdream: Wow, the Wikipedia article you linked is one of the most buzzword-laden wikipedia articles I&apos;ve ever seen. It&apos;s amazing how this industry can make such a big deal out of &quot;you can reboot it from the serial console&quot;.&lt;/em&gt;

I agree it&apos;s got a lot of buzzwords, but it&apos;s usually quite a bit more capable than just being able to reboot the system. The internal controller runs by itself as long as the system is plugged in. It has its own IP address and can monitor all of the temperatures, fan speeds, battery and power levels, SMART status, etc., whether the server&apos;s main internet connection is functioning or not. It can also send out alerts to an external SMTP server.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1951937</guid>
		<pubDate>Wed, 19 Dec 2007 15:17:55 -0800</pubDate>
		<dc:creator>odinsdream</dc:creator>
	</item>	<item>
		<title>By: esch</title>
		<link>http://www.metafilter.com/67557/ITAPPMONROBOT#1954954</link>	
		<description>My job would be infinitely more difficult if HP didn&apos;t have their &lt;a href=&quot;http://en.wikipedia.org/wiki/Integrated_Lights-Out&quot;&gt;iLO tools&lt;/a&gt;. There&apos;s really no reason to go into the data center when all of your machines are rocking iLO.</description>
		<guid isPermaLink="false">comment:www.metafilter.com,2007:site.67557-1954954</guid>
		<pubDate>Sun, 23 Dec 2007 01:05:24 -0800</pubDate>
		<dc:creator>esch</dc:creator>
	</item>
	</channel>
</rss>
