<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: 5 steps towards building a metrics-driven business</title>
	<atom:link href="http://andrewchenblog.com/2008/06/04/5-steps-towards-building-a-metrics-driven-business/feed/" rel="self" type="application/rss+xml" />
	<link>http://andrewchenblog.com/2008/06/04/5-steps-towards-building-a-metrics-driven-business/</link>
	<description>Essays on viral marketing, freemium, and social gaming</description>
	<lastBuildDate>Tue, 16 Mar 2010 06:01:41 -0700</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: Adam</title>
		<link>http://andrewchenblog.com/2008/06/04/5-steps-towards-building-a-metrics-driven-business/comment-page-1/#comment-110</link>
		<dc:creator>Adam</dc:creator>
		<pubDate>Wed, 04 Jun 2008 19:39:23 +0000</pubDate>
		<guid isPermaLink="false">http://andrewchenblog.com/2008/06/04/5-steps-towards-building-a-metrics-driven-business/#comment-110</guid>
		<description>&lt;p&gt;&quot;The only way to separate these variables out is via A/B testing.&quot;&lt;/p&gt;

&lt;p&gt;Doesn&#039;t multi-variate testing using DOE also accomplish this?  In fact, DOE also exposes how much each variable affects an outcome, and how a combination of variables interact.  &lt;/p&gt;

&lt;p&gt;&lt;a href=&quot;http://www.isixsigma.com/dictionary/Design_of_Experiments_-_DOE-41.htm&quot; rel=&quot;nofollow&quot;&gt;http://www.isixsigma.com/dictionary/Design_of_Experiments_-_DOE-41.htm&lt;/a&gt;&lt;/p&gt;

&lt;p&gt;The problem I tend to run into with pure A/B testing is that it&#039;s very dependent on the order in which you conduct your tests.  For example, testing having a button on the left or right of a landing page as well as the text and design of the button.  If you test left vs right first, and left wins, you&#039;ll never know if having it on the right with alternate text or shape might be even better because you would have assumed that left is your winner.  This makes it very hard to come away with any concrete findings.  But yeah, DOE&#039;s are harder to do, and usually require more complex software.&lt;/p&gt;
</description>
		<content:encoded><![CDATA[<p>&#8220;The only way to separate these variables out is via A/B testing.&#8221;</p>
<p>Doesn&#8217;t multi-variate testing using DOE also accomplish this?  In fact, DOE also exposes how much each variable affects an outcome, and how a combination of variables interact.  </p>
<p><a href="http://www.isixsigma.com/dictionary/Design_of_Experiments_-_DOE-41.htm" rel="nofollow">http://www.isixsigma.com/dictionary/Design_of_Experiments_-_DOE-41.htm</a></p>
<p>The problem I tend to run into with pure A/B testing is that it&#8217;s very dependent on the order in which you conduct your tests.  For example, testing having a button on the left or right of a landing page as well as the text and design of the button.  If you test left vs right first, and left wins, you&#8217;ll never know if having it on the right with alternate text or shape might be even better because you would have assumed that left is your winner.  This makes it very hard to come away with any concrete findings.  But yeah, DOE&#8217;s are harder to do, and usually require more complex software.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nik</title>
		<link>http://andrewchenblog.com/2008/06/04/5-steps-towards-building-a-metrics-driven-business/comment-page-1/#comment-109</link>
		<dc:creator>Nik</dc:creator>
		<pubDate>Wed, 04 Jun 2008 11:56:00 +0000</pubDate>
		<guid isPermaLink="false">http://andrewchenblog.com/2008/06/04/5-steps-towards-building-a-metrics-driven-business/#comment-109</guid>
		<description>&lt;p&gt;Great stuff Andrew. This has been pretty much our experience as well in terms of the effort and process for building a metrics business.&lt;/p&gt;

&lt;p&gt;But the good thing is that, once you actually break down the drivers to its sub-components, there are probably not more than 5 pages/features that drives the overall goal that you are trying to achieve.&lt;/p&gt;

&lt;p&gt;And I agree with you a 100% on this:&lt;br /&gt;
&quot;Recalibrating the &quot;core mechanic&quot; of the product to make uploading photos a natural part of using the product (like HotOrNot, for example)&quot;&lt;/p&gt;

&lt;p&gt;This is where we got the biggest bang for our buck...&lt;/p&gt;
</description>
		<content:encoded><![CDATA[<p>Great stuff Andrew. This has been pretty much our experience as well in terms of the effort and process for building a metrics business.</p>
<p>But the good thing is that, once you actually break down the drivers to its sub-components, there are probably not more than 5 pages/features that drives the overall goal that you are trying to achieve.</p>
<p>And I agree with you a 100% on this:<br />
&#8220;Recalibrating the &#8220;core mechanic&#8221; of the product to make uploading photos a natural part of using the product (like HotOrNot, for example)&#8221;</p>
<p>This is where we got the biggest bang for our buck&#8230;</p>
]]></content:encoded>
	</item>
</channel>
</rss>
