@andrewchen

New here? Check out my list of featured essays and Blogging roadmap

User retention: Why depending on notification-driven retention sucks

User retention: Sending lots of e-mail to your visitors = Push notifications
When it comes to getting your users back onto your site, you have several options:
  • They love your site so much that they come back themselves (direct-navigation)
  • They see or get a link from a friend or a source while they are browsing (reacquisition)
  • You send them a notification, like a friend-add, a newsletter, a list of top videos, or similar 
The first I'll define as "pull," where the user is pulling you. The last one I'll define as "push," where you have to push the user to come back to the site. The middle one (and alternate scenarios), are basically in-betweens.

The case where the user navigates to your domain to come back is great. It means that you've built a brand that people can recall from their memories, and they like it enough that they will automatically come back. In general, this seems like the most desirable scenario.

The second scenario is good, although weaker than the first one. If users are regularly publishing links back to your site, enough so that other users can discover it, then that's effective word-of-mouth, which is great. You can think of advertising as a specific subclass of this type of acquisition or retention. If the link is published in a trusted environment, then the trust rubs off on the link as well – it creates social proof for your app.

The last one, focused on notifications, is the least desirable, because of the fact you are needing to "push" information to the user rather than the user taking action themselves. In the particular case where this is the majority of your traffic, it means your web product has failed to integrate itself in your user base's life, and there isn't a recurring set of traffic that you can depend on.

Hierarchy of push notifications
There's even a hierarchy in here too – clearly some notifications are more personal, and thus more desirable, than others. Here's a rough hierarchy, from top to bottom:
  • Good friend sends you a private message
  • Friend writes on your profile 
  • Acquaintance writes on your profile  
  • Friend sends you a friend request

… versus less desirable messaging, which lacks personal context and comes from the company, not a friend or :

  • "Come try out new feature X!"     
  • "Check out this week's top videos!" 
  • "You should update your photo!"
  • Total stranger sends you a friend request 

In the cases where you are getting notifications from just the site, it's far more likely users will think of it as spam, which is obviously a negative. The more personal information that is in the notifications, and the more personally relevant that information is, the better.

A simple model for notification-based retention
Let's examine a scenario in which you are completely dependent on notifications to get your users back – there are some big assumptions here, but just to illustrate the idea. First, let's determine a couple starting values:
  • Initial active users = 1000
  • % that will create useful news = 10% 
  • % that will click through on the notification: 5%  
Now I'll describe the simple flow:
  • The idea is that you have 1000 users, of which 10% will create useful news
  • That means 100 people will create news
  • As long as there's at least 1 piece of news, that news can be republished to 1000 people as 1000 notifications (Note that in a more sophisticated model, the more news items, the better the clickthrough rates, and the less, the smaller the CTR)
  • Once you have 1000 notifications out there, then there's 50 people that click through
  • Of those 50 people, they produce 5 pieces of news 
  • That 5 pieces of news is then republished again to the 1000 people 
  • Then the secondary cycle repeats again

Basically, there's a quick collapse from 1000 active users down to 50 active users. If you made the model more complex, and added a CTR that goes down depending on how much news there is, or adding deliverability issues from people getting too much e-mail, then you could see this spiraling down to 0 actives.

Compare that to a scenario to one where you have many users coming back just from direct-navigation. Those folks will come in day-in-and-day out, create useful content, and otherwise support your entire ecosystem. Even if you only have 20% of your 1000 coming back on their own, that group rapidly outpaces the notifications group, and can also bring more users back.

High value content creators
The point is, the users that come to your site and create content are hugely helpful. So the question is, how do you find and support these high-value users? Here are a couple thoughts from a brainstorm:
  • Build features that support high-quality single-user experiences
  • Make it easy to create content on the site, and reward users that do
  • Create differentiated experiences that users can weave into their daily routine
  • Be as sticky as possible – this is a place where software clients are great, but websites are hard
I think a lot of the traditional values of Web 2.0 apply here – many of the product features that appeal to creators and builders are great.

Are all Facebook apps notification driven?
One interesting point of all of this is: How many Facebook apps are notification driven versus being pulled by the user? Only the app builders can answer that, but I would guess that most of the apps are notification driven. My theory there would be that people tend to get re-engaged based on seeing their friends in the newsfeed or through a notification.

The only opportunities for people to navigate to their apps is either on the left-side bar on the homepage (which needs to be clicked on to extend all the way out), or by browsing into their friends' profiles. I'd guess that the latter would be promising, from a navigating perspective, but Facebook is also more centralized than MySpace is, for example. On MySpace, there's a lot of profile-to-profile browsing, whereas anecdotally, Facebook is more about checking your newsfeed as a central point, then jumping to wherever the action is (be it on a picture, a wall, a group, or whatever), and then coming back to the homepage.

For better or worse, I think it would hugely benefit Facebook to allow more prominent display of apps on the homepage – by adding the ability for apps to build their own brands and get return visitors, there would be an incentive to develop deep applications rather than ones that focus on virality. On the negative side, letting apps build brand is also the first step to Facebook losing control of its own platform.

If anyone has comments or data on the above, I'd be interested in hearing more.

UPDATE: Thanks to Brian Radmin to correct me on my faulty multiplication :)

Like this post?
If you liked this post, please subscribe or follow me on Twitter. You can also find more essays here.

Written by Andrew Chen
May 29th, 2008 at 8:39 am
  • http://ireadokay.blogspot.com chica

    I read your blog often and its highly informative about current trends. One thing I’ve noticed, and I may not be completely correct on this, is that you focus on Facebook apps when talking about viral/social marketing. Would you add some thoughts on Orkut too? Orkut apps are new and I am very curious to how you would compare your findings on Facebook with Orkut.

  • http://www.rosshill.com.au Ross Hill

    Thanks Andrew, this post is awesome.

  • http://eschnou.com eschnou

    Thanks Andrew !

    This post was an eye-opener for me. In fact many of your posts are :-) Any plans to turn all these posts & conversations into a good book on marketing 2.0 ?

  • http://www.bview.co.uk/app/frontend/UserProfile?id=WwlHxOa3Dwi03hVx8NnIMmnS&t=aboutme Colin

    Out of interest…what is your opinion on update emails such as Plaxo and Linkedin send out? These don’t appear on the hierarchy you propose above and would seem to cut across it i.e. unsolicited/untriggered updates about people you know.

    On a separate note, I can’t stress enough the “Build features that support high-quality single-user experiences” as a means of bridging from low to high community usage and engagement.

  • http://www.sexywidget.com lawrence

    Hey Andrew, I hear you on most of your points. Of course it’s preferable to have folks love your site and come back on their own, but in the absence of that, push notifications are better than nothing. So yeah, notification driven retention sucks, but it sucks less than passively sitting back as your new users bounce off your site.

    I couldn’t agree with you more on the home surface. I see much better retention on MySpace apps than on Facebook, because of the home surface that MySpace gives you. As an app publisher, you can push fresh content through there to keep folks engaged.

  • http://bitchybetty.Org Aronado

    hola! Andrew

    excellent post my friend!!! I was happy to see that we built our site very much inline with most of your suggestions regarding notifications.

    We are currently building our widget for OS & FB so, it was great to hear some thoughts on that as well.

    Thank you!

  • http://ignighter.com Adam

    Andrew I love reading your stuff, it’s always insightful and always backed by good math (despite a multiplication error now and then, then logic is always right on target haha).

    I run a group dating site and this is the kind of thing we talk about often. At the end of this most recent post you start to get into the concept of deep vs. shallow apps on Facebook, and I really think that as the viral channels close up (and they’ve been closing very quickly as notifications are getting spammier and Facebook is cracking down on them), then I think that ultimately the only apps left standing will be ones that offer a significant value to the user, or as you say, deep apps. I wrote something about this back in March on our blog:
    http://ignighter.com/blog/2008/03/31/its-not-i-have-a-dream-but-its-something/

    Keep up the great work Andrew!

  • http://500hats.typepad.com dave mcclure

    missed this first time around, but it’s excellent summary.

    that said, i don’t think you should be TOO hard on email-driven notification / retention — i agree that organic retention is much more desirable, but achieving that via great user experience is probably orthogonal (or at least not mutually exclusive) wrt email retention.

    otoh, i think you’re spot on to spend a lot of time thinking about how to engage high-value active users, whether via emotional or economic rewards.

    one additional thought: many times people tend to split the audience into only 2 groups: readers & content-creators. actually, i think it’s useful to consider splitting them into 3 groups:
    * readers = visit your site & read stuff
    * creators = visit your site & create stuff
    * pimps = visit your site & “pimp” stuff out

    what i think many people miss is that often the pimps are higher value than the creators, and that your incentive structures should actually emphasize the “pimps” over the “creators” (note: this may also assume you have already incentivized creators to get to minimum critical mass of content).

    anyway, just a thought.

Recent posts

Want more? Featured essays and book recommendations