How to Build a Collective Intelligence Platform to Crowdsource Almost Anything

Introduction

The MIT Center for Collective Intelligence recently published an important overview of the theory and mechanisms behind successful crowdsourcing efforts.  Their report, called “Harnessing Crowds: Mapping the Genome of Collective Intelligence“, can be found here.

Their research reveals similarities behind many high-profile collective intelligence (CI) systems, including Threadless, Wikipedia and InnoCentive.  It then describes how these lesson can be applied to the design of other successful CI platforms.

I call this work the MIT Approach to Collective Intelligence, which is a generic approach applicable to a wide range of problems and circumstances.  This post explores how I have used the MIT approach in my own work and how you can use it to build your CI system.  I also offer a slightly reformatted version of their content – in the form of a detailed process flowchart – which I hope will make their work more accessible to a wider audience.

The MIT approach to collective intelligence

According to the Center for Collective Intelligence, a good collective intelligence platform (CI) must address the following themes:

  1. Goals, referring to the desired outcome;
  2. Incentives, referring to the motivational factors;
  3. Structure/process, referring to the business model and organizational structure to complete the task; and
  4. Staffing, referring to the people required to support the business model and sustainability of CI within the organization.

These four themes then translate into the following four questions:

  1. What is to be accomplished?
  2. Why should anyone help out?
  3. How are they meant to contribute?
  4. Who will perform the necessary work?

Figure 1, below, illustrates how these four themes and questions interact to form the building blocks of any collective intelligence system.

Figure 1, the basic building blocks of a CI system

Developing a detailed decision tree

This approach then asks a series of sequential, logical questions, the answers of which form specific guidelines for all CI systems:

  1. Can activities be divided into pieces? Are necessary resources widely distributed or in unknown locations?
  2. Are there adequate incentives to participate?
  3. What kind of activity needs to be done?
  4. Can the activity be divided into small, independent pieces?
  5. Are only a few good (best) solutions needed?
  6. Does the entire group need to abide by the same decision?
  7. Are money or resources required to exchange hands or motivate decision?

The answer to these questions comes in the form of specific “genetic” building blocks, such as the “Create” gene, the “Crowd” gene, or the “Decide” gene.  The paper concludes with a detailed table listing these genes and how they interact with the questions above.

In my own work developing online scenario planning systems, I have found it useful to translate these questions into a flowchart that can be used to help navigate this process.  This chart is presented in Figure 2, below, which presents each of these questions and possible answers in the form of a decision tree (full PDF by clicking on the image or downloading here).

Figure 2, a flowchart for the design of any CI system

Applying this method to the real world

Answering these questions in turn, using this flowchart as your guide, can help you develop your own strategy for setting up a successful collective intelligence system.

Lets see how this works in two real world examples taken from the original paper.  The first is InnoCentive, a platform for crowdsourcing novel solutions to complex scientific problems, and the second is the t-shirt design company Threadless.

Figure 3, below, illustrates the core “collective intelligence genes” for each example.

Figure 3, the MIT Approach applied to two real world examples

InnoCentive has two core CI functions.  These are “create” and “decide”.  Scientific solutions are created by the crowd, who do it for the promise of money in a contest-like setting.  The second function, “decide”, is used to determine which solution gets the reward.  This is decided by the management of the sponsoring company, who also does it for money, in a hierarchical decision process. This example is important because it illustrates that not all crowdsourced efforts rely upon “the wisdom of the crowds” in all circumstances.  This is especially true in scientific ventures and other high-precision efforts, where technical rigour and excellence are more important than popularity or attractiveness to the majority of participants.

Threadless is another interesting example.  Their core platform has three functions, “create” and two different versions of “decide”.  First, T-shirt designs are created by the crowd for both the love of design and t-shirt culture as well as the promise of potential money.  Their creations are submitted in a contest fashion.  Next, the crowd also picks which designs it likes best.  They do this by scoring each t-shirt they like and the shirt with the highest average score, wins.  Finally, it is up to the management of Threadless to decide which of the most popular designs it will use to put into production.  They do this through a traditional management hierarchy which is primarily motivated by money (even though they might still love their jobs).

Conclusion

In my experience, the MIT approach to collective intelligence offers a robust framework for thinking about crowdsourcing in a rigourous, pragmatic way.  It is informed by specific examples, backed up by a theory of social interaction online, and when combined with my decision-tree flow chart, can be readily applied to a variety of other circumstances.

I hope that this summary of their approach helps you think about setting up your own collective intelligence platform, in wherever context that might be.

6 Comments

  1. Posted September 18, 2010 at 3:09 am | Permalink

    Noah, I also really liked this piece. It provided a very useful conceptual framework, so I put it in the Open Government report I did at the City of Boston this summer. It’s on my website as a PDF but I’ll blog about it soon. Hopefully we can connect next time you come to Cambridge.

  2. Adel M Inbaya
    Posted November 29, 2010 at 2:44 am | Permalink

    Please can you help me to do
    Model of collective intelligence for collaboration of students and teacher when they use virtual and augmented reality in education

  3. Noah Raford
    Posted December 9, 2010 at 11:27 pm | Permalink

    Hi Adel,

    Sure, maybe if you explain more I might be able to offer some help. Feel free to email me, details on the Contact page.

  4. Posted June 8, 2012 at 5:11 pm | Permalink

    Great post, great PhD research.
    I will mention this article on my blog and put a link of your paper!
    Thank you,

    Massimiliano

  5. Noah Raford
    Posted June 17, 2012 at 10:23 pm | Permalink

    Thanks Massimiliano! Great post and very interesting blog.

  6. Mohammed Hashim
    Posted March 31, 2013 at 12:28 pm | Permalink

    this is a very rich article , I have forwarded it to our design team members for our project , to map schools in sudan , which based in a Collective-Intelligence platform . thanks for this work .

4 Trackbacks

  1. […] the logic of collective intelligence (as part of my my PhD), I broke up the the scenario thinking process into discrete chunks, came up […]

  2. […] scenario planning systems, offers a truly revolutionary  approach to risk management.  I wrote a short introduction to crowdsourcing and collective intelligence here, which risk managers may also find […]

  3. […] http://news.noahraford.com/?p=695 large copied excerpts : […]

  4. By Noah Raford » Back to the Futurist Interview on January 27, 2012 at 8:02 pm

    […] am also proud of my PhD research on crowdsourced scenario platforms. Adding scalable, web-based social intelligence to the scenario planning process is one of the […]

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*