Measuring the value of communities of practice

0 0
Read Time:2 Minute, 12 Second

Ed Mitchell over at Platform Neutral picks up on the issue of Return on Investment (ROI) for on-line communities, quite rightly identifying this as growing topic for debate and argument over the coming months. In Ed’s words:

ROIfor ‘communities’ is going to appear on our horizons for proper thisyear. We will have the debate from the sponsors asking if it’s worthit, and another one about which way around it should be – ie: ROI forwhom? The sponsors, or the participants. Likewise there is much talkabout the ROI of ’social media’, and all of the projects I am workingon have measurement built into them at the strategy level

Personally, I haven’t quite cracked this nut for the virtual communities using the IDeA platform (240 of them at the last count). Since many of the communities are closed, self-organising networks, I only really see the platform-wide metrics. So, for example, I can see:

  • Total number of communities
  • Total registered users
  • Total contributors 
  • Members per community
  • Total topics 
  • Threads with responses
  • Responses per thread
  • Participating users
  • Total number of blogs
  • Total posts
  • Total comments
  • Total number of Wikis
  • Total edits
  • Articles per community
  • Total number of documents
  • Total number of document comments
  • Number of Documents per community
  • Total number of messages
  • Number of users sending messages
  • Number of users receiving messages 
  • Total events posted
  • Events per community

I can get the same raw data from eachindividual community (but it’s a tedious process doing this for 240 communities!)- though this does at least give a more accurate indication of the health ofthe individual community (where my definition of ‘health’ means’activity’), but none of this information can provide me witha ‘value’ or ROI – no matter how I slice and dice the data.

Hence the need for a more qualitative approach, in the form of membership and user surveys etc. Picking up on Ed’s comment that all of his community projects have measurement built into them at a strategy level – which sounds like the right approach – it should also be noted that even this can be difficult to quantify in terms of an ROI. The IDeA community strategy was developed to “improve local government services”. I can infer from the platform statistics that the communities appear to be active, but I cannot yet connect a specific output (service improvement) to the work of any individual community.

So, allowing for the subjective nature of user surveys, I still think they are more likely to give an indication of ROI if not an absolute measure.  If I’m right, the next step is in asking theright questions!

The Online Community Research Network are doing a survey on this, so please have a read, fill it in, and pass it on. The more responses the better.

About Post Author

Stephen Dale

I’m a life-long learner with an insatiable curiosity about life. I love travel, good food, and good company. I’m happy to share what I know with others….even the interesting stuff! My outlook on life is pretty well captured in this quote from a book about the legend of King Arthur: “The best thing for being sad,” replied Merlin, beginning to puff and blow, “is to learn something. That’s the only thing that never fails. You may grow old and trembling in your anatomies, you may lie awake at night listening to the disorder of your veins, you may miss your only love, you may see the world about you devastated by evil lunatics, or know your honour trampled in the sewers of baser minds. There is only one thing for it then — to learn. Learn why the world wags and what wags it. That is the only thing which the mind can never exhaust, never alienate, never be tortured by, never fear or distrust, and never dream of regretting. Learning is the only thing for you. Look what a lot of things there are to learn.” ― T.H. White, The Once and Future King So much to learn, so little time!
Happy
Happy
0 %
Sad
Sad
0 %
Excited
Excited
0 %
Sleepy
Sleepy
0 %
Angry
Angry
0 %
Surprise
Surprise
0 %
Previous post ID cards and the database state
Next post 100 Banned Words – again!

Average Rating

5 Star
0%
4 Star
0%
3 Star
0%
2 Star
0%
1 Star
0%

Leave a Reply

Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.