http://www.growmap.com/blogworld
 

CrowdSourcing: Failures and Successes

March 6, 2011 · 47 comments

Geoff Mattie of Project Management Institute published a post asking, “Does Crowdsourcing Work in a Project Environment?” that raises some very valid concerns that indicate to me that he is far sharper than the average bear.

This infographic from 99designs is a good introduction to what crowd-sourcing is (click the image to see the entire infographic):

The Power of Crowdsourcing by 99designs

Click the image to see full infographic

There are different ways to use crowdsourcing. The example used in the infographic of having random people brainstorm solutions could work well, but it has also created crowdsourcing disasters. Other uses though are more problematic especially regarding quality – or lack of it.

The best known and most widely used application of crowdsourcing I know of is Akismet, a spam blocking plugin that is a default in WordPress blogs. What Akismet does – blacklisting the most active and intelligent bloggers’ comments – is an excellent example of crowdsourcing gone wrong.

There are huge issues involved in using crowds as your source for answers. The spam or not spam poll I did illustrates the largest problem with crowd-sourcing. In that poll and the comments it surfaced, it becomes obvious that many people believe they know what comment spam in blogs is but their definitions are all over the map and very surprising.

Some went so far as to say they flag every comment they don’t like or every comment from someone they don’t already know as spam. The beliefs I mention above and that are shown in my poll are what causes Akismet to either send to a spam area – or depending on how the blogger has Akismet configuration set – instantly delete comments from the best regular readers and commentators who frequent blogs I do.

Crowd Sourcing Drawbacks

StyleHop on CrowdSourcing

Most bloggers do not realize that when they flag a comment as spam they are effectively blacklisting and banning that person and preventing their comments from appearing in ALL other WordPress blogs.

If it only kept your comments from appearing in their own blog that would be fine – but that isn’t how Akismet works.

The Akismet problem is so serious – taking away the voices of the most
intelligent and influential – that we developed an Akismet Alternative.

Most people see only what THEY know, believe there is only ONE correct way to do anything, and are sure they are right and everyone else is wrong. They don’t realize there are usually many ways and many opinions based on different backgrounds.

Only those who source their knowledge from large groups of disparate opinions can obtain the big picture. If I were to use crowd-sourcing I would carefully choose my “crowd” depending on what I wanted to know.

If I wanted to develop best practices I would select a “crowd” of the most intelligent, brilliant people I know in that niche area of expertise.

Crowdsourcing

Click Image for Crowdsourcing Successes and Disasters

If I wanted to know what some specific target audience wants to buy I would carefully select only those in that target demographic because anyone else’s opinions would not be valid for that study.

People like me know we are not “normal” and one of the largest hurdles for many business owners to get over is that their target audience is NOT like them. They do NOT know what you know. They are NOT familiar with your industry jargon. They are NOT as passionate about whatever it is you love and do NOTwant to spend their spare time learning all about it. They just want to buy what they want to buy and usually that is whatever the people they follow use or recommend.

The target demographic of most businesses is made up of followers – not leaders. Business owners and managers are usually leaders. These are very different kinds of people just as technical people are usually very poor sales people and those who excel at sales usually do not have strong technical skills. (Yes there are SOME exceptions – brilliant people are often good at a vast range of things – but I have yet to meet anyone who excells at everything.)

Akismet proves to me that crowd-sourcing for blocking spam or blacklisting spammers does NOT work and would only work if they hand-selected the bloggers with wisdom enough to know that only those who are obvious spammers should be banned from commenting – not just those whose opinions you do not like.

Bill Casselman raises many more concerns about CrowdSourcing. His definition?:

Crowdsourcing is getting low-pay or no-pay outside amateurs to do company work.

He continues:

A Business Concept as Old as Suckers

The word crowdsourcing may be new but the concept is as old as P. T. Barnum. You remember P.T? He’s the American sharper who invented the freak show, the department store and the three-ring circus. Barnum’s most famous utterance? “There’s a sucker born every minute, and two to take him.” To which that spry iconoclast H.L. Mencken (1880-1956) added: “No one in this world has ever lost money by underestimating the intelligence of the great masses of the plain people. Nor has anyone ever lost public office thereby.”

He has other objections to uses of crowdsourcing I had not thought of so you may want to head over and read the rest of his diatribe against other types of crowdsourcing.

There is another crowdsourcing disaster on the horizon that could seriously affect Internet users who use Google search. Google recently announced a Chrome Personal Blocklist browser extension add-on that COULD be used to blacklist sites exactly the same way Akismet blacklists bloggers:

“While Personal Blocklist is designed to allow individuals to build up their own unique blocklists, Google says it may use the data to influence the search results for others. From its announcement: “The extension also sends blocked site information to Google, and we will study the resulting feedback and explore using it as a potential ranking signal for our search results.””

While that quote says “potential ranking signal” there is nothing to keep Google from using it to censor Google results. If you are one of the naive who trusts Google implicitly I implore you to read these posts:


http://www.growmap.com/raven-tools/
 

Read the Best of GrowMap or Stay In The Loop!

Subscribe to the GrowMap feed via RSS or Email to receive notifications when new posts are published. Follow GrowMap on Twitter too!

{ 40 comments… read them below or add one }

Digital Agency Delhi May 8, 2012 at 2:49 am

I guess, This thing has both negative and positive aspects. And, It depends on person to whom it may concern.

Reply

Matt Clarke who writes about Funny Quotes About Life March 4, 2012 at 7:31 am

As an owner of 4 sites I think that the Google blocklist mention above is very worrying. My sites feature only the best quality content but unfortunately not everybody understands what the true definition of good content is. For example, I know a number of people who think that standard display adverts like Adsense on websites are intrusive and spammy. All of my sites are adsense funded and I would hate to think that someone could add my site to their blocklist because it has adverts on it….and that in turn could damage my rating with google. There needs to be some way of defining the reason for blocking if google are going to start incorporating this info into the rankings.
Matt Clarke would love you to read ..Funny Football QuotesMy Profile

Reply

growmap
Twitter:
March 4, 2012 at 10:18 am

Twitter: @GrowMap

Hi Matt,

The problem we have is that G just doesn’t care about the individual site owner and you’re correct that there can be no consensus on something as subjective as what is spammy and what isn’t.

They are selling that block feature as a way to refine YOUR OWN content and then using it for something else entirely. There are many reasons a person might not be interested in a site – but that doesn’t mean that site won’t interest OTHER people.

That you aren’t interested TODAY doesn’t even mean you might not be interested tomorrow. The average person isn’t going to be thinking about their own tomorrows much less what anyone else in interested in.

I check sites before I approve comments and at least the two pages linked in this comment display ads in a reasonable quantity (3) in optimum positions.

As long as a blogger doesn’t make the mistakes I mention in How NOT to Monetize Your Blog they should not be penalized – but I’m betting many will.

We MUST take back the power we have handed that one company to decide who succeeds and who fails. The Google Monopoly is dangerous to our freedom of choice and Google’s Evil makes it obvious they can’t be trusted.

It is up to all of us to find alternatives and explain why we MUST use them to everyone we know and in our blogs. The are taking away our freedom of choice as I show in the screen captures on this page about the Google’s Panda update.

They are marching us toward one so-called “choice” and I for one am totally opposed to giving up ANY of my freedoms. I do not answer to THEM – I answer to a higher power.
growmap would love you to read ..Traditional Versus Collaborative World ViewsMy Profile

Reply

Architectural Visualization Course February 28, 2012 at 4:56 am

Like every coin has two sides. Same thing goes with this crowd sourcing also. However, once can avoid it’s negative sides by following this article as it let you know it’s pros & cons.

Reply

Adrian
Twitter:
January 28, 2012 at 9:36 pm

Twitter: @A_Biljan

Here’s my experience with crowdsourcing as recently as Jan 2012:

Things I’ve learned about Crowd-sourcing Media content:

  • More than 75% of respondents were from Eurasia.
  • Respondents did not understand north american idiosyncrasies
  • Language barrier was evident
  • Visual change instructions are incredibly difficult to verbalize in an email.
  • Recommendation: Its worth paying a single person who’s work speaks for themselves.
    Bottom Line: Its just like code outsourcing, you get less than what you pay for.

    The time I had to wade through the terrible (I mean MSPaint bad) designs that were submitted, I would GLADLY pay someone who has a reputation and who, immediately understands western culture.

    Crowd-sourcing tournaments are only good if you have no clue what you want, and are in dire need of direction. Then, hire a professional.

Reply

Lisa | Parfum January 25, 2012 at 6:23 am

We see the trend where ‘crowd’ generated solution that is not only pertinent but lot cheaper than the expert generated solution.
Lisa | Parfum would love you to read ..ParfumMy Profile

Reply

nish who writes about income tax efiling January 19, 2012 at 3:50 am

It’s relative, you know. Of course, it fails many times, but it also has pros. A start-up with a small budget can get to choose from a bundle of logos/designs made solely for them!
And if they dont like any – there are no bounds. One can end up finding some really good designs there, without spending a fortune.

Reply

growmap
Twitter:
January 19, 2012 at 4:38 am

Twitter: @GrowMap

Hi Nish,

The problem is it benefits one side but damages many on the other. While someone who wants a logo can get a deal, is it really fair to have many people working for free in hopes they might be the lucky one chosen to receive a pittance for their work?

Anyone who is truly skilled would do well to avoid participating is such an unfair competitive environment.
growmap would love you to read ..SOPA Blackout Strike Already Started; Why Major Sites and Blogs Went Dark in SupportMy Profile

Reply

iPhone App Development December 16, 2011 at 12:18 am

I think before broadcasting your problem online better is to try to solve it by yourself or take help from your team expert. If not then use the technology and make it viewable to others. I know if doing so, there are few problems of spamming but if you have able management like suggested one here then i think no to worry about. Sometime broadcasting your problem online can get a better solution than not found in yours.

Reply

Danny August 30, 2011 at 6:32 pm

I didn’t even know that GASP was made to solve this problem. I’ve been using akismet and GASP together. But I better disable Akismet and see what happens.
I think it was a great idea to make the program/plugin work like that. It just went wrong. How else are you going to make a good blacklist?
There are too many human spammers that need to get blacklisted. You can’t let a team of people deal with that.
Danny would love you to read ..Black & Decker NPP2018 18-Volt Cordless Electric Pole Chain SawMy Profile

Reply

growmap
Twitter:
January 19, 2012 at 4:40 am

Twitter: @GrowMap

Hi Danny,

The problem is there is no consensus on what spam is – and most bloggers who haven’t thought this issue through would immediately flag YOUR comments as spam because they link to your business and you offer products for sale.

That is why I so frequently write about what IS and IS NOT spam and the importance of supporting small businesses.
growmap would love you to read ..What If There Was an Easy Way to Get Your Tweets Retweeted? There Is – And It is Fast and FreeMy Profile

Reply

Ryan Ward July 14, 2011 at 11:38 am

Thanks to genius brains like Jeffe Howe who introduced the concept of crowdsourcing in an interesting way. Dealing with Akismet can also become a headache sometimes but it is applications like Akismet which makes wordpress blog more challenging to use. However, blocking even the good guys can become its own downfall. Blocking spammers is one thing but blocking even the best commenters doesn’t sound too friendly.

Reply

wny yoga
Twitter:
July 14, 2011 at 4:49 am

Twitter: @n/a

thanks for this post..i now know that flagging can have consequences…i am now being careful when i do this from now on

Reply

Mexican Drinks
Twitter:
July 13, 2011 at 6:13 am

Twitter: @allaboutmexican

im so disappointed with Akismet..they flag you even if your are not a spammer..it has become a nuisance for us
Mexican Drinks would love you to read ..A Simple Quesadilla RecipeMy Profile

Reply

Buffalo Tees
Twitter:
July 8, 2011 at 1:07 am

Twitter: @stutterwear

thank you for telling me about crowdsourcing..i never knew this term existed.thanks for educating me
Buffalo Tees would love you to read ..Buffalo Cool Place T-ShirtMy Profile

Reply

John Knights who writes about Business Loans July 5, 2011 at 12:56 pm

People should start using GASP now.. There are certainly times when program Fails.. I don’t really recommend anyone to use Akismet since I’ve already heard a lot of complaints about their service and blocking comments problems.

Reply

Leave a Comment

CommentLuv badge
This blog uses premium CommentLuv which allows you to put your keywords with your name if you have had 1 approved comments. Use your real name and then @ your keywords (maximum of 5) WARNING: Comments that contain ONLY keywords are likely to be deleted. Please use a name followed by @ your keywords.

{ 7 trackbacks }

Previous post:

Next post: