TopCoder Crowdsourcing
TopCoder Crowdsourcing
?
?
?
?
?
?
THIS BOOK IS DEDICATED TO THE TOPCODER COMMUNITY. YOU NEVER CEASE TO AMAZE US.
EVERY GRAPHIC, ICON, COPY FORMATTING, AND PAGE DESIGN YOU ARE ABOUT TO EXPERIENCE IN THIS BOOK, AND CONVERSION WIDGETS AND BANNERS SEEN ON TOPCODER.COM WERE CREATED BY THE TOPCODER COMMUNITY VIA OPEN COMPETITIONS. DURING THE PROCESS OF WRITING, EDITING AND PREPARING THIS BOOK FOR PUBLIC CONSUMPTION, WE LEVERAGED TWO EXCEPTIONAL COPILOTS AND ONE WITH A FOCUS ON DESIGN ELEMENTS AND ONE WITH A FOCUS ON WEBSITE IMPLEMENTATION AND CONVERSION. THIS BOOK IS DEDICATED TO ALL THE AMAZING AND TALENTED INDIVIDUALS WHO HELPED BRING THIS BOOK TO LIFE.
PAGE01
INTRODUCTION
?
?
PAGE02
INTRODUCTION
LOGISTICS - HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED? ? EXECUTION - HOW DO I PRODUCE IN OPEN INNOVATION AND CROWDSOURCING?
In total, this starting guidebook will answer 10 burning questions on Open Innovation and Crowdsourcing that every person (and enterprise) venturing into this world of massively parallel production should understand before they get going. Each answer will explain the importance of the question why it matters to you and the specic way in which that question is answered for the TopCoder Enterprise Open Innovation (EOI) platform. The world has shifted. There is a global talent pool with exceptional and specic skill-sets waiting for their opportunity to produce for you. Through Open Innovation and Crowdsourcing, you can innovate and deliver like never before and we hope this starting guide is your launching pad to amazing success.
PLEASE ENJOY THE 10 BURNING QUESTIONS ON CROWDSOURCING AND BEST OF LUCK ON YOUR CONTINUING JOURNEY TO PERSONAL AND ENTERPRISE SUCCESS!
PAGE03
TABLE OF CONTENTS
PAGE05
PAGE 13
PAGE26
PAGE04
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
You host a competition and you get the winning solution, idea, or digital asset Whats so hard about that!?
Yes, it can be that easy. Before we dive into any and all of the forthcoming Q&A please realize one over-arching point: The platform and community/crowd you choose to engage makes all the dierence. Seek a platform that is truly focused on your outputs and your innovations; one that doesnt ask you to get bogged down in the minutia, but instead allows you to focus on your productivity and your value creation. The community of solvers, producers, and contributors you engage with Open Innovation and Crowdsourcing competitions should be both wide and deep, meaning you should be able to accomplish a wide variety of work via your community, while accessing hyper-specialized talent with very specic skill-sets that compete for you in each unique competition, contest, or challenge.
TopCoder focuses on digital asset creation through competitions and we canvass an array of specic competitions in that space. Other communities that leverage Crowdsourcing focus on things such as video production, localization, and physical mobile application testing on specic handsets. Understand your needs, do your homework, and then choose wisely. Regardless of which communities you work with in the future, the following content will help you prepare for repeatable success.
PAGE05
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
BURNING
QUESTION #1
HOW DO I DECIDE HOW MUCH MONEY TO OFFER THE CROWD?
$
?
Crowdsourcing and Open Innovation platforms are an evolved marketplace and economic factors are in play, meaning you need to correctly price tasks, work, and challenges in order to draw-out the best talent from any given community so that they will work on your projects. One of the major benets of Crowdsourcing is the fact that it is mainly meritocratic, meaning the lions share of the prizes goes to the winning contributors and solvers and you pay for the best outputs, not eort. So you have to make sure youre oering a fair market value for the lift you are expecting of the individuals within the community. Remember, they the community members creating value for you - are taking on risk and very often have no guarantee of payment, so pricing a contest fairly is crucially important to overall success. At the same time, you need to work within your budget. Dierent Crowdsourcing and Open Innovation communities have an incredible variety of payments being oered spanning from literal pennies for the completion of a micro-task to prizes of over a million dollars being oered for solving really large, complex problems and algorithmic challenges.
PAGE06
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
SO HOW DO YOU DECIDE HOW MUCH MONEY TO OFFER THE CROWD FOR EACH SPECIFIC COMPETITION OR CHALLENGE?
?
ANSWER:
You shouldnt. This is part of the minutia of Crowdsourcing we discussed earlier and it should not be a focus of yours. Of course you have budget, but setting prize monies for specic challenges should be based on historical success of similar challenges on whichever platform you are using. You should be working on a platform that oers you clear and transparent visibility into the market price for each specic type of task or challenge.
PAGE07
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
BURNING
QUESTION #2
HOW LONG SHOULD MY CONTESTS RUN FOR?
?
?
?
?
?
stand-alone challenge and being done with it. Instead, its about transforming how you approach the very notion of work, how you access global talent, and ultimately, how you produce, innovate, and succeed like never before. To achieve this long-term success, it means making Open Innovation part of your daily routine, and for that to happen, you have to have an understanding of how long things will take to get done and delivered back to you. You have deadlines, people to answer to, and projects that have to cross the nish-line on time. From the standpoint of the community or crowd you are working with, contests that are either too short or too long in duration hinder the maximum participation that will drive the best results.
SO IN SHORT, KNOWING HOW LONG YOUR CONTESTS NEED TO RUN FOR IN ORDER TO BE SUCCESSFULLY COMPLETED BECOMES A CRUCIAL PIECE OF YOUR SUCCESS IN CROWDSOURCING AND OPEN INNOVATION.
PAGE08
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
HOW LONG SHOULD MY CONTESTS RUN FOR?
?
ANSWER:
It greatly depends on the type of work you are putting out to a community and crowd, and much like the rst question; you should be seeking guidance from the operators of the platform. You shouldnt be worrying about how long a particular contest is going to run for. Instead, your focus should be on the entirety of the project, and orchestrating multitudes of projects in unison to vastly increase your personal productivity via Open Innovation and Crowdsourcing. In short, its not about how long, its about how predictable and repeatable a certain type of contest is, so you can eectively set a contest up for success, walk-away from it while the competition is on-going and doesnt require your active involvement, and in the meantime, work on other projects, pieces of projects, and yes, even run more competitions to really force-multiply your eorts.
PAGE09
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
BURNING
QUESTION #3
HOW DO I PICK THE WINNERS?
?
?
?
?
[]
[]
?
?
you and your co-workers indeed must be the one choosing the winners, it behooves you to set aside time to do this extraordinarily important task. That time should be factored into your work schedule and this responsibility is something to take quite seriously after all, the winning submissions are your outputs! There are times when choosing a winner should not be your responsibility, for example if you are too busy, or would like technical experts to serve as judges. From the standpoint of the community or crowd you are working with, judging has to be absolutely transparent, fair to the members, and when appropriate, standardized. To keep a community engaged and producing creative outputs, fairness and consistency in judging is paramount. Selection of winners must happen on expected schedule so that the individual members can most eectively manage their projects and workload.
[]
UNDERSTAND YOUR RESPONSIBILITIES. IF YOU ARE DECIDING A WINNER, DEDICATE TIME TO YOUR SELECTION PROCESS AND ALWAYS TREAT THE COMMUNITY OR CROWD MEMBERS FAIRLY. STICK TO YOUR PRE-DETERMINED SCHEDULES AND FINISH YOUR CONTESTS ON-TIME.
PAGE10
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
HOW DO I PICK THE WINNERS?
ANSWER:
Depending on the type of competition, your involvement in choosing the winners will vary tremendously. Why? Well, if it is a subjective contest, such as a design competition, it is very likely you would prefer to choose the design you and your team feels is the best t. Why would you hand over that decision to anyone but your team? Perhaps you might see benet in doing so to have an outside team pick their favorite to see how it compares to your choice, but ultimately, the nal decision is likely best to remain with you. Then there are contests where the outputs can be measured against a certain set of pre-determined criteria. For instance in a data compression competition, you simply might be looking for the solution that performs the greatest while retaining a certain level of identied data integrity. Here, the winner would simply be decided by the performance of the solution.
FRONT-END OF INNOVATION
SOFTWARE DEVELOPMENT
ALGORITHM ANALYTICS
PAGE11
PART 1 - LOGISTICS HOW DOES CROWDSOURCING LOGISTICALLY WORK AND WHAT MUST I DO TO GET STARTED?
Front-End Innovation (FEI) deals with mainly subjective contests where design and user-experience are the focus. These can be idea or conceptualization contests, UI/UX innovations, storyboards, icons, click-able prototypes, and more. For these types of contests you and your team are responsible for selecting your favorite submissions. Software Development is completely dierent. Deciding between a better piece of Java code could engulf your entire day. Instead at TopCoder, each piece of software developed via competition is peer reviewed by 3 community members who utilize didactic and language specic scorecards. These scorecards - and what they seek to grade - can (and often are) edited to t a specic clients needs. The work is graded, the top rated piece of code wins, any remaining aws are documented, xed by the winning competitor, and the nal output is your deliverable. Algorithms & Analytics is most often completely objective. Well before an algorithmic competition or Big Data challenge commences, our team works with you to highly dene the parameters of success and how the solutions will be graded against one another. At the end of the specied competition period, there is a clear winner that simply performed the best within the parameters pre-described. There is one exception in this pillar. We also host Big Data ideation competitions that ask our global community to provide ideas on how they would utilize a large data set and the assets and applications they would seek to create from the data. This is more of a Front-End exercise and therefore the outcomes are subjectively evaluated and judged.
PAGE12
Yes! You have now decided to utilize Open Innovation and Crowdsourcing to succeed like never before!
You now have a better understanding of how it all works. But understanding why and executing how are quite different. This part will concentrate on your execution and how your consistent approach will lead to repeatable success in Crowdsourcing and Open Innovation. As you read through this section of the starting guide, think about how good habits are formed and how consistent execution becomes a reality. No matter what you are executing on, consistent success doesnt happen overnight and it certainly doesnt come to be without effort and practice. Treat your Open Innovation and Crowdsourcing execution in the same light. Mastery of these tactics and techniques are not a singular event, but rather a process of learning, experimenting, and achieving.
PAGE13
BURNING
QUESTION #1
HOW DO I PREPARE A PROJECT OR A SERIES OF PROJECTS FOR SUCCESS?
?
?
?
?
?
?
?
Lather, rinse, repeatable success: Crowdsourcing and Open Innovation shouldnt be about running one isolated competition, never to revisit the methodology again. If that were the case, you probably would not have decided to download and digest this starting guide. This question matters because as you master the art of Open Innovation you will learn from your own experiences, what works best, what can save you time and ultimately, how it can help you predictably & repeatedly steer Crowdsourced competitions to resounding success. After all, thats why youre here to succeed. From the standpoint of the community or crowd you are working with, preparation of the inputs heading to the members is crucial. Vagueness, unclear goals, a lack of necessary shared domain, and other negative factors can sincerely disrupt your contests and impact your results. Be comprehensive. Be clear, and anticipate questions the community or crowd will likely ask, and prepare those answers in advance.
PAGE14
ANSWER:
In the world of digital creation, developing well written, appropriately detailed specications is paramount to success. First and foremost, ingratiate yourself with how the community or crowd you are about to engage is accustomed to receiving information. Look at other examples of inputs that community has digested in the past and ask specic questions as to why certain inputs seemed to be favored over others. Secondly, understand the right level of detail you will need to provide and for which type of contest. If you are seeking solutions that will be judged subjectively, you should purposefully keep the specication or contest input more obtuse and allow for the natural creativity of your community to arise. Part of Open Innovation and Crowdsourcing success is your willingness to be surprised! Then there will be other competitions where rigorous documentation and knowledge share of a specic domain is simply essential to procuring a highly valuable contribution from the community. Think hard about how much needs to be shared, prepare that documentation in a way the community is accustomed to receiving it, and make yourself or a subject matter expert from your team available to answer questions that will come from the community. Finally, ask your platform provider if they oer help in creating the specication. Youll read in the TopCoder EOI section (just below) why this might save you a great deal of time and eort, and result in superior outputs as well.
MANY OF OUR CLIENTS PREFER TO NOT CREATE THEIR OWN SPECIFICATIONS FOR CONTESTS THEY ARE RUNNING ON TOPCODER. SO WHERE DO THE SPECIFICATIONS COME FROM?
TopCoder has contests where the output is the specication document. This allows our clients to really stick to strategy & execution and to avoid getting bogged down in transforming real world projects into atomized competition inputs. Some clients prefer to create their own specications while others utilize these specialized contests to produce the documentation for them. It is your choice.
PAGE15
BURNING
QUESTION #2
HOW DO I ENSURE THE RIGHT TALENT IS WORKING ON MY PROJECT OR BUILD?
?
?
?
?
?
?
?
The right talent will most often procure the right results. Open Innovation and Crowdsourcing are focused on the outputs the competition will breed. The more specic the task or project - the more hyperspecialized the talent you will want to attract to the work. Attracting 700 coee-shop baristas will likely do you little good if the project is to rebuild a 6Os era muscle car engine. If you are not engaged with the right community (or crowd) for the work or innovation you seek to accomplish, your chances of success diminish greatly. It should be noted: There is a huge dierence between the need to recreate something that already exists a 60s era muscle car engine versus something that has yet to be solved or created. When the object of the contest is more open because no solution yet exists, we often see that near-eld repurposing of knowledge and skills can play a crucial role in helping to formulate the new solution. From the standpoint of the community or crowd you are working with, the individuals that comprise the crowd have very specic skill sets and personal desires. Put simply, they really enjoy doing certain types of work that they are either already good at, or want to learn and master. But like everyone else, their time and bandwidth (individually) is limited, so they will gravitate towards work they enjoy, work that is rewarding both nancially and personally and, work that ts their personal bandwidth, meaning the size of the ask is a crucially important factor.
PAGE16
ANSWER:
Depending on which community, or crowd, or network of solvers, or platform you choose to engage will determine greatly your ability to repeatedly access the hyperspecialized talent you need in order to succeed. Sure, if you can come up with an amazing dollar prize amount and can craft a contest so worthy that all the technology and social blogs are sharing the challenge for you; that could also do the trick. But, the big dierence is, that path is nearly impossible to scale and again, youre not here to run one competition. Rather, your focus needs to be on the repeat-ability of the process, so that you can drive extraordinary value and outcomes for your team and potentially transform how your enterprise approaches innovation and productivity.
PAGE17
BURNING
QUESTION #3
HOW DOES ITERATION AND SUBJECT MATTER EXPERTISE WORK WITH THE CROWD?
?
?
?
?
?
?
?
It may be high time to debunk a myth. Crowdsourcing and Open Innovation are not magic. You do not simply post a contest, only to ignore the contest for a set period of time, and receive amazing results in return. It just doesnt work that way. You need to be aware that Open Innovation and Crowdsourcing do take eort and specic eort at that. You will be involved in the success of your Crowdsourced projects and in at least two very specic ways providing iterative feedback and managing your internal subject matter experts, ensuring knowledge ows properly from your internal organization out to the community you have decided to engage. Be prepared to engage work dierently, but still be prepared to work! From the standpoint of the community or crowd you are working with, iteration with the client is a crucial step to their individual success. Remember, the community member is here to succeed too! Their eorts and their ability to create outstanding assets often hinges on receiving quality feedback from the client. Regarding access to subject matter experts; if a particular challenge is complex and the necessary domain knowledge is not shared from your team to the community or crowd, you likely will nd participation quite light. The converse is can also be true. If domain is properly shared, the community will likely respond in-kind, driving participation and the volume of quality submissions higher.
PAGE18
?
ANSWER:
Iteration: Open Innovation can be quite collaborative and iterative if you approach the work properly and you are engaged with a community that fosters such activities. Often while running an Open Innovation competition you are going to be presented outputs that surprise you. It could be a nuanced and clever idea, a really sharp icon design, or a new approach to a solution your team would likely never have come up with. Very often, outputs, as they are rst presented, are not nished - or perhaps better put they can use some level of renement and editing. This is where iteration comes into play. If you are able to oer feedback and specic guidance to competitors during a competition, you should. Be clear, be honest, be respectful, and communicate what is succeeding so far, and which areas of the design or solution you feel can be improved. Take this role of providing critical feedback very seriously. You will be amazed how well competitors will take good direction and how advanced their new outputs will be because of the quality feedback you provided. Subject Matter Experts: Depending on the type of challenge or contest you are seeking to run, you may need to consider how you will eectively transfer knowledge to your community or crowd so that they can eectively work on your problem or task. The greatest step you can take is to properly facilitate this knowledge share. Prepare your internal team well before hand and alert the specic players who may need to be involved that they will be required to spend time either presenting or answering questions in which they have a certain domain expertise. Ask the community or Open Innovation provider before hand how this is handled and press for a detailed answer. If you cant eectively share knowledge outwardly with a community or crowd it might prohibit the range of work and innovation you can attempt.
PAGE19
PAGE20
BURNING
QUESTION #4
HOW DO I MANAGE MY OPEN INNOVATION & CROWDSOURCED COMPETITIONS?
?
?
?
?
?
?
?
You can master managing Open Innovation competitions just as you can master managing an internal team or external outsourcing partner. Yes, the work itself is dierent, but as we discussed earlier, there is still work to do Crowdsourcing is not magic! If a process of managing the work breaks down, it doesnt matter what methodology you are incorporating to get the work accomplished, you will greatly limit your success. However, if you learn to manage Open Innovation contests eectively, allowing you to have assets created in a massively parallel fashion, you will realize success and productivity on levels you never thought possible. From the standpoint of the community or crowd you are working with, individual members like to participate in contests and challenges where the management of the contest is professionally executed and consistent. Community members will also gravitate towards your specic challenges and contests once your history and reputation intra-community is established.
PAGE21
? ? ?? ? ? ? ?
?
ANSWER:
answered and when you can, anticipate what they will ask for and provide it at the onset.?
Some of the below has already been canvassed in this starting guide, but it bears repeating. After preparing your contests for success, by ensuring the right level of detail has been shared and that you have attracted the right level of talent to your work or challenge, your focus should shift to managing the contest(s). So where should you start? First, you will need to learn to let go. Remember you or no longer doing the work and your role has therefore shifted. Instead focus on making sure your community or crowd has everything they need
Second, when questions arise from your community about a particular project or task and please note they will arise and this is a good sign of healthy participation answer your potential contributors fast and as thoroughly as possible. Remember, it is highly probable that people within your community or crowd speak English as a second language. Dont be afraid to over-explain details, this will help you avoid any miscommunication and time wasted because of it. If you have visuals, screenshots or picture examples you can share, do so if it helps to more eectively communicate your answers. Be clear! Finally, learn to work in a massively parallel fashion. We will discuss scaling Open Innovation later in this starting guide. For now, understand that you should challenge yourself and seek to conduct several contests at one time. Why? This will force you to not revert back to bad habits of doing the work and instead ll your time with orchestrating multitudes of solutions. This is where you want to be. You are a conductor of grand value, so emerge as the maestro by challenging yourself to successfully manage multiple contests at one time. When you arrive at this point, your value soars, you accomplish more, and you successfully innovate faster than ever before.
PAGE22
PAGE23
PAGE24
Now envision several of your most productive team members multiplying their outputs and delivering for your enterprise or business at 3X, 5X, or even 10X their traditional productivity levels. Do the work necessary to achieve this type of scale with your team and your value as a strategic leader who delivers results will soar.
PAGE25
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
Is Crowdsourcing a nice marketing tool to get eyes to your work or is it transformational, allowing you to innovate faster and produce more, while taking on less risk?
Its really up to you. Today, global communities and production platforms exist and your willingness to re-think work and push the boundaries of what can be accomplished via Open Innovation will determine how much you can get done. This part of your starting guide is all about your growth, your innovation, and your success. Individually, you are likely looking to grow your skills and emerge as an innovation expert within your enterprise or business. That emergence can be your reality and you can achieve amazing growth. Build on all that you have learned so far and begin to think about real world projects and scenarios you can envision beneting from Open Innovation. Think about how you would structure these projects, the subject matter experts you might bring to the community or crowd, and more in order to achieve success. As you read through this nal part of the starting guide, begin honing in on the details and thinking through them in your mind, or better yet, mapping them out visually.
PAGE26
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
BURNING
QUESTION #1
HOW DO I ACCOMPLISH COMPLEX AS WELL AS SIMPLE TASKS?
?
?
?
?
?
?
?
Are you here to transform how you approach productivity and innovation or are you here to source more aordable ways to accomplish fairly mundane tasks? Ask yourself this honest question. If your answer is the former, than how much you can accomplish via the methodologies matters tremendously. From the standpoint of the community or crowd you are working with, individual members tend to be attracted to challenging and complex work if it is well organized and properly dened. There are myriad reasons why, ranging from greater potential prize money earned, their desire to work on challenges their daily life does not present to them, their want to solve something that has no existing solution, community peer recognition, and more can motivate a community member and get them excited to help you succeed.
PAGE27
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
HOW DO I ACCOMPLISH COMPLEX AS WELL AS SIMPLE TASKS?
ANSWER:
Todays Crowdsourcing and Open Innovation landscape is maturing rapidly. Sure, there are ample solutions and crowds that now exist that can help you do a mundane task; such as physically waiting in line at the DMV for you, or localization services that utilize crowds to translate documents. These can save you time and money. They can make you more ecient, but not more innovative. The other side of Crowdsourcing encompasses projects, contests, and challenges that are truly innovative. Where an unknown or optimized solution is what you are seeking, and it doesnt exist yet! These types of challenges and contests are more properly dened as Open Innovation.
Micro-tasks/Crowdsourcing
Cost Savings Faster Results Free-Up Your Internal Resources Focus on Higher Value Task
Open Innovation
New Products Breakthrough Discoveries Extreme Value Outcomes Community Building and Engagement
PAGE28
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
Specically on the TopCoder EOI Platform:
At TopCoder we have over 30 specialized competitions ranging from the very front-end of innovation contests focused on ideas and concepts all the way through Bug Hunts and Bug Races contests to identify, and then x veried bugs. As a client you can choose to do a less complex singular competition like a design contest and then bring that asset back to your team to continue the work internally OR you can build a digital asset all the way through the software development life-cycle from ideation through testing & maintenance. It is your choice. This choice is made possible due to TopCoders process of atomization and one of the consequences of atomization is incredible exibility you gain throughout the development life-cycle. At TopCoder we have delivered solutions to complex challenges and projects ranging from Big Data Bio-medics contests, mobile applications to be used in remote and desolate environments, energy harvesting for the International Space Station, legacy system modernization and beyond.
PAGE29
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
BURNING
QUESTION #2
HOW DO WE PROTECT INTELLECTUAL PROPERTY?
?
?
?
?
?
?
?
Much like we discussed earlier, if you are highly limited in what you can attempt and therefore create via Open Innovation, then the potential value to you and your enterprise diminishes. And that is not why you are here. Protecting intellectual property is a legitimate concern most every enterprise will have when assessing Open Innovation. If it is not your concern, it will be someone elses from your team. Your best strategy is to understand the risks, the process, and the platform you are engaging and make educated decisions based on your understanding. From the standpoint of the community or crowd you are working with, the smaller the barriers to entry to participate in any given contest or challenge, the greater the participation rates will likely be. However, individuals that comprise a community typically understand that additional layers of screening or an additional security process sometimes is necessary so that they can work on what is deemed by the client as an IP sensitive project.
PAGE30
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
HOW DO WE PROTECT INTELLECTUAL PROPERTY?
? ?
ANSWER:
??
This question is impossible to answer in a generic fashion as we have in this section throughout this starting guide. TopCoder does not want to begin to profess how other platforms and communities handle this sensitive subject. What we can communicate generically is that everything has some level of risk. Whether it is traditional hiring, outsourcing, or Crowdsourcing, you are dealing with people. With that said, specically on our platform, we take this matter extraordinarily seriously. In fact, an upcoming eBook from TopCoder solely focuses on this topic and it canvasses 8 questions on intellectual property in Open Innovation that you should be asking, and why they matter to you.
PAGE31
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
As simply as this can be stated; when the work is broken down into its smallest pieces of the build and launched as separate competitions, this process innately helps to protect the whole or entirety of the project from being unveiled. Often, we have clients that simply cannot discuss an innovative project publicly due to the competitive advantage they can potentially gain, so they opt to not share with our community the entire project. They may still desire user interface innovation, or an algorithmic solution that speeds up a computational engine, but they simply dont feel comfortable unveiling the entire project to our global community. When you need to, on-demand, you can highly isolate work, have the isolated work created via TopCoder while your internal team works on pieces of the project that you perhaps deemed too sensitive to be shared externally. Again, this is about your choice and your gained exibility via Open Innovation on the TopCoder Platform. As we stated earlier, an upcoming eBook from TopCoder focuses solely on the challenges of IP in Open Innovation. Subscribe to the TopCoder Blog at www.topcoder.com/blog/ (upper right corner of page) and you wont miss this eBooks release.
PAGE32
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
BURNING
QUESTION #3
HOW CAN WE TRULY SCALE OPEN INNOVATION?
?
?
?
?
?
?
?
At the risk of entering broken record territory we will say the following: Open Innovation is about the transformation of how you approach productivity and continuous value creation. If it were instead about hosting a singular one o challenge that you were never likely to repeat (from a process stand-point) that might be better classied as a complicated marketing initiative you were attempting in order to get new eyes around your brand, with the possible consequence of some gained innovative perception. You may even have outstanding and innovative results from that one o competition. But that isnt repeatable, that isnt scale, and therefore that isnt transformative. From the standpoint of the community or crowd you are working with, when you are consistently launching, eectively managing, and executing contests through the delivery of the newly created asset, the individual community members take notice. If they see a robust pipeline of work stemming from you and your company, paired with your professional and consistent approach to Open Innovation management, they will continually register for and compete on your work. Having that type of community following can pay big dividends and help you to achieve scale even faster.
PAGE33
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
HOW CAN WE TRULY SCALE OPEN INNOVATION?
?
?
ANSWER:
? ?
There are 4 key factors you should look for in ascertaining whether a specic Crowdsourcing or Open Innovation platform can help you achieve scale. They are: Repeatability How easily can you Lather. Rinse. Repeat.? How often can you launch open competitions and is the eort to do so easy or hard? Delve deep into the process of launching, managing, and closing out individual contests. If it seems dicult to operate one competition at a time, you need to ask yourself how you plan on achieving the type of scale you truly want to arrive at. The solution, community, or platform you choose to use should allow you to create in a massively parallel fashion. Predictability For any given competition, contest, or challenge, you should have a legitimate understanding of the % of success you are likely to achieve. Of course, no prediction is perfect, but fundamentally, understanding how likely it is that you succeed (and understanding the true cost of time and money spent if your competition fails) plays a formidable role in how often you attempt. Open Innovation (and to a lesser extent Crowdsourcing) is at their core, methodologies that lower the level of risk to a specic threshold that allows for more creative attempts endeavored. Ask the very dicult question of how predictability is measured on any platform you are considering. The answer will likely reveal how mature the platform is, or is not.
PAGE34
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
Dierentiation If you can repeat only one type of task, contest or challenge even if you can routinely predict a favorable outcome it likely limits how valuable that community or crowd can be for you. If you are contracting a Crowdsourcing localization service to only handle your document translation, which may save you money and speed up your translation processes, but as we discussed earlier; this does not make you more innovative, it simply makes you more ecient. Your ability to canvass a wide variety of tasks and challenges is an important aspect to how you will ultimately scale. The more types of specic work you can accomplish and innovation you can attempt, the greater the transformation that can take hold. Results Open Innovation and Crowdsourcing models are mainly outcomes based, meaning you are paying for best in breed results (the winning solutions) instead of paying for eort. The level of results you can receive is directly correlated to the level of talent within any given community or crowd. This is as simple as doing your homework. Understand what this community or crowd has accomplished, what it likely can accomplish, and for extra credit ask how the platform would adjust to support a newer technology or task it has yet to encounter. The past results of a community and how they likely will perform for you going forward ties directly to your potential success. If you are condent on a particular platform, human nature would dictate you will likely scale that platform to maximize the outcomes.
PAGE35
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
Technically speaking: Almost every type of competition on TopCoder is tied to a predictive engine that takes into account the level of specialized talent registering to compete on your work, their predictability rating (measuring how often an individual submits a solution after deciding to register for the given contest), and other factors. Before a contest even enters the competitive phases you have a clear understanding of the likelihood of that specic contests success. Dierentiation We discussed earlier TopCoders 3 Pillars of Digital Creation, spanning idea and design contests, to software construction, all the way over to Big Data algorithmic challenges. There is a very large variety of work you can accomplish and innovation you can attempt on the TopCoder Platform. The variety of work you, your team, and your enterprise decide to make happen is just that, your choice. You can master it all and produce like never before. Results As mentioned earlier, results are directly correlated to the talent you are accessing. The TopCoder community is now over 485,000 members strong and in 2012 alone we hosted over 4,500 separate competitions. With a fulllment rate above 90%, our clients enjoy an outcomes based model that is focused on results and their innovative success.
PAGE36
PART III GROWTH HOW DO WE SCALE OPEN INNOVATION AND CROWDSOURCING AND CONTINUOUSLY CREATE VALUE?
Five frogs sit on a log. Four decide to jump in. How many frogs are left on the log? Five. Deciding is not doing.
PAGE37
?
?
?
?
?
?
Brought to you by