130 likes | 238 Vues
This presentation by Cristin Dorgelo outlines strategies for designing and measuring impact in public sector prize competitions. It emphasizes a portfolio approach to innovation, exploring various prize types and their evolving understanding. Key topics include community stewardship, market stimulation, and capturing meaningful outcomes. Notable examples such as the Wendy Schmidt Oil Cleanup X Challenge highlight successes and lessons learned from past competitions. The aim is to optimize prize design to foster collaboration, engagement, and tangible results that address critical challenges.
E N D
Incentive Prizes:Designing and Measuring for Impact Cristin Dorgelo Assistant Director for Grand Challenges Office of Science and Technology Policy Executive Office of the President
2013 Priorities for Public Sector Prizes • Designing for higher impact, broader scope • Portfolio/laddering approach • Similar mechanisms • Legacy planning • Solution sharing • Resources • Assets • Partners • Vendors • Communications • Capturing impact (focus of today!) • Community stewardship
Prize Types from the McKinsey Report • Exemplar (recognition) • Point-solution • Exposition • Participation • Network • Market stimulation
Evolving Understanding of Prize Types • Exemplar (recognition) • Point-solution • Apps challenges, often built on “open data” • Algorithm and coding challenges • Design/plan/proposal competitions (intersecting with Exposition & Participation) • Exposition • Ideation challenges • “Plan + implementation” challenges (intersecting with Participation) • Participation • Identifying and developing promising talent/workforce • Community-focused/behavior change (intersecting with Exposition & Network) • Network • Market stimulation • Complex technology demonstrations (intersecting with Point-solution) • New markets/industries vs. existing markets (intersecting with Network)
Intersection with Other Trends • Ideation (internal/external; online/offline) • Collaborative innovation (without competition) • Hackathons/Codeathons • Idea “Boot Camps” • Crowd-sourcing platforms • Crowd-funding • Open data • Grand Challenges
Planning Prizes Along the Innovation Chain • Ideation • Exposition • Participation • Market Stimulation (new markets) • Market Stimulation(existing markets) • Point Solution • Apps, Algorithm, & Coding Challenges • Design/Plan/Policy Challenges • Participation • Exposition • Network
Wide Variety of Possible Success Criteria • Return on investment (ROI) • Cost-effectiveness of competition • Financial leverage during competition • Follow-on investment post-competition • Quantity/quality/viability/diversity of submissions • Quantity/diversity of participants • Performance improvement compared to current solutions • Public awareness • Community engagement beyond “solvers” • Media impressions (traditional/earned media; social media) • Survey results • Sponsor/donor/partner satisfaction/engagement • Behavior change, adoption, and decay rate
Wendy Schmidt Oil Cleanup X Challenge • Target: 2500 gpm at 70% efficiency, 2x today’s standard oil recovery rate • 350+ narrowed down to 10 finalist teams • $1,000,000 First Place Winner Elastec(Illinois) • Achieved 4x today’s standard oil recovery rate in <6 months product development • 4670 gallons per minute at 89.5% efficiency
Impact of the Oil Cleanup Challenge (1 of 2) • Return on investment (ROI) • Cost-effectiveness of competition • What did teams spend to compete? • Tracking industry investments in winning/qualified technology • Tracking job creation and mergers & acquisitions • Quantity/quality/viability/diversity of submissions • 10 finalist teams had widely diverse approaches • 7 met 1 of the 2 minimum performance thresholds (rate or efficiency) • 2 of 3 prize purses awarded for meeting thresholds for both recovery rate and efficiency • Quantity/diversity of participants • 300+ initial teams>10 finalists>2 winners • 5 domestic finalists; 5 international • 5 known industry players; 5 new to industry
Impact of the Oil Cleanup Challenge (2 of 2) • Performance improvement compared to current solutions • 4x improvement over existing solutions • Multiple options optimized for diverse environments • Public awareness • Significant media impressions tracked through PR firm • Key stakeholder awareness • Sponsor/donor/partner satisfaction/engagement • Donor agreed to support follow-on prize • Sponsor participated in post-prize briefings to Federal agencies
Impact on Prize Design • Submission templates • Judging protocol • Tracking public relations/social media data • Post-competition surveys, interviews, and anecdotes • Participants • Followers • Stakeholders • Research partners • Required reporting from solvers/winners • Legacy plan for post-competition tracking
Annual Report to OSTP/Congress • Due 12/31 (LAST MONTH!) • Need an extension? • Reporting on impact…consider all of the above • Dealing with and reporting failures & lessons learned