European Infrastructure for science governance: Management, Accountability and Advocacy

1. European Infrastructure for science governance:Management, Accountability and Advocacy Julia Lane American Institutes for Research University of Strasbourg Observatoire des Sciences et des Techniques University of Melbourne

2. Overview • Charge • Approach • Examples

3. Overview • Charge • Approach • Examples

4. Charge in Europe • Expert Group • Develop a shared information infrastructure for relevant data to be collected, maintained, analysed, and disseminated across the European Union. • OECD 2010 Innovation Strategy • go beyond targets and aggregates in order to understand the dynamics of innovation in firms

5. Charge in the US How much should a nation spend on science? What kind of science? How much from private versus public sectors? Does demand for funding by potential science performers imply a shortage of funding or a surfeit of performers?......A new “science of science policy” is emerging, and it may offer more compelling guidance for policy decisions and for more credible advocacy

6. Another way of stating charge Ideas: Understand their • Creation • Transmission • Adoption

7. Key Idea: Science of Science Policy Need feasible, low cost and flexible approach, so use science to describe and to manage the scientific ecosystem: Management; accountability; advocacy. • Conceptual framework: Science is done by scientists (not documents) so focus on scientists and networks of scientists • Empirical framework: New ways of collecting data so use new cybertools to capture information automatically • Pragmatic Approach: New ways of presenting information to visualize information so public can see results of research

8. Bo-Christer Björk, 2007

10. Overview • Charge • Approach: Use Science • Examples

11. Scientific Ecosystem: Links Matter Support Pay for Employ; provide infrastructure Produce; use Train; coauthor

12. Scientific Framework • Goal of project/firm: • create and transmit scientific ideas • push for their adoption (by other scientists, policy-makers or businesses) • Behavioral Framework; • Principal Investigator has research agenda, funded by multiple sources • Ideas are transmitted by workers (postdocs, grad students, staff scientists) in a variety of potentially measurable ways, including publications and patents, but also presentations, blogs, internal project workspaces, and emails (altmetrics) • Behavioral Framework: • Social networks/collaboration are a major vehicle whereby ideas are transmitted

13. Scientific Framework: Theory of the firm • Repurposing the theory of the firm • (1) Yit(1) = Yit(2)α + Xit(1)λ + εit • (2) Yit(2) = Zitβ +Xit(2)μ + ηit • where the subscripts i and t denote project teams and quarters • ε and η stand for unobserved factors and errors of measurement and specification (and can possibly include individual unobserved project teams’ characteristics). • The output variables are measured by Y(1) and research collaboration variables by Y(2). • Both are determined by a set of control variables X(1) and X(2) that can overlap and be truly exogenous or predetermined variables of key interest Z.

14. Scientific Framework: Data Jim Gray’s paradigm • Observational Science • Scientist gathers data by direct observation • Scientist analyzes data • Analytical Science • Scientist builds analytical model • Makes predictions. • Computational Science • Simulate analytical model • Validate model and makes predictions • Data Exploration Science • Data-driven science Data captured by instrumentsror from the web,or data generated by simulation • Information extraction • Processed by software • Placed in a database / files • Scientist(s)/scholar(s) analyze(s) database / files • Access crucial

15. Scientific Ecosystem: Links Matter Support Pay for Employ; provide infrastructure Produce; use Train; coauthor

16. Overview • Charge • Approach • Examples

17. Accountability: Show results to stakeholders… To help find researchers and research by geography, organization, class and topic Examples: White House R&D Dashboard; ASTRA

18. Advocacy: Show public/private partnerships To document collaborations in the invention process Examples: HELIOS project in France

19. Management: Describe networks NIH-supported milestone discovery event

20. Management: STAR METRICS: Private university, Med Control Theory, Sensor Networks, Optimization, Seismology Molecular Dynamics, Numerical Methods, Turbulence, Seismology Plants, DNA Ocean Science, Plate Tectonics, Seismology Inorganic Chemistry LIGO, Astrophysics, Dark Matter, Simulation, Quantum Information Liquid Crystal Source: Jason Owen Smith, U Michigan

21. Management: Comparison of Social Networks

22. Advocacy: Describe patent portfolios To describe patent activities to inventors and the public Example: NSF Portfolio Explorer

23. Another way of stating charge Ideas: Understand their • Creation • Transmission • Adoption

24. Key Idea: Science of Science Policy Need feasible, low cost and flexible approach, so use science to describe and to manage the scientific ecosystem. • Conceptual framework: Science is done by scientists (not documents) so focus on scientists and networks of scientists • Empirical framework: New ways of collecting data so use new cybertools to capture information automatically • Pragmatic Approach: New ways of presenting information to visualize information so public can see results of research

25. Thank you • Julia Lane • jlane@air.org