Active Citation: The Coming Revolution in Qualitative Methods

1. Institute for Qualitative and Multi-method Research Syracuse 2013 Active Citation: The Coming Revolution in Qualitative Methods Andrew Moravcsik Princeton University

2. The Crisis of Qualitative Political Science • QUALITATIVE CASE STUDY ANALYSIS IMPORTANT • A plurality of scholars primarily use qualitative methods (IR) • 90% of scholars use qualitative methods • Qualitative work is more policy-relevant • Even statistical work relies on qualitative coding • BUT NOT BEING SUSTAINED • The number and prestige of qualitative scholars is declining (e.g. top journals, universities, gatekeeper positions) • Area and functional knowledge is thinning • The quality of such scholarship is questionable • Qualitative scholars cannot publicly demonstrate excellence • Neighboring fields (e.g. diplomatic history) are in crisis

3. Transparency as an Ideal “The idea is to try to give all the information to help others to judge the value of your contribution; not just the information that leads to judgment in one particular direction or another.” -- Richard P. Feynman

4. APSA has Adopted NewProfessional Ethics Guidelinesfor Research Transparency In support of evidence-based knowledge claims, researchers should provide: • Data Transparency: Provide precise references and, if possible, access to data. • Analytical Transparency: Explicate the link from data to descriptive/causal conclusions. • Production Transparency: Reveal procedures used to collect or generate the data, theory, etc.

5. One Response: Greater Transparency in Qualitative Analysis • ACTIVE CITATION • Hyperlink footnotes to precisely cited, fully annotated excerpts from sources in appendix • QUALITATIVE DATA ARCHIVING • GRADUATE SOCIAL SCIENCE AND POLICY TRAINING IN QUALITATIVE METHODS

6. ACTIVE CITATION CONTESTABLE KNOWLEDGE-BASED CLAIM (MAIN TEXT) ENTRY IN TRANSPARENCY APPENDIX ANNOTATION SOURCE EXCERPT CITATION SCAN OR LINK TO SOURCE (OPTIONAL) CITATION

7. What does an active citation look like? An Example (1 of 3) • MAIN TEXT OF PAPER, ARTICLE OR BOOK French agriculture lay at the center of President de Gaulle’s calculations about the European Economic Community (EEC) and British membership in it. Indeed, agriculture was a paramount foreign policy interest of France. At one meeting, de Gaulle identified divergent agricultural interests as the major reason why agreements within the EEC had been so difficult to reach. He noted that British membership would not just call the Common Agricultural Policy into question; it would transform the EEC into a wholly different organization. He referred to the transformation of agriculture as France’s “greatest problem,” now that the Algerian war had been settled, and added, strikingly, that “if we do not surmount it, we could see another Algerian affair on our own soil.” (Peyrefitte, C’était de Gaulle, I, p. 302)

8. Example (2 of 3) CITATION LINKED TO ENTRY IN TRANSPARENCY APPENDIX Annotation: De Gaulle held this confidential discussion with his press spokesman Alain Peyrefitte on 6 June 1962, following a cabinet meeting that discussed a recent summit between de Gaulle and Macmillan. At the summit, the Britishhad displayed an unexpected willingness to “do whatever it takes” to enter the EEC. This forced de Gaulle to clarify the extent of his essential opposition to British membership. This source confirms the quotation in the main text verbatim, providing emphatic and unambiguous evidence of the central importance of agriculture in de Gaulle’s conception of French domestic, foreign and European policies. Source Material: « Le sort de notre agriculture est désormais, après le règlement de l'affaire algérienne, notre plus grand problème. Et si nous ne le réglons pas, nous pouvons avoir une autre affaire d’Algérie sur notre propre sol. Notre industrie peut affronter la concurrence, mais si notre agriculture devait rester en dehors du Marché commun, la charge qui en résulterait pour nos industriels ne serait pas supportable. Seulement, ça a été si difficile de s'entendre avec nos partenaires pour l’agriculture, et il reste encore tant de difficultés, que je ne vois pas comment on pourrait maintenant élaborer un autre régime. De toute façon, l'entrée de l'Angleterre serait un tel bouleversement, qu'il s'agirait alors d'un autre Marché commun.» “Henceforth the fate of our agriculture is, after the resolution of the Algerian affair, our greatest problem. And if we do not surmount it, we could see another Algerian affair on our own soil. Our industry can handle the competition, but if our agriculture remains outside of the Common Market, the resulting burden for our industrial firms would be unbearable. Only, it has been so difficult to reach agreement with our (six EEC) partners on agriculture, and there remain many difficulties, that I don’t see how we could now elaborate another different scheme. To the contrary, the entry of England would be such an upheaval, that it would then amount to a different Common Market.” [Translation: Andrew Moravcsik] Full Citation: Alain Peyrefitte, C’était de Gaulle (Paris: Fayard, 1994), p. 302.

9. Example3 of 3 Optional Scans and Hyperlinks to Original Text (or Non-Textual Sources) May Be Added (Subject to IP) ES Example

10. Traditional Footnotes vs.Active Citations

11. Active Citation: Potential Benefits • One click reveals the full richness of qualitative evidence and context. • Readers can cost-effectively check, critique and debate work, creating interest and exposing those who lack area and functional knowledge. • Qualitative Scholars can demonstrate excellence and advance in the field, creating an incentive to invest in intensive field research, languages and area studies, policy knowledge, interviews, archival work, and detailed process-tracing of case studies. • Qualitative work is more open-ended, so this should fuel theoretical innovation. • Evidence is a public good: it can be reused for scholarly or public policy purposes. • Those with specific functional, area and policy expertise will be in greater demand on journal review boards, book series, prize committees, and disciplinary governance groups, thereby enhancing their prestige and influence. • Greater opportunities are created for interdisciplinary cooperation with fields like history and law, as well as interaction with practitioners in public policyand journalism. Remember: Qualitative work is more policy relevant.

12. Active Citation: What has been done? • Articles, Proposals and Workshops • http://www.princeton.edu/~amoravcs/ and Qualitative Data Repository (QDR) • APSA Standards • New Transparency/Replicability Guidelines • NSF Funding • Considering Legal, Human Subject, and Logistical Issues • Creating NSF/QDR Demonstration Website • 20+ scholars retrofitting “classic” articles and chapters • Younger scholars preparing new and forthcoming work • Designing New Software

13. ACE Word Add-in Look Up • OUTPUT: • Word Document • Web Document • Database (Access, Atlas…) Translate… Look Up Active Citation… Translate… Active Citation…

14. Active Citation: The Future Agenda • Expand demonstration website to include work in Policy Analysis, Human Rights, Human Security, Development and Political Economy, Regional and Area Studies, Environment and other functional global issues. • Work with Journal Editors, Publishers to Secure Adoption • Develop Teaching Materials for Undergraduate, Graduate, Policy Analysis • Establish Prizes, Training Courses, Recognition, Publicity • Expand Free Word-processing Software Options (e.g. ad-on’s for other WP) • Work with Major Software Providers (e.g. database software) • Establish inter-disciplinary links with history, law, policy schools • Reach out to Journalists, Policy-makers, Government agencies, NGOs, Policy Analysts to exchange ideas and develop common standards

15. One reason to be optimistic about active citation: The world is going this way!

16. Best Practices:Traditional Political Science

17. Best Practices:Natural ScienceExample: When did Polar Bears Evolve? Article Supplementary Materials

18. Best Practices: Legal Academia(Yale On-Line Law Review)

19. Best Practices: Policy Analysis

20. Best Practices: Journalism

21. Best Practices: Classified Intelligence Reports

22. Institute for Qualitative and Multi-method Research Syracuse 2013 Active Citation: The Coming Revolution in Qualitative Methods Andrew Moravcsik Princeton University