Proposal in Detail – Part 2

1. Proposal in Detail – Part 2 Project Aim, Objectives, Evaluation Criteria, Deliverables, Technical and Non-Technical Resources Required

2. Project Aim Reminder

3. Project Aim • This is the “thesis” of the project • Consider using Bloom’s Taxonomy Verbs in stating your aim. • e.g. “This research will measure how Web 2.0 tools can improve collaboration and knowledge sharing”

4. Bloom’s Taxonomy Bloom, B.S. (Ed.) (1956) Taxonomy of educational objectives

5. Bloom, B.S. (Ed.) (1956) Taxonomy of educational objectives

6. Bloom’s Taxonomy • Evaluation: appraise, argue, assess, attach, choose, compare, defend, estimate, judge, predict, rate, score, select, support, value • Synthesis: arrange, assemble, collect, compose, construct, create, design, develop, formulate, manage, organize, plan, prepare • Analysis: analyze, appraise, calculate, categorize, compare, contrast, criticize, differentiate, discriminate, distinguish, examine • Application: apply, choose, demonstrate, dramatize, employ, illustrate, interpret, operate, practice, schedule, sketch, solve, use • Comprehension: classify, describe, discuss, explain, express, identify, indicate, locate, recognize, report, restate, review • Knowledge: arrange, define, duplicate, label, list, memorize, name, order, recognize, relate, recall, repeat, reproduce state

7. Project Aim

8. Project Aim • Complete the following sentences: • “The aim of this project is to ...” • “This will be done by ...” • “It will be evaluated by ...”

9. Project Objectives Reminder

10. Project Objectives • Typically between 4 and 7 objectives • The objectives are the milestones in reaching your project aim.

11. Project Objectives • Suggested objectives • Review appropriate research • Identify interesting approaches • Identify a range of opinions • Design the experiment • Execute the experiment • Analyze the results

12. Project Objectives

13. Project Objectives • These are generic objectives, create ones that are specific to your project: • Review appropriate research • Identify interesting approaches • Identify a range of opinions • Design the experiment • Execute the experiment • Analyze the results

14. Evaluation Criteria Reminder

15. Evaluation Criteria • About half a page for this section • How you intend to implement and evaluate your research? • What methods are you going to use, both quantitative and qualitative?

16. Evaluation Criteria • How have other researchers who have done similar projects in the past evaluated their projects? • Is there a standard model, framework, or instrument to be used?

17. Evaluation Criteria • Can you find a formal framework for assessing the outcome the a previous project has already used? • Use standards? • IEEE 829 Standard for Software Test Documentation. • ISO 9126 and ISO 14598 (which are standards on software evaluation)

18. Evaluation Criteria • Suggested criteria • The suitability of the design • The suitability of the experiment • The suitability of the evaluation

19. Evaluation Criteria • How do you evaluate the project? • How effective were the methods? • Did the combination of quantitative and qualitative techniques match the research? • How effective were the tools you used? • Did the tools prove to be suitable? • How effective were they at measuring your research question? • Did the tools accurately model the research question?

20. Evaluation Criteria

21. Evaluation Criteria • If you haven’t checked yet, explore the literature, and find out how these type of projects are evaluated. Google and GoogleScholar things like: • “Project topic” evaluation • “Project topic” metrics • “Project topic” standards • “Project topic” ISO • “Project topic” framework

22. Evaluation Criteria • Write down two criteria under each of the following headings: • The suitability of the design • The suitability of the experiment • The suitability of the evaluation

23. Evaluation Criteria • Also, remember that measurements like: • Area under the Curve • Misclassification Error • Confusion Matrix • N-fold Cross Validation • ROC Graph • Log-Loss and Hinge-Loss

24. Evaluation Criteria • ...are good for evaluating the analysis, so they are good for checking how good the model is based on the dataset, and are definitely part of the evaluation, but if you want to discuss the findings with respect to the real-world (and to the research question) you must do the following: • Test predictions using the real-world

25. Deliverables Reminder

26. Deliverables • Generic deliverables: • Literature Review • Dissertation Document • Software • Survey results on CD • etc.

27. Deliverables

28. Deliverables • These are generic deliverables, create ones that are specific to your project • Literature Review • Dissertation Document • Software • Survey results on CD • etc.

29. Technical and Non-Technical Resources Required Reminder

30. Technical and Non-Technical Resources Required • Access to people • PC / Laptop / PDA / etc. • Software Libraries

31. Technical and Non-Technical Resources Required

32. Technical and Non-Technical Resources Required • Over to you... • Access to people • PC / Laptop / PDA / etc. • Software Libraries