1. Test Maturity Level Achieved in Avea

2. Agenda • Introduction • Background • Applied Methodology • Results and Conclusion

3. Who am I? • İrfanUgur – Head of IT Test Team in Avea – brief history in pictures • 10 years in Avea • 5 years in Mobildata area Görseller hazırlanıyor Introduction

4. Scapegoat wanted Introduction

5. Storylineandemotions Görseller hazırlanıyor Introduction

6. Whoarewe? Avea IT Test Department • 3 inhouse lines • 2 for testing • 1 for support • 1 outsource line • Test outsourcing with «Managed Service» approach Introduction

7. How much did we test in 2012? • 57 PROJECTS • 754 REQUESTS Introduction

8. How was at the beginning? • A test group • Test cases, test execution, defects on HP Quality Center • No test environment • No defined process • No plan, strategy, policy • Testing some of the projects Introduction

9. How do we work now? • Follow defined test process • Cover all domains • Use tools • Reuse assets • Keep and increase knowledge • Establish, use and maintain test environments • Outsource Introduction

10. What is TMMi? The TMMiis • is a framework, • is developed as a guideline and reference model, • has a staged architecture for process improvement background

11. TMMi maturity levels and process areas (5) OPTIMIZATION • Defect Prevention • Test ProcessOptimization • Quality Control (4) MEASURED Test Measurement Product Quality Evaluation Advanced Peer Reviews (3) DEFINED Test Organization Test Training Program Test Lifecycle and Integration Non-functional Testing Peer Reviews (2) MANAGED Test Policy and Strategy Test Monitoring and Control Test Planning Test Design and Execution Test Environment background (1) INITIAL

12. TMMi : How was at thebeginning at Avea? APPLIED METHODOLOGY

13. Milestones in testingroadmap InternalAssessment APPLIED METHODOLOGY

14. TMMi : How does Avea work now? APPLIED METHODOLOGY

15. Milestone#1 Test Organization RESULTS AND CONLUSION Recommendations • Train the people • Grow in a controlled way • Put the rules • Publish the rules • Use tools

16. Milestone#2 Test Environments RESULTS AND CONLUSION Recommendations • Define and use test strategy • Use test environment management tools • Force automatic deployment • Document troubleshootings • Put rules for environment delivery

17. Milestone#3 Test Capacity Management RESULTS AND CONLUSION Recommendations • Define and use test strategy and test plan • Use test library • Develop and utilize test effort estimation tool • Prioritize test case

18. Milestone#4 Speed and Quality of Tests RESULTS AND CONLUSION Recommendations • Make reviews • Do Root Cause Analysis of production defects • Focus on lessons learned • Make visible quality KPIs • Put smart targets about production defects • Trainings

19. Beyond the Test Maturity – IT Maturity RESULTS AND CONLUSION

20. Improvements for the future RESULTS AND CONLUSION

21. Summary Speed & Quality Capacity Management Environments & Tools Test Organization & Processes Adhoc Testing