1 / 16

Testing of XBRL files for the supervisory reporting

5 May2014. Testing of XBRL files for the supervisory reporting. Katrin Heinze. Eurofiling Workshop in Rome. The objective of this presentation is to provide an overview on the testing strategy of the SUBA project to explain the test plan and sample test cases

thi
Télécharger la présentation

Testing of XBRL files for the supervisory reporting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 5 May2014 TestingofXBRL files for the supervisory reporting Katrin Heinze Eurofiling Workshop in Rome

  2. The objective of this presentation is to provide an overview on the testing strategy of the SUBA project to explain the test plan and sample test cases to inform about the next steps Objectives Eurofiling Workshop in Rome, 5th of May 2014

  3. Agenda Overview 1 SUBA* test strategy 2 Sample XBRL test cases 3 Next steps * SUpervisoryBAnking Data System Eurofiling Workshop in Rome, 5th of May 2014

  4. Agenda Overview 1 SUBA Test Strategy 2 Sample XBRL test cases 3 Next steps Eurofiling Workshop in Rome, 5th of May 2014

  5. SUBA Test Strategy Regression Tests Functional Tests Non-Functional Tests • Based on • User requirements • Use cases • Experience of users • Technical requirements • Source code (unit tests) • … • Categorised following • Load tests (number of users) • Performance tests (processing time) • Volume test (quantity of data) • Stress test • Test of the (data) security • Usability tests • … • Done after changes on • Components • XBRL taxonomy • Validation rules • Interfaces • EXDI • RIAD • Infrastructure • … Technical Test Execution Status 17.04.2014 Page 5 Eurofiling Workshop in Rome, 5th of May 2014

  6. Scope • Planning of releases and test cycles • Enable traceability between requirements, tests, defects and according code changes • Increase visibility with dashboards on analysis and KPIs Achievements • Definition of test cases linked to the defined requirements • Execution of test cases based on defined test data • Defect tracking and documentation of bug fixes Way forward • Increase the level of automation on test execution • Customise reports and analysis based on the project needs • Preparation of test cases for the next release SUBA Test Strategy HP ALM usage within the SUBA project Page 6 Eurofiling Workshop in Rome, 5th of May 2014

  7. Test plan structure 1. level: Categories 2. level: Use cases 3. level: Test cases Conventions on numbering Structure in the Test Lab Page 7 Eurofiling Workshop in Rome, 5th of May 2014

  8. Tracking of the test progress in HP ALM Page 8 Eurofiling Workshop in Rome, 5th of May 2014

  9. Agenda Overview 1 SUBA Test Strategy 2 Sample XBRL test cases 3 Next steps Eurofiling Workshop in Rome, 5th of May 2014

  10. Sample XBRL test cases Positive functional test cases • Creation of test data for • each module of the COREP taxonomy • which is a valid XBRL instance document. • Valid according to • XML specification • XBRL 2.1 specification • XBRL Dimension 1.0 specification • XBRL Formula 1.0 specification • EBA disabled validation rules • EBA Filing Rules for COREP and FINREP • By using different file sizes • small • medium • large Page 10 Eurofiling Workshop in Rome, 5th of May 2014

  11. Sample XBRL test cases Negative functional test cases • Tests that ensure that the application shows a proper behaviour when invalid files are received. • Creation of test data where the system is expected to provide correct error messages. • Possible test cases : A reporting entity sends a file which • is not a well-formed XML document. • has not the correct format, i.e. jpg, txt, xls etc. • has not the expected encoding. • includes neither facts nor contexts. • misses a namespace in the xbrli root element • includes letters where numbers are expected as fact value • misses an explicit member in the scenario element • Includes a fact with no value but also no nil attribute is provided • Refers to a non-existing module • Refers to two different modules. Page 11 Eurofiling Workshop in Rome, 5th of May 2014

  12. Agenda Overview 1 SUBA Test Strategy 2 Sample XBRL test cases 3 Next steps Eurofiling Workshop in Rome, 5th of May 2014

  13. Next steps Voluntary functional tests with NCAs Test scope • Test period: 13th to 15thof May • Test activities: • Acquisition • NCA sends data to EXDI via WebUI or standard adapter. • EXDI system sends a delivery message. • SUBA system sends an acknowledgement message to NCA with the XBRL validation result • NCA receives the messages in the scheduled time periods. Eurofiling Workshop in Rome, 5th of May 2014 Page 13

  14. Next steps Load tests IT infrastructure for establishing a supervisory function at the ECB

  15. Next steps Organisation and approach – Test case preparation Control point A Control point B Control point C Eurofiling Workshop in Rome, 5th of May 2014 Page 15

  16. Next steps Key issues and challenges Functional tests • Supporting the voluntary functional tests with the NCAs, organized by WG SIM Load tests • Defining scenarios for load tests on XBRL processing via automated test, simulating also peaks Preparation for next releases • Defining test cases based on more precise user requirements EBA testing • Participating in tests scheduled by EBA Page 16 Eurofiling Workshop in Rome, 5th of May 2014

More Related