150 likes | 242 Vues
IIC Test Framework : illustrated on ebXML Conformance Testing. Michael Kass michael.kass@nist.gov Han Kim Ngo hankim.ngo@nist.gov Jacques Durand jdurand@us.fujitsu.com. The IIC [ebXML] Test Framework. V1.0 May 2003, V1.1 October 2004
E N D
IIC Test Framework :illustrated on ebXML Conformance Testing Michael Kass michael.kass@nist.gov Han Kim Ngo hankim.ngo@nist.gov Jacques Durand jdurand@us.fujitsu.com
The IIC [ebXML] Test Framework • V1.0 May 2003, V1.1 October 2004 • An architecture that defines Test Components that work together • Test Driver • Test Service • XML schemas for defining Test Suites • Test Requirements • executable Test Suites (set of Test Cases)
Challenges eBusiness / eGov Testing: • Interoperability needs to be Maintained between Business Partners • Threatened by continuous, non synchronized systems upgrades • eBusiness Interoperability is an integration problem: has to be tested “live”, in production upgrading
Vision for eBusiness / eGov Testing: • The Role of Test Centers • Provide testing services at all phases of eBusiness product life cycle • Early conformance tests • Pre-release Interop tests • Business guidelines tests (vertical) • Interop Maintenance testing
Testing for the “Interoperability Stack” Application Content Interoperability (A2A) • System in Production Conformance to Business Guidelines Protocol-level Interoperability Infrastructure Conformance to Technical Specifications
Vision for eBusiness / eGov Testing: • Testing Technology evolving toward: • Automation and [XML] scripting • Versatile frameworks • various formats/standards, • evolve with them, • ease of customization • Support for Testing will become a product feature, not just a QA thing
Test Framework: Implementations • NIST (US) • Test Driver & Test Service. Intended for local testing. 1.1 Available for beta-testing end of year. • KorBIT (Korea) • 1.0 Test Driver & Test Service. Used remotely at ETSI test event 2004 (ebMS 2.0). • DrakeCertivo (US) • Test Driver. Used for ebMS conformance , and also OAG BODs testing • KWareSoft (Korea)
ebXML Message Handler Test target Test Framework component Testing ebXML MS Conformance Test suite Test Service ebXML Message Test Driver Host 2 Conformance/ Interoperability report Host 1 (or test center)
Test suite Test Service Test Driver ebXML Message Handler ebXML Message Handler Test Service ebXML Message (HTTP / SMTP) Test target Test Framework component Testing MS Interoperability: point-to-point Host 2 Host 1
NIST’s Role • Provide expertise in conformance testing to OASIS IIC • Help develop the OASIS IIC ebXML Testing Framework specification for all ebXML specifications • Prototype a Test Framework implementation as proof of concept • Assist in writing conformance tests for Messaging, Registry, and Business Process specifications
Design Goals • Flexible testing architecture • Provide simple XML scripting • Promote test suite re-use
Test Suite • Testing Requirements • Executable Test Cases • Testing Profile • Associated Message Content
Conformance Test Requirements • Reference Conformance Clause in Specification • Reference the Normative Specification • Broken down into concise Functional (Semantic) Requirements expressed as a Test Assertion Clause “For conformance to this specification, all the version attributes of any SOAP extension elements defined in this specification MUST have a value of “2.0”
Demo ebXML Messaging Services 2.0 Conformance Test Suite Message Packaging - # 2 ebXML Message is in root part of MIME Envelope - #28 MessageHeader version attribute is ‘2.0’
Download • NIST Test Framework Implementation free for download in December at http://ebxmltesting.nist.gov • NIST Test Driver and Test Service (source/binary) • OASIS IIC ebXML MS 2.0 Conformance Test Suite • NIST ebXML RS 2.1 Conformance Test Suite