Semantics and Information Exchanges

1. Content Assembly Mechanism XML Exchange Development Deploy Requirements CAM Model Data Test Semantics and Information Exchanges Build Exchange Generate Dictionary Overview – Public Sector NIEM Team, June 2011

2. Applications of Semantics - Topic Areas * NIEM – National Information Exchange Model * IEPD – Information Exchange Package Documentation *MPD – Model Package Description • Dictionaries and Exchange development • Simplifying and accelerating effective exchanges • Toward a better NIEM – is it a model really? • Forms and Security profiles • SOA deployment architecture • Automated mapping mechanisms – OASIS SET TC • Simplify ETL / product integration – e.g. Siebel • Rule based systems for data cleansing • Reasoning and alerting engines

3. Officially - What is NIEM? • Joint DOJ / DHS / HHS program created to promote standardization of information exchange for cross jurisdictional information sharing. • Provides the tools for enabling interoperability at the data layer within and acrosssystems supporting information sharing, while preserving investments in current technology and optimizing new technology development. Components of NIEM Repeatable, reusable process for business users to document information exchange requirements “Common Language” for Information Exchange Built and governed by the business users at Federal, State, Local, Tribal and Private Sectors

4. Reality – NIEM is… • Collections of complex XML Schema • Attempt to marry modelling techniques and XSD Schema syntax • Verbose • Embedded context in names • Currently facing significant scaling challenges • Inconsistencies • Too much manual management • Slow lifecycles • Dictionary technology incubating

5. What is LEXS? LEXS: a comprehensive, NIEM-based, framework for the development of information exchanges. Initially developed for the law enforcement information sharing program at US Department of Justice, LEXS is now being widely used in criminal justice community at large, as well as by the homeland security, intelligence and other communities.

6. Makingsense of all this • NIEM • Information exchanges – transactional • Business process orientated • Common schema / dictionary definitions • LEXS • Open communications infrastructure • Patterns for message exchanges • Open / Linked Data • Ad hoc information – citizen reporting • Accounting data • Statistical data

7. CAM: Top Down Exchange Assembly Components Canonical XML Components Dictionary 1 XML User Inserts Navigation and Query Tools Relationship Lookups Component Associations and Couplings 2 Domains Reuse Library Exchange Templates and Rules 3 Artefact relationships Catalog Template Presentation Automatic Rendering Tools W3C Schema and Model Representations 4 Collaboration Services XML Schema Components Models Delivery Control, Messaging, Security Deployment Environments and Middleware 5 Testing Workbench, Rules Engine, Data Samples, Integration ETL Implementation Artifacts and Examples 6

8. Available XML Dictionaries LEXS 3.1.4 dictionary OASIS EDXL dictionary OASIS EML dictionary NIEM 2.1 dictionaries CBRN dictionary Emergency dictionary Family dictionary Immigration dictionary Infrastructure dictionary Intelligence dictionary Justice dictionary Maritime dictionary Screening dictionary Trade dictionary Immigration blueprint NIEM core dictionary • Packaged with CAM editor see dictionary folder of install + spreadsheet + sample control files XML XML XML Note: Those marked in bold are model style dictionaries with recursive components. Available from download site direct link: http://sourceforge.net/projects/camprocessor/files + includes spreadsheets and sample models XML XML XML XML XML XML

9. Exchange Delivery Lifecycle Component Dictionary Drag and Drop Visual Editor Template Updates Design Monitor Author Test CAM Template XML Samples Deploy XSD Schema Production Log Results XMI / UML Models Compiled Templates Documentation

10. NIEM Exchange Package Artifacts • Template Evaluation Report • Naming and Design Rules assessment • Interoperability factors review • Spell checking • Comparison to Dictionary • Reuse report, cross-reference spreadsheet, subset “wantlist” • Generate Schema Bundle with layout styles (e.g. NIEM) • Realistic test samples generation • Testing with runtime validation engine (CAMV) • Business information exchange documentation • Models – XMI and mind maps

11. CAM Template CAM Templates – WYSIWYG Semantics Structure Rules Documentation http://www.oasis-open.org/committees/cam

12. XML Schema Industry Domain schemas Code list xsd *Code list xsd xsd subset Exchange xsd LEGEND: * Optional CAM Template *Extension xsd *Constraint xsd *Restriction xsd Namespace CAM and W3C Schema Wizards Exchange Schema Structure XSLT tools process entire XSD collection XSD Collection Rules INGEST EXPORT Documentation

13. CAM editor capabilities overview

14. BusinessOpportunities • Synthetic data and test case generation • Domain dictionary creation and management • Oracle SOA repository • Application of rule engine technologies • Sidebar – RuleML 2011 • LEXS messaging systems and enabling secure information exchanges • Semantics – use of Oracle 11g features – SparkQL, OWL, XQuery – to develop smarter applications