280 likes | 287 Vues
Learn how MetaMatrix products enable government agencies to achieve information sharing and interoperability through service enabling data assets and resolving semantics.
E N D
Government Information Sharing and Interoperability via Data Services and SOA Rob Cardwell CTO, MetaMatrix rcardwell @ metamatrix.com June 21, 2006
Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions
MetaMatrix Enterprise Data Services • Project-level or Enterprise-wide data services layer • Integrated views of data from multiple sources • Metadata-driven • Optimized performance • Interoperable security • Complements BI, ETL, ESB/EAI, DQ, CDI, Search
MetaMatrix Fit in FEA DRM Data Sharing DRM Version 2 Data Access Services • Context Awareness Services • Structural Awareness Services • Transactional Services • Data Query Services • Content Search and Discovery Services • Retrieval Services • Subscription Services* • Notification Services*
Data Service Layer in SOA Data Services Layer Client Process & Applications App App App App App App ESB Business Process Services Business Services Message Services (ESB) Data Service Data Service Data Service Data Service Data Service Data Service Data Sources
Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions
MetaMatrix Products JDBC SOAP ODBC JMS Access Models Integrated Security Views XML Docs Services <a> Users … <b> in proc out MetaMatrix Integration Server </b> Virtual Data Bases Integration Server </a> VDB VDB Roles Query Processor Optimizer Processor Entitle ments MetaMatrix Connector Framework Information Consumers MetaMatrix Designer - Design and deploy data services Packaged Connectors Web Svc XML RDBMS MetaMatrix Catalog IMS IDMS Siebel, SAP Oracle Apps
MetaMatrix Approach to Data Services SOAP ODBC JDBC <sale/> <value/> </ sale > <WSDL> (contract) <WSDL> (contract) <WSDL> (contract) Designing data services Exposed Data Services Reusable, Integrated Data Objects Enterprise Information Sources (EIS) Information Consumers Web Services,Business Processes services warehouses EAI, Data warehouses databases Logistics Packaged Apps spreadsheets xml Custom Apps geo-spatial Reporting, Analytics Intelligence rich media …
MetaMatrix Product Lines MetaMatrix Enterprise • Web services & SQL • Modeling enterprise data • Scalable deployment server • Metadata management • Application/legacy connectors MetaMatrix Enterprise Enterprise MetaMatrix Dimension • Web service-enablement of data sources • Expose business views as XML • Lightweight modeling – rapid integration • Standard WAR-based deployment MetaMatrix Dimension Project, Node
Information Exchange Architecture Master Data Person / Facility / Vehicle Search Engine Index / Metadata Catalog Ontology Mgmt / Reasoning Mediation XSLT, Multi-source Enterprise Service Bus State/Local Orchestration Encryption High Availability Security/Authentication Operations Management Error / Exception Management Data Access Services • SQL, Web Service/XML • Staged Data (optional) MetaMatrix Dimension MetaMatrix Enterprise SOA App’s Stage State/Local Federal Agencies
MetaMatrix Dimension Differentiators Dimension adds the following capabilities to an ESB… • Rich, advisor-based, model-driven design tool • Ability to leverage data models and manage metadata • Clear way to visualize and define mappings between non-XML sources and XML views (even for complex industry schemas – NIEM, GJXDM, HL7, XBRL) • Ability to do SQL-based transformations, not just XSLT (including multi-source, complex joins and unions) • Query planner/optimizer that makes intelligent decisions about whether to execute transformations “at the source” vs. “on the bus” • Automated semantic matching & generation of transformations Data Services to connect ESB’s to Enterprise Data
Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions
Mediation: XML From Non-XML Sources «Relational» «XML» <person> <addresses> … </addresses> <accounts> <accountID=…> … </accountID> </accounts> </person> «Application» Target: Fixed (complex) XML Schema Need: Data complying to schema’s vocabulary Source: Data Sources containing Information to integrate «Text File» T MetaMatrix: Mapping from Data to XML
Map Data Sources to XML & Deploy MetaMatrix Designer – for XML-centric Data Services Model XML Docs, Schemas Build XML Doc. models from XML Schemas Map XML Doc. models to other data models Enable data access via XML
Rapid Web Service-Enablement MODEL Web service PACKAGE Web service DEPLOY Web service 1 2 3 Dimension Designer Model-based Expose multiple sources, integrated Expose business views of data Output = integration container (vdb) • Standard WAR file bundling: • Integration container • Query engine • Web service fully defined Web Svc App (WAR) MetaMatrix Query Engine Web Server Deploy WAR file to Web Server Executable Web service Access via SOAP Data exposed using standard vocabulary
MetaMatrix Dimension Modeling • Rapid design & deployment of Web Services • Expose integrated data as XML-based business views • Deployment of Web Services as standard Web apps • Runtime execution optimized through use of MetaMatrix Query Engine Dimension Models Data Sources Source Models Business Views Web Service Operations Web Server Import Map Model Deploy <XML> <XML> to to as WAR <XML> XSD WSDL
Dimension – Choose your approach Data Sources Source Models Business Views Web Service Operations Web Server Import Map Model Deploy <XML> <XML> to to as WAR <XML> XSD WSDL • Rapid design & deployment of Web Services • Expose integrated data as XML-based business views • Deployment of Web Services as standard Web apps • Runtime execution optimized through use of MetaMatrix Query Engine Dimension Models Start Here? Start Here?
Secure Access – Accredited Username/Password Logon • Connector connects with same ID for all queries • Optional: Integrated with existing authentication system MetaMatrix Data Source Client App Connector username password username password Membership Provider authenticates Trusted Payload Logon: • Connector uses different credentials per connection, per query • Optional: Integrated with existing authentication system source- specific MetaMatrix Data Source Client App Connector trusted payload trusted payload logon info trusted payload payload payload Optionally accesses source-specific information Authentication Service Membership Provider authenticates, generates payload authenticates, optionally modifies payload
Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions
COI Data Dictionary Location_ID Location_Type bldg_type bldg_id Depot_Number SITENUM Facility_ID Business Intelligence Applications Search Applications Web Services ODBC/JDBC JDBC SOAP Application views of information: • Relational, XML XML Document <a> … <b> </b> </a> T T T C2, Logistics, Intelligence, … Logical Data Model: • Agency or COI-specific • Rationalize, harmonize, mediate T T T Authoritative Sources: • Mapped to logical Multiple Internal/External Information Sources
Semantic Matching - example Ontology “Sex” semantically related to “Gender” Semantic Data Services • key component of information sharing and interoperability programs • automated semantic mapping to aid domain experts in quickly reconciling disparate schemas and vocabularies • more rapid deployment of a mediation solution MatchIt • an extensible ontology-driven tool • variety of algorithms for determining semantic equivalence • discovers similarities between elements of heterogeneous data, automatically exposing potential semantic matches. • matches elements of data sources to target schemas of Data Services, such as TWPDES, GJXDM, NIEM, C2IEDM, HL7 Matched (Confidence of 90%) Gender ID Semantic Data Services Person Sex Code FBI CBP NYC NY NJ Data Sources
Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Resolving Semantics • Enabling Enterprise (Deep) Search • Customers • Conclusions
Person Search - Conceptual Use Case Enterprise Information: Addresses Organizations Affiliations Accounts Transactions Call History Agreements Policies Relationships inherent in the search results link to enterprise apps, databases, and other repositories
MetaMatrix and Google Google Search Index (GSA) ContentRepository ContentRepository 2 Text Search w/ filtering criteria (optional) . . . ContentRepository Select & drill down to discover record details, related data links, & metadata Structured Data crawling & index build 3 1 RDBMS HTML I/F Field name look-up in Business Data Dictionary JDBC HTML I/F Connector Framework MetaMatrixServer ERP, CRM… Legacy Systems 4 Navigate to related data from Search UI Custom Application
Agenda • MetaMatrix Architectural Fit • MetaMatrix Products & Capabilities • Achieving Information Sharing • Service Enabling Data Assets (Data Services) • Data Service Design Approaches • Customers • Conclusions
Sample Customers/Awards • Government • DISA Global Combat Support Systems (GCSS) • Fort Meade • USTRANSCOM • USJFCOM • CIA/In-Q-Tel • SPAWAR CIPC • Mitre (various DoD initiatives) • Commercial • Merrill Lynch • Credit Suisse First Boston • SAP • Motorola
Conclusions • MetaMatrix provides best-of-breed components for rapidly deploying data services for information sharing • MetaMatrix is a proven entity within the Intelligence agencies, DISA, other DoD agencies, and commercial organizations • Unique value-add for mapping existing data assets to vocabulary standards adopted by COI’s • Agencies can avoid building MetaMatrix-like functionality via custom-coding, instead deploy solutions more quickly • MetaMatrix provides an agile infrastructure for information sharing, built on SOA standards
Government Information Sharing and Interoperability via Data Services and SOA Rob Cardwell CTO, MetaMatrix rcardwell @ metamatrix.com June 21, 2006