1 / 39

Data Virtualization & Information As A Service ( IaaS )

Data Virtualization & Information As A Service ( IaaS ). By Anil Allewar Senior Solutions Architect - Synerzip. About Me!!. Anil Allewar. Senior Solutions Architect @ Synerzip. Technology Evangelist & speaker. Core interests: JEE, EAI, EII. Agenda. Use cases. What does it mean?.

pearl
Télécharger la présentation

Data Virtualization & Information As A Service ( IaaS )

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data Virtualization&Information As A Service (IaaS) By Anil Allewar Senior Solutions Architect - Synerzip

  2. About Me!! Anil Allewar Senior Solutions Architect @ Synerzip Technology Evangelist & speaker Core interests: JEE, EAI, EII Confidential

  3. Agenda • Use cases • What does it mean? • Architecture explained • Implementation Frameworks • Demo • Questions?

  4. Why it makes sense? Confidential

  5. Use Cases Confidential

  6. Traditional Data Integration Confidential

  7. Problems with ETL More than 1 copy of data for staging Intermediate data => Errors Lead time to add new source Domain knowledge for mapping Batch Process => No real time data Confidential

  8. Problems with DBMS consolidation Alternate approach => Single EIS (say RDBMS) Extensive changes to existing apps Might not satisfy everyone’s requiremets Confidential

  9. Agenda • Use cases • What does it mean? • Architecture explained • Implementation Frameworks • Demo • Questions?

  10. Data Virtualization & Federation Single API to access data Only metadata stored at virtualization layer Real time access without copying/moving data Federate data across hetero/homogenous sources Confidential

  11. Data Virtualization Confidential

  12. Agenda • Use cases • What does it mean? • Architecture explained • Implementation Frameworks • Demo • Questions?

  13. Architecture Common Access API Translator 1 Virtual Database Connector 1 Translator 2 User Application Connector 2 RUNTIME & QUERY ENGINE Confidential

  14. Agenda • Use cases • What does it mean? • Architecture explained • Implementation Frameworks • Demo • Questions?

  15. Vendors • Commercial Products • Composite Software • http://www.compositesw.com/data-virtualization/ • Denodo • http://www.denodo.com/en/product/overview.php?n=h • IBM • http://www-03.ibm.com/software/products/en/ibminfofedeserv • Informatica • http://www.informatica.com/us/data-virtualization/ • Red Hat • http://www.redhat.com/products/jbossenterprisemiddleware/data-virtualization/ • Open Source • Jboss Teiid • http://teiid.jboss.org/ Confidential

  16. Selected Platform – JBoss Teiid Open Source JEE standards Number of relational/NoSQL/ERP/CRM data stores Add custom EIS support using JEE components Active & responsive community Synerzip contribution: Defect discovery, root cause analysis, feature verification Confidential

  17. Teiid Components • Virtual Database • container for components used to integrate data from multiple data sources • Source Models • structure and characteristics of physical data sources • View Models • structure and characteristics of abstract structures you want to expose to your applications • Teiid Designer • Eclipse based UI to dynamically discover data source objects and apply data federation • Generate virtual database from 1 or more sources Confidential

  18. Teiid Components • Translator • Provides abstraction later between Teiid Query Engine and source system • Convert Teiid SQL commands to source specific execution commands • Convert result data from source system to Teiid specific format • Resource Adapter • Provides connectivity to the physical data source • Integration provided through Java Connector Architecture (JCA) API Confidential

  19. Teiid – Supported EIS • Amazon SimpleDB • Apache Accumulo • Apache SOLR • Cassandra • File • Google Spreadsheet • JPA • LDAP • Excel – as file • SalesForce • JDBC • MS access, DB2, derby, excel-odbc, greenplum, h2 , hive(for accessing Hadoop), oracle, teradata and most RDBMS • MongoDB • Object • OData • OLAP • Web Services • SAP Netweaver Gateway Confidential

  20. Performance Characteristics • Access same data using Oracle and Teiid drivers • Retrieval times comparable when accessing tables having no Blobs ms Confidential

  21. Performance Characteristics • Teiid slower when accessing Blob data • Can be tuned Confidential

  22. Agenda • Use cases • What does it mean? • Architecture explained • Implementation Frameworks • Demo • Questions?

  23. Demo JDBC API mySQL Translator RDBMS Resource Adapter Federated VDB MongoDB Translator JDBC Client mySQL MongoDB Resource Adapter TEIID RUNTIME & QUERY ENGINE Confidential

  24. Demo-Steps • Pre-requisites • mySQLserver 5.5+ installed • MongoDB2.4.x+ installed • Steps • Load the mySql and MongoDB database with sample data • Setup environment – JBoss, Eclipse • Create Teiid project in Eclipse using Teiid designer • Import source model using JDBC • Create the virtual model and federate data from the source model • Create a virtual database (VDB) and deploy to JBoss • Access data using JDBC client or through browser using OData Confidential

  25. Demo – Scenario Federated Data Confidential

  26. Demo – Connection Profile Confidential

  27. Demo – Source Model Confidential

  28. Demo - Source Model Generation Confidential

  29. Demo – Map Source To View Confidential

  30. Demo - Association Confidential

  31. Demo – Data Federation Confidential

  32. Demo – Source Code • Source code • https://github.com/Synerzip/JBoss-Teiid • Contains • Configuration files • Instructions • “How-to” videos • VDBs, source models and view models Confidential

  33. Conclusion • Data Virtualization and Federation is a rapidly emerging technology that solves traditional BI/ETL problems. • It provides lower time to market, distributes data across the enterprise as a service and provides real time access to enterprise data. Confidential

  34. Agenda • Use cases • What does it mean? • Architecture explained • Implementation Frameworks • Demo • Questions?

  35. Contact Me • anil.allewar@synerzip.com Confidential

  36. www.synerzip.com Hemant Elhence hemant@synerzip.com 469.322.0349 Questions? • 36 84

  37. Synerzip in a Nutshell • Software product development partner for small/mid-sized technology companies • Exclusive focus on small/mid-sized technology companies, typically venture-backed companies in growth phase • By definition, all Synerzip work is the IP of its respective clients • Deep experience in full SDLC – design, dev, QA/testing, deployment • Dedicated team of high caliber software professionals for each client • Seamlessly extends client’s local team, offering full transparency • Stable teams with very low turn-over • NOT just “staff augmentation”, but provide full mgmt support • Actually reduces risk of development/delivery • Experienced team - uses appropriate level of engineering discipline • Practices Agile development – responsive, yet disciplined • Reduces cost – dual-shore team, 50% cost advantage • Offers long term flexibility – allows (facilitates) taking offshore team captive – aka “BOT” option

  38. Our Clients

  39. Thanks! Call Us for a Free Consultation! Hemant Elhence hemant@synerzip.com 469.322.0349

More Related