370 likes | 598 Vues
Dr. Rainer v. Ammon Managing Director CENTRUM FÜR INFORMATIONS-TECHNOLOGIE-TRANSFER (CITT) GmbH KONRAD-ADENAUERALLE 30 D-93051 REGENSBURG +49 171 756 4557 RAINER.AMMON@CITT-ONLINE.COM WWW.CITT-ONLINE.COM. Florian Springer Business IT Consultant.
E N D
Dr. Rainer v. Ammon Managing Director CENTRUM FÜR INFORMATIONS-TECHNOLOGIE-TRANSFER (CITT) GmbH KONRAD-ADENAUERALLE 30 D-93051 REGENSBURG +49 171 756 4557 RAINER.AMMON@CITT-ONLINE.COM WWW.CITT-ONLINE.COM Florian SpringerBusiness IT Consultant SENACOR TECHNOLOGIES AGVORDERE CRAMERGASSE 11D-90478 NÜRNBERG INFO@SENACOR.COMWWW.SENACOR.COM
Event-Driven Busines Process Management taking the example of DHL R. v. Ammon, C. Emmersberger, F. Springer, C. Wolff Vienna 08/09/28
Agenda • The forecast of ED-BPM for the next decades • EDBPM – a combination of two disciplines: Business Process Management (BPM) and Complex Event Processing (CEP) • A reference model for ED-BPM – how its components work together • The business modeller and the event modeller – different qualifications not in personal union • DHL Use Case - First experiences from the DHL-Project
Forcast of ED-BPM for the next decades Forecast of Prof. David Luckham: • we need skilled people at least up to 2050… • we are only at the end of the period of Simple CEP
The forecast of ED-BPM for the next decades The warning of Roy Schulte (VP of Gartner) since 2006… …we won‘t have enough skilled people who would be able to do all the jobs and projects The statement of Prof. Mani Chandy (California Techical University) at the Gartner Event Processing Summit 2007… …The work of IT during the next twenty years will be to complete the evolution of business processes from sequences of slow-moving, disjointed applications to more responsive end-to-end, event-based straight-through flows of action.
representation of the effects of system availabilities and -disturbances monitoring of time-critical bottleneck factors and transaction control BusinessProcess Monitoring Workflow Management process and system-linked emergency and disturbance management transparency over integrated represented processes monitoring of SLA-compliance Managing and monitoring of processes means ...
Big Picture: Monitoring Business Proceses and Activities event cloud with thousands of events per sec… event patterns and complex event processing… account login withdrawal new auto pay deposit transfer logout enquiry deposit activity history Sensor account login account balance logout enquiry passwdchange passwdchange account login new auto pay enquiry account login withdrawal new auto pay deposit account login transfer logout enquiry Sensor deposit activity history logout …e.g. above a bank The important steps: 1. Redesign the business processes for SOA and BPM 2. Make a SOA, identify services, build WSDL-interfaces…3. Precise description of patterns of events 4. Detecting patterns in the event cloud 5. Abstraction of complex event pattern instances to higher level events
The Pain Point: The Event Cloud, todays IT-Blindness and the „Event Tornado“ startedService_6 startedService_4 startedService_7 exitService_4 startedService_5 exitService_5 exitService_6 startedService_8 exitService_8 startedService_1 exitService_7 Low level events without semantics exitService_1 startedService_2 exitService_2 … Business Process 1 startedService_3 exitService_3 genCBE (start,service1) genCBE (start,service2) genCBE (exit,service1) genCBE (exit,service2) genCBE (start,service3) genCBE (exit,service3) Visualization of the processed/correlated events via Business Activity Monitoring … Business Process n …
The Challenge and the Principle of BPM/BAM/CEP Enterprise cockpit Workflow Modeler • realize scenarioprocess instances • set parameters Domain specific reference models for event patterns Event Modeler Monitor / Analyze / Act Workflow Engine based on BPEL workflows Scenario Rules Engine„special“ SQLresp. other languages AppServer Event Store analysehistory… Normalized events,build business level events IF …AND …FOLLOWED BY…WITHIN…ACTION Adapterse.g. RFID, topics of Pub/Sub, … calculate pott, offer rates, profit… Low Level Event Clouds / Streams e.g. payments e.g. credit offers (completed)
A proposal for a curriculum of a new Master course of study“Event-Driven Business Process Management” Draft V0.1 The business modeller and the event modeller – different qualifications not in personal union Description: Curriculum together with required credits and examinations Certificate: Master of Science Programme Duration: Four Semesters (120 credits/cr) Mastercourse-EDBPM-v01.doc(www.citt-online.com)
The business modeller and the event modeller – different qualifications not in personal union Concept: The course consists of the fields of study Business Process Management, Complex Event Processing, Business Activity Montoring included Business Intelligence and Data Warehousing, Computer Networks, Messaging as well as several application disciplines like Algorithmic Trading, Supply Chain Management in the retail domain, fraud detection in the banking and insurance domain etc. All courses are completed with course-related tests and Credits (cr) according to European Credit Transfer System (ECTS) are awarded. All courses are given in English and are designed as distance learning/eLearning courses.
Current research work and projects in ED-BPM Previous Tasks Several Proof of Concept (PoC) Implementations • PoC in the logistics domain in cooperation with Deutsche Post AG and Oracle Event Driven Business Process Management taking the Example of Deutsche Post AG, An evaluation of the Approach of Oracle and the SOPERA Open Source SOA Framework(C. Emmersberger, F. Springer; September 07 – March 08) • PoC in the finance domain in cooperation with TeambankMonitoring Application for monitoring the credit application easyCredit of Team Bank and the evaluation of several CEP approaches(H.-M. Brands, D. Guschakowski; 2007)
DHL Use Case – A Logistics Use Case for EDBPM EDBPM Background and Definition Event-Driven Business Process Management (EDBPM) is a combination of two different disciplines: • Business Process Management (BPM): Deals with the management of business processes with the approach to increase the efficiency, flexibility and technology integration of the business.Business Processes describe the unique way of doing business. Today they are seen as the most valuable asset of a corporation. • Complex Event Processing (CEP): Event processing concept that deals with handling multiple events within an event cloud to identify meaningful event patterns.It is an emerging technology for obtaining relevant situation knowledge from distributed systems in realtime (= event time + processing time)
DHL Use Case – A Logistics Use Case for EDBPM Logistics Use Case for EDBPM • Deutsche Post AG is the world largest logistic company • Investigates the feasibility of combining Oracles tools for BPEL, CEP and BAM with the latest Sopera Enterprise Service Bus (ESB) • Use case serves a PoC implementation for a solution combing the goals of service-oriented architecture (SOA) with the advantages of CEP • Use case contains a typical business process at Deutsche Post addressing “shipping”, “monitoring/investigation” and “claim” • Sopera services are orchestrated through Oracle’s BPEL engine and implement the process functionalities. They are capable to send events. • Oracle’s CEP Engine queries the events and sends results to the BAM application for displaying and alerting purpose Example: extract of shipment process C. Emmersberger, F. Springer: Event Driven Business Process Management taking the Example of Deutsche Post AG, An evaluation of the Approach of Oracle and the SOPERA Open Source SOA Framework
DHL Use Case – A Logistics Use Case for EDBPM Logistics Use Case for EDBPM Shipment Investigation Claim
DHL Use Case – A Logistics Use Case for EDBPM Simplified Illustration of Components and Interaction Development: • Service development in SOPERA • Service orchestration in Oracle BPEL • Setup events, which should be sent from the Notification Receiver (event service). Settings are defined within SOPERA policies (XML) • Development of CEP patterns in Oracle CEP with CQL • Design of reports for the BAM dashboard in Oracle BAM External events (e.g. traffic) Runtime: • Execution of a business process in the BPEL Engine • Notification Receiver deals as event service. Creates and sends business and technical events to a specified endpoint (BAM, CEP), depending on the settings. • Complex Event Processing in Oracle CEP • Process reporting in Oracle BAM
DHL Use Case – A Logistics Use Case for EDBPM Merging Event Information of Oracle and SOPERA Hurdle: • Oracle BPEL Engine and SOPERA are running isolated from each other • The SOPERA Web service has no information about the process which has executed the service • CEP has no chance to connect events coming directly from BPEL with SOPERA Service events Task: • Connect the independent events Solution: • Enhancing the message payload with BPEL process information. • BPELContent includes the filed “ProcessID” as an unique identifier for an executed process • BPELContent is sent every time when a service is called during process execution. This mechanism closes the gap between Oracle and SOPERA BPELContent BPEL event Service event
Intrusive generated events: Service has to implement code for event generation Disadvantage: Existing code has to be changed (e.g. a bank would not allow to change existing code) Business functionality and monitoring have to work independent. Service should provide only business functionality. Advantage: Information which is not part of the payload can be used Non-intrusive generated events: Information is extracted out of the payload and the service with adapters and sensors. The extracted information has to be merged to an event. Disadvantage: Only payload and public service information can be part of an event Advantage: Service Code has not to be changed Service has not to deal with monitoring functionality DHL Use Case – A Logistics Use Case for EDBPM Differences in Event Generation SOPERA SOPERA
DHL Use Case – A Logistics Use Case for EDBPM Aggregation and correlation to business level complex events Several event types influence the business process: • Process events: happening during process execution and • Business events: providing business content, e. g. parcel allocated to truck • Technical events: providing technical content, e. g. service not available • External events: events occur outside the business process, but also influencing the process, e. g. weather, traffic
First link between BPM and CEP Main concepts of both technologies in a general reference model for EDBPM CONCLUSION The Paper Provides: Summary: • EDBPM is able to detect possible errors within a business process using CEP technology and alert responsible persons using BAM • Added business value compared to pure BPM solutions Perspective: • Automatic reaction on errors has to be implemented in future solutions, e.g. conditional decision and reaction logic • Additional use cases can be defined for various domains and first projects on the basis of such “Event Driven BPM” platforms start in 2008 • Research projects for a faster set-up of EDBPM are currently under preparation Detailed Information: • Further information about the PoC can be seen on www.citt-online.com in a video presentation hold on the 6th CEP/BAM expert meeting in Regensburg
Current research work and projects in ED-BPM Tasks for the future Analyzing different domains and provide CEP patterns and best practices for each domain Current PhD thesis: • Domain Specific Reference Models for Complex Event Processing Patterns in the domain of Finance/Banking (F. Springer) • Domain Specific Reference Models for Complex Event Processing Patterns in the Automotive Domain (C. Emmersberger) • Domain Specific Reference Models for Complex Event Processing Patterns in the Retail Domain (T. Paulus)
Backup Backup
Architectural Project Overview Complete Component Overview plus Event Could
Architectural Project Overview SOPERA Service • SOPERA provides a standards-based framework for SOA solutions • A central Service Registry manages all services • Services can be deployed in Tomcat, JEE Application Servers • Service interfaces and bindings are described by plain WSDL documents instead of using the proprietary SOPERA descriptions
Architectural Project Overview Oracle BPEL • Oracle AS 10g contains the BPEL engine • Services are orchestrated through a BPEL process which is deployed on the BPEL Engine • SOPERA services are invoked by using partner links
Architectural Project Overview SOPERA Notification Receiver • It is the binding component between SOPERA services and Oracle JMS Provider • Runs as a service within a Tomcat server • Registered in the SOPERA service registry • Passes events, generated by the service back bone as well as the services to JMS provider
Architectural Project Overview Oracle Business Activity Monitoring • Oracle BAM 10g runs within a Microsoft IIS environment • It pulls events from the JMS Provider through Enterprise Message Sources (EMS) and stores them into Data Sinks (DS) • Plans contain the description how the events are processed between an EMS and a DS • On top of the DS, BAM offers the ability to create real time dashboards
Architectural Project Overview Oracle Business Activity Monitoring
Architectural Project Overview Oracle Complex Event Processing • Oracle CEP offers the ability to fetch events from different event sources • Incoming events are queried in a SQL like language called CQL (Continous Query Language) • Based on the query result new events can be generated • The generated events are pushed on to output streams to be able to react on these events
Intended as a test of functionality demonstrating the applicability and usability of EDBPM for real-time monitoring of online business processes Application domain is monitoring the credit application easyCredit of Team Bank(German online credit system featuring instant credit application confirmation for customers) Focus on real-time monitoring of potential credit process cancellations Front-end components based on metrics and key performance indicators (KPIs) visualized in BAM dashboards For prototypical implementation, different CEP, BAM and Event Processing Languages (EPLs) have been analyzed, among them: Coral8, Systar, StreamBase, Tibco Financial Use Case for EDBPM Financial Use Case for EDBPM H.-M. Brands, D. Guschakowski: Complex Event Processing in the context of Business Activity Monitoring, An evaluation of different approaches and tools taking the example of the Next Generation easyCredit
______ _____ ______ Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach? Open Source-Approach Packaged Approaches
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach? TEST Best-of-Breed-Approaches
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?
Complex Event Processing in the retail domain • Scenario: • Complex, heterogenous and distributed IT Landscape • Multiple vendor-independent hard- and softwaresystems • Multiplicator effect generates high ammount of bussines data • Crossing with other domains ( Logistics, Finance, etc.) • Benefits: • Shorter response time in case of failures and deviation; based on event driven realtime-analysis of business-data and historical data • Proactive and predictive acting; based on combination of reference, historical and realtime data for detecting failures and deviation in realtime • Usecases: • Realtime – Marketing • Stock- and Order-Management • Supply-Chain-Management • Customer – Binding • Hard- and Software-Monitoring
congnition of daily operation Company Strategy React on errors within business processes Analyzing historical data and process data CEP Lifecycle Create CEP patterns detecting potential errors Results of Analysis