EDIMatrix Ltd. DMX Overview - Efficient EDI System Modules

1. DMX OverviewOrbit Nov 2011 EDIMatrix Ltd 1993-2011

2. Introduction DMX Modular EDI SystemA series of self-standing programs which can be used individually or combined seamlessly to make the EDI system which suits your needs EDIMatrix Ltd 1993-2011

3. Important Modules • DMXCONST - construction • DMXTRANS - translation • DMXERRAN - session report • DMXSCHED - scheduler • DMXGWAY - traffic analyser • WINTASKS - batch file processor • DMXPRINT - flat file re-formatter • DMXREFRM - relational file re-formatter • DMXEFAX - delimited file re-formatter EDIMatrix Ltd 1993-2011

4. EDIFACT Interchange Structure EDIMatrix Ltd 1993-2011

5. Segments & Groups • A segment has structure:TAG+element+element:element+ ….. ’ • Within a message sequences of segments can be marked as repeatable. They are then said to form a GROUP. EDIMatrix Ltd 1993-2011

6. Data Element • Has properties such as: • Fixed/Variable length • Maximum Length • Alphanumeric/Alphabetic/Numeric content • Mandatory/Conditionale.g. A6 AN..35 N..14 EDIMatrix Ltd 1993-2011

7. Separators (Syntax Characters) • Components : • Data Elements + • Segments ’ • Escape Character ? • BUT - can be re-specified by a UNA segment before the UNB EDIMatrix Ltd 1993-2011

8. Compression - remove • Trailing blanks • Leading zeroes • Trailing decimal zeroes • +element::+ becomes +element+ • +element++’ becomes +element’ • NOTE +element::element+ unchanged • Sigh! These rules are often broken EDIMatrix Ltd 1993-2011

9. Mandatory / Conditional • A Group, Segment, Composite or Data Element may be Mandatory or Conditional • The status of a composite structure is independent of the individual statuses of its components • Violations of these statuses are probably the most common fault in EDIFACT messages • SO - you need to understand them! EDIMatrix Ltd 1993-2011

10. Other EDI Standards • Tradacoms - obsolete but widely used in UK • X12 - the USA standard; seldom found in UK • XML - use slowly growing; handled by DMXEFAX • … and some non-standard EDI types ... • Delimited formats - handled by DMXEFAX • SDF formats (VDA, BISAC, GENCOD etc.); handled by DMXPRINT EDIMatrix Ltd 1993-2011

11. A Simple EDI System EDIMatrix Ltd 1993-2011

12. An Even Simpler System EDIMatrix Ltd 1993-2011

13. Management Information Flow Converters Session Log ErrorAnalyser Gateway Database Renames Network I/F EDIMatrix Ltd 1993-2011

14. Outgoing DATA Flow Application Re-formatter DmxConst EDIMatrix Ltd 1993-2011

15. Incoming DATA Flow Interchange Files DMXTRANS DMXPRINT APP Inhouse Files EDIMatrix Ltd 1993-2011

16. DMXGWAY • Most of the operational functionality of a conventional EDI Gateway lies in the DMX converters themselves. The DMX Gateway is therefore primarily a Traffic Analyser whose function is to show you what has been happening in your system, and to tie together the various information sources available to you. EDIMatrix Ltd 1993-2011

17. DMXGWAY • View EDI traffic using a query generator • Update the traffic database • Create and view archives • Edit and maintain the database • Easy links to all EDI system information EDIMatrix Ltd 1993-2011

18. Information Sources Gateway View Session Log Control Log Gateway Log Data Files Net I/F Log Net Reports Gateway Reports EDIMatrix Ltd 1993-2011

19. Converters • DMXCONST constructs EDI, DMXTRANS translates it • Mapping driven by a compiled table • Operational control by a text control file • EDIFACT, Tradacoms and X12; XML aware • Very rich set of operational options • Can be data-stream driven by using a profile • Batch, server and service modes EDIMatrix Ltd 1993-2011

20. Profiles • Switch the operational environment of the converter according to contents of the incoming data stream. • Based on Trading Partner • Based on Message Type • Based on Test status • OR - based on complex pattern matching EDIMatrix Ltd 1993-2011

21. Profiles You only need two profiles to cover all your EDI processing; one for construction (DMXOUT.PRO) and one for translation (DMXIN.PRO). Once operating under a profile the converter becomes data-driven, and switches its environment automatically to respond to the changing requirements made of it EDIMatrix Ltd 1993-2011

22. Profile Logic ? Use DEFAULT EDIMatrix Ltd 1993-2011

23. Table Generation DMXTEDIT Table DMXSCOMP DMXTCOMP DMXTDUMP DMXMKTRN Source EDIMatrix Ltd 1993-2011

24. DMXTEDIT • Interactive • Direct • Quick • Automation • Edits, not creates • Full sets of UNSM’s • Intuitive ? • EDI knowledge helps EDIMatrix Ltd 1993-2011

25. Control of Conversion Command Line Parms Converter Control File Profile Includes Codes CharConv EDIMatrix Ltd 1993-2011

26. Table Input File(s) Output File(s) Flags Moves Profile Semaphores Data Errorlevels Codes Links Logging Seeds Includes Local Variables ….. More! Control File Contents EDIMatrix Ltd 1993-2011

27. Format ... Error behaviour ... Residence ... Fast/Thorough Debug Imp/Exp Nesting Decimal Separator Buffering Cache Sizes Profile Triggers Convert Characters Timeslicing Empty File Removal Flags EDIMatrix Ltd 1993-2011

28. Network Interfaces • Export - identify files to be sent • Connect - call and monitor the network program • Import - register incoming files and net reports • Update traffic database EDIMatrix Ltd 1993-2011

29. Network Interface • Desirable, but not essential! • Needed for status recording in traffic database • All DMX network interfaces are modifications of a single generic model • The requirements of the network may need to be considered at converter control file level EDIMatrix Ltd 1993-2011

30. Network Communications • Program to dial a network, establish a session, and perform file transfers as dictated by the Network Interface program • Network specific. • DMXCOMMS often used, with a script for the particular network being accessed • Expedite, FTPS and Putty also used • Network determines facilities available EDIMatrix Ltd 1993-2011

31. DMXCOMMS Features • Script-driven comms for Async & TCP/IP • Normally used with standard scripts • Can be used for most Internet protocols • Can be used to create a server • For secure comms use with Stunnel • Cannot implement FTP, since it only supports a single communication channel EDIMatrix Ltd 1993-2011

32. Compiled Tables • Several programs in the DMX range operate using compiled tables; the information for them is prepared as a text file which is then compiled to a binary form more suitable for active processing by the program involved. • This is done to separate activities which can be performed off-line from those which are part of the ‘real’ processing. EDIMatrix Ltd 1993-2011

33. DMX Compilers EDIMatrix Ltd 1993-2011

34. Application Interface • Intermediary file(s) - Inhouse files • DMX can create and accept most formats, providing they are not too crazy! • Convenience for Application decides form • Semaphores used to prevent conflicts • Hierarchical tagged (flat) file often used • Relational filesets also popular EDIMatrix Ltd 1993-2011

35. Hierarchical Tagged Files • The most common interface file for applications consists of a hierarchy of different records, each identified by a unique tag. • The hierarchical structure tends to be very similar to that of the EDIFACT interchange • BUT - where the number of iterations of an entity is limited it can often be folded into the level above it. EDIMatrix Ltd 1993-2011

36. Relational Files • Essentially equivalent to database tables • Each repeating entity has its own file with a discrete record structure • Records in different files are linked by Keys • Once again, if an entity has a limited number of repetitions it is often folded into an existing file EDIMatrix Ltd 1993-2011

37. DMX Converter Inhouse Files • Are hierarchical tagged files • Re-formatting to and from relational files can be achieved by the DMXPRINT and DMXREFRM programs • These programs have many other uses! • The hierarchical tagged file is, in theory, inferior to a relational fileset but is, in practice, normally better! EDIMatrix Ltd 1993-2011

38. Re-formatters • Three different ones depending on input type; DMXPRINT, DMXEFAX and DMXREFRM • All can generate a variety of outputs; SDF, CSV, Reports, HTML, XML to one or more output files • All are template driven, and easy to modify • All use compiled input file specifications • Used for mapping without need of EDI awareness • All have scripting capabilities • DMXEFAX is the most versatile EDIMatrix Ltd 1993-2011

39. Wintasks • Started out to provide a simple batch processing capability for Windows • Grew gradually over the years to give extra capabilities • Now has the power of a scripting language .. BUT • Still tries to look like a simple batch file, because languages are intimidating to many clients • Windows now offers other scripting capabilities, so it is not a compulsory component EDIMatrix Ltd 1993-2011

40. Wintasks Features • Runs external apps - sync or async • File movement, with logging • IF/THEN/ELSE and FOR statements • IFOLDER, IFGREATER, IFEXIST • Labels, GOTO & GOSUB/RETURN • Manipulation of local strings & integers • Read from & write to files EDIMatrix Ltd 1993-2011

41. Scheduler Runs the EDI tasks Monthly, daily, many times a day Versatile time window settings EDIMatrix Ltd 1993-2011

42. Utilities • There are a lot of other handy DMX programs to support a system • Splitters, viewers, table tools ….. • Too many to list! EDIMatrix Ltd 1993-2011