70 likes | 202 Vues
Applying SAS Parallel-Processing Feature. Berwick Chan, berwick.chan@kp.org Kaiser Permanente Vaccine Study Center NCAL Division of Research For BASAS May 2014 meeting. SAS Step-by-Step Sequential Processing Flow. Execution Time. SAS starts. Task 1. X seconds. Task 2. y seconds.
E N D
Applying SAS Parallel-Processing Feature Berwick Chan, berwick.chan@kp.org Kaiser Permanente Vaccine Study Center NCAL Division of Research For BASAS May 2014 meeting
SAS Step-by-Step Sequential Processing Flow Execution Time SAS starts Task 1 X seconds Task 2 y seconds Total: (x+y) seconds SAS ends Applying SAS Paralle Processing Feature - B. Chan
SAS Parallel Processing Flow Execution Time SAS starts Task1 Task 2 SAS starts SAS starts Task 2 y sec Task 1 SAS ends x sec SAS ends Total exec time: max(x,y) sec SAS ends Applying SAS Paralle Processing Feature - B. Chan
Ideal Tasks For Parallel Processing • Independent tasks that run on the same server. For example, sorting 2+ huge SAS tables • Independent tasks that run on different servers. For example, reading Oracle/DB2/Teradata tables simultaneously • Linking standalone SAS programs together with a set of user-defined condition. (Production job setting) Applying SAS Paralle Processing Feature - B. Chan
SAS Code Samples • Basic MP-Connect program structure • Sorting two tables concurrently • Sending two passthrusql to different servers concurrently Applying SAS Paralle Processing Feature - B. Chan
More SAS Code Samples Linking/Running independent SAS programs with controls such as: • Be able to communicate among independent programs • Be able to check status of individual program • Be able to define logic to determine program flow on the fly, for example, if anyone of the independent programs yields non zero return code then abort the entire program Applying SAS Paralle Processing Feature - B. Chan
More About MP-Connect • Useful links: http://support.sas.com/onlinedoc/913/getDoc/en/connref.hlp/connrefwhatsnew900.htm http://support.sas.com/rnd/scalability/tricks/connect.html http://www2.sas.com/proceedings/sugi28/279-28.pdf Applying SAS Paralle Processing Feature - B. Chan