200 likes | 283 Vues
Explore the EGRID project, its community, added value for research, infrastructure details, and future plans. See how grid technology is revolutionizing research in complex systems.
E N D
The EGRID project S.Cozzini www.egrid.it Athens, 21rs April 2005
Agenda • The EGRID project (short overview) • The new egrid community • The added value for EGRID • The added value for EGEE • Our plans/commitments
The EGRID project • A FISR project funded by MIUR (2003) • Original Aim: • Use of grid paradigm for research on complex system in economics and finance • MIUR asked to similar FISR projects to coordinate together • ICTP new task: • Provide a National Italian Facility for economical and financial data using grid technology
The EGRID community • Several different research groups in Italy • Palermo: dep of Physics; • Roma: dep. Of Physics; • Roma: IAC-CNR Istitute; • Ancona: Department of Economics; • Firenze: dep. of Statistics. • Alessandria: dep of Physics; • Trieste: • Dep of Economics • Dep of Engineering • Area Science Park • ICTP • 2 groups in USA: UCLA + Columbia • Grid research applied to finance They posed the user requirements to the Egrid team at ICTP
User requirements in a nutshell • High Frequency Financial Data: raw data • Different Stocks Exchanges (NYSE/LSE/Paris/BorsaMilano) . • Restricted access to raw data acquired under legally binding disclosure policies (privacy and security) • Raw Data should be: • Safe kept/backed-up/shared on the GRID • Actions on the raw data: transformations • Filtering procedures (size reduced) • Building procedures (size increased) • Authorized and authenticated access to financial databases • Computational power • To transform data / To perform simulations
EGRID infrastructure • Version 1.0 released: 8-9 october 2004 (meeting in Trieste) • Globus based EDG middleware. • Specific VO within Grid.it. ( our Grid provider..) • A star shaped topology for data management: • Central SE (large and backed up storage) hosted in grid.it • Local SE hosted in research centres acting as a temporary storage space. • Data management based on EDG Replica manager
AN Roma PADOVA WN WN CE TS WN WN SuperNode: CE+SE+WN FI PA AL A graphical view (as 11/04) Main Storage
EDG & Egrid • EDGLimits • Data privacy not guaranteed • EDG software installations: complex/invasive… • Other problems • Limited Bandwidth among different sites. • EGRID solutions • Temporary Work-around on privacy/security • Temporary cache system based on star-topology • Ad hoc procedures for installing (Live CD for UI and SuperNode)
EGRID solution: UI • Egrid UI now also on Live CD: • Based on Knoppix • http://www.egrid.it/download/software/ui/
EGRID enhancements (from 11/04) • Storm project (see later) • Filtering tools provided to users • EGRID software layer completed • Live CD's updated (2.4.0 EDG version) • An updated testbed with all the grid services
StoRM: • SRM protocol: standard for accessing files in a GRID environment. • Storm: an implementation norn from a collaboration between INFN and ICTP EGRID project • Storm features: • Promiscuous access to files: GRID users and the computing farm's Local users, can access the same files. • Support for File protocol: direct Filesystem access for GRID users running jobs on the computing farm's Worker Nodes, by leveraging the farm's Distributed Parallel Filesystem. • security model for the our needs of privacy and security
EGRID users’ s financial applications in production • Filtering/Building procedures • From Row data to ready to use data.. • Now inserted in a software layer built on the top of EDG commands and based on the EGRID architecture • Pricing financial derivatives • by means of MCS and genetic algorithms • USA partners + Trieste groups • Order Book reconstruction and analysis • Palermo Group • Volatility estimation via Hidden Markov models • Firenze Group GRID USAGE (as today) Jobs : 2961 WallTime: 42166285 sec. ~ 500 days !!! CPUTime: 38103152 sec.
The European-EGRID community • European research groups interacting with us: • Giulia Iori (City College London) • MAS Laboratory (Ioane Muni Toke, Lionel Gabet) from the Ecole Centrale Paris, France. • European research groups ready to join: • Madrid • Budapest
EGRID – City College London interaction • Giulia Iori’ s research Group • Currently using our local testbed to get acquainted and port applications • Ready to either to install a small local facility or to contribute to enlarge other sites
EGRID – MAS interaction • Currently playing with our UI Live CD and with our testbed. • Ready to port their Grid-aware applications on our testbed and our production grid • Willing to enlarge the community with their commercial partners • Ready to merge local facilities within EGEE
Other future partners: • Financial Institutions already working with MAS ready to support our community: • Société Générale and other • expression of interest from Avanade Italy (www.avanade.com) • Quite recent (last week meeting)
EGRID added values in joining EGEE • EGEE middleware is addressing some of our requirements • Egrid needs to be aligned with major european grid research avoiding duplications • Egrid partners want to include European research group: infrastructure needs to be at European scale • EGRID is now addressing Banks and Financial Institutions interested in using a continental grid instead of a national one.
EGEE added values in accepting EGRID • very important security/privacy issues addressed • A well trained and motivated group • Scientific & academic community with a large technological transfer • Financial & economical entities can play a determinant role in spreading grid technologies outside academic/scientific world
EGRID future working plans • Applications: • Porting of Paris/London applications • Fine tuning of currently supported programs • Middleware: • Integration of our middleware within EGEE glite product (very much interested) • Release of version 2.0 of our facility (web portal) • Community: • Enlarge further the community • Go with its own proposal to the next European call
Future EGRID event: “Finance in GRID” Palermo 14/15 october 2005 chair: Rosario Mantegna A international workshop where two communities (Grid and Finance) can meet and discuss and interact Call for papers will be out next week ! (Hopefully with the EGEE logo)