PingER : Research Opportunities and Trends

1. PingER: Research Opportunities and Trends R. Les Cottrell, SLAC University of Malaya

2. PingER project and publications etc. Insert Presentation Title in Slide Master • Originally: • Research project funded from 1995-2000 by DoE • Aimed at High Energy Physics collaborations • Journal publications e.g.: IEEE Comm paper 2000 • Popular magazine articles e.g.: IEEE Spectrum 2013 • Yearly reports going back to1998 • Papers at conferences e.g.: Passive & Active Measurements • Numerous presentations in over 20 countries

3. Potential Projectshttps://confluence.slac.stanford.edu/display/IEPM/Future+Projects Insert Presentation Title in Slide Master • Two layers: • Development of the infrastructure • Research using the PingER data and infrastructure

4. 1: Development of PingER Insert Presentation Title in Slide Master • Set up, extend and maintain Malaysian end-to-end active performance monitoring mesh • Improve management tools: • Installation make easier, e.g. Ubuntu distribution with PingER installed • detecting/resolving problems • Hosts not responding, notifying contact • Replacing non-working hosts • New vizualization/analysis/mining • Publication of PingER data vis Open Linked Data (OLD) access • Could be part of a research project • Started (1.5. months in) by a Brazilian student at SLAC for 3 months • Improved Google map access • Improve analysis tools: • Extend for IPv6 (Measurements have been IPv6 capable since 2002)

5. 2: Research Opportunities using the PingER data Insert Presentation Title in Slide Master

6. Case studies • Case study of Malaysian internet performance • How does Malaysia compare to the rest of the world, to other S.E. Asian nations, is it getting better etc. • Where are there problems? • Un-reliable and causes • Noisy (jitter & loss) • Very indirect connections • Work with site contacts, MYREN or ISPs to notify them of problems Insert Presentation Title in Slide Master

7. Case study - 2 Insert Presentation Title in Slide Master • What applications will work • Expected data transfer rates • Ok for email, web surfing, streaming video, online gaming, web hosting, online TV, downloading movies • Where will VoIP work well? • Would Haptic surgery work? • Based on RTT, loss and jitter?

8. Publication of analyzed PingER data in Open Link data formathttps://confluence.slac.stanford.edu/display/IEPM/PingER+Linked+Open+Data Insert Presentation Title in Slide Master • Have made a start • Enables correlation of PingERdata and mashups • Versus economic indicators, happiness, corruption… • Is there a correlation between Network performance and the Faculty/student ratio, do private universities have better connectivity than public, etc.?

9. Anomaly detectionhttp://slac.stanford.edu/pubs/slacpubs/13250/slac-pub-13399.pdf Insert Presentation Title in Slide Master • Looking at time series, detect anomalous changes in performance • Multiple metrics, choice of data set • Statistical analysis of time periods, training period: • plateau algorithm, Holt-Winters (filtering out seasonal effects), Kalman filters, Klomogorov-Smirnov … • Compare & contrast methods • Tie into traceroutes • Correlate monitor/remote pairs to find shared links with problems • E.g. Principal Component Analysis • Measure success by high true positives (i.e. low false positives, low false negatives), speed of detection …

10. Problem reporting Insert Presentation Title in Slide Master Reporting to identified appropriate contact Some hysteresis so do not report one event multiple times Also report when fixed.

11. IPv6 Insert Presentation Title in Slide Master Extend PingER data gathering, archiving, analysis to support IPv6 Use PingER to make IPv6 measurements of IPv6 hosts Compare to IPv4 hosts at similar locations Make PingER IPv6 measurements with QoS to compare withputQoS measurements

12. GeoLocation of specified Internet hosthttp://www.slac.stanford.edu/comp/net/wan-mon/tulip/ Insert Presentation Title in Slide Master • Location of nodes (especially routers) using trilateration • Routers usually report they are located at the corporate HQ and not their physical location • Use PingER monitors (plus other ping servers such as PlanetLab & perfSONAR) as landmarks to: • Ping target with unknown location to get minimum RTT • Knowing speed of light in fibre get an estimate of minimum distance • Correct for estimated indirectivity to get improved distance estimate • Research problem estimating indirectivity • Using 2 distances get doughnut of distance of target from landmark • Constrained • Using smallest doughnuts trilaterate to find location of target

13. Geo Location challenges Insert Presentation Title in Slide Master • Make it fast enough to use in realtime from a web form • Multi-step • Using a few well chosen landmarks first find region target is in, • Use all the landmarks in that region to get distance estimates and trilaterate • How to estimate directivity correction factor? • By region … • Security concerns (DDOS)? • Target may block pings • Try TCP ping …

14. Geolocation: Landmarks Insert Presentation Title in Slide Master • Finding landmarks that are working well • Ongoing problem needs automating, disable non responding landmarks, recover now working disabled landmarks • Finding landmarks in all regions of interest • Where does it work?

15. Geo Location Insert Presentation Title in Slide Master • When does it fail & why • Comparison to other methods such as databases • Whois, GeoIPtools/MaxMindetc. • How does performance relate to number of landmarks? • What is it useful for: • Targeted marketing • Valuable for routers and hence visual traceroutes • Find proxies • Which server to use (e.g. HotMail)

16. Geolocation visualization Insert Presentation Title in Slide Master Using Google maps

17. Going forward Insert Presentation Title in Slide Master One year Internships at SLAC Proposals to apply for grants Coordination between UM, UMT, UNIMAS, SLAC. NUST