Universal Computing @ Berkeley Activities in the ISRG / Endeavour

1. Universal Computing @ BerkeleyActivities in the ISRG / Endeavour David Culler Randy Katz, Eric Brewer, Anthony Joseph, James Landay and others http://www.cs.berkeley.edu/~culler Philips Visit 8/5/99

2. Natural Tides of Innovation Innovation ?? Integration Personal Computer Workstation Server Log R Minicomputer Mainframe 2/99 Time Philips

3. Scalable Infrastructure • highly available • persistent state (safe) • databases, agents • service programming environment Service Path • Ubiquitous Devices • billions • sensors / actuators • smart space • PDAs / smartphones / PCs • heterogeneous Expanding the Spectrum • Desktops • max out at few 100M • in your face • connected to the infrastructure Philips

4. Issues Converge at the Extremes • Powerful Services on “Small” Devices • massive computing and storage in the infrastructure • active adaptation of form and content “on the way” • Lean, Flexible Communication Building-Blocks • simplicity is the key to efficiency • Federated System of Systems • Availability, Automatic Configuration and Management • Novel interfaces and usage models • Plug it all together and have it DWYM! • Computer Science focused on problems of scale! Philips

5. Outline • Brief perspective on current activities • Directions ahead under the Endeavour effort Philips

6. ISRG+ Projects • Millennium Testbed • Culler, Demmel, … (Intel, NSF, UCB, Microsoft, Sun, IBM, Nortel) • Ninja Proactive Infrastructure • Brewer, Culler, Katz, Joseph (ARPA) • Iceberg: Computer/Telephony Integration • Katz, Joseph (Ericsson, ATT) • Istore / Telegraph / Oceanic • Patterson, Hellerstein, Kubiatowitz, Brewer • GUIR - novel user interfaces • Landay • Universal Computing Lab • IBM • => Endeavour Expedition to the 21st Century Philips

7. Underlying Message • It’s not just putting together good computer science research projects, its growing a community that “thinks” in the emerging world Philips

8. Experimental Testbed Fax IBM WorkPad Image/OCR Text Speech MC-16 Ericsson CF788 Motorola Pagewriter 2000 WLAN Pager 306 Soda 405 Soda 326 Soda “Colab” GSM BTS Network Infrastructure Millennium Cluster Smart Spaces Personal Information Management Philips Millennium Cluster

9. Your PDA connects to the local infrastructure and asks it to build a custom GUI • Next, your PDA asks the infrastructure for a path out to your personal information space, where agents are processing your e-mail, v-mail, faxes, and pages You have complete, secure, optimized access to local devices and your private resources Ninja Vision • You walk into a room Philips

10. Open Clients Clients Clients Clients Servers Clients Clients Servers Servers The Internet Push Services into an Active Infrastructure Infrastructure Services => enable Distributed Innovation of Scalable, Avail. Services Philips

11. NINJA Infrastructure Services Key Store sRMI Embeded Untrusted Client Content Filter (pseudonym) https DATEK (Trust Contract) Trusted Client The Internet https Embedded Untrusted Interface? Philips

12. One Time Passwd to pseudo-service Cannot increasing the security of the channel so decrease the value of the content. Philips

13. 1 2 Informal Collaborative Interfaces Take free-form ink notes on Pilots or CrossPads* Meet in any environment * accumlate, share, transform in the infrastructure Philips

14. Building the Bazaar • What we need is not just a new research project, but a new “computing culture” => Build a department-wide, universal wireless PDA infrastructure, smart spaces and a community to take it forward • Initial Seed Fall 98 with IBM • 150+ IBM workpads + lots of cradles + IR + ??? • Pervade the first-year grad research projects • bold experiment in the senior UI course • accelerated the on-going research efforts • Follow-on Universal Computing Lab • Endeavour provides the framework Philips

15. Some Lessons • Communication is enabling • low-power wireless needs to be like IP • Virtual Environment is important • Devices connect “into the infrastructure” • Network HotSync, groupware, centralized e-mail => Need lean, clean communication substrate • “User Service” is fundamental • not just profile and customization info • routing point for security • Much room for improvement in devices • Development effort is the limiting factor • OSKI: 1 person for infrastructure, 2 for WorkPad => need complete distributed system debugging and simulation environment Philips

16. The Endeavour Expedition:Charting the Fluid Information Utility Randy H. Katz, Principal Investigator EECS Department University of California, Berkeley Berkeley, CA 94720-1776

17. Vision/Objective • Enhancing human understanding through information technology • Make it dramatically more convenient for people to interact with information, devices, and other people • Supported by a “planetary-scale” Information Utility • Stress tested by challenging applications in decision making and learning • New methodologies for design, construction, and administration of systems of unprecedented scale and complexity • Figure of merit: how effectively we amplify and leverage human intellect • A pervasive Information Utility, based on “fluid systems technology” to enable new approaches for problem solving & learning Philips

18. Potential Impacts on Commercial Practice • Personal Information Mgmt is the Killer App • Not corporate processing but management, analysis, aggregation, dissemination, filtering for the individual • People Create Knowledge, not Data • Not management/retrieval of explicitly entered information, but automated extraction and organization of daily activities • Information Technology as a Utility • Continuous service delivery, on a planetary-scale, constructed on top of a highly dynamic information base • Beyond the Desktop • Community computing: infer relationships among information, delegate control, establish authority Philips

19. Information Devices Beyond desktop computers to MEMS-sensors/actuators with capture/display to yield enhanced activity spaces InformationUtility InformationApplications High Speed/Collaborative Decision Making and Learning Augmented “Smart” Spaces: Rooms and Vehicles Design Methodology User-centric Design withHW/SW Co-design; Formal methods for safe and trustworthy decomposable and reusable components “Fluid”, Network-Centric System Software Partitioning and management of state between soft and persistent state Data processing placement and movement Component discovery and negotiation Flexible capture, self-organization, and re-use of information Proposed Approach Philips

20. High Speed Decision Making Learning Classroom E-Book Vehicles Applications Collaboration Spaces Info Appliances Human Activity Capture Generalized UI Support Event Modeling Transcoding, Filtering, Aggregating Statistical Processing/Inference Proxy Agents Negotiated APIs Self-Organizing Data Information Utility Interface Contracts Wide-area Search & Index Nomadic Data & Processing Wide-Area Data & Processing Automated Duplication Movement & Positioning Distributed Cache Management Stream- and Path-Oriented Processing & Data Mgmt Non-Blocking RMI Soft-/Hard-State Partitioning Laptop PDA Wallmount Display Camera Information Devices Smartboard MEMS Sensor/Actuator/Locator Handset Philips

21. Task 1: Base Program Option 1: Systems Architecture for Vastly Diverse Computing Devices Option 2: Implementation and Deployment of the Oceanic Data Information Utility Option 3: Sensor-Centric Data Management for Capture and Reuse Option 4: Negotiation Architecture for Cooperating Components Option 5: Tacit Knowledge Infrastructure and High-Speed Decision-Making Option 6: Information Management for Intelligent Classroom Environments Option 7: Scalable Safe Component-based Design and UI Design Tools Option 8: Scaled-up Field Trials D e s I g n M e t h o d o l o g y Applications Rapid Decision Making, Learning, Smart Spaces: Collaboration Rooms, Classrooms, Vehicles Information Utility Fluid Software, Cooperating Components, Diverse Device Support, Sensor-Centric Data Mgmt, Always Available, Tacit Information Exploitation (event modeling) InformationDevices MEMS Sensors/Actuators, Smart Dust, Radio Tags, Cameras, Displays, Communicators, PDAs Base Program Option 1: Sys Arch for Diverse Devices Option 2: Oceanic Data Utility Option 3: Capture and Re-Use Option 4: Negotiation Arch for Cooperation Option 5: Tacit Knowledge Infrastructure Option 6: Classroom Testbed Option 7: Scalable Heterogeneous Component-Based Design Task Structure

22. Base Program: Leader Katz • Broad but necessarily shallow investigation into all technologies/applications of interest • Primary focus on Information Utility • No new HW design: commercially available information devices • Only small-scale testbed in Soda Hall • Fundamental enabling technologies for Fluid Software • Partitioning and management of state between soft and persistent state • Data and processing placement and movement • Component discovery and negotiation • Flexible capture, self-organization, info re-use • Limited Applications • Methodology: Formal Methods & User-Centered Design Philips

23. Option 1: “System Architecture for Vastly Diverse Devices”Leader Culler • Distributed control & resource management: data mvmt & transformation, not processing • Path concept for information flow, not the thread • Persistent state in the infrastructure, soft state in the device • Non-blocking system state, no application state in the kernel • Functionality not in device is accessible thru non-blocking remote method invocation • Extend the Ninja concepts (thin client/fat infrastructure) beyond PDAs to MEMS devices, cameras, displays, etc. Philips

24. Option 2: Implementation & Deploy-ment of Oceanic Data Info UtilityLeader Kubiatowicz • Nomadic Data Access: serverless, homeless, freely flowing thru infrastructure • Opportunistic data distribution • Support for: promiscuous caching; freedom from administrative boundaries; high availability and disaster recovery; application-specific data consistency; security • Data Location and Consistency • Overlapping, partially consistent indices • Data freedom of movement • Expanding search parties to find data, using application-specific hints (e.g., tacit information) Philips

25. Option 3: Sensor-Centric Data Management for Capture/ReuseLeader Hellerstein • Integration of embedded MEMS with software that can extract, manage, analyze streams of sensor-generated data • Wide-area distributed path-based processing and storage • Data reduction strategies for filtering/aggregation • Distributed collection and processing • New information management techniques • Managing infinite length strings • Application-specific filtering and aggregation • Optimizing for running results rather than final answers • Beyond data mining to “evidence accumulation” from inherently noisy sensors Philips

26. Option 4: Negotiation Architecture for Cooperating ComponentsLeader Wilensky • Cooperating Components • Self-administration through auto-discovery and configuration among confederated components • Less brittle/more adaptive systems • Negotiation Architecture • Components announce their needs and services • Service discovery and rendezvous mechanisms to initiate confederations • Negotiated/contractural APIs: contract designing agents • Compliance monitoring and renegotiation • Graceful degradation in response to environmental changes Philips

27. Option 5: Tacit Knowledge Infra-structure/Rapid Decision MakingLeader Canny • Exploit information about the flow of information to improve collaborative work • Capture, organize, and place tacit information for most effective use • Learning techniques: infer communications flow, indirect relationships, and availability/participation to enhance awareness and support opportunistic decision making • New collaborative applications • 3D “activity spaces” for representing decision-making activities, people, & information sources • Visual cues to denote strength of ties between agents, awareness levels, activity tracking, & attention span Philips

28. Option 6: Info Mgmt for Intelligent ClassroomsLeader Joseph • Electronic Problem-based Learning • Collaborative learning enabled by information appliances • Enhanced Physical and Virtual Learning Spaces • Wide-area, large-scale group collaboration • Capture interaction once for replay • Preference/task-driven information device selection • Service accessibility • Device connectivity • Wide-area support • Iterative evaluation Philips

29. Option 7: Safe Component Design and UI Design ToolsLeader Sangiovanni • Information Appliances as an application of hardware/software codesign • Co-design Finite State Machines (CFSMs) • Formal methods to verify safety from faults • Safe partitioning of components into communicating subcomponents placed into the wide-area • Model-based User Interface Tools • Information device user interfaces • Multimodal interface design for variety of devices Philips

30. Option 8: Scaled-up Field TrialsLeader Katz • Testbed Rationale • Study impact on larger/more diverse user community • Higher usage levels to stress underlying architecture • Make commitment to true utility functionality • Increasing Scale of Testbeds • Building-Scale • Order 100s individuals • Campus-Scale • Order 1000s individuals • City-Scale • Order 100000 individuals Philips

31. Putting It All Together 1. Diverse Devices 2. Data Utility 3. Capture/Reuse 4. Negotiation 5. Tacit Knowledge 6. Classroom 7. Design Methods 8. Scale-up Devices Utility Applications Component Discovery & Negotiation Fluid Software Info Extract/Re-use Self-Organization Group Decision Making Learning Philips

32. universal Function: adjective 1 : including or covering all or a whole collectively or distributively without limit or exception 2 a : present or occurring everywhere b : existent or operative everywhere or under all conditions <universal cultural patterns> 3 a : embracing a major part or the greatest portion (as of mankind) <a universal state> <universal practices> b : comprehensively broad and versatile <a universal genius> 4 a : affirming or denying something of all members of a class or of all values of a variable b : denoting every member of a class <a universal term> 5 : adapted or adjustable to meet varied requirements (as of use, shape, or size) Philips

33. F99 Universal Computing Lab w/ IBM • Intelligence in the infrastructure • Production Ninja cluster servers • Computing and connectivity wherever you go • compact notebooks • and in the space around you • kiosk machines with touch-sensitive flat panels • with novel form factors • more pilots • plus a mix of wired ethernet, wireless, and IR • rennovated offices to form a flexible shared space cutting across areas Philips

34. Where should Philips and UCB go together? Philips

35. GWY RMI PXY ST CF Constrained Personal Device & Untrusted Gateway NINJA Key Store Personal Appl sRMI Content Filter (pseudonym) Embeded Untrusted Client https DATEK (Trust Contract) Trusted Client The Internet https Philips

36. Example: Minimal Trader • Shared secret between user and keystore • keystore maps to service identity / authentication • Content filter transcodes to very concise info to pilot Philips

37. Uniform Access to Diverse Services NINJA Key Store Personal Appl sRMI GWY RMI PXY ST CF Trade-R-us Trade-R-us Content Filter (pseudonym) Embeded Untrusted Client https DATEK (Trust Contract) Trusted Client The Internet https Philips

38. Automated “Clients”, ... NINJA Key Store Personal Appl sRMI GWY RMI PXY ST CF BOT svc Trade-R-us Trade-R-us Content Filter (pseudonym) Embeded Untrusted Client https DATEK (Trust Contract) Trusted Client The Internet https Philips

39. Fall’98 Project Excerpts • E-Commerce and Security • Pay-Per-Use Services on the Palm Computing Platform (Mike Chen, Andrew Geweke) • Secure Email Infrastructure for PDAs (Hoon Kang, Rob von Behren) • SyncAnywhere - Secure Network HotSync (Mike Chen, Helen Wang) • Groupware • Kiretsu - Ninja Instant Messaging Service (Matt Welsh, Steve Gribble) • The MASH MediaPad - Shared Electronic Whiteboard for the PalmPilot (Yatin Chawathe) • NotePals - Lightweight Meeting Support Using PDAs (Richard Davis) • OSKI - Open Shared Kalendaring Infrastructure (Jason Hong, Brad Morrey, Mark Newman) • OS and Communications • PalmRouter - Networking Sporadically Connected Devices (Andras Ferencz, Robert Szewczyk) • Numerous Architecture Studies • Excellent UI Projects • Ink Chat, Nutrition/Excercise Tracker, Rendezvous - Meeting Scheduler Philips