420 likes | 609 Vues
Technical Presentation. What’s on the menu - Software Architecture Messyboard application Web program Database details Hardware Details Mimio Dashboard Audio system Social Geometry Interactive Devices Rollout Numbers Lessons Learned and Closing Thoughts.
E N D
Technical Presentation • What’s on the menu • - Software Architecture • Messyboard application • Web program • Database details • Hardware Details • Mimio • Dashboard • Audio system • Social Geometry • Interactive Devices • Rollout Numbers • Lessons Learned and Closing Thoughts
Database Database sign-in & reservation Desktop iPen/mimeo Mouse coords. files reservations login capture app desktop display text files coordinates keyboard Image TS app Image file Image file image screen shot Web Page Interface Brain file UL/DL files Messyboard text information TS App files Text post-its data structures Image TS App social geo display TWI mute information text Audio files? Text msgs lighting control clock Text post-its chat Web BARN Audio logging Social geo Peripheral TS Server audio information microphone cellphone devices
Messyboard! “Thinking Surface of the Future” • Simple ‘board’ to be used for communication and organization of ideas • Mouse-click based menu • Rectangle, circle, text box commands • Chat box bubble and chat tool • Arrows to link everything together • Save and load function • Toolbars at the bottom of the board (e.g. trash, circle, rectangle) • Pen stroke to ease writing • Easily accessible with Java Applets
Basic Structure (Written in Java, the base code is thanks to Adam Fass) • Server <–> Client structure means that there can be numerous clients looking at a single server. • Each client sends requests to the server to lock thinking surface elements (in order to make changes) and makes those changes on a local database. Requests are sent through as packets. • The client has a “local” copy and a “true” copy of the state of the board. The “true” copy is the state which has been validated by the server. The “local” copy is the state which is pending upon acknowledgement from the server. • The server handles all requests in a sequential fashion. Upon accepting an element lock request, the server sends an acknowledgement to the client that sent it, and broadcasts the change details it receives to the other clients. • Client receives Acknowledgement packet and sends the changes to the server. It then updates the “true” state and updates the “local” state to the true state. • If the client was denied the lock request, then it merely reverts the “local” state to the last known “true” state.
WebBARN! “As if you were actually in the Barn!” • Your key to logging in and reserving BARN space • A view of all you need to know going on in a BARN • Update applications allow for real-time view of presentations • Keep track of what’s on the Messyboard • Chat program allows for easy communication, private or public • Access to all files and presentation materials
Technical Insides • Chatter Program • Based off the Build-a-Chat Program • Allows for logging of messages • Allows for private chat • Highly configurable and written in Perl • Web Portal • Based off of Microsoft’s .NET architecture • Module based, can be easily customized • Built for scalability
Database Jfna9^8743!@$y5ba09v93$^949a04rya0b93yrma9w#83u[rabv8wgr#$awvyr&^*(*(naw93ghvbq4$^6tqcb2ey12yr)(**cb3&$68g4t9ac4hrcwb$^@jdh38t4bv0#%!2y3ma92jerc9a23yvr280((*yrcna9823urma2938yrh@$^nc827yraj0874hya9283yr235nca902hr308nx7@$^%ay2987a98m7yan2087ty098t7amtrhy20!$!@987tka29(4tujhma2984cha0(*&&&827tnh08&(c2^)(*)athq02amh#@!tm^q02a4x8h4t0a9m80dfhv14t414yb@$^93yvbt84tgns84&tus8(**&*&3049v8n305398)(*&y53874c5%$%mrja290384747#@^%19843ycjs39845n293a8ych7*&^)(yc0a24h&0aw5319j4uawertvj38974yq08k45q09ju0%$#)*#98c27!#$!#%y5q90827y50q2 $^@jdh38t4bv0#%!2y3ma92jerc9a23yvr280((*yrcna9823urma2938yrh@$^nc827yraj0874hya9283yr235nca902hr308nx7@$^%ay2987a98m7yan2087ty098t7amtrhy20!$!@987tka29(4tujhma2984cha0(*&&&827tnh08&(c2^)(*)athq02amh#@!tm^q02a4x8h4t0a9m80dfhv14t414yb@$
Database “You put your Files In, You take your Files Out, You put Files In, and you Shake it all about…” • Organizes and maintains all files used by the BARN • Can upload and download to the Database, before or after a meeting • All applications use the database as a transfer point • Post-meeting archiving transfers all active meeting files to a permanent database • Uses a special program to auto-transfer active files when meeting sign-off detected
File Structure c:/Meeting/ /CurrentFiles/ /Group1/ /Group2/ … TS.jpg /DataFiles/ /MeetingFiles/ Members.txt DT.jpg Blah.ppt /ChatLog/ /Sound/ /Attendance/ /TSFiles/ SG.jpg Blah2.doc FileNamebyDate.txt FileNamebyDate.mp3 FileNamebyDate.txt FileNamebyDate.tsf Login/group info … … … … … Key: Green = folders Yellow = files
Hardware Layout Internet Messy board protocols social geometry information Messyboard Host The Brain [Projections, web host, database] People Loc. Devices Projectors
Dashboard! “So much Control at your Fingertips” • Users ID-in • Restore existing group project workspace • Create a new Group • Room environmental controls • TWI, Mute buttons
Technical Insides • System Architecture • Vertical array of sensors creates interaction zones for the user • Stamp II Microprocessor monitors the sensors, applies protocols for the RFID • RFID behind faceplate at the bottom for ID reads • Communicates with Brain through custom VB application over 2 RS232 serial ports • Projected buttons are aligned with actual sensor arrays, combining the flexibility of a digital display with actual physical interaction
Capacitive-sensor Interaction zones Projector Serial 1 Custom protocol Stamp Serial 2 Brain RFID Reader VB Application Dashboard : Implementation
Mimio! “A picture is worth a thousand words.” • Mimio uses ultrasound technology to pinpoint pen locations • Each pen emits a different frequency allowing Mimio detector to differentiate between them • One time calibration process is required for each new environment • Ultrasound waves are emitted when pen circuit is complete and internal pressure buttons are activated by pressing pen tip to writing surface • Mimio detector has internal memory that is able to capture and store information until download to PC through USB port
How It Works • Uses ultra-sound technology. When the pen tip is pressed, it touches contacts inside the pen that enable ultra-sound waves be emitted • Each pen has different waves that allow the Mimio unit to differentiate between them • Calibration must be done for each pen, but only once • The Mimio unit can handle a blackboard space of 4x8 feet
Audio Devices! “Listen to the sound of my voice… you are getting sleepy….” • KLH 6-Piece Home Theater with 50-watt subwoofer • 2 way satellites for front, center and surround channels • Magnetically shielded • Kenwood 500-Watt A/V Receiver with Dolby Digital • 5.1 Channel Experience • Compression of frequency response • High-end base microphone captures the entire audio environment of the Barn without a need for individual wireless microphones • Audio Logging • Continuous recording throughout meeting for archiving • TWI button to mark important segments during meeting • Compresses into mp3 format for space efficiency
Technical Insides • Audio Logging • At the meeting start, forks a new process that tells the audio program to begin recording • The application is called Loop Recorder. It has built-in features such as scheduled recording and auto-compression • TWI button sends a signal to fork a new process and begin recording in a separate segment • Prevents redundant recording data • Microphone positioned at the ceiling corner to best capture room audio
Social Geometry! “Nerds of a feather flock together.” • In-Room social geometry • Makes use of the augmented reality toolkit • Digital Camera tracks unique visual markers • Markers map location and direction of each participant • X10 for environment control through automated handling of electronic devices based on the detected social geometry • Campus wide network to locate absent members via the wireless network • Members are located based on the access points they are logged into • Authorization is required by users since privacy is a major issue • Data and visualizations are logged during meetings
AR Toolkit • AR toolkit tracks markers of unique markers with no symmetry. • Social Geo then generates a JPEG representation. • Allows for interpretation of social geometry. • Allows for automated control of environment.
X10 • What is included? • ActiveHome PC kit – a PC interface that allows computerized control of electric devices. Commands can be sent through WinXP command line or Windows Messages • Wall Switch Module – control any wall switch with X10 • 4 Lamp Modules – control any electric lamp with dimming capabilities • Motion Sensor – know when there is activity in the room Motion Sensor Lamp Module Wall Switch PC Kit
Interactive Devices! “Set phasers to stun.” • RFID technology and AR Toolkit • RFID reader and tags used to identify people in the BARN • RFID tags can be placed covertly onto any ID card • Remote whiteboard control of the iPen is done by the Gyromouse • Gyromouse is a remote mouse with 3D control • Can program the Gyromouse to draw lines or highlight items • Receiver uses USB connection to the Brain • Integration of Gyromouse and Mimio Pen • Cut out unnecessary parts and combine the Gyromouse and Mimio Pen to make the iPen • Can edit the Whiteboard directly and remotely
RFID Structure • RFID systems use radio transmissions to send energy to a RFID Tag • RFID Tag emits a unique identification code back to a data collector reader • Reader is linked to the PC through a serial port
Conclusion Moo….
Lessons Learned • Organization and leaders tend to evolve • Engineers are from Mars, HCI are from Venus • Cross-pollination of groups makes for interesting benefits and extra chaos • There has to be a top-level decision maker and organizer • Communication is key in large groups. A “common list” of big issues and questions should be kept and maintained • It is important to adhere carefully to the timelines • Start on technical aspect earlier. Expect problems and delays • Get orders for components early. Expect them to ship everything LATE • Always have a Plan B, and sometimes a Plan C • Integration, integration, INTEGRATION • Don’t expect technical support to be helpful • The small things are what will get people to say “That’s cool!” • People will be discouraging. They might express doubts, they might laugh at you, they might outright tell you that you will fail. Succeed or not, take pride in the lessons learned and the work done • But when it does get finished, it feels GREAT
What We Would Add in BARN v. 2.0 • Add some entertainment consoles for “free-time” gaming during the lunch hour and alter the iPen case to look like a gun • Add a karaoke machine and get some wireless microphones • Add a laser gun option to the iPen (with stun mode) • Change the door so that it slides open in a very futuristic/slick manner • Add extra chairs for watching movies in the Barn (hey, it’s got great surround sound) • Wear those nifty social geometry hats ALL THE TIME • Add a fridge next to the Dashboard. ID in for your free drinks!