210 likes | 351 Vues
This thesis presents the design and implementation of LBFE-S, a Location-Based File Exchange system controlled through speech recognition. The project addresses the problem of file sharing in specific locations, leveraging speech commands for seamless interactions. The document outlines the architecture, server-client communication, data sources, and user authentication required for the system's functionality. It also showcases the speech recognizer and synthesizer components, which facilitate user commands. Thorough testing revealed satisfactory performance, and the thesis concludes with future work recommendations, including multimedia file support.
E N D
Location Based File Exchange controlled By Speech Location Based File Exchange Controlled By Speech (LBFE-S) Final Project (Master Thesis) By Mohammed Marouf marouf@itu.dk Supervisors John A. Sørensen & Michael Lund Project period: 1stSeptember 2003 - 31stMay 2004 Mohammed Marouf
Location Based File Exchange controlled By Speech • Schedule • ProblemStatement • LBFE-S Presentation • LBFE-S Design and Implementation • Test • Conclusion and Future Work • Demo • Questions Mohammed Marouf
Location Based File Exchange controlled By Speech • Problem Statement • Services • Informing Service • File Uploading / Downloading Service Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Presentation Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Presentation Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Design and Implementation • LBFE-S Architecture • Client/Server Communication • LBFE-S Data Sources • LBFE-S Server Design • LBFE-S Client Design • Sequence Diagram Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Architecture Service one Data Source Mohammed Marouf
Location Based File Exchange controlled By Speech • Client/Server Communication (1-3) • LBFE-S Internet protocol stack Mohammed Marouf
Located+ Position+ course &File names Location Based File Exchange controlled By Speech • Client/Server Communication (2-3) • LBFE-S Protocol Mohammed Marouf
Location Based File Exchange controlled By Speech • Client/Server Communication (3-3) Time LBFE-S Client LBFE-S Server Threeway Handshake Welcome Socket Client Socket Connection Socket Bytes Mohammed Marouf
Location Based File Exchange controlled By Speech • Threading LBFE-S Request CLient LBFE -S - Request CLient LBFE- -S CLient t s e u q e R Port Number A c c e p t 8000 A c cept Thread A c c Server e p Thread t Thread Position Server DateTime.java Information Files LBFE-S Server Side Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Data sources • Users.XML • Data.XML <LBFE-S> <Info> <Room> 4.14 </Room> <Day> Monday </Day> <Month> October </Month> <Date> 27 </Date> <TimeFrom> 9 </TimeFrom> <TimeTo> 12 </TimeTo> <Course> java </Course> <FileName> brixtofte.txt </FileName> </Info> … </LBFE-S> <Users> <User> <UserName> marouf</UserName> <PassWord> marouf</PassWord> </User> … </Users> Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Server Design • Accessing the data sources • Authenticate users • Position calculation If Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Client design • Speech Recognizer • Speech Synthesizer Mohammed Marouf
Location Based File Exchange controlled By Speech • The Speech Recognizer (1 of 2) • The computer listens to the user speech, determines what is said and translates it into understandable format for the computer. 1. Speaker Dependent/Independent 2. Vocabulary size • Rule Grammar grammar javax.speech.demo; Header • public <sentence> = Submit | Read me | Ok | Exit Body Mohammed Marouf
Location Based File Exchange controlled By Speech • The Speech Recognizer (2 of 2) 3. Speech Recognizer classes • Isolated words • Connected words • Continuous speech • Spontaneous speech 4 . Quiet/Noisy environment Mohammed Marouf
Location Based File Exchange controlled By Speech • The Speech Synthesizer • Computer can speak • JSML Mohammed Marouf
Location Based File Exchange controlled By Speech • LBFE-S Sequence diagram Position Server Status+ Position + Activity name+ File name Mohammed Marouf
Location Based File Exchange controlled By Speech • Test LBFE-S needs Success Failure Acceptance Test System requirement Success Failure Integration Test System analysis Success Failure Unit Test System Design Success Writing the code Mohammed Marouf
Location Based File Exchange controlled By Speech • Conclusion • The accuracy of the EPE can affect the appliaction • The accuracy of the speech recognizer was acceptable • The results of the system were satisfactory • Future work • LBFE-S is easy to extent • Upload and download audio and video files • Run LBFE-S on PDA • Integrate LBFE-S with other systems Mohammed Marouf
Location Based File Exchange controlled By Speech Demo Questions Thanks Mohammed Marouf