1 / 43

Portland Cyber Theatre

Portland Cyber Theatre. Marek Perkowski. Part 1. Graduate Seminar, Friday, May 7, 2004. Portland Cyber Theatre. Funded by Korea Institute of Science and Technology, Daejeon, Republic of Korea and Intel Corporation, Hillsboro. Contributors.

gazit
Télécharger la présentation

Portland Cyber Theatre

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Portland Cyber Theatre Marek Perkowski Part 1 Graduate Seminar, Friday, May 7, 2004

  2. Portland Cyber Theatre Funded by Korea Institute of Science and Technology, Daejeon, Republic of Korea and Intel Corporation, Hillsboro Contributors Martin Lukac, Jacob Biamonte, Stefan Gebauer, Robert Klug, Myron Machado, Normen Giesecke, Atsumu Iseno, Tsutomu Sasao, Michele Folgheraiter, Uland Wong, Mikhail Pivtoraiko, Jeff Morris, Chris Motch, Nicola Sian Rees, Ping Hang Cheung, Randall Borck, Ray Schmelzer, Steve Mbah,Yu Xia, Akashdeep Aulakh, Tyler Nguyen, Jeff Allen, Kevin Xue, Kevin Chen, Ben Xue

  3. Or more scientifically A robot with many bodies, many personalities, quantum, fuzzy and logic brains or how to Use of Machine Learning based on Constructive Induction in Dialogs with Robotic Heads

  4. Talking Robots • Many talking toys exist, but they are still very primitive • Actors for robot theatre, agents for advertisement, education and entertainment. • Designing inexpensive natural size humanoid caricature and realistic robot heads Dog.com from Japan We concentrate on Machine Learning techniques used to teach robots behaviors, natural language dialogs and facial gestures. Work in progress

  5. Robot with a Personality? • Future robots will interact closely with non-sophisticated users, children and elderly, so the question arises, how they should look like? • If human face for a robot, then what kind of a face? • Handsome or average, realistic or simplified, normal size or enlarged? • The famous example of a robot head • is Kismet from MIT. • Why is Kismet so successful? • We believe that a robot that will interact with humans should have some kind of “personality” and Kismet so far is the only robot with “personality”.

  6. Professor Perky – the robot built by us in Japan

  7. A robot of Martin Lukac: Cynthi-A sings

  8. Robot face should be friendly and funny The Muppets of Jim Henson are hard to match examples of puppet artistry and animation perfection. We are interested in robot’s personality as expressed by its: • behavior, • facial gestures, • emotions, • learned speech patterns.

  9. Behavior, Dialog and Learning • Robot activity as a mapping of the sensed environment and internal states to behaviors and new internal states (emotions, energy levels, etc). • Our goal is to uniformly integrate verbal and non-verbal robot behaviors. • Words communicate only about 35 % of the information transmitted from a sender to a receiver in a human-to-human communication. • The remaining information is included in para-language. • Emotions, thoughts, decision and intentions of a speaker can be recognized earlier than they are verbalized.

  10. Robot Head Construction Furby head with new control Jonas We animate various kinds of humanoid heads with from 4 to 20 DOF, looking for comical and entertaining values.

  11. Robot Head Construction Skeleton Alien We use inexpensive servos from Hitec and Futaba, plastic, playwood and aluminum. The robots are either PC-interfaced, use simple micro-controllers such as Basic Stamp, or are radio controlled from a PC or by the user.

  12. Technical Construction Details Marvin the Crazy Robot Adam

  13. BUG (Big Ugly Robot) Max Image processing and pattern recognition uses software developed at PSU, CMU and Intel (public domain software available on WWW). Software is in Visual C++, Visual Basic, Lisp and Prolog.

  14. Visual Feedback and Learning based on Constructive Induction

  15. Mister Butcher Latex skin from Hollywood 4 degree of freedom neck

  16. Virginia Woolf heads equipped with microphones, USB cameras, sonars and CDS light sensors

  17. Professor Perky Professor Perky with automated speech recognition (ASR) and text-to-speech (TTS) capabilities • We compared several commercial speech systems from Microsoft, Sensory and Fonix. • Based on experiences in highly noisy environments and with a variety of speakers, we selected Fonix for both ASR and TTS for Professor Perky and Maria robots. • We use microphone array from Andrea Electronics. 1 dollar latex skin from China

  18. Maria 20 DOF

  19. location of head servos Construction details of Maria skull • location of controlling rods • location of remote servos Custom designed skin

  20. Animation of eyes and eyelids

  21. Frown of eyes and eyelids

  22. Smile and Jaw Action

  23. High School students help us to build robot heads

  24. The newest robot of Jake Biamonte and Jeff Allen has many sensors on the face

  25. The back of the new robot head

  26. The hands do not move. The new, movelable hands are under design by Michele Folgheraiter, our collaborator from Italy.

  27. The new robot is mobile. The new robot is controlled by a micro-controlled and a laptop. It will move randomly and talk about PSU greatness. See demo soon.

  28. Laptop and its screen

  29. I am friendly and beautiful

  30. I can turn my body left and right towards the speaker or away from him

  31. Figure 4: Latex skin on the robotic head Figure 2: Advanced construction of the robotic head, with servos inside the head, added are eyes and jaws. Also can be seen wires for future movements of cheeks, lips, eyebrows, chins and front. Figure 1: Empty skull of the robot Figure 3: Opened back head of the robot showing implacement of servos controlling the lower jaw, eyes, eye brows, cheeks and the chin.

  32. New neck mechanism constructed by Jake and two Jeffs.

  33. New neck mechanism constructed by Jake and two Jeffs.

  34. Hahoe Robots On a grant from Korea Institute of Advanced Studies we are building a theatre of traditional korean masks

  35. Hahoe Robots

  36. Hahoe Robots

  37. The Hahoe Theatre has 12 robots, automatically controlled stage, lights and smoke generators. Help needed to design more heads and program scripts.

  38. The Hahoe robots will sing and dance. A long neck and springs.

  39. Mechanisms of Braitenberg’s Vehicles for Quantum vehicles explained next

  40. Please wait for change of slides file to Part 2

More Related