The FlatWorld project is an immersive virtual reality environment in which users can walk and run freely among simulated rooms, buildings, and streets. FlatWorld uses a system of "digital flats," large rear-projection screens that employ digital graphics to depict a room's interior, a view to the outside, or a building's exterior. By adding physical props to the flats, FlatWorld becomes a "mixed reality" environment where users interact with both the physical and virtual worlds seamlessly.
Digital flats can be readily assembled in any open space to simulate multiple situations in a variety of geographic locations. The scenes on the digital flats can represent a real world setting, such as a city in the Middle East, depicting actual city buildings in their correct locations.
The FlatWorld display system also integrates immersive audio and 4D sensory features with the visual displays. The FlatWorld Simulation Control Architecture software enables environment designers to synchronize sounds and effects with real-time graphics, as well as respond to user interactions with physical props (such as opening a door or window). Sensory immersion in a scene can further be augmented by strobe lighting and tactile floor speakers which simulate the flashes and vibrations of explosions or a lightning storm. FlatWorld provides a genesis point for a training system that participants could easily walk through unencumbered by head mount displays, and incorporates life-size projected displays with physical props and real-time, 3D graphics.
Video
Download Video:
MP4,
WebM,
Ogg
HTML5 Video Player by VideoJS
Two minutes long preshow video, played for visitors before FlatWorld tour.
Download Video:
MP4,
WebM,
Ogg
HTML5 Video Player by VideoJS
Jarrell Pair gives a FlatWorld tour in 2006.
Download Video:
MP4,
WebM,
Ogg
HTML5 Video Player by VideoJS
Flatworld as in 2008: projection on regular wall (bullet holes), helicopter shadow on the floor, body tracking computer vision system.
Publications
- Anton Treskunov, Jarrell Pair (2006) Projector-Camera Systems For Immersive Training Proceedings of the 25th Army Science Conference Orlando, FL bibtex pdf
- Jarrell Pair, Anton Treskunov, Diane Piepol (2005) Leveraging Hollywood Set Design Techniques to Enhance Ad Hoc Immersive Display Systems bibtex pdf
- Anton Treskunov, Jarrell Pair (2005) Integrating an Open Source Game Engine Into a Virtual Reality Application Framework Institute for Creative Technologies technical report bibtex pdf
- Anton Treskunov, Jarrell Pair, Bill Swartout (2004) The Flatworld Simulation Control Architecture (FSCA): A Framework for Scalable Immersive Visualization Systems Poster, 24th Army Science Conference, Orlando bibtex
Awards
- Best paper award : 24th Army Science Conference, Orlando, Fl 2004.