WHY FLASHLIGHT Flashlight torches are cheap, robust, familiar and fun and so make interesting devices upon which to base interaction technologies. Computer vision software has been developed that can recognise and distinguish between different flashlight beams and these can be used to activate digital media including audio, video or special effects. The technology appears to ’magically bring to life’ objects and areas of the environment merely by shining a torch on them and has been used successfully to enhance visitor attractions such as museum exhibits and displays.
THE PROGRAMMED THAT CAN BE USED
The Enlighten interactive flashlights system
Flashlights are excellent tools for exploration and discovery, particularly in darkened environments, and the pools of light they cast focus attention and provide immediate topics for discussion. They are readily available in a variety of physical forms (sizes, shapes weights, powers and designs) and mountings (including handheld, head-mounted, stand mounted and vehicle mounted). They are also relatively safe, in terms of being shone into eyes and onto delicate surfaces. Enlighten is a novel interaction system that uses ordinary flashlight torches to explore and interact with displays and objects in the environment. The user simply shines an ordinary torch over the surface of interest. When the torch beam is positioned over one of a set of pre-defined targets, the system recognises the flashlight and triggers the appropriate system response (Benford et al. 2004). Responses can include any computer-driven effect such as playing an audio recording or video sequence, switching on a machine or triggering a special effect.
A key advantage of the system is that there is nothing special about the flashlights or the interaction surface used and there is no need to attach any sensors, transmitters or other devices to the surface. Enlighten uses computer vision techniques to identify and respond to different flashlight beams. This means that the system is portable and can be positioned in almost any environment. All that is needed is a standard desktop PC or laptop, Enlighten software, a standard web-cam and suitable flashlight torches (Figure 1). Use of standard equipment ensures that the system is affordable and readily available. The main constraint that affects Enlighten is lighting. The computer vision techniques underpinning Enlighten require the local illumination to be fixed, or vary only slowly. The technology may not be suitable for some environments, which have very bright or highly variable lighting.
Enlighten also requires space to mount video cameras so that they can get a sufficiently wide and interrupted view of the surface of interest. To date, the most common use of Enlighten has been to trigger audio responses, and the current version of the software reflects this. Enlighten consists of two key components: a configuration system for interactively defining targets and flashlight torches and associating them with sound files, and a run-time system that detects and tracks flashlight beams and triggers the appropriate sound file whenever one hits a target. Configuration begins once the camera is in position. A familiar and simple graphical user interface is used to set up configuration of an interactive experience. The main control panel allows access to different modes of configuration including camera selection, target creation, sound selection and torch training (Figure 2).
A user can create target zones in the visual scene by simply ’drawing’ boxes over image that the camera sees. These target zones can be repositioned, resized or removed using standard cursor click and drag techniques. In sound selection mode, the user clicks on a target zone to open the ’sound selector’ window specific to that target zone (Figure 3). Sound files can then be attached to the target zone using standard drop-down menus. Once the targets are defined, the system is trained to recognise the torches to be used. The user simply plays each torch in turn over the surface while Enlighten extracts and stores a description of up to 10 different torch beams. Torch 1 is used to activate sound 1 assigned to each target, with subsequent torches activating subsequent sounds/audio files accordingly.
Figure 4 shows a pair of torches being used to interact with a poster showing the planets of our solar system (Green et al. 2004). Figure 5 shows the two flashlight beams extracted from the image sequence. Enlighten detects, describes and recognises the individual torch beams (labelled as Class 0 and Class 2). In this demonstration system torch 0 triggers children’s spoken descriptions of the planets, while torch 1 triggers samples from Holzt’s PlanetsSuite. Key features of Enlighten are that it: - Is easy to use: Enlighten is very easy to learn and simple to use - Is child friendly: Flashlights are especially appealing to children - Is entertaining: Enlighten creates magical experiences in which everyday flashlights bring ordinary surfaces to life - Is personalised: Different flashlights can trigger different responses, providing personalised experiences for different users - Supports exploration and discovery: Flashlights offer the ideal means to explore dark areas. Shine a flashlight over a surface to reveal specific features and activate multi-media explanations and information about these features -Supports shared interaction: Several flashlights can be used together providing an interaction experience, which can be shared by groups. Different responses may be triggered by each flashlight, providing a montage of effects to be explored collaboratively Enlighten has been installed in a variety of situations. An early version was used to allow children to interact with projected graphics within a StoryTent (Green et al. 2001, see Figure 6). In the first large-scale public trial visitors to the caves beneath Nottingham Castle used Enlighten to access audio clips describing the history behind key features of King David’s Dungeon (Ghali et al. 2003, see Figure 7). Approximately 150 visitors used the system over a two-day period. Lessons learned from these installations led to technical improvements to the system, which was then used in interactive storytelling sessions with groups of 4 - 7 year old children and a professional storyteller at the 2004 Nottinghamshire Show (Reeves et al. 2006). Enlighten has recently been commercialised, and a number of installations are currently underway in the museums and heritage sector (www.visibleinteractions.com).How can make flashlight work with sound:
Figure 8 Mapping physical targets to media objects
The model in Figure 8 is a comparatively simple illustration of the most common use of Enlighten to date:
using flashlights as a direct control interface to activate pre-recorded audio files. However, the system is more flexible than this and is also capable of varying responses over time. For example, Enlighten can be configured such that target N only responds to torch 1 after torch 2 has accessed target M. Alternatively, target K may play audio clip X the first time it is accessed by torch 3, but video clip Y thereafter.
Reference:
http://www.icdvrat.reading.ac.uk/2006/ArtAbilitation/Proceedings_Complete/Cobb.pdf
Here I have found a similar concept to our idea, it does not use any flash light but it does detect light and sound will be produce.HIROSHI MATOBA [JAPAN]
INSTALLATION "DENKI DOMINO"
INSTALLATION "DENKI DOMINO" DENKI DOMINO is a new composition system for visual and audio sequences.
"DENKI ("d‹C)" means "electric". DENKI DOMINO is small boxes implemented LEDs,light detector, micro computer, and small speaker. Each DOMINO reacts to the light. When DOMINO receives the light, it makes a small sound from itself and turn on its led light. Each DOMINO is just a box which make a sound and light, but when we put it like a "domino toppling", the sequence of sound and light happen to be generated. In addition, we can make a musical loop by putting DOMINO as circular layout. DENKI DOMINO enabled us to grab the sound by hand, put or pile
on floor like a musical score and play in real time at real space.
BIO Hiroshi Matoba was born in Japan in 1983. After undergraduate course of product design, now he is studying sound art and programming at the Kyushu university and ADCDU. His interest is focused on making a new sequence system for music. Recently he try to make a original circular software and hardware sequencer instead of throwing away a traditional liner sequence system.
These system make his original audio and visual performance and installation.
Transmediale award 2009 [Nominated], International festival of electronic art 404 [SELECTED], BACA-JA 2008 [Network Art: Grand Prix], Asia Digital Art Award 2008 [Interactive art: Finalist Prizes].
VIDEO:
http://vimeo.com/5583815reference: http://www.404festival.com/eng/agosto09.htm