Toshio Iwai

Toshio Iwai (岩井 俊雄, Iwai Toshio, born 1962) is a Japanese interactive media and installation artist who has also created a number of commercial video games. In addition he has worked in television, music performance, museum design and digital musical instrument design.

Iwai was born in 1962 in Kira, Aichi, Japan. As a child, he spent time creating flip book-style animations in the corner of text books and making motor-driven mechanical toys, since these were the only technologies available to him.^[1] In 1981 Iwai matriculated in the Fine Arts Department at the University of Tsukuba, studying Plastic Art and Mixed Media.^[2] Influenced by the work of Norman McLaren,^[3] he began producing installation art that combined pre-cinema animation techniques (the phenakistoscope and the zoetrope) with modern methods of image capture and creation (photocopiers, video cameras and computer graphics) and of stroboscopic lighting (video monitors, video projectors and LEDs).^[3][4] His 1985 installation Time Stratum won the Gold prize at the High Technology Art Exhibition '85, held in Shibuya Seibu, Tokyo.^[1] Time Stratum II was awarded the Grand Prize at the 17th Contemporary Japanese Art Exhibition, Meguro Art Museum, Tokyo.^[1] In 1987 Iwai graduated from the University of Tsukuba with a master's degree in Plastic Art and Mixed Media.^[1] In the same year, Iwai designed his first published videogame, Otocky, in association with ASCII Corporation.^[1]

In 1991-92 Iwai was an Artist-in-Residence at the Exploratorium in San Francisco, California, where he created two exhibits that are now part of the museum's permanent collection, Well of Lights (1992) and Music Insects (1992).^[1] Music Insects became the foundation for his unpublished video game Sound Fantasy.^[4]

This period of work culminated in Another Time, Another Space (1993), an interactive installation devised for Antwerp Centraal Station, Belgium. The installation used 15 video cameras to capture live images of visitors to the station; 30 computers manipulated the video feeds output to 30 video monitors in real-time, introducing visual effects such as time-lapse delays, slow-motion effects and time compression.^[3]

From 1994 to 1995 Iwai was an Artist-in-Residence at the ZKM (Center for Art and Media) in Karlsruhe, Germany.^[1] Around this time his work became increasingly focused on the relationship between sound and image, using interactivity, gestural interface and generative, interactive and aleatoric music. These interests are expressed in three key installation works, Resonance of 4, Piano - As Image Media and Composition on the Table.

Resonance of 4 (1994) is a collaborative music-creation artwork consisting of four adjacent stations, each comprising a small podium bearing a computer mouse, a 16-by-16 grid projected onto the floor from a video projector above, and a cursor connected to the mouse. Dots can be placed in each of the grid's cells by clicking with the mouse. A synchronized bar sweeps across all the grids simultaneously, triggering musical notes wherever a dot has been placed. Sound is relayed over a loudspeaker system, and the notes from all four stations are superimposed, although each station has its own musical tone. This work was shown at the Serious Games exhibition at the Laing Art Gallery, Newcastle in 1996 and 1997 and at the Barbican Arts Centre, London in 1997.^[5]

In Piano - As Image Media (1995), audience members operate a trackball to draw lighted dots on a grid projected onto a sheet of fabric that leads to the keyboard of a small grand piano. The dots move towards the piano keyboard, and as they come close to it they accelerate and strike a key. The piano, controlled by a computer, plays the note corresponding to the 'struck' key, and at the same time, a computer-generated graphical figure appears on another sheet of fabric suspended above the piano, appearing to fly out of the piano and up into the air.^[6] This work, along with Composition on the Table, was shown in the Play Zone at the Millennium Dome in London, 1999–2000.^[7] It was also one of the works used in Iwai's performance collaboration with Ryuichi Sakamoto, Music Plays Images x Images Play Music.^[8]

Composition on the Table (1998/99) comprises four white tables bearing physical interface components: switches, dials, and turntables. Computer graphics images are projected onto the tables from ceiling-mounted video projectors, and loudspeakers are present. As the audience manipulates the interface elements, graphical and audio changes take place in a way that is intimately connected to the audience's input. The objective of this work was to create a mixed reality environment where multiple participants could create visuals and music together.^[9] Elements of this work are recognizable in Iwai's Nintendo DS videogame Electroplankton. The piece was presented as part of the Art Gallery at SIGGRAPH'99, Los Angeles.^[10]

From 1996 to 1998 Iwai was the first Artist in Residence at IAMAS in Ōgaki, Japan. In 1997 he had a major retrospective exhibition at the NTT InterCommunication Center in Tokyo. From 1998 to 2001 he was Artist in Residence at Mixed Reality Systems Laboratory in Yokohama, Japan.^[7]

Iwai is the first internationally recognized gallery artist also to have led the creation of several successful commercial video game projects. This cross-disciplinary ability typifies Iwai's career.^[11]

Iwai's first game was the musical shoot 'em up Otocky (1987), produced in association with ASCII Corporation for the Famicom Disk System, an add-on for the NES available only in Japan.^[12] The game is notable for being the first to include creative/procedural generative music. Through association with different game mechanics and player actions, the game plays quantized-in-time musical notes in a variety of digitally synthesized voices. Otocky is a precursor of Rez, Tetsuya Mizuguchi's 2002 Dreamcast and PlayStation 2 game exploring similar themes of player action and musical evolution.^[13]

Later, leveraging work done on the 1993 installation art project Music Insects at San Francisco's Exploratorium, Iwai created another sound-based game in 1994 for the Super Famicom system called Sound Fantasy.^[11] In the game animated insects traverse a grid containing colored dots. As the insects pass over the dots, musical scales, sounds, and graphical effects are triggered. The player can select colors from a palette and paint on the grid, triggering new results and changing the insects' direction, improvising a visual music performance.^[14] However, the game's release was cancelled and it was eventually converted into the PC title SimTunes, published by Maxis, a division of Electronic Arts.^[1][15]

In 2000, Iwai worked to publish Bikkuri Mouse (びっくりマウス), a collaborative drawing game that became the PlayStation 2's first mouse-compatible title.^[16] This was followed in 2001 by the limited-edition release of a simple step sequencer, Tenori-on (テノリオン), for the WonderSwan. This non-game would be the precursor to the more advanced 2005 version released together with Yamaha.^[17]

Iwai's acclaimed Electroplankton for the Nintendo DS was released in Japan in 2005 and in Europe and North America in 2006.^[18] A suite of ten different interactive music and audio toys themed around cartoon plankton and using the novel touchscreen and microphone interface features of the Nintendo DS, Electroplankton draws heavily on Iwai's earlier work, including Composition on the Table.^[19]

• Otocky (1987; Famicom Disk System)
• Sound Fantasy (canceled; Super Famicom)
• SimTunes (1996, PC)
• Bikkuri Mouse (びっくりマウス) (2000, PlayStation 2)
• Tenori-on (テノリオン) (2001, WonderSwan)
• Electroplankton (2005, Nintendo DS)

In 1990 Iwai's solo show Machine for Trinity exhibited at the Laforet Museum in Tokyo; some of the works shown there demonstrated that computer graphics could be generated and combined in real-time with live action images. The TV director Shinji Fukuhara visited the exhibition and shortly afterward contracted Iwai to create concepts and a virtual set for a weekly half-hour science news show Einstein TV (Fuji TV, 1990–91). Created on the Amiga, the virtual set included GUI-like pop-up menus.^[1][3][11]

This led to more work with Fuji TV the following year in the development of the daily interactive children's show Ugo Ugo Lhuga (1992–94).^[1][11][20] Influenced by Pee-wee's Playhouse, which Iwai had seen during his tenure at the Exploratorium in the United States, the show was imaginative and irreverent and featured talking TVs, a tomato that gave advice to call-in guests, a robot named Robot that asked riddles and broke down when given silly answers, anthropomorphic faeces named Professor Poo Poo, and a cubo-surrealist artist named Surr.^[11] Ugo Ugo Lhuga is 'go-go girls' anagrammed in Japanese.^[11]

A central concept of the show was that two live-action main characters would appear to interact with the sets and characters of a virtual world. Instead of generating the virtual characters first and orchestrating the actions of the live-action cast to fit pre-rendered imagery, the characters were generated and composited in real-time with minimal post-production. At first the shows were pre-recorded, but after the first six months cast and crew were confident enough to perform live.^[11]

To enhance the live-broadcast appeal of the show, Iwai helped devise a call-in sumo match. Children from across Japan sent in drawings of sumo wrestlers on postcards, which Iwai scanned. During the program the audience called in and, watching their televisions at home, shouted into the telephone; the louder they shouted the stronger their sumo wrestler became, finally pushing the opposing wrestler out of the dohyō.^[3][11]

In 1996 and 1997, Iwai collaborated with musician and composer Ryuichi Sakamoto to create the multimedia stage performance Music Plays Images x Images Play Music. The performance included use of Iwai's installation Piano - As Image Media and a version of Resonance of 4 adapted to use a chessboard-like interface.^[8]

In June 2004, Iwai gave a prestigious invited public lecture at the 4th International Conference on New Interfaces for Musical Expression, held in Hamamatsu, Japan.^[21]

Created during his time as an Artist-in-Residence at the Exploratorium in San Francisco, California, Iwai's works Well of Lights (1992)^[22] and Music Insects (1992) are part of the Exploratorium's permanent collection.

Iwai contributed to the construction of the Bouncing Totoro 3-dimensional zoetrope at the Ghibli Museum in Mitaka, Tokyo. He helped conceive an LED strobe device to be used in place of conventional strobe lights, softening the lighting as a result. He also made a layout plan for the positioning of the figures using a computer.^[23]

A current^[when?] project of Iwai's, in collaboration with Yamaha Corporation, is the creation of a new interactive digital musical instrument. Called Tenori-on, the instrument is a sixteen-by-sixteen array of illuminated LED switches which can be activated in a variety of ways to create a changing musical soundscape.^[24]

Tenori-on was showcased throughout its development through stage and conference performances.^[14][25] It went on sale in the United Kingdom on 4 September 2007.^[26]

• Norman McLaren
• Thomas Wilfred's Lumia
• Visual music
  • Color organ
  • Mary Hallock-Greenewalt
  • Oskar Fischinger
• Aleatoric music
• Generative music
  • Brian Eno
• Interactive music
• Conway's game of life
• Pong
• Open-ended Gameplay
  • Will Wright

"I've been longing for the feeling of my childhood in the digital world and that is why I've been sticking to relations among media, machine(s), and people through interactive works."^[1]

"All of his work is sincere, and all consists of equal doses of seriousness and play, pathos and humor, intricacy and simplicity." - Azby Brown^[11]

Installations

• Time Stratum IV 1990
• Another Time, Another Space NHK version 1994^[3]
• Resonance of 4 1994
• Piano - As Image Media 1995
• Composition on the Table 1998/99
• Shanghai World Financial Center, Observation Deck 2008

Permanent Exhibits

• Well of Lights Exploratorium, 1992
• Music Insects Exploratorium, 1992
• Another Time, Another Space, National Museum of Photography, Film and Television (now the National Media Museum), Bradford, UK 1999^[7]

Videogames

• Otocky 1986
• SimTunes 1996
• Electroplankton 2005

Television

• Einstein TV 1990-91
• Ugo Ugo Lhuga 1992-94

Performance

• Music Plays Images x Images Play Music 1996-97

Digital Musical Instrument Design

• Tenori-on

Books, magazines and printed matters

• Artist, Designer and Director SCAN (Rikuyosha, 2000)
• 100 Floors House (Kaiseisha, 2008)
• Docchiga!? Books (Books KInokuniya, 2006)

Others

• Docchi Ga Hen?' poster (Tokyu Railways, 2007–2008)

• Yamaha Tenori-on Official Website
• Toshio Iwai at IMDb
• Insects and pianos: Toshio Iwai's talk at Futuresonic (July 20, 2006) on samurai.fm
• Toshio Iwai Works