1 2
 
 
  • SUB CATEGORY :
    INNOVATION IN TECHNOLOGY
  • COMPANY ENTERING :
    DENTSU INC., TOKYO
  • TITLE :
    ALL PLAYERS TOOL LAB.
  • BRAND :
    WITH ALS
  • ADVERTISER :
    WITH ALS
  • AGENCY :
    DENTSU INC., TOKYO
  • DIRECTOR :
    SHIGERU MAKINO
  • CREATIVE DIRECTOR :
    NAOKI TANAKA
  • ART DIRECTOR :
    YUSUKE KOYANAGI
  • COPYWRITER :
    TINA TODA
  • CREATIVE TECHNOLOGIST :
    SHINTARO MURAKAMI
  • EXECUTIVE PRODUCER :
    KOHEI AI
  • AGENCY PRODUCER :
    MIYUKI FUJISHIMA
  • PRODUCE :
    KIYOSHI RUNZE/YUZURU HASEGAWA/KENJIRO MATSUO
  • TECHNICAL DIRECTOR :
    YUTO KUMON/JUNICHI AKAGAWA
  • DESIGNER :
    JIRO WATANABE
  • STAGE DIRECTOR :
    WORRY KINOSHITA
  • PLANNER :
    JUYOUNG YUN
  • MEDIA AGENCY :
    DENTSU INC., TOKYO
  • PR AGENCY :
    DENTSU INC., TOKYO
  • FILM PRODUCTION COMPANY :
    P.I.C.S. CO., LTD., TOKYO/WOW INC., TOKYO/
    DENTSU CREATIVE CUBE INC., TOKYO
  • DIRECTOR :
    YUSUKE TAKUNO (P.I.C.S)/SHOTA OGA(WOW)
  • FILM PRODUCER :
    SOHEI HARADA (P.I.C.S)/YASUAKI MATSTUI (WOW)/
    SHINYA INAGAWA (DENTSU CREATIVE CUBE)
  • PROJECT MANAGER & MUSIC DIRECTOR :
    YOICHIRO HATAKEYAMA
  • ENGINEER :
    TSUYOSHI OTABE
  • ART PRODUCER :
    YOSHIE KRIS
  • COMPOSER :
    PONE
  • SPECIAL EFFECTS COMPANY :
    WOW INC., TOKYO
  • SOUND PRODUCTION COMPANY :
    Y'SCONNECTION, TOKYO
  • SOUND PRODUCER :
    HIROYUKI NASU
  • MUSIC COMPOSER :
    MASATANE MUTO/PONE
  • CAMPAIGN SUMMARY :
    【Background】
    There are many people in the world who have not be players due to their disabilities. But just like the typewriter was invented by a blind friend‘s perspective, those who could not be players due to disabilities will be a force for leading new ideas and the world’s innovation.

    Our challenge is to shift the social stereotype that disability leads to give up to be a player, by utilizing a technology and creativity.

    【Idea】
    Due to our mission, we launched a platform for developing new expression tools with people who have disabilities – ALL PLAYERS TOOL LAB.
    As first project, we worked with two ALS artists to develop a music instrument that utilizes the possibilities of gaze input.

    【Tool Development】
    A total of three instruments were developed: including a tool that enables remote live music performance and make a new tone expression based on eye gaze input.
    -EYE XY PAD : Free Viewpoint Performance Device.
    The eye movements facilitate the intuitive performance of real-time effects manipulation and synthesizers.
    -EYE MIDI PAD : Real-time track operation UI.
    Sound source playback just like a MIDI controller, but with eyesight input.
    -EYE SHOOTING PAD : Remote performance device for latency networks.
    A UI that allows for synchronization during online performance, even if latency occurs.

    【Online live performance】
    World's first remote live performance by ALS musicians using eye gaze input was held in a total of three countries.
    -Cannes, France (24th June.) / Istanbul, Turkey (9th, Nov.) / Budapest, Hungary (10th, Nov.)
  • THE BRIEF :
    There are many people in the world who have not be players due to their disabilities or other reasons. We want to change these social stereotypes and ancient rules by a utilizing technology. Through this project, we will prove that disability would be another ability.

    To achieve this goal, we focused on creating innovations for everyone, not just those with disabilities. We created innovative instruments from the unique perspective of people with disabilities, while at the same time making future expandability, customizability, and scalability key points of development to ensure that the tool would be valuable to everyone in the world.
  • THE STRATEGY :
    In this project, we have co-developed a tool with ALS musicians MASA and PONE.
    *ALS (Amyotrophic Lateral Sclerosis) - an incurable disease that gradually reduces muscle strength and inability to move of one’s own volition

    For people living with ALS and other conditions that cause paralysis of the limbs, operating computer applications using eye gaze is a primary tool for their activities.

    However, such tools require gazing for a few seconds instead of clicking and require eye movement to operate detailed buttons that are designed for normal people to operate with a mouse, making it difficult to use them in a setting that requires real-time performance, such as a live music performance.

    In addition, ALS patients have had difficulty traveling abroad due to their health status and the high cost of transportation.

    Therefore, together with ALS musicians MASA and PONE, we developed a brand-new tool and system that enables live performance with the line of sight. Our tools solved the problems of ALS patients who wants to show their music performance and allows remote performances anywhere in the world. In fact, they performed live in Cannes, Istanbul, and Budapest.
  • THE EXECUTION :
    The project started in early March 2022, with interviews with MASA and PONE, and the first three prototypes were produced in early April 2022. In these prototypes, the UI was designed in three levels of detail and used by MASA and PONE to verify how complex the UI could be operated in real time with the user's perspective.

    Based on the findings from the first prototype, further development was carried out, and three prototypes (EYE XY PAD, EYE MIDI PAD, and SHOOTING PAD) were produced in early May 2022.
    On June 24, 2022, the first performance with the developed tools was held at Cannes, France.
    And project platform-ALL PLAYERS TOOL LAB. was released on same day.

    Subsequently, in response to requests for additional performances, performances were held in Istanbul, Turkey on November 9 and Budapest, Hungary on November 10.

    In early October 2022, the collaboration of performance tools with new players, such as players with cerebral palsy and elementary school students with spinal muscular atrophy (SMA), began. The development of the performance tool has started and is underway for performance in 2023. A patent application is pending as of 2022.
  • THE RESULT :
    【Tool Development】
    We created a total of three tools:
    -EYE XY PAD: which specialized in real-time performance
    -SHOOTING PAD: which solves the issue of remote performance
    -EYE MIDI PAD: which focuses on integration with the Ableton Live UI.

    Each tool receives the performer's eye movements, converts them into MIDI signals in real time, and sends them to the live performance tool, Ableton Live. Musicians can perform in real time while utilizing the assets they have created with Ableton Live, which they use on a regular basis. In addition, by using MIDI signals as a medium, it is possible to link not only Ableton Live but also any DAW software in accordance with the player's production environment.

    Players can freely customize tones and performance rules by mapping MIDI signals and editing the sound source on the DAW software. This design concept makes this a tool that can be used by any players in the future.

    【live performance】
    World's first remote live performance by ALS musicians using eye gaze input was held in a total of three countries.
    -A total of 2,280 audiences experienced the world's first live performance
    -Featured in over 60+ medias worldwide