Skip to Main content

Keywords

Augmentations Performance Correspondences Models of audio patterns Digital musical instrument Control live-looping Audience experience Collaboration Boeuf Immersion Bf-pd Drile BOEUF Live-looping Immersive virtual musical instruments Audio reconstruction Causality Familiarity Orchestra Digital orchestras
› Full list

Export Publications

Export the displayed publications:
Number of documents

46

CV

My main research interest consists in exploring connections between
3D User Interfaces (3DUI) and Musical Interaction.

In one direction, 3DUIs open new possibilities for musical control,
in particular with complex musical structures,
for musical collaboration, and for augmented musical performances.

In the other direction, Musical Interfaces provide
a rich application domain for 3DUIs, with very specific constraints
which both open numerous research questions and provide
interesting opportunities for interaction and visualization techniques.

Journal articles7 documents

  • Olivier Capra, Florent Berthaut, Laurent Grisoni. Levels of Detail in Visual Augmentations for the Novice and Expert Audiences. Computer Music Journal, Massachusetts Institute of Technology Press (MIT Press), In press. ⟨hal-03106626⟩
  • Florent Berthaut. 3D interaction techniques for musical expression. Journal of New Music Research, Taylor & Francis (Routledge), In press, ⟨10.1080/09298215.2019.1706584⟩. ⟨hal-02430634⟩
  • Florent Berthaut, Martin Hachet. Spatial Interfaces and Interactive 3D Environments for Immersive Musical Performances. IEEE Computer Graphics and Applications, Institute of Electrical and Electronics Engineers, 2016, 36 (5), pp.82 - 87. ⟨10.1109/MCG.2016.96⟩. ⟨hal-01374911⟩
  • Florent Berthaut, Luke Dahl. BOEUF: A Unified Framework for Modeling and Designing Digital Orchestras. Lecture Notes in Computer Science, Springer, 2016, Music, Mind, and Embodiment, 9617, pp.153 - 166. ⟨10.1007/978-3-319-46282-0_10⟩. ⟨hal-01380373⟩
  • Florent Berthaut, Myriam Desainte-Catherine. Interaction musicale numérique. Recréer les signaux du contrôle et de la perception. Traitement du Signal, Lavoisier, 2015, 32 (4), pp.345-363. ⟨10.3166/ts.32.345-363⟩. ⟨hal-01304262⟩
  • Florent Berthaut, David Janin, Benjamin Martin. Advanced Synchronization of Audio or Symbolic Musical Patterns: An Algebraic Approach. International Journal of Semantic Computing, World Scientific, 2012, 6 (4), pp.409-427. ⟨10.1142/S1793351X12400132⟩. ⟨hal-00794196⟩
  • Florent Berthaut, Myriam Desainte-Catherine, Martin Hachet. Interacting with 3D Reactive Widgets for Musical Performance. Journal of New Music Research, Taylor & Francis (Routledge), 2011, 40 (3), pp.253-263. ⟨hal-00633750⟩

Conference papers35 documents

  • Fatma Ben Guefrech, Florent Berthaut, Patricia Plénacoste, Yvan Peter, Laurent Grisoni. Revealable Volume Displays: 3D Exploration of Mixed-Reality Public Exhibitions. IEEE Conference on Virtual Reality and 3D User Interfaces, Mar 2021, Lisbonne (Virtual ), Portugal. ⟨hal-03186282⟩
  • Florent Berthaut. Musical Exploration of Volumetric Textures in Mixed and Virtual Reality. International Conference on New Interfaces for Musical Expression, Jun 2021, Shangai, France. ⟨hal-03260466⟩
  • Vincent Reynaert, Florent Berthaut, Yosra Rekik, Laurent Grisoni. The Effect of Control-Display Ratio on User Experience in Immersive Virtual Musical Instruments. International Conference on New Interfaces for Musical Expression, Jun 2021, Shanghai, China. ⟨hal-03265169⟩
  • Olivier Capra, Florent Berthaut, Laurent Grisoni. A Taxonomy of Spectator Experience Augmentation Techniques. NIME 2020 - The 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom. ⟨hal-02560931⟩
  • Florent Berthaut, Luke Dahl. Adapting & Openness: Dynamics of Collaboration Interfaces for Heterogeneous Digital Orchestras. New Interfaces for Musical Expression, Jul 2020, Birmingham, United Kingdom. ⟨hal-02561064⟩
  • Olivier Capra, Florent Berthaut, Laurent Grisoni. All You Need Is LOD : Levels of Detail in Visual Augmentations for the Audience. The 20th International Conference of New Interfaces for Musical Expression, Jul 2020, Royal Birmingham Conservatoire, United Kingdom. ⟨hal-02560794⟩
  • Olivier Capra, Florent Berthaut, Laurent Grisoni. Have a SEAT on Stage : Restoring Trust with Spectator Experience Augmentation Techniques. Designing Interactive Systems (DIS), Jul 2020, Eindhoven, Netherlands. ⟨10.1145/3357236.3395492⟩. ⟨hal-02560916⟩
  • Maxime Dariosecq, Patricia Plénacoste, Florent Berthaut, Anis Kaci, Frédéric Giraud. Investigating the semantic perceptual space of synthetic textures on an ultrasonic based haptic tablet. HUCAPP 2020, Feb 2020, Valletta, Malta. ⟨hal-02434298⟩
  • Cagan Arslan, Florent Berthaut, Jean Martinet, Ioan Marius Bilasco, Laurent Grisoni. The Phone with the Flow: Combining Touch + Optical Flow in Mobile Instruments. NIME 2018 - 18th International Conference on New Interfaces for Musical Expression, Jun 2018, Blacksburg, VA, United States. ⟨hal-01809210⟩
  • Olivier Capra, Florent Berthaut, Laurent Grisoni. Toward Augmented Familiarity of the Audience with Digital Musical Instruments. International Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Portugal. ⟨hal-01577953⟩
  • Florent Berthaut, Cagan Arslan, Laurent Grisoni. Revgest: Augmenting Gestural Musical Instruments with Revealed Virtual Objects. International Conference on New Interfaces for Musical Expression, May 2017, Copenhagen, Denmark. ⟨hal-01518579⟩
  • Luke Dahl, Florent Berthaut, Antoine Nau, Patricia Plenacoste. bf-pd: Enabling Mediated Communication and Cooperation in Improvised Digital Orchestras. International Symposium on Computer Music Multidisciplinary Research, Sep 2017, Matosinhos, Porto Portugal. ⟨hal-01577942⟩
  • Farzan Kalantari, Florent Berthaut, Laurent Grisoni. Enriching Musical Interaction on Tactile Feedback Surfaces with Programmable Friction. International Symposium on Computer Music Multidisciplinary Research (CMMR 2017), Sep 2017, Porto, Portugal. ⟨hal-01580750⟩
  • Florent Berthaut, Alex Jones. ControllAR: Appropriation of Visual Feedback on Control Surfaces. Interactive Spaces and Surfaces, ACM, Nov 2016, Niagara Falls, Canada. ⟨10.1145/2992154.2992170⟩. ⟨hal-01356239⟩
  • Florent Berthaut, Diego Martinez Plasencia, Martin Hachet, Sriram Subramanian. Reflets: Combining and Revealing Spaces for Musical Performances. New Interfaces for Musical Expression (NIME), May 2015, Baton Rouge, United States. ⟨hal-01136857⟩
  • Florent Berthaut, David Coyle, James Moore, Hannah Limerick. Liveness Through the Lens of Agency and Causality. International Conference on New Interfaces for Musical Expression, May 2015, Baton Rouge, United States. ⟨hal-01170032⟩
  • Florent Berthaut, Deepak Ranjan Sahoo, Jess Mcintosh, Diptesh Das, Sriram Subramanian. Dynamir : Optical Manipulations using Dynamic Mirror Brushes . ACM International Conference on Interactive Tabletops and Surfaces,, Nov 2015, Madeira, Portugal. ⟨hal-01222512⟩
  • Florent Berthaut, Luke Dahl. BOEUF : a Unified Framework for Modeling and Designing Digital Orchestras. International Symposium On Computer Music Multidisciplinary Research, Jun 2015, Plymouth, United Kingdom. ⟨hal-01222396v2⟩
  • Florent Berthaut, Victor Zappi, Dario Mazzanti. Scenography of immersive virtual musical instruments. VR Workshop: Sonic Interaction in Virtual Environments (SIVE), 2014 IEEE, Mar 2014, Minneapolis, United States. ⟨10.1109/SIVE.2014.7006285⟩. ⟨hal-01222454⟩
  • Diego Martinez, Florent Berthaut, Abhijit Karnik, Sriram Subramanian. Through the Combining Glass. ACM Symposium on User Interface Software and Technology, Oct 2014, Honolulu, United States. ⟨hal-01222458⟩
  • Florent Berthaut, Mark Marshall, Sriram Subramanian, Martin Hachet. Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience. New Interfaces for Musical Expression, May 2013, Daejeon, South Korea. 6 p. ⟨hal-00807049v3⟩
  • Florent Berthaut, David Janin, Myriam Desainte-Catherine. libTuile : un moteur d'exécution multi-échelle de processus musicaux hiérarchisés. Journées d'Informatique Musicale, May 2013, Saint-Denis, France. pp.45-50. ⟨hal-00790792⟩
  • David Janin, Florent Berthaut, Myriam Desainte-Catherine. Multi-scale design of interactive music systems : the libTuiles experiment. SMC 2013, 2013, Stockholm, Sweden. pp.123-129. ⟨hal-00813313⟩
  • David Janin, Florent Berthaut, Myriam Desainte-Catherine, Yann Orlarey, Sylvain Salvati. The T-Calculus : towards a structured programing of (musical) time and space. FARM 2013, 2013, Boston, United States. pp.23-34, ⟨10.1145/2505341.2505347⟩. ⟨hal-00789189v3⟩
  • Florent Berthaut, David Janin, Benjamin Martin. Advanced Synchronization of Audio or Symbolic Musical Patterns: An Algebraic Approach. ICSC, Sep 2012, Palermo, Italy. pp.202-209, ⟨10.1109/ICSC.2012.11⟩. ⟨hal-00698963v2⟩
  • Florent Berthaut. Beyond the Tunnels: Advanced 3D graphical modulation. 2012 IEEE Symposium on 3D User Interfaces (3DUI), Mar 2012, United States. pp.139-140. ⟨hal-00793580⟩
  • Florent Berthaut, Haruhiro Katayose, Hironori Wakama, Naoyuki Totani, Yuichi Sato. First Person Shooters as Collaborative Multiprocess Instruments. New Interfaces for Musical Expression, May 2011, Oslo, Norway. pp.44-47. ⟨hal-00631782⟩
  • Florent Berthaut, Martin Hachet, Myriam Desainte-Catherine. Piivert: Percussion-based Interaction for Immersive Virtual EnviRonmenTs. Symposium on 3D User Interfaces, Mar 2010, United States. p 15-18. ⟨hal-00522637⟩
  • Florent Berthaut, Myriam Desainte-Catherine, Martin Hachet. Drile: An Immersive Environment for hierarchical live-looping. New Interface for Musical Expression, Jun 2010, Sydney, Australia. page 192. ⟨hal-00530071⟩
  • Florent Berthaut, Myriam Desainte-Catherine, Martin Hachet. Combining audiovisual mappings for 3D musical interaction. International Computer Music Conference, Jun 2010, New york, United States. p 100. ⟨hal-00530076⟩
  • Martin Hachet, Arash Kian, Florent Berthaut, Jean-Sébastien Franco, Myriam Desainte-Catherine. Opportunistic Music. JVRC 2009 (EGVE - ICAT - EuroVR), Dec 2009, Lyon, France. ⟨inria-00406390v2⟩
  • Florent Berthaut, Myriam Desainte-Catherine, Martin Hachet. Interaction with the 3D reactive widgets for musical performance.. Brazilian Symposium on Computer Music (SBCM09), Sep 2009, Recife, Brazil. pp.0. ⟨hal-00413339⟩
  • Nicolas Mellado, Patrick Reuter, Florent Berthaut. Analyse de l'influence des systèmes de visualisation immersif sur l'assemblage virtuel de fragments en archéologie. 4ème Journées de l'Association Française de Réalité Virtuelle, Dec 2009, Lyon, France. p83. ⟨hal-00576884⟩
  • Florent Berthaut, Myriam Desainte-Catherine, Martin Hachet. Widgets Réactifs 3D pour l’interaction musicale. Journées d'informatique musicale, GMEA, Mar 2008, Albi, France. pp.87. ⟨hal-00354898⟩
  • Florent Berthaut, M. Desainte-Catherine, Martin Hachet. Interaction 3D pour la musique. Actes des 2emes Journées de lAFRV, 2007, France. pp.75 -- 81. ⟨hal-00307879⟩

Poster communications1 document

  • Pierre-Marie Plans, Florent Berthaut. Les Passages : Une métaphore pour la Collaboration Musicale en Réalité Virtuelle. 25ème conférence francophone sur l'Interaction Homme-Machine, IHM'13, Nov 2013, Bordeaux, France. ⟨hal-00879603⟩

Book sections2 documents

  • Luke Dahl, Florent Berthaut, Antoine Nau, Patricia Plénacoste. bf-pd: Enabling Mediated Communication and Cooperation in Improvised Digital Orchestras. Mitsuko Aramaki; Matthew E. P. Davies; Richard Kronland-Martinet; Sølvi Ystad. Music Technology with Swing, 11265, Springer, pp.454-467, 2018, Lecture Notes in Computer Science, 978-3-030-01691-3. ⟨hal-01989776⟩
  • Olivier Capra, Florent Berthaut, Laurent Grisoni. Toward Augmented Familiarity of the Audience with Digital Musical Instruments. Music Technology with Swing, Springer, pp.558-573, 2018, 978-3-030-01691-3. ⟨hal-01954791⟩

Theses1 document

  • Florent Berthaut. Construction, manipulation et visualisation de processus sonores dans des environnements virtuels immersifs pour la performance musicale. Informatique [cs]. Université Sciences et Technologies - Bordeaux I, 2010. Français. ⟨tel-00573382⟩