For more than three centuries we have been watching and studying microscopic phenomena behind a microscope. We discovered that cells live in a physical environment whose predominant factors are no longer those of our scale and for which we lack a direct experience and consequently a deep intuition. Today’s computational approaches to microscopy allow high frame rate volumetric reconstructions from 2D holographic patterns that encode the full 3D structure of the sample. On a parallel track, modern holographic spatial light modulators integrated in optical tweezers setups allow to dynamically arrange complex many-particles systems in precise 3D configurations. In this regard, highly efficient iterative algorithms ensure quick hologram computation for the live refresh of the spatial light modulator. In this PhD thesis, we present a novel instrument which, by integrating holographic and virtual reality technologies, allows the user to be completely immersed in a dynamic virtual world which is the simultaneous replica of a real system under the microscope. We use a 3-axis implementation of holographic microscopy for fast 3D imaging and real-time rendering on a virtual reality headset. At the same time, hand tracking data is used to dynamically generate holographic optical traps that can be used as virtual projections of the user hands to interactively grab and manipulate ensembles of micro-particles or living motile cells, like swimming bacteria. The strategy used can be flexibly adapted to different sample types by integrating suitable 3D imaging techniques into the system. The dynamics of larger eukaryotic cells is observed using the gradient light interference microscopy label-free technique, which provides quantitative height maps of the specimen. Our interface allows a more direct interaction with systems at the micron scale. The user can immersively explore a microscope sample of colloidal particles or living cells, analyze their motility interactively and with quantitative tools, control optical traps to ...


    Access

    Download


    Export, share and cite



    Title :

    Virtual micro-reality: immersive manipulation of live microscopic systems



    Publication date :

    2021-07-06


    Type of media :

    Theses


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    535 / 629



    Interaction with virtual crowd in Immersive and semi‐Immersive Virtual Reality systems

    Kyriakou, Marios / Pan, Xueni / Chrysanthou, Yiorgos | BASE | 2016

    Free access

    Walking in an immersive virtual reality

    Menegoni F / Albani G / Bigoni M et al. | BASE | 2009

    Free access

    Cable Harness Design Using Virtual Immersive Reality

    Ritchie, J. | British Library Conference Proceedings | 2006


    Immersive Virtual Reality Beyond Available Physical Space

    Caporusso, Nicholas / Carlson, Gordon / Ding, Meng et al. | Springer Verlag | 2019


    Transcending the Self in Immersive Virtual Reality

    Slater, M / Sanchez-Vives, MV | BASE | 2014

    Free access