Research
Research interests
My research interests include computer vision, 3D reconstruction, computational photography, VR, AR, free-viewpoint video, AI and deep learning.
My research centres on scene modelling from multi-view video input, with a focus on complex dynamic scenes. In particular I am looking at how to generalise modelling to scenes with complex surface reflectance properties (e.g. glossy materials), and how to extend modelling to uncontrolled outdoor environments. I have undertaken many research projects in collaboration with industry to develop applications for the creative sector. Examples of applications of my research include free-viewpoint video, AR, VR and immersive content production.
To date, my area of research has resulted in the introduction of robust methods for outdoor scene modelling from a small number of cameras and novel algorithms for the reconstruction of scenes with arbitrary unknown reflectance properties. Applications have been investigated as part of a stream of collaborative research projects with major companies from the creative industry sector (BBC, Foundry, Double Negative, Framestore, etc). This has the potential to open new applications in other disciplines requiring accurate scene modelling and understanding (e.g. in robotics, healthcare, cultural heritage).
In the future I would like to explore how new acquisition techniques such as lightfield imaging, and deep learning, can be leveraged to remove current constraints, enabling us to model live action scenes ‘in the wild’ from a small number of cameras.
Research projects
Current:
- BBC Prosperity Partnership: Future Personalised Object-Based Media Experiences Delivered at Scale Anywhere (EPSRC, October 2021–September 2026, Co-Investigator)
Previous:
- Audio-Visual Media Research Platform (EPSRC Platform Grant, August 2017–January 2023, Co-Investigator)
- Polymersive: Immersive Video Production Tools for Studio and Live Events (InnovateUK, March 2019–June 2022, Co-Investigator)
- ALIVE – Live Action Lightfields for Immersive Virtual Reality Experiences (InnovateUK, July 2016–December 2017, Co-Investigator)
- VISUALMEDIA – Immersive and Interactive Real Time 3D Social Media Graphics Environments for the Broadcast Industry (EU Horizon 2020, January 2016–December 2017, Co-Investigator)
- Shape and Reflectance Acquisition of Complex Dynamic Scenes (EPSRC First Grant, June 2015–May 2017, Principal Investigator)
- Multi-View Computational Photography for Dynamic Scene Modelling in the Wild (Royal Society Research Grant, March 2016–March 2017, Principal Investigator)
- Hand tracking and Pose Estimation (InnovateUK/HEFCE ICURe Innovation-to-Commercialisation Project, April 2016–July 2016, Principal Investigator)
- Fashion garment design, e-tailing and manufacturing with zero prototyping (InnovateUK, October 2014–April 2016, Co-Investigator)
- Imagineer Systems: Multiview Planar Tracking (TSB, October 2012–September 2014, Co-Investigator)
- IMPART – Intelligent Management Platform for Advanced Real-Time media processes (EU FP7, November 2012–October 2015, Co-Investigator)
- SCENE – Novel Scene Representation for Richer Networked Media (EU FP7, November 2011–October 2014, Co-Investigator)
- SyMMM – Synchronising Multimodal Movie Metadata (TSB, November 2011–April 2013, Co-Investigator)
- i3Dlive – Interactive 3D Methods for Live Action Media (TSB/EPSRC, January 2009–July 2011, Researcher)
- iView – Free-viewpoint Video for Interactive Entertainment Production (TSB/EPSRC, May 2006–April 2009, Researcher)
- VAMPIRE – Visual Active Memory and Interactive REtrieval (EU FP5, May 2002–July 2005, Researcher)
PhD research supervision
I am currently supervising 4 PhD students (3 as principal supervisor, 1 as co-supervisor). If you are interested in doing a PhD in one of my research areas, please contact me to make an informal enquiry.