Research
Research interests
My research interests include computer vision, 3D reconstruction, computational photography, VR, AR, free-viewpoint video, AI and deep learning.
My research centres on scene modelling from multi-view video input, with a focus on complex dynamic scenes. In particular I am looking at how to generalise modelling to scenes with complex surface reflectance properties (e.g. glossy materials), and how to extend modelling to uncontrolled outdoor environments. I have undertaken many research projects in collaboration with industry to develop applications for the creative sector. Examples of applications of my research include free-viewpoint video, AR, VR and immersive content production.
To date, my area of research has resulted in the introduction of robust methods for outdoor scene modelling from a small number of cameras and novel algorithms for the reconstruction of scenes with arbitrary unknown reflectance properties. Applications have been investigated as part of a stream of collaborative research projects with major companies from the creative industry sector (BBC, Foundry, Double Negative, Framestore, etc). This has the potential to open new applications in other disciplines requiring accurate scene modelling and understanding (e.g. in robotics, healthcare, cultural heritage).
In the future I would like to explore how new acquisition techniques such as lightfield imaging, and deep learning, can be leveraged to remove current constraints, enabling us to model live action scenes ‘in the wild’ from a small number of cameras.
Research projects
Current:
- Polymersive: Immersive Video Production Tools for Studio and Live Events (InnovateUK, April 2019September 2020, Co-Investigator)
- Audio-Visual Media Research Platform (EPSRC Platform Grant, May 2017April 2022, Co-Investigator)
Previous:
- ALIVE Live Action Lightfields for Immersive Virtual Reality Experiences (InnovateUK, July 2016December 2017, Co-Investigator)
- VISUALMEDIA Immersive and Interactive Real Time 3D Social Media Graphics Environments for the Broadcast Industry (EU Horizon 2020, January 2016December 2017, Co-Investigator)
- Shape and Reflectance Acquisition of Complex Dynamic Scenes (EPSRC First Grant, June 2015May 2017, Principal Investigator)
- Multi-View Computational Photography for Dynamic Scene Modelling in the Wild (Royal Society Research Grant, March 2016March 2017, Principal Investigator)
- Hand tracking and Pose Estimation (InnovateUK/HEFCE ICURe Innovation-to-Commercialisation Project, April 2016July 2016, Principal Investigator)
- Fashion garment design, e-tailing and manufacturing with zero prototyping (InnovateUK, October 2014April 2016, Co-Investigator)
- Imagineer Systems: Multiview Planar Tracking (TSB, October 2012September 2014, Co-Investigator)
- IMPART Intelligent Management Platform for Advanced Real-Time media processes (EU FP7, November 2012October 2015, Co-Investigator)
- SCENE Novel Scene Representation for Richer Networked Media (EU FP7, November 2011October 2014, Co-Investigator)
- SyMMM Synchronising Multimodal Movie Metadata (TSB, November 2011April 2013, Co-Investigator)
- i3Dlive Interactive 3D Methods for Live Action Media (TSB/EPSRC, January 2009July 2011, Researcher)
- iView Free-viewpoint Video for Interactive Entertainment Production (TSB/EPSRC, May 2006April 2009, Researcher)
- VAMPIRE Visual Active Memory and Interactive REtrieval (EU FP5, May 2002July 2005, Researcher)
PhD research supervision
I am currently supervising 6 PhD students (3 as principal supervisor, 3 as co-supervisor). If you are interested in doing a PhD in one of my research areas, please contact me to make an informal enquiry.