Super-Pixels: Redefining the way we sense the world.

Project Information

Super-Pixels

Grant agreement ID: 829116

DOI

10.3030/829116

Project closed

EC signature date 26 November 2018

Start date 1 March 2019

End date 28 February 2023

Funded under

• EXCELLENT SCIENCE - Future and Emerging Technologies (FET)

Total cost

€ 2 479 003,75

EU contribution

€ 2 479 003,75

Coordinated by

UNIVERSITY OF GLASGOW
United Kingdom

Periodic Reporting for period 3 - Super-Pixels (Super-Pixels: Redefining the way we sense the world.)

Reporting period: 2021-08-01 to 2023-02-28

Summary of the context and overall objectives of the project

We observe the world around us predominantly through the measurement of optical intensity. Although powerful, this leaves the other fundamental optical degrees of freedom, phase and polarisation massively under-utilised. Our tendency to solely use intensity results from the static sensor technology that is available, which offer very limited ability to dynamically reconfigure their function or perform any optical processing. In SuperPixels we will co-develop a new integrated sensor platform that will revolutionise the way we process light to allow the full utilisation of its fundamental properties. Redefining the core functionality of our sensor technology will radically impact the technology that is deployed in a broad spectrum of cross-disciplinary areas such as nano-particle detection, compact atmospheric corrected imaging systems, endoscopy, coherent communications and on-chip processing of structured light. This vision will be enabled by a compact and multi-functional photonic integrated chip that would be installed into phones, microscopes, cameras, communication and environmental monitoring systems, becoming a central part of the way we collect and process optical information.

In SuperPixels, we will create an integrated photonics device that is based on a mesh of several hundred Mach-Zehnder interferometers, which will be used to dynamically map phase and polarisation, with the ability to fully transform any incident optical field. A revolutionary prototype system will be delivered that will partner our SuperPixels chip with a commercially available camera to enhance its functionality within a single frame of a camera. This prototype will support a number of potential applications that include visualising normally invisible nano-particles through phase mapping, imaging through multimode optical fibres, reconfigurable quantum communication links and mapping of airflow and particulates through phase and polarisation retrieval.

We will develop a new sensing platform that can be built into every optical device we use. We expect this technology to drastically change the landscape of research in many of the areas where non-standard camera technology is central, including biomedical imaging and quantum level systems. As the technology matures, we envisage our smart pixels being integrated alongside camera technology in cell-phones and cameras for adaptive imaging.

Work performed from the beginning of the project to the end of the period covered by the report and main results achieved so far

The SuperPixels project has achieved considerable progress towards all of the project objectives and fully operational SuperPixels' are now making their way into lab across the consortium. The structure of the project had an early focus on fundamental platform development and control, Objectives 1 and 2, followed by more targeted applications, Objective 3-6. Driven by highly successful collaborations, tailored meshes of Mach Zehnder Interferometers have been designed to suit an array of applications, where some early successes have been realised both as feasibility studies and with integration of SuperPixels' chips into experimental investigations.

Key Successes:
- Design and Fabrication of a 128 input SuperPixels' chip, with integrated control a central pillar of the design. A novel multi-asic control architecture was developed to support this chip's use in a myriad of applications.

- Demonstration of SuperPixels being used for the creation and measurement of structured beams for propagation in Free-Space.

- Development and demonstration of automatic device control systems for the SuperPixel based on custom ASICs

- Successful measurements of environmental parameters from optical interactions with structured beams.

- Demonstration of fiber shape sensing enhanced by structured light.

- High-precision localisation of individual nano-particles and multi-pole retrieval.

- Distribution of packaged and computer controllable SuperPixels' chips into groups across the consortium for experimental integration.

- Demonstration of visible light integrated photonics for wavefront sensing.

Over this period we have made a conscious effort to support collaboration and co-design, where the systems were developed in an open manner to allow for the sharing of code, interface electronics, and know-how across the application focused groups. All of the key feasibility tests have been completed and we don't expect any major issues in delivering on all the tasks outlined in the project. The project has garnered a healthy number of publications and presentations at internationally leading conferences.

Progress beyond the state of the art and expected potential impact (including the socio-economic impact and the wider societal implications of the project so far)

We have completed a broad range of task that will advance the state of the art in integrated photonics to facilitate the manufacturing, control and deployment of game changing imaging technologies of the future. We have successfully delivered a process for the growth and processing techniques for visible-light compatible integrated photonics chips that is a critical achievement that will not only directly support the SuperPixels project but will have broad application in a large range of optical technologies. We have also development a range of advanced control strategies for large networks of Mach Zehnder Interferometers (MZIs) and control for many 100’s of MZI. Fully automatic control techniques have been successfully demonstrated for a range of feasibility tests and will fully utilised in realistic applications situations in research groups across the consortium which is expected deliver new sensing techniques that will be the state of the art in several key research disciplines. Our consortiums successes have already experimentally demonstrated a range reconfigurable optical devices that are an improvement beyond the state of the art and these device are now being actively being used by application based researchers.

At the application level, the project so far has been pushing to out perform the state of the art in nano-particle localisation and environmental sensing, where early results have indicting a road map towards novel technologies that could be delivered based on the SuperPixel Platform.

Uniquely in SuperPixels, we wish to instigate a paradigm shift in the use of integrated photonics chips for free-space optical applications such as imaging. This has led to various interesting and challenging questions. Through analyses of our intended end user applications, we have developed novel routes to free-space coupling based on novel multi-component optical systems. These approaches have led to the successful completion of core deliverable that builds on the technical foundations to support the future project tasks.

This new technology platform and the re-thinking of the way we image will kick start a new industrial sector in smart imaging that Europe is uniquely placed to lead. There is already a critical mass of researchers in the areas of spatial mode enhanced sensing and communication systems that will provide an extensive collaborative network for future projects.

SuperPixel