×
 

Results

The main objective of the project is to define a workflow easing the integration and reduction of complex deep neural networks (DNN) models on Soc FPGA platforms.

Result
14
Dec
2020

SUMMARY of RESULTS

The main objective of CORTEX is to define a workflow easing the integration and reduction of complex deep neural networks (DNN) models on SoC FPGA devices embarked in spatial platforms. This workflow has been demonstrated on a deep learning (DL) image processing pipeline devoted to feature extraction and tested on an FPGA representative of the on-board hardware. In order to define a generic pipeline, three use cases have been selected: 1) ships detection in Sentinel-2 images with a DNN trained with transfer learning technics, 2) oil spills and ocean features detection in Sentinel-1 images, two separate models are developed to demonstrate the flexibility offered by easy processing updating on-board, 3) Sentinel-1 to Sentinel-2 transformation applied on specific regions (refugees camps), demonstrative use case for future applications based on generative adversarial networks. Deep Learning models have been implemented and delivered as well as generated/modified data bases and training software. The networks trained for use cases 1 and 2 showed very good performances (F1-score over 80%) compared to available public results. The results obtained for use case 3 were encouraging even so they would need a more extended study. The distillation process showed to be fairly robust and provided low performance loss with a drastic reduction in the number of parameters of factor 52 on the use cases 1 and 2. A small performance drop was observed for the oil spill case, but we believe that more parameter exploration should solve the case. The techno push use case 3 proved to be difficult but we gained insights on the distillation of GAN approaches: first we managed to use a loss which is more focused on structures in the images. The inference code for the simplified/distilled DNN models was ported to be executed in a middle/low range FPGA representative of the devices used on-board small sats. Eventually, the quantization result has shown a minimal F1 score loss around 1% (1.33% at worse) for the use cases 1 and 2 from the distilled models. These results are fairly good and prove that the hard part lies in the distillation process, justifying our methodology and approach. Moreover, our student architecture can be ported on the selected hardware, enabling our pipeline to bring deep learning models on (small) satellites abiding by COTS hardware constraints. We continue to work, we will keep you informed of our progress... Thank you to ESA and specially to ESA Ф-Lab (https://blogs.esa.int/philab/) for its support and recommendations.

Publication
4
Nov
2020

Ф-WEEK 2020: CORTEX Presentation

CORTEX team participated to ESA EO Ф-WEEK 2020 organised in a virtual form this year. Our presentation shows CORTEX results in DNN training and simplification for several use-cases addresed with classification and GAN architectures. Our presentation is available in the ESA Open Science group: Even if the phi week is over now, we are always at your disposal to answer your questions.

CORTEX
Publication
3
Nov
2020

Ф-WEEK: CORTEX Open datasets

CORTEX team participated to ESA EO Ф-WEEK 2020 organised by ESA-EOP in a virtual form this year. Our presentation shows the databases generated and published and the results on DNN training for these and other use-cases addresed by classification and GAN architectures. Our presentation is available in the ESA Open Science group. Even if the phi week is over now, We are always at your disposal to answer your questions.

Open training databases
Database
29
Sep
2020

Open database: Sentinel-1 and Sentinel-2 for refugee camps detection

AGENIUM Space makes public the learning databases created in the CORTEX project with ESA/Phi-lab (https://www.linkedin.com/groups/8984375/) during the Phi-Week (https://phiweek.esa.int/). You have at your disposal a database of Sentinel-1 and Sentinel-2 images showing refugee camps with an open CC BY-NC-SA licence (doi: 10.5281/zenodo.3924349). We would like to thank the UNHCR (United Nations refugee agency, https://www.unhcr.org/) for publishing the data that allowed us to create this database.

Access the database
Database
28
Sep
2020

Open database: Sentinel-2 dataset for ship detection

AGENIUM Space makes public the learning databases created in the CORTEX ESA/Phi-lab (https://www.linkedin.com/groups/8984375/) project during the Phi-week (https://phiweek.esa.int/). You have at your disposal a ship detection database on Sentinel-2 with an open CC BY-NC-SA licence, doi:10.5281/zenodo.3923841. Take advantage of it! and please keep us informed.

Access the database