Module 7 – Data

Within NPEC, each module is outfitted with advanced imaging and sensor systems, initially storing acquired data on the local hard drives of individual PCs. NPEC has implemented a data framework to ensure automatic synchronization of this data from local PCs to either Microsoft Azure or high-end local network storage solutions. This synchronized data, referred to as 'hot', remains available on these systems for several months after the experiments have been ended.

Users can securely access this data through MS Azure, even daily during their ongoing experiment, allowing researchers to monitor the progress of the experiments from commencement to conclusion. The NPEC data module has been developed to refine raw sensor data into coherent and usable information for every imaging system and sensor in each module. NPEC is storing data according to the FAIR principles, and to enable re-usability extensive metadata information is stored with the phenotypic data, where the guidelines of MIAPPE are followed. Utilizing Artificial Intelligence (AI) and other sophisticated data processing tools, using automated Python scripts and VM technologies, the module handles complex tasks such as the bulk processing of UAV/ drone images, sensor fusion of multiple imaging systems and extraction of phenotypic traits from 3D point clouds with precision and reliability.

For long-term preservation, the data is subsequently transferred to iRODS and is archived on tape. Medio 2023, NPEC already collected and archived 1.000’s of terabytes.