ESA title

APPIDE

  • ACTIVITYDemonstration Project
  • STATUSOngoing
  • THEMATIC AREAInfrastructure & Smart Cities, Energy

Objectives of the service

 

The solar photovoltaic energy market is showing an ever-increasing demand in the last years, with ongoing focus on scaling up the world’s renewable energy generation capacity. This significant growth of the photovoltaic solar market has two main consequences: 1) the increase in the number of installations and 2) the increase in the average size of said installations.

This growth generates a need to correspondingly scale up the sector’s capability perform regular asset inspections to detect and repair faults in solar cells and modules in a timely manner, to keep the installation working at high capacity. UAV-based thermographic inspection is an optimal way to perform full plant inspections, detecting faults early and determining their underlying causes. However, this process generates huge amounts of data, and the manual execution of this analysis, as it is mostly done to date, has serious disadvantages for customers mainly due to the following two aspects:

  1. Time-consuming activity: leading to significant delays between contracting and receipt of inspection results, and in turn infrequent inspection scheduling: installations will be left operating below maximum performance for extended periods.

  2. Manual, tedious and repetitive tasks:  leads to a cumulative increase in the probability of mistakes due to human fatigue, making it difficult to scale to large photovoltaic installations.

This scenario calls for the development of means and procedures that optimize the thermographic data processing, with the consequent reduction in time, thanks to a high level of automation, the elimination of the human error factor, and delivering the accuracy of cutting-edge AI and computer vision techniques.

Users and their needs

Our analytics-as-a-service tool is aimed at thermographic inspection companies that serve the main stakeholders of the photovoltaic sector: Engineering, Procurement and Construction (EPC) companies, PV asset owners, Operation & Maintenance (O&M) companies, etc.

These inspection companies organise the UAV flights to acquire the required data, either with own UAVs or through partner pilots, and provide detailed inspection reports to their customers. Most of these companies lack the capability to analyse the thermographic data on their own, as they either focus on UAV flights or are too small to afford building their own capabilities. The main needs of our customers are the following:

  • Low-cost, automated, and quick analysis of thermographic data and reporting of results.

  • Precise fault detection, identification, and location.

  • Robust inspections against false positives.

This collection of needs is the ideal scenario for an AI-based solution, which can process large amounts of data in short times, at low cost, and eliminating human errors.

Service/ system concept

Our data-analysis service uses thermographic and RGB imagery of solar plants to detect electrical faults in solar panels. The data is provided by the thermographic inspectors, and they receive a detailed inspection report (in digital and PDF format) as output. The report contains information on the faults or incidents found in the cells, modules, and strings of the PV asset. This information is crucial for PV plant owners to maintain the efficiency of their plant, which is the main goal of thermographic inspections.

Thanks to automatic data processing, we can generate large amounts of insights for each inspection, at a lower cost. This allows thermographic inspectors to fly their drones more often, maximising their return on investment, as well as PV plant owners to perform more comprehensive, recurrent inspections, maximising the efficiency of solar assets. Our web-based user interface allows our users to process the data from all inspections more easily than with traditional PDF reports.

To achieve all of the above, it is necessary to process the input data properly through our automated tool. The processing chain for this tool is briefly explained below:

  • Fault detection & classification: images captured with the UAV will be processed and analysed using artificial intelligence algorithms, to detect and classify faults.

  • False positive discrimination: multispectral imagery data fusion will be used, using RGB cameras to discriminate false positive detections and unambiguously determine the underlying root cause of real faults.

  • Fault location: through navigation and positioning techniques combined with asset detection and computer vision analysis, the position of each detected fault within the wider installation will be identified. This also provides an “on-the-fly” model-free asset digitisation service without the need to perform high-altitude overview flights.

 

Space Added Value

As a key aspect, our service leverages Satellite Earth Observation and Satellite Navigation space assets. In this way, we can offer our customer an effective, efficient, and accurate solution providing extended information on the status and performance of their facilities.

On one hand, the use of Satellite Earth Observation allows us to carry out an adequate flight planning and, thanks to the very high resolution (VHR) images, it permits us to analyse the status of the plant to verify that it is ready to be inspected (for example, detecting and monitoring the presence of obstacles, vegetation in excess, status of installation cleanliness, etc.). We also leverage our image processing algorithms, developed for space, as a key element of the processing chain.
On the other hand, the use of Satellite Navigation allows UAV operators to execute precise flights, and enables our AI to accurately locate the detected faults at solar module level, integrating the navigation solution in our algorithms.
 

Current Status

The final review meeting of the project was held on the 27th of July 2023. A CCN was performed following the project which was concluded in the Final Review meeting on 30 April 2024. 

At the close of the project APPIDE is a commercially active product, having successfully delivered results for more than 20 different thermographic inspections. The goals for 2024 include growing its customer base, with a concerted effort in business development, and increasing the automation of the tool, by reducing the need for manual quality checks and improving the reliability of the AI system. APPIDE’s unique capability in the market to efficiently work with smaller plants (< 20 MW), as well as its unique capability to process rooftop-mounted installations, has seen high demand among potential customers, presenting an optimistic outlook for the commercial penetration of the product.
 

Prime Contractor(s)

Status Date

Updated: 06 May 2024