THROUGH FOLIAGE DETECTION OF ILLEGAL CROSS-BORDER ACTIVITIES FOLDOUT BORDER SURVEILLANCE TECHNOLOGY FOLDOUT BORDER SURVEILLANCE TECHNOLOGY THROUGH FOLIAGE DETECTION OF ILLEGAL CROSS-BORDER ACTIVITIES FOLDOUT BORDER SURVEILLANCE TECHNOLOGY THROUGH FOLIAGE DETECTION OF ILLEGAL CROSS-BORDER ACTIVITIES

FOLDOUT

Border surveillance made smart and seamless

Interoperability

FOLDOUT solution incorporates an abstraction layer that allows the integration of existing sensors for better integration. An interoperable system allows integration with European border surveillance systems to avoid vendor Lock-Out and is a first step towards standardization.

Through Foliage Detection

A transportable system with mobile (transportable) sensors and detection technologies applying innovative solutions which are specifically adapted for through foliage detection scenarios. The sensors can provide information day & night, and in harsh environments.

Machine Learning Algorithms

With novel specialized machine learning algorithms and performance evaluation matrices FOLDOUT technology provides added value to sensor data . This allows the system to perceive, localize, track and classify objects into humans, vehicles and other objects.

Multi-Altitude Sensor Platforms

FOLDOUT technology integrates ground- aerial and satellite data for securing near real-time detection in foliated areas. The technologies provide early and long-distance detection allowing  swift alarms or pre-warning to border authorities

Simple User Interface

The user centric interface is easy and efficient to operate by the border guards. FOLDOUT collects sensor-data, as well as the derived detections and alarms in a command and control (C2) software solution for common event visualization. This feature helps border guards fill gaps in their current day-to-day operations when they have to monitor and use a large number of independent sensors, browse independent data streams from different sensors, and manage uncorrelated data while trying to operate on the ground.

Compliance with Legal and Ethical Requirements

FOLDOUT delivers technical solutions that are in-line with EU Legal-Ethical-Privacy rules and regulations. Technology impact assessment anticipates legal and privacy concerns. The collection, processing and production of the data are compliant with GDPR.

FOLDOUT - an overview of the developments in the H2020 FOLDOUT project

SITUATIONAL AWARENESS and ALARMING

Situational Awareness and Alarming is a software component  that fuses information from multiple heterogeneous sensors (including ground and airborne), thus reducing cognitive load on the operators. Fusing information from multiple heterogeneous sensors also enables information cross-checking and filtering in order to reduce information overload and hence decrease false alarm rate.

This feature helps border guards to fill the gaps they currently face in their daily activities by having to monitor and operate a large number of independent sensors; needing to browse independent streams of information from the different sensors and managing uncorrelated information to try to act on the spot. Situational Awareness and Alarming is a software component  that fuses information from multiple heterogeneous sensors (including ground and airborne), thus reducing cognitive load on the operators. Fusing information from multiple heterogeneous sensors also enables information cross-checking and filtering in order to avoid information overload of the operator and also to decrease false alarm rate.

Effective surveillance technology for foliage penetration

Detecting vehicles and people through dense foliage in extreme climates using only penetration technology is a challenging task. At our end-user sites, we are demonstrating the FOLDOUT solution, that combines different sensors and technologies embedded in an intelligent, efficient and robust detection platform.

IRREGULAR BORDER CROSSINGS

UNAUTHORIZED ENTRY AND TRANSPORT OF GOODS

EFFECTIVE SEARCH & RESCUE OPERATIONS

DENSE FOLIAGE

EXTREME CLIMATES

INNOVATIVE SENSORS & DETECTION TECHNOLOGIES

SMART CAMERA

  • GDPR compliant: camera output is completely GDPR compliant, no personal information is stored and all collected is processed on the system and deleted.
  • Estimated detection range with current sensor configuration is 5 m into the foliated area along a 200m distance
  • Modular and configurable sensor combination allows for variations in range (100m – 600m)
  • Weight approx. 5kg (Possibly Drone Mounted)
  • Operates on battery, communicates over LTE/ WIFI – no cables required for operation
  • Deployed easily and mountable on trees and masts (not fixed)

Novel approach to automated surveillance cameras:

    • Multi-sensor detection system for improved performance in foliated environment
    • Automated object detection and classification at sensor level: AI based algorithm for object detection and classification (person, vehicle, animal), low false alarm rate
    • ‘Event generator’ at sensor level
    • Open interface for integration with different surveillance systems
    • Embedded system: software and AI based algorithms are running at sensor level (AI based algorithm for object detection and classification, background modelling algorithm for through foliage detection)

AERIAL SENSORS

Fixed Wing drones have the payload capacity to carry sensors for extended missions

Multispectral IR camera detection system
Airborne LiDAR detection
and in future  the Stratobus®  platform

NOVEL MACHINE LEARNING ALGORITHM AND PERFORMANCE EVALUATION MATRICES FOR SENSOR SIGNALS

FOLDOUT solution guarantees a full exploitation of the information available in the sensor data and thus enhanced through foliage observation. The algorithm can be applied to different sensor modalities, to data capturing different scenes, e.g. from ground, from above, from mobile vehicles and from fixed poles.

Heavy occlusion prevents the detection of the 3rd person with conventional camera systems

CUSTOMIZABLE INTERACTIVE PLANING TOOL

FOLDOUT technology comprises a planning tool for decision makers to configure a surveillance system for the specific requirements of a target deployment area. This tool also assist border guards with optimal placement of sensors in a given terrain.

DEFINE YOUR BORDER

An area of interest is selected on a map. If available, airborne LIDAR and Hyperspectral sensors map the area. Automatic classification of terrain marks River-Field-Forest, High and Low density. Alternatively, the classification is done from the available images such as satellite etc.

SELECT YOUR SENSORS

Sensor placement can be simulated and varied in real time

TEST DIFFERENT SET-UPS

Various Sensor combinations can be simulated and compared

COST ESTIMATES

Using estimated the cost range of a set-up can be broadly estimated

PERFORMANCE EVALUATION ON FOUR DEMONSTRATOR SITES

FOLDOUT team demonstrated technologies in 4 different regions of European land borders under realistic and harsh conditions for 24 months (pilot operation in Bulgaria) and 2-5 months demonstration each in GR, FI and French Guiana. Systems were deployed at the FOLDOUT demo sites where they were integrated into real selected environment and under realistic operational border settings.