30 Oct 2018
EU's TULIPP project delivers on results for embedded vision applications
Tulipp (Towards Ubiquitous Low-power Image Processing Platforms), an EU initiative targeting the development of high performance, energy-efficient embedded systems for the growing range of increasingly complex image processing applications, has delivered its first three Use Cases covering Medical X-Ray Imaging, automotive ADAS (Advanced Driver Assistance Systems) and UAVs (Unmanned Aircraft Vehicles).
The new Use Cases, coupled with the Tulipp embedded computing reference platform, deliver outstanding results for embedded vision applications.
The Medical X-Ray Imaging Use Case combines an embedded computing board with a medical X-ray imaging sensor to eliminate the noise on images when radiation doses are reduced. The ADAS Use Case enables the implementation of pedestrian detection algorithms running in real-time on a small, energy efficient, embedded platform. The UAVs Use Case equips a UAV with real-time obstacle detection and avoidance capabilities based on a lightweight and low-cost stereo camera setup.
“At first glance, Medical X-Ray Imaging, ADAS and UAVs would appear to have very little in common,” said Philippe Millet of Thales and Tulipp’s Project Co-ordinator. “But that’s only true when viewed from the perspective of the final application as they all have a requirement for high-performance image processing and they also suffer from the so-called SWaP (Size, Weight and Power) computing constraints typical of embedded systems. Tulipp has addressed these challenges by taking a diverse range of application domains as the basis for defining a common reference processing platform comprising the hardware, the operating system and its programming environment that captures the commonality of real-time, high-performance image processing and vision applications.”
Tulipp’s Medical X-Ray Imaging Use Case demonstrates advanced image enhancement algorithms for X-Ray images running at high frame rates. It focuses on improving the performance of X-Ray imaging Mobile C-Arms, which provide an internal view of a patient’s body in real-time during the course of an operation to deliver, increases surgeon efficiency and accuracy with minimal incision sizes, aids faster patient recovery and lowers nosocomial disease risks. Using Tulipp’s embedded hardware reference platform, which is the size of a smart phone, the Use Case demonstrates how radiation doses to which patients and staff are exposed, which are typically 30 times ambient radiation levels, can be reduced by 75%. At the same time it is possible to maintain the clarity of the real-time X-Ray images which would otherwise be rendered useless by the increases in the noise level on the images that a reduced radiation dose can cause.
ADAS adoption is dependent on the implementation of vision systems or on combinations of vision and radar and the algorithms must be capable of integration into a small, energy-efficient Electronic Control Unit (ECU). An ADAS algorithm should be able to process a video image stream with a frame size of 640x480 at a full 30Hz or at least at the half rate. The Tulipp ADAS Use Case demonstrates pedestrian recognition in real-time based on Viola & Jones algorithm. Using the Tulipp reference platform, the ADAS Use Case achieves a processing time per frame of 66ms, which means that the algorithm reaches the target of running on every second image when the camera runs at 30Hz.
Tulipp’s UAV Use Case demonstrates a real-time obstacle avoidance system for UAVs based on a stereo camera setup with cameras orientated in the direction of flight. Even though we talk about autonomous drones, most current systems are still remotely piloted by humans. The Use Case uses disparity maps, which are computed from the camera images, to locate obstacles in the flight path and to automatically steer the UAV around them. This is the necessary key towards totally autonomous drones.
“The Tulipp Use Cases, coupled with the development kit, comprising hardware platform, multi-core operating system, development tool chain and guidelines, have demonstrated that the computational demands of complex image processing can be delivered in a diverse range of embedded applications within the context of challenging size, weight and power constraints,” concluded Philippe Millet of Thales and Tulipp’s Project Co-ordinator.
Most popular news in Processing & embeddedNew microcontroller-based dual USB platform
RISC-V SoC FPGA architecture brings real-time to Linux
First 7 nanometer PC platform unveiled
Wind River brings VxWorks safety portfolio to cutting-edge NXP platforms
Xilinx extends functional safety into AI-class devices
Share this page
Want more like this? Register for our newsletter