Tag: image processing

  • Ingenuity makes historic flight on Mars

    Ingenuity makes historic flight on Mars

    Only if you have been living under a rock will it be a surprise to hear that the unmanned helicopter called Ingenuity has arrived on Mars attached to the SUV-sized rover called Perseverance. Both have been on the Red Planet since they landed on Feb. 18.

    NASA has since then been in checkout and test mode for both rover and UAV, but Perseverance got a pretty clean bill of health and was commanded to motor over to a flat piece of adjacent Jexero crater — now referred to as the airfield or heliport. There, Ingenuity was detached from the underbelly of Perseverance. Then the little bird lost its power feed from mama rover. Now it has to rely on its own batteries and a small solar panel. The big SUV rover pulled away to a safe 215-foot distance ,and the folks at NASA set about preparing Ingenuity for flight.

    This article was written during the period when things were proceeding with some hesitancy and delay, so things in the article unfold in the same sequence as we all experienced them while we eagerly awaited Integrity’s maiden flight.


    The Ingenuity waits to take its first flight. (Photo: NASA)
    The Ingenuity waits to take its first flight. (Photo: NASA)

    Countdown to Flight

    At only 4 pounds (weighing 1.5 pounds on Mars), the Ingenuity UAV is small, but it’s packed with electronics that allow it to communicate via top-mounted antennas with the rover.

    It carries a lithium ion battery recharged by a small solar panel mounted on top (350 watts is required for a 90-second flight). The UAV also contains heaters to maintain the avionics through the cold of the Martian night. It carries two cameras — a black-and-white navigation camera and a high-density color imager — plus sensors for image processing, data collection and storage, navigation processing and vehicle control.

    One of the objectives for this first flight demonstration is the miniaturization and weight reduction of all these electronics. The NASA website is a little obscure about how the UAV navigates, but perhaps it uses some form of terrain matching/image processing in conjunction with an onboard inertial sensor and laser altimeter.

    Early Shutdown. The UAV had already survived a few nights on its own at around -117F when NASA began to spool up the two four-foot long blades to around 50 rpm during the checkout, and all seemed well until April 9, when a full-speed 2400 rpm spin-test began, and there was an early shut-down due to a watchdog timer — intended to shut things down if something wrong was detected prior to flight. None of this was learned in real time, as radio signal commands take more than 15 minutes to travel the 173-million-miles from Earth to Mars, with the same delay to send back data from what has already happened.

    The density of atmosphere on Mars is only 1% that of Earth, so getting Ingenuity off the ground is more complicated than on Earth. The four-foot-long composite carbon blades have much more surface area than here on Earth for a typical UAV. The two contra-rotating blades spin at around 2400 rpm — a drone on Earth would typically spin its rotors at around 450 rpm.

    Testing on Earth. NASA tested this configuration in a huge vacuum chamber with 1% air density, and Ingenuity flew just fine. The lower gravity on Mars — about 38% that of on Earth — will also help compensate for the lower level of lift available from the Martian atmosphere.

    Because of the radio link delay to and from Mars, Ingenuity can fly and land autonomously only once commands are received. Onboard sensors provide data to enable the vehicle to execute the stored flight profile. The navigation camera provides guidance, and the 13-megapixel color-imaging camera can record the scene. Data and video collected are sent back to the rover for transmission to Earth via the Mars Reconnaissance Orbiter, an Mars satellite that acts as a data relay.

    Ingenuity left the rover and rested on the surface of Mars, while NASA ran a slew of preflight checks. (Photo: NASA)
    Ingenuity left the rover and rested on the surface of Mars, while NASA ran a slew of preflight checks. (Photo: NASA)

    The First Hop. The first‘ hop  was planned to last only a few seconds, but subsequent flights promise to be 165-foot plus, at more than 16 feet above the surface. If things go well, NASA might get more adventurous for the planned fourth and fifth flights.

    All these flights are supposed to happen during the first month of Ingenuity’s flight activity; then Perseverance has to move on with its real task — searching for signs of ancient life on Mars. With no communications possible without the rover, the current plan is to abandon the little bird, even though it may still be fully functional.

    Working to Clear the Watchdog Timer. NASA worked to clear the watchdog-timer problem and give Ingenuity clearance to fly. Over the weekend of April 10–11, the Ingenuity team came up with a fix for flight software. which overcomes the watchdog-timer issue.

    However, before the new software could be uploaded to the ground station on Earth and sent to the Perseverance rover for onward transmission to Ingenuity, extensive testing and validation of the software change was necessary. The existing flight software had not been changed for more than two years, so it’s  understandable that NASA wanted to be sure before uplinking new software.

    Past the April 14 Date. The initially predicted flight date of April 14 came and went, and we still awaited news of the outcome of the next rotor spin-up test. Lift-off and autonomous flight and landing were still to come.

    Meanwhile, another team member came up with a fix to the sequencing of commands that would transition Ingenuity from ground to flight mode, the place in the sequence where things had previously hung up. The revised sequence was sent to Mars and on April 16. The subsequent spin test went off successfully with the contra-rotating blades turning at the anticipated flight speed of 2400 rpm. Apparently, the work on the new version of flight control software was still proceeding, but NASA had decided they have sufficient confidence to set a new flight date of April 19.

    Monday April 19 — The Integrity photographs its shadow while airborne. (Photo: NASA)
    Monday April 19 — The Integrity photographs its shadow while airborne. (Photo: NASA)

    Maiden Flight

    Then, while we all slept, on April 19 at 3:30 a.m. Eastern Time, Integrity executed the command. It  autonomously took off, hover edat a height of 10 feet for around 60 seconds, and then returned to its Martian airfield.

    Above is a picture Integrity took of its own shadow while airborne. it was around noon on Mars in bright sunlight, hence the clear, well-defined shadow. Data received some time later via Perseverance and the Mars Reconnaissance Orbiter contained laser altimeter readings that confirmed this first flight. The color video from Perseverance also shows the spinning rotors and the UAV taking off, hovering at 10ft, descending and landing.

    A small patch that Integrity carries is from the Wright Brothers’ flimsy, powered Wright Flyer, which flew for the very first time on Earth on Dec. 17, 1903. Now we have the very first powered flight on another planet. NASA has scheduled another four or five flights for Integrity, so we may soon even see moving panoramas of Mars from Integrity.

    So now we can chalk up the first powered flight on another planet as another major human achievement — discounting, of course, that maybe some other species has done it eons ago. But, nah, we all know Mars is a dead planet, now.

    Tony Murfin
    GNSS Aerospace

  • LandViewer’s change-detection tool runs in a browser

    A major use of remote sensing data is to compare images of an area taken at different times and identify the changes it underwent. With a wealth of long-term satellite imagery in open use, detecting such changes manually would be time-consuming and most likely inaccurate.

    To address this, EOS Data Analytics has introduced an automated Change Detection tool to its flagship product LandViewer, a cloud tool for satellite imagery search and analysis in today’s market.

    Unlike the methods involving neural networks that identify changes in the previously extracted features, the change detection algorithm implemented by EOS is using a pixel-based strategy, meaning that changes between two raster multi-band images are mathematically calculated by subtracting the pixel values for one date from the pixel values of the same coordinates for another date.

    This new signature feature is designed to automate a change detection task and deliver accurate results in fewer steps and in a fraction of the time needed for change detection in most image-processing software.

    Change detection interface: Images of Beirut city coastline selected for tracing the developments of the past years. (Image: LandViewer)
    Change detection interface: Images of Beirut city coastline selected for tracing the developments of the past years. (Image: LandViewer)
    Change detection interface: Images of Beirut city coastline selected for tracing the developments of the past years. (Image: LandViewer)
    Change detection interface: Images of Beirut city coastline selected for tracing the developments of the past years. (Image: LandViewer)

    Applications from farming to environmental monitoring

    One of the main goals set by EOS team was to make the complex process of change detection in remote sensing data equally accessible and easy for non-expert users coming from non-GIS industries.

    With Land Viewer’s change detection tool, farmers can quickly identify the areas on their fields that were damaged by hail, storm or flooding. In forest management, satellite image detection of changes will come in handy for estimation of the burned areas following the wildfire and spotting the illegal logging or encroachment on forest lands.

    Observing the rate and extent of climate changes occurring to the planet (such as polar ice melt, air and water pollution, natural habitat loss due to urban expansion) is an ongoing task of environmental scientists, who may now have it done online in a matter of minutes. By studying the differences between the past and present using the change detection tool and years of satellite data in Land Viewer, all these industries can also forecast future changes.

    Top change detection use cases: Flood damage and deforestation

    A picture is worth a thousand words, and the capabilities of satellite image change detection in Land Viewer can be best demonstrated on real-life examples.

    Forests that still cover around a third of the world’s area are disappearing at an alarming rate, mostly due to human activities such as farming, mining, grazing of livestock, logging, and also the natural factors like wildfires. Instead of massive ground surveying of thousands of forest acres, a forestry technician can regularly monitor the forest safety with a pair of satellite images and the automated change detection based on NDVI (Normalized Difference Vegetation Index).

    How does it work? NDVI is a known means of determining vegetation health. By comparing the satellite image of the intact forest with the recent one acquired after the trees were cut down, Land Viewer will detect the changes and generate a difference image highlighting the deforestation spots, which can further be downloaded by users in JPG, PNG or TIFF format. The surviving forest cover will have positive values, while the cleared areas will have negative ones and be shown in red hues indicating there’s no vegetation present.

    A difference image showing the extent of deforestation in Madagascar between 2016 and 2018; generated from two Sentinel-2 satellite images. (Image: LandViewer)
    A difference image showing the extent of deforestation in Madagascar between 2016 and 2018; generated from two Sentinel-2 satellite images. (Image: LandViewer)

    Another widespread use case for change detection would be agricultural flood damage assessment, which is of most interest to crop growers and insurance companies. Whenever flooding has taken a heavy toll on your harvest, the damage can be quickly mapped and measured with the help of NDWI-based change detection algorithms.

    Results of Sentinel-2 scene change detection: The red and orange areas represent the flooded part of the field,; the surrounding fields are green, meaning they avoided the damage. California flooding, February 2017. (Image: LandViewer)
    Results of Sentinel-2 scene change detection: The red and orange areas represent the flooded part of the field,; the surrounding fields are green, meaning they avoided the damage. California flooding, February 2017. (Image: LandViewer)

    How to run change detection in Land Viewer

    There are two ways you can launch the tool and start finding differences on multi-temporal satellite images: by clicking the right menu icon “Analysis tools” or from the Comparison slider ‒ whichever is more convenient. Currently, change detection is performed on optical (passive) satellite data only; addition of the algorithms for active remote sensing data is scheduled for future updates.

    A guide to Land Viewer is available here.

  • Teledyne presents image processing solutions at Xponential 2019

    Teledyne Scientific & Imaging’s Mark Anderson gives GPS World an overview of the company’s image processing solution, which uses an artificial intelligence algorithm to recognize various objects, at AUVSI’s Xponential 2019.

  • Septentrio Launches UAS Receiver, Software for Drone Market

    The AsteRx-m UAS by Septentrio.
    The AsteRx-m UAS by Septentrio.

    Septentrio has launched the AsteRx-m UAS, an RTK-accurate GNSS receiver solution specially designed for the drone market. The AsteRx-m UAS provides high-accuracy GNSS positioning with low power consumption, according to Septentrio.

    The launch of the AsteRx-m UAS board is complemented by the release of GeoTagZ software suite. The GeoTagZ suite works with the UAS camera and image-processing solution to provide centimeter-accurate position tagging of images without the need for a real-time data link.

    The AsteRx-m UAS will be on display at booth #635 during AUVSI’s Unmanned Systems 2015, held May 4-7 at the Georgia World Congress Center in Atlanta.

    Despite being Septentrio’s smallest receiver, the AsteRx-m UAS provides consistent, robust and accurate positioning from to Septentrio’s in house GNSS+ algorithm technology. The receiver delivers cm-level accuracy at less than 600 mW with GPS and less than 700 mW with GLONASS. LOCK+ technology guarantees tracking under heavy usage and IONO+ guarantees no interference in challenging ionospheric conditions, Septentrio said.

    Integration into Any UAS. One of the key characteristics of AsteRx-m UAS and GeoTagZ is the seamless integration into any UAS. AsteRx-m UAS features standard connection functionality that directly connects to a UAS autopilot, such as Pixhawk and Ardupilot. The power comes directly from a number of power sources, including micro USB, a 9-30V external power supply or the vehicle power bus. GeoTagZ is available as a library of software to integrate into an UAS image-processing tool chain.

    “We want to make UAS-based data collection and processing extremely simple. AsteRx-m UAS and GeoTagZ do just that,” said Jan Leyssens, commercial product manager at Septentrio. “The GNSS board connects seamlessly to standard hardware and cameras used on a drone. Together with our software, we provide a data collection solution that provides cm-level accuracy without the need for ground control points or real-time data links, and that integrates effortlessly with an existing UAS image processing software solutions.”