Tag: disaster response

  • Hurricane barrels toward Texas, maps show impact

    Hurricane Harvey is hitting Texas with wind speeds of at least 111 mph. Widespread flooding is a risk for Texas and neighboring states as public safety groups and communities prepare.

    Esri has created a new Hurricanes and Tropical Cyclones Story Map that identifies the potential impact of the storm through a variety maps, including:

    • Public Information Map — identifies the current and recent location of Harvey as well as forecast positions and probable track; additionally, the shaded area is called the “cone of uncertainty,” the likely path of the center of Harvey.
    • Impact Summary Map — shows the storm surge by identifying locations most at risk for life-threatening inundation from storm surge; accordingly, to Esri’s data, the total population at risk is 248k people, 99k households, and 10k businesses.
    • Forecast Precipitation Map — forecasts the amount of rain expected within the next 72-hour period.

    Click here to view the story map.

    Hurricane-Harvey-Esri-storymap

  • Intergeo preview: Photogrammetry heads for new markets

    We’ve entered a new golden age for photogrammetry, powered by the ease of digitizing images and their ubiquitous availability.

    Photogrammetry is the science of making measurements from photographs. While science drives the process, business is driving a wealth of associated applications.

    “Photogrammetry is ahead of its time because everything is already fully digital in this discipline,” said Heinz-Jürgen Przybilla, professor of Geodesy at Bochum University of Applied Sciences.

    UAVs, digital cameras and image sensors on the Internet of Things, in aircraft or on satellites are opening up applications that only the world of science was predicting a few years ago.

    Intergeo Show. The developments that photogrammetry is setting in motion will be on display at Intergeo 2017, Sept. 26–28 in Berlin.

    The art of using photographs for surveying, which laid the foundation for present-day photogrammetry, dates back 150 years and involves developing processes to derive information from images that go far beyond simply viewing them. In recent years, the discipline has made huge progress, with businesses discovering new application areas.

    The high level of automation makes it possible to interpret huge volumes of data from sources such as large-scale satellite imagery. The process also works in real time — a prerequisite in applications such as autonomous navigation.

    “Automation in image evaluation makes people incredibly flexible. We’re no longer restricted to viewing the world from our own height,” said Christian Heipke, president of the International Society for Photogrammetry and Remote Sensing (ISPRS).

    Photogrammetry applications are moving into numerous sectors and tackling a host of challenges. Global change is being documented using images from space. Image data is being used to forecast crop sizes. Inaccessible structures are being monitored with the help of images from UAVs.

    As Przybilla said, image evaluations from UAVs are already being used for high-precision land register surveys. What took days manually can now be accomplished in minutes.

    Disaster Prevention. Other applications include disaster prevention and monitoring refugee movements. In many cases, drones provide a rapid overview, while satellites offer the large-scale basis for evaluating a situation.

    In architecture, 3D models from aerial images complement computer-aided design (CAD) plans.  In conjunction with virtual reality, 3D models enable design variants for a building to be depicted in the actual environment.

    Information is also being shared with disciplines such as computer vision and robotics, with “seeing robots” increasingly recording and mapping their surroundings.

    Industrial site in 3D: A digital elevation model from a series of overlapping photos taken from a UAV at 300 feet above ground level.
    Industrial site in 3D: A digital elevation model from a series of overlapping photos taken from a UAV at 300 feet above ground level. (Image: Eric Gakstatter)

    More and more, the processes and algorithms on which image evaluations are based are becoming like a “black box” for users — hard to understand from the outside. While the black box is getting bigger, scientists are refining their methods.

    “We’re increasingly combining existing data and this will leverage a huge amount of new potential,” explained Heipke. The black box for photogrammetry will be discussed at Intergeo.

    Once the process of image content recognition is automated, applications are limitless.

    Several sessions organized by the German Society for Photogrammetry, Remote Sensing and Geoinformation (DGPF) at Intergeo will be looking at topical issues in photogrammetry. The contents of the presentations range from new sensors and remote sensing to “engineering geodesy meets photogrammetry.” Numerous companies will also be showcasing their image-evaluation solutions at Intergeo’s specialist exhibition.

  • A network in a box with GPS: Plum Case for challenging environments

    1-13_commandpost_exercise_lIf you are responding to a disaster that may have destroyed cell phone towers, and you have no power or otherwise limited connectivity, how will you work GIS data and imagery under these seemingly impossible conditions? Every map query, location shift, every zoom in/out requires a fresh query of the data from the server — precisely what you can no longer do. Now an inventor has come forward with a device that can provide phone or internet connectivity in environments that would be impossible for traditional equipment.

    As a frame of reference for this disaster scenario, five years ago when I was still working for Pictometry, I participated in a large DHS disaster response exercise in New York City. This was a full blown NIMS exercise that included more than 250 local, state and federal participants at the command center with even more personnel in the field. The exercise simulated a massive oil spill between Staten Island and Bayonne and was a full mobilization of personnel and equipment including the Coast Guard and related commercial businesses just as if it was a real event.

    The ad hoc command center was set up in a large ballroom of a Staten Island hotel and was organized and operated in accordance with “National Incident Management System” (NIMS) guidance. The Incident Command and Control Center was laid out as recommended by the Incident Command System (ICS). Standard NIMS procedures and communications were followed as the exercise ramped up with participants arriving at the hotel setting up their equipment. Most had cell phones, laptops and other communications devices.

    containership-grounding-in-new-york-harbor-investigation-report-figure-2For my part I had a computer and large LCD projector to display GIS data and high resolution oblique imagery of the disaster location on a large screen for all participants to see. I was getting a lot of oohs and aahs as the measureable high resolution imagery hit the screen. For a while I was the center of attention as everyone became familiar with the visual details of the disaster site and surrounding locations. I was using a an online capability developed by Pictometry and Lockheed Martin called Intelligence On Demand (IOD). The system accessed Pictometry servers containing over 4 petabytes of measureable ortho and oblique imagery overlaid with multiple layers of GIS vector and raster data. The system was very robust and was able to help participants build a common operational picture of the unfolding scenario. But my glory was short-lived since IOD had an Achilles heel.

    NEW YORK – U.S. Coast Guard is responding to fuel oil discharged from a barge in Kill Van Kull at Mariner’s Harbor, Staten Island N.Y., Dec. 15, 2012. The barge’s tank holds approximately 147,000 gallons of #6 fuel oil. Photo: Petty Officer 2nd Class Jetta H. Disco
    NEW YORK – U.S. Coast Guard is responding to fuel oil discharged from a barge in Kill Van Kull at Mariner’s Harbor, Staten Island N.Y., Dec. 15, 2012. The barge’s tank holds approximately 147,000 gallons of #6 fuel oil. Photo: Petty Officer 2nd Class Jetta H. Disco

    IOD relied on a continuous connection to the server. Every map query, location shift, every zoom in/out required a fresh query of the data from the server. This was no problem with a fast connection but as the number of participants grew the internet connection slowed to a crawl even with a T1 line serving the facility. With more than 250 participants all crowding the line, it was difficult to send even a simple email. I was dead in the water and learned a painful lesson.

    A had a similar experience several years ago during the multiple tornado outbreaks in northeast Alabama. With power out for over a week we experienced our own isolation with no cable service, limited TV and spotty sporadic cell phone service. We had to charge our phones using our cars but had to be frugal with that since area gas pumps were also out of commission.

    plum-caseI had numerous discussions with the Pictometry engineers asking if there was some way that at the start of an event, when we identify a disaster location, that we could cache the needed imagery of the location negating the need to keep hitting the server. Not sure if that’s been done yet.

    The engineers kept referring to new methods in the works to provide connectivity in lean environments. I’ve seen some of them ranging from portable towers, overhead aircraft, satellites and even aerostats but most are not cheap or quickly available.   Two month ago at a geospatial technology showcase I saw a device that may provide the answer: the Plum Case.

    I’m not a communications/internet expert so I’m relying on third party experiences and opinions that the Plum Case, developed by a retired communications CEO, seems to be a solution for many applications. It simply is a “network in a box” that can deliver cell phone service and fast internet connectivity in locations that may have weak or seemingly no service. It does that using an array of very sensitive antennas that nurse even the weakest signals and boost them to usable connectivity for the local users.

    Below is a video clip of the Plum Case being demonstrated at the recent TechVet conference.

    The inventor, Lee Williams, said he named it a Plum because Apple was taken. Simply put, the Plum Case is a network in a box with GPS. It can provide phone or internet connectivity in environments that would be impossible for traditional devices. It does that by jumping between four wireless services and choosing the best one or MU-MIMO (Multiple User – Multiple Inputs/Multiple Outputs).

    It can provide phone or internet connectivity in environments that would be impossible for traditional devices.  It does that by using highly sensitive vertical polarity antennas spaced in a specific arrangement that far exceeds most antenna systems such as those found in smartphones, wireless cards or dongles.  As a result, this “hyper-sensitive” receiving system can extract connectivity when all other equipment indicates “no signal. Additionally, the very robust connections result in very high data transmission rates.

    What this means is that if you are responding to a disaster that may have destroyed cell phone towers, no power or otherwise limited connectivity, the Plum Case will extract connectivity under seemingly impossible conditions. Contact the people at Plum Laboratories for additional information and current user experience and testimonies.

     

  • PNT Roundup: DARPA FLA program tests sensor-loaded quadcopters

    DARPA-FLA-drone

    MicroUAVs Self-Navigate Indoors with Inertial, Cameras, More

    The sensor-loaded quadcopters edged around obstacles and achieved target speeds of 20 meters per second in a cluttered Massachusetss hangar, during initial data collection for the U.S. Defense Advanced Research Projects Agency (DARPA) Fast Lightweight Autonomy (FLA) program.

    The project develops and tests algorithms to reduce the amount of processing power, communications and human intervention needed for UAVs to accomplish low-level tasks.

    If successful, FLA would reduce operator workload and stress and allow humans to focus on higher level supervision of multiple formations of manned and unmanned platforms as part of a single system.

    Military teams patrolling dangerous overseas urban environments and rescue teams responding to disasters such as earthquakes or floods currently can use remotely piloted unmanned aerial vehicles (UAVs) to provide a bird’s-eye view of the situation.

    But to know what’s going on inside an unstable building or a threatening indoor space often requires physical entry, which can put troops or civilian response teams in danger.

    FLA technologies could be especially useful to address this pressing surveillance shortfall by furnishing operatives independent of communication with outside pilots or sensors and without reliance on GPS.

    PNT Payload

    The platform tested by DARPA researchers uses a commercial DJI Flamewheel 450 airframe, E600 motors with 12-inch propellers, and 3DR Pixhawk autopilot. It carries high-definition onboard cameras and other sensors, such as lidar, sonar and inertial measurement units.

    The tests demonstrated autonomous capabilities such as seeing obstacles and flying around them at slow speed unaided by a human controller.

    The three performer teams are Draper teamed with the Massachusetts Institute of Technology; the University of Pennsylvania; and Scientific Systems Company teamed with AeroVironment. Flights and data collection took place at Otis Air National Guard Base in Cape Cod, Massachusetts, with simulated walls, boxes and obstacles to test agility and speed.

    The tests did produce several crashes. “The only way to achieve hard goals is to push physical systems and software to the limit,” said program manager Mark Micire. Continuing tests will obstruct the venue with more obstacles and clutter. “What makes the FLA program so challenging is finding the sweet spot of a small size, weight and power air vehicle with limited onboard computing power to perform a complex mission completely autonomously.”

  • Esri’s disaster recovery tools at work in Louisiana, California

    Esri technology has been in full force in Louisiana during both the search-and-rescue phase and cleanup and disaster recovery efforts following massive flooding in Baton Rouge. Esri’s ArcGis Online is providing a way to collect, monitor and report field activities to be sure all departments are on the same page using real time imagery, data and apps.

    In an emergency situation, location is a key component in response efforts — from maps showing affected areas to first responders; to where relief supplies are located; to evacuation routes and impending weather.

    Baton-Rouge-Esri-disaster-O
    The Esri Story Map references the locations of civil air patrol photos.

    Esri’s Disaster Response Program provides software support, data support, and consulting/technical support for active disasters. The program is available to any agency supporting a disaster, regardless of whether they are an Esri customer.

    Currently, the Esri Disaster Response Program is supporting the efforts to respond to the wildfires in California as well as the flooding in Louisiana, but the tools are called into action on countless disaster situations and are available at any time.

    For the flooding, a Public Information Map is updated continuously with multiple data streams such as social media and weather reports. There are also a Flooding Story Map and a Local Impact Map available. Similar resources are available for the wildfire emergency.

  • Drones Dispatched to Nepal to Search for Survivors

    Aeryon Labs, GlobalMedic and Monadrone are working together to deploy three unmanned aerial systems (UAS) in Nepal to help locate earthquake survivors. The drones are outfitted with thermal cameras and the Aeryon HDZoom30 camera, which has an extended zoom, to look at targets from more than 1,000 feet away. 

    On Saturday, April 25, a 7.8 magnitude earthquake struck Nepal — the largest quake in 81 years in the region. More than 4,000 people have died, with death tolls expected to rise as the rubble is cleared.

    In response, Aeryon Labs deployed three of its sUAS (small UAS) and a qualified Aeryon pilot to the affected region. Aeryon is collaborating with partners GlobalMedic and Monadrone to provide aerial support to international disaster relief teams on the ground.

    The Global Medic UAV team responded immediately to the crisis in Nepal. “sUAS provide us the unmatched capability to get onsite and into the air immediately to start determining how and where to provide support to the people,” said Rahul Singh, executive director of GlobalMedic.

    Damage to, or the complete loss of, fundamental infrastructure such as airstrips and refueling facilities can make manned aircraft operations in disaster relief scenarios very challenging. Sending rescue workers into damaged structures, or rubble piles, to search for survivors also puts them in harm’s way. sUAS enable ground-based rescue teams to collect critical visual intelligence and deploy rescue resources quickly, carefully and exactly where they are most needed, the companies said.

    The Aeryon HDZoom30 is a fully-integrated, ruggedized, high performance electro-optical camera payload for UAS.
    The Aeryon HDZoom30 is a fully-integrated, ruggedized, high performance electro-optical camera payload for UAS.

    The Aeryon sUAS being sent to Nepal are equipped with thermal cameras to help locate survivors by detecting body heat, as well as the companies newest imaging payload, the Aeryon HDZoom30, which can be used at extended distances to zoom in to see a target with clarity and detail. For example, operators are able to recognize a face from more than 1,000 feet (300 meters) away. The team will also undertake aerial mapping of the affected areas, building 2D and 3D maps, so that further response efforts can be planned.

    “At Monadrone, we see sUAS as mission-critical tools that not only support day-to-day military, police and fire department needs, but can also play a vital role when disaster strikes,” said Robin Morris, director at Monadrone, Monaco. “The images the Aeryon sUAS will capture will enable the creation of up-to-date maps required to aid the disaster relief in Nepal.”

    Aeryon sUAS were also deployed in the aftermath of the August 2014 landslide that devastated the region along the banks of the Sunkoshi River in northern Nepal. Despite the high altitude of Nepal, which is challenging for many aircraft, and the rugged terrain, Aeryon sUAS proved effective and more than up to the task.

    “UAS are uniquely able to provide immediate support for disaster relief, like the earthquake in Nepal, helping rescue teams search more effectively, efficiently and safely,” Dave Kroetsch, president and CEO of Aeryon Labs, told AUVSI News. “It’s an honor to see the technology you create make such a difference. We are privileged to be able assist the aid workers who are helping the people of Nepal.”

  • Airbus Releases Satellite Imagery of Nepal Earthquake

    Following Nepal’s devastating magnitude 7.8 earthquake on Saturday, Airbus Defence and Space has acquired Pléiades satellites imagery to support the International Charter and Copernicus Emergency Management Service. The data acquired will assist in assessing the damage and help rescue organizations in the delivery of humanitarian aid.

    The before and after Pléiades images over Kathmandu (full image can be downloaded here) show the devastation caused by the earthquake. The below “before” Pléiades image was acquired on Nov. 29, 2014, and the “after” Pléiades image was acquired on April 27, 2015, two days after the earthquake.

    Kathmandu, viewed by Pléiades satellites, before and after the earthquake. (Image: Airbus Defence & Space)
    Kathmandu, viewed by Pléiades satellites, before and after the earthquake. (Image: Airbus Defence and Space)

    The Airbus Pléiades 1A and Pléiades 1B satellites operate as a constellation in the same orbit, phased 180 degrees apart. The identical twin satellites deliver high-resolution optical data products and can revisit any point on the globe, according to Airbus.

    UPDATE:

    Esri has created a Nepal Earthquake Swipe Map, which allows users to compare the pre- and post-earthquake images from Airbus Defence & Space to explore damage around Nepal. This map includes several bookmarks to help users navigate around key points of interest and landmarks that were damaged or destroyed.

    Esri-Nepal-Swipe-W

  • Alta Systems Balloon: Oblique Imagery Capture with a Light Footprint

    Alta balloon.
    Alta balloon.

    Three weeks ago, GPS World / Geospatial Solutions held a webinar highlighting new technologies for imagery and data capture. The webinar had four presenters: Paul Smith of CycloMedia, Ted Ralston with Soft Power Solutions, Peter VanAmburgh from IIF Data, and John Ciampa CEO of Alta. You can view a YouTube video of the session. Because webinar time is limited, we couldn’t cover the technologies in detail, so I’m covering some of the technologies one column at a time.

    In February, I devoted my column to CycloMedia, so you may want to review that material if you want more detail. This month I want to delve into the Alta balloon system that was presented by John Ciampa, the CEO of Alta. John was the original patent holder of Pictometry, the revolutionary high resolution geo-referenced metric oblique imagery system. He and Steve Schultz took the concept from theory to a practical functioning system that has been an industry standard for over 10 years.

    John continues his research, dividing his time between the Rochester Institute of Technology (RIT) and Florida International University (FIU) while also working with the National Science Foundation (NSF). Although Pictometry was very successful, he also understood the limitations and cost of a manned aircraft as a capture system, especially for disaster response. Pictometry was a very capable system, but John felt that what was needed was a system that had a “lighter footprint” figuratively and literally. John took his knowledge and experience, and combined it with the latest developments in micro-miniaturized technology, to develop a system that was elegant in its simplicity and usefulness.

    The Platform

    Simply put, the Alta balloon is a steerable oblique geo-referenced camera system attached to a weather balloon. By using a balloon, John solved several problems associated with manned aircraft — cost, image quality, and accessibility. A balloon is cheaper than an aircraft, doesn’t require a licensed pilot, is more easily deployable, and can “fly” at lower altitudes.

    Even a small aircraft is expensive, and requires a trained pilot and complex support logistics. A small used aircraft can run $50,000 to several hundred thousand dollars. Additionally, most high-end aerial imagery systems generally require expensive FAA-approved modifications of the airframe. This adds cost, and limits the aircraft that can be used. Equipped with Pictometry cameras and electronics, a total aircraft capture system can easily cost $300,000 and up.

    A significant factor during disaster response events is transportability and support. Past experience has shown that it can be very difficult to transport and operate even small aircraft in disaster regions, especially if the damage is widespread.  Fuel and ground support in disaster sites can also be a serious limitation. By comparison, a balloon system can be carried in a suitcase, shipped quickly, and set up in less than an hour.  Since the cost is in the range of several thousand dollars, multiple systems are practical and can be deployed in numerous remote locations. Equally impressive is that operators can be trained in less than an hour.

    But don’t get the impression that Alta is as simple as strapping a digital camera to a balloon. Achieving the image quality, accuracy and dynamic performance of the Alta system requires a very sophisticated package, including the balloon, controls, communications and sensors. The balloon system is actually two balloons, one within the other, an outer balloon and inner lift gas balloon. The outer balloon provides some external protection while presenting a consistent profile. The inner balloon provides the lift and is filled with either hydrogen or helium.

    The altitude is remotely controlled by venting lift gas to descend or by dumping water ballast to ascend.  An onboard computer and sensors can also maintain altitude autonomously. When the balloon is brought down, a tethered weight drops to several feet under the balloon. The weight contacts the ground first and “anchors” the balloon and payload for retrieval. This keeps the balloon and payload off the ground, and also makes it easier to spot.

    There are several modes of operation that are determined by the operator prior to launch:

    • “Path Mode”: The balloon is released, ascending to the programmed altitude, then drifting with the wind currents before descending back to the ground.
    • “Patch Mode – single tether”: Used to launch and retrieve the balloon. The balloon ascends to altitude, and its position is downwind based on the strength of the wind acting on both the balloon and tether.
    Patch mode with single tether.
    Patch mode with single tether.
    • “Patch Mode – multiple tethers”: Very precisely controls the location of the balloon over a limited area. This is very similar to the overhead cameras used in televised football games but in reverse, since the balloon wants to fly up.
    Patch mode with multiple tethers.
    Patch mode with multiple tethers.

    The system can also be equipped with a parachute for emergency landings, a solar trickle charger for extended missions, and even a quadcopter that can steer the balloon to specific target areas. The lift capability of the balloon permits significantly longer duration flights than a quadcopter alone. A detailed operator’s manual is available for review at the Alta website — look for the Operators Manual.

    The Payload

    The modular payload is complex, but also lightweight and compact thanks to the latest developments in miniaturization. It consists of a precision GPS unit, inertial measurement/navigation unit (IMU), an onboard computer, environmental sensors, Wi-Fi communications, and an aimable high-resolution camera on a stabilized gimbal. The camera can be RGB, night vision or even multi-spectral. The imagery is downloaded as captured and delivered almost real-time.

    Modular payload.
    Modular payload.

    The Output

    Because the balloon floats at low altitudes, image resolution is an impressive “game changer.” Here is just one example comparing a 4-inch pixel Pictometry/Bing image taken from 3,000 feet to a 1-centimeter pixel Alta image of the same location taken from several hundred feet.

    Bing (left) and Alta images of stadium seats, compared.
    Bing (left) and Alta images of stadium seats, compared.

    Similar to Pictometry, the system uses GPS and IMUs to very accurately determine the camera location and attitude. That information, linked via algorithms to the captured imagery, results in imagery that is geo-referenced, measurable and available with full metadata, including the time of capture.  I can’t over emphasize how important this is. Having instant access to imagery is nice, but having that imagery already geo-referenced means that the imagery can be quickly and easily imported into a GIS and overlaid with legacy GIS data for instant analytics.

    The system has been used for many mundane applications such a real estate, agriculture, construction/engineering and event planning. More critical applications include crime-scene monitoring, surveillance and disaster response. Recently, in response to a South Florida Mall shooting, police launched an Alta balloon to view the crime-scene location. The imagery was instantly and continuously sent to police station computers and mobile devices of responders en route to the mall for pre-planning of their response. Viewing rooftops and walkways for victims and perpetrators, a near real-time operational picture was provided to police before putting themselves and others in harm’s way.

    Actual image from an ALTA Balloon used in SWAT team maneuvers. Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m
    Actual image from an Alta balloon used in SWAT team maneuvers.

    Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m.

    The Potential

    I’m especially excited about the potential lifesaving use of Alta balloons. On numerous occasions I was involved in emergency response actions, and the dominant overarching need was high-quality imagery that could be combined with legacy data and imagery as close to real-time as possible. This system answers that need, and at a low cost. I could envision several Alta systems in every county nationwide ready to deploy on a moment’s notice. I believe that these units would be especially valuable for disaster response in second- and third-world countries. Dozens of Alta systems and trained operators could be delivered on short notice to major disaster sites, providing almost real-time common operational pictures for first responders. The added advantage is the very light need for logistics and support.

    Military applications could be equally important. The silence of balloons coupled with a small visibility profile, including almost total invisibility at night, makes them ideal for reconnaissance and surveillance.  The relatively low cost of the platforms also permits them to be expendable. In a tethered mode, the persistent “eye in the sky” could serve as a deterrent, or at a minimum make hostile activity more complicated for the perpetrators as they try to hide activities from the balloon.  The “light” logistics and fast operator learning curve are just added benefits.

    A key question raised during the webinar was FAA control. John indicated that the FAA does not consider the Alta balloons in a tethered mode subject to their control, and is currently reviewing it in a drift mode.  John further amplified that the very low altitude of operation and dual control of descent should also exempt the drifter from FAA involvement. Alta could provide a significant advantage where UAS operations are restricted or not practical.

    In a recent book, “Smaller Faster Lighter Denser Cheaper” by Robert Bryce, reviewed in the Wall Street Journal, the author argues that a similar dynamic, making less do more, drives virtually every technological change that has created the modern world, from cars and airplanes to advanced medicine, strategic metals and the iCloud. Alta balloons are certainly a good example.

    I was an early proponent of Pictometry because, unlike abstract GIS data and ortho imagery, the metric oblique imagery was easily understood by non-GIS users. I saw many examples where it saved lives because police and firefighters were able to form and exploit a common operational picture quickly. Alta has me equally excited because it brings that same capability to users with a much simpler system that delivers almost real-time imagery at a cost anyone can afford. This technology is going to help a lot of people.

  • Alta Systems Balloon: Oblique Imagery Capture with a Light Footprint

    Alta balloon.
    Alta balloon.

    Three weeks ago, GPS World / Geospatial Solutions held a webinar highlighting new technologies for imagery and data capture. The webinar had four presenters: Paul Smith of CycloMedia, Ted Ralston with Soft Power Solutions, Peter VanAmburgh from IIF Data, and John Ciampa CEO of Alta. You can view a YouTube video of the session. Because webinar time is limited, we couldn’t cover the technologies in detail, so I’m covering some of the technologies one column at a time.

    In February, I devoted my column to CycloMedia, so you may want to review that material if you want more detail. This month I want to delve into the Alta balloon system that was presented by John Ciampa, the CEO of Alta. John was the original patent holder of Pictometry, the revolutionary high resolution geo-referenced metric oblique imagery system. He and Steve Schultz took the concept from theory to a practical functioning system that has been an industry standard for over 10 years.

    John continues his research, dividing his time between the Rochester Institute of Technology (RIT) and Florida International University (FIU) while also working with the National Science Foundation (NSF). Although Pictometry was very successful, he also understood the limitations and cost of a manned aircraft as a capture system, especially for disaster response. Pictometry was a very capable system, but John felt that what was needed was a system that had a “lighter footprint” figuratively and literally. John took his knowledge and experience, and combined it with the latest developments in micro-miniaturized technology, to develop a system that was elegant in its simplicity and usefulness.

    The Platform

    Simply put, the Alta balloon is a steerable oblique geo-referenced camera system attached to a weather balloon. By using a balloon, John solved several problems associated with manned aircraft — cost, image quality, and accessibility. A balloon is cheaper than an aircraft, doesn’t require a licensed pilot, is more easily deployable, and can “fly” at lower altitudes.

    Even a small aircraft is expensive, and requires a trained pilot and complex support logistics. A small used aircraft can run $50,000 to several hundred thousand dollars. Additionally, most high-end aerial imagery systems generally require expensive FAA-approved modifications of the airframe. This adds cost, and limits the aircraft that can be used. Equipped with Pictometry cameras and electronics, a total aircraft capture system can easily cost $300,000 and up.

    A significant factor during disaster response events is transportability and support. Past experience has shown that it can be very difficult to transport and operate even small aircraft in disaster regions, especially if the damage is widespread.  Fuel and ground support in disaster sites can also be a serious limitation. By comparison, a balloon system can be carried in a suitcase, shipped quickly, and set up in less than an hour.  Since the cost is in the range of several thousand dollars, multiple systems are practical and can be deployed in numerous remote locations. Equally impressive is that operators can be trained in less than an hour.

    But don’t get the impression that Alta is as simple as strapping a digital camera to a balloon. Achieving the image quality, accuracy and dynamic performance of the Alta system requires a very sophisticated package, including the balloon, controls, communications and sensors. The balloon system is actually two balloons, one within the other, an outer balloon and inner lift gas balloon. The outer balloon provides some external protection while presenting a consistent profile. The inner balloon provides the lift and is filled with either hydrogen or helium.

    The altitude is remotely controlled by venting lift gas to descend or by dumping water ballast to ascend.  An onboard computer and sensors can also maintain altitude autonomously. When the balloon is brought down, a tethered weight drops to several feet under the balloon. The weight contacts the ground first and “anchors” the balloon and payload for retrieval. This keeps the balloon and payload off the ground, and also makes it easier to spot.

    There are several modes of operation that are determined by the operator prior to launch:

    • “Path Mode”: The balloon is released, ascending to the programmed altitude, then drifting with the wind currents before descending back to the ground.
    • “Patch Mode – single tether”: Used to launch and retrieve the balloon. The balloon ascends to altitude, and its position is downwind based on the strength of the wind acting on both the balloon and tether.
    Patch mode with single tether.
    Patch mode with single tether.
    • “Patch Mode – multiple tethers”: Very precisely controls the location of the balloon over a limited area. This is very similar to the overhead cameras used in televised football games but in reverse, since the balloon wants to fly up.
    Patch mode with multiple tethers.
    Patch mode with multiple tethers.

    The system can also be equipped with a parachute for emergency landings, a solar trickle charger for extended missions, and even a quadcopter that can steer the balloon to specific target areas. The lift capability of the balloon permits significantly longer duration flights than a quadcopter alone. A detailed operator’s manual is available for review at the Alta website — look for the Operators Manual.

    The Payload

    The modular payload is complex, but also lightweight and compact thanks to the latest developments in miniaturization. It consists of a precision GPS unit, inertial measurement/navigation unit (IMU), an onboard computer, environmental sensors, Wi-Fi communications, and an aimable high-resolution camera on a stabilized gimbal. The camera can be RGB, night vision or even multi-spectral. The imagery is downloaded as captured and delivered almost real-time.

    Modular payload.
    Modular payload.

    The Output

    Because the balloon floats at low altitudes, image resolution is an impressive “game changer.” Here is just one example comparing a 4-inch pixel Pictometry/Bing image taken from 3,000 feet to a 1-centimeter pixel Alta image of the same location taken from several hundred feet.

    Bing (left) and Alta images of stadium seats, compared.
    Bing (left) and Alta images of stadium seats, compared.

    Similar to Pictometry, the system uses GPS and IMUs to very accurately determine the camera location and attitude. That information, linked via algorithms to the captured imagery, results in imagery that is geo-referenced, measurable and available with full metadata, including the time of capture.  I can’t over emphasize how important this is. Having instant access to imagery is nice, but having that imagery already geo-referenced means that the imagery can be quickly and easily imported into a GIS and overlaid with legacy GIS data for instant analytics.

    The system has been used for many mundane applications such a real estate, agriculture, construction/engineering and event planning. More critical applications include crime-scene monitoring, surveillance and disaster response. Recently, in response to a South Florida Mall shooting, police launched an Alta balloon to view the crime-scene location. The imagery was instantly and continuously sent to police station computers and mobile devices of responders en route to the mall for pre-planning of their response. Viewing rooftops and walkways for victims and perpetrators, a near real-time operational picture was provided to police before putting themselves and others in harm’s way.

    Actual image from an ALTA Balloon used in SWAT team maneuvers. Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m
    Actual image from an Alta balloon used in SWAT team maneuvers.

    Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m.

    The Potential

    I’m especially excited about the potential lifesaving use of Alta balloons. On numerous occasions I was involved in emergency response actions, and the dominant overarching need was high-quality imagery that could be combined with legacy data and imagery as close to real-time as possible. This system answers that need, and at a low cost. I could envision several Alta systems in every county nationwide ready to deploy on a moment’s notice. I believe that these units would be especially valuable for disaster response in second- and third-world countries. Dozens of Alta systems and trained operators could be delivered on short notice to major disaster sites, providing almost real-time common operational pictures for first responders. The added advantage is the very light need for logistics and support.

    Military applications could be equally important. The silence of balloons coupled with a small visibility profile, including almost total invisibility at night, makes them ideal for reconnaissance and surveillance.  The relatively low cost of the platforms also permits them to be expendable. In a tethered mode, the persistent “eye in the sky” could serve as a deterrent, or at a minimum make hostile activity more complicated for the perpetrators as they try to hide activities from the balloon.  The “light” logistics and fast operator learning curve are just added benefits.

    A key question raised during the webinar was FAA control. John indicated that the FAA does not consider the Alta balloons in a tethered mode subject to their control, and is currently reviewing it in a drift mode.  John further amplified that the very low altitude of operation and dual control of descent should also exempt the drifter from FAA involvement. Alta could provide a significant advantage where UAS operations are restricted or not practical.

    In a recent book, “Smaller Faster Lighter Denser Cheaper” by Robert Bryce, reviewed in the Wall Street Journal, the author argues that a similar dynamic, making less do more, drives virtually every technological change that has created the modern world, from cars and airplanes to advanced medicine, strategic metals and the iCloud. Alta balloons are certainly a good example.

    I was an early proponent of Pictometry because, unlike abstract GIS data and ortho imagery, the metric oblique imagery was easily understood by non-GIS users. I saw many examples where it saved lives because police and firefighters were able to form and exploit a common operational picture quickly. Alta has me equally excited because it brings that same capability to users with a much simpler system that delivers almost real-time imagery at a cost anyone can afford. This technology is going to help a lot of people.

  • Alabama Tornadoes: This Editor’s Personal Experience

    Wall cloud approaching.
    Wall cloud approaching.

    Four years ago my wife and I moved to Lake Guntersville as our ultimate retirement location because it seemed to have ideal factors we were looking for — mountains, lakes, great fishing, mild weather, low taxes, low cost of living and genuinely nice people. This inland location had navigable water to the Gulf of Mexico and even to the Great Lakes. We liked the small town atmosphere away from coastal hurricanes, panicky road clogging evacuations, blizzard, earthquakes or big tornadoes. Well, so much for that plan as we had a front row seat to one of the biggest tornado events of the decade with one of the tornadoes passing 500 yards in front of our windows.

    Just like in the movies, on Wednesday morning, April 27, the winds started to pick up, tornado alarms sounded, and debris started flying, including outdoor furniture. The boathouse next to us had the shingles stripped off the roof like a deck of cards, and then big oak trees started toppling over. The lake looked like it was boiling violently as winds in Guntersville reached 130 mph. We could see countless power lines and transformers arcing green and then going dead. Many buildings and trees were okay while others were totally demolished.

    Downed trees caused much of the damage.
    Downed trees caused much of the damage.

    My visual estimate was that at least 10 percent of the power poles and lines were damaged or toppled. It’s now six days after the storm. Although utility crews have been busy putting in new poles and lines, much remains to be done and I’m doing this article on battery power from my car charger.

    This tornado event was unusual in that Alabama rarely gets more than one tornado at a time with most being the smaller F-1/F-2 storms. Tuscaloosa got the worst of it with an F-4 that stayed on the ground for 70 miles.

    Concrete block walls were no match for the 130 MPH winds.
    Concrete block walls were no match for the 130 MPH winds.
    This was a TV repair shop in downtown Guntersville.
    This was a TV repair shop in downtown Guntersville.

    Our county, Marshall County, was lucky with only 10 tornadoes during the 8 hour period. I don’t think any were over an F-2 but Marshall County still had 5 fatalities. Alabama had over 200 tornadoes that day with fatalities nearing 300.

    One thing that really impressed me about the people in Alabama is their resilience and willingness to help their neighbors. There was no hand wringing waiting for the government to help. Almost immediately after the first tornado you could hear the sound of chainsaws as neighbor helped neighbor dig out and clear the roads. This helped the city and county get most roads passable within a day.

    People helping people.
    People helping people.

    Local businesses helped also. Within 12 hours T.L.’s Barbeque and our favorite seafood restaurant, Crawmama’s, had a catering service set up in downtown Guntersville providing free meals for the National Guard, emergency workers and anyone who needed a hot meal. Crawmama’s is one of those hidden gems that serve seafood comparable to the best restaurants in New Orleans.

    After the tornadoes, NOAA captured ortho imagery of the affected areas using a King Air at 5000 ft. The imagery can be seen at the NOAA website. Pictometry is providing low altitude high resolution ortho and oblique imagery and there are stunning video clips of the Tuscaloosa tornado on youTube.

    The first tornado came and went so fast that I really didn’t have much time to ponder the event. However the unexpected surprise was news media reports that we could expect numerous tornadoes during the 8 hours following the initial tornado. The tornado alarms sounded again and again throughout the day and I can tell you from first-hand experience that getting through this was much easier thanks to the location based GIS services of my iPhone. Here is why.

    When the power was still on we had the luxury of watching the television news with Doppler radar and all the detailed graphics. Once the power went out all we had were tornado alarms, a portable radio and my lowly cell phone.  The tornado alarms were nerve racking since they went off so often. I later learned that the alarms are linked county-wide so a tornado threat anywhere in the county will cause all the alarms to sound. Radio stations were helpful but it was difficult to form a clear picture of the moving storms.

    IMG_1482The iPhone proved to be wonderful. It continued working even after power was lost so we could communicate with family members. From the first power outage until now the cell phone service continued un-interrupted. The service did slow and show weaker cell tower signals as the system switched to battery power and standby generators.  But it did continue to work.

    Most important, the iPhone radar mapping application from the Weather Channel provided us with a video loop of weather bands and their path on a Google map so we could see for ourselves how the storms were moving and if we would be affected. This really put our minds at ease most of the time despite numerous tornado alarms.  Throughout the day as we dodged other tornadoes, I thought about all the man-hours I and my colleagues spent in the early ’90s digitizing street centerline data and addresses ranges to build the digital street databases and other maps that are now the backbone of location based services.

    I never could get really excited about the tiny screens of smart phones but this tornado event and even more mundane applications such as navigation are making me appreciate these little devices. My iPhone has replaced my cell phone, camera, calculator, notepad, and now my GPS. I liked the navigation and Google maps of my iPhone but many times, such as in DC traffic, it was hazardous looking at the screen. So I was very pleasantly surprised with an application that turns the iPhone into a full featured car navigation system including voice navigation and real time traffic. The MotionX GPS Drive  is one of the hottest selling applications for the iPhone and I’m a convert. I bought a mounting bracket that lets me mount the iPhone on the AC vent of any rental car and I now don’t bother packing my old GPS. The only downside is that it uses up the iPhone battery so I have a 12v adapter to keep it charged when using navigation.

     

    That little iPhone and GIS keep making my life better. So for all the hand wringers nearly panicked that their iPhone tracks their location and worried about their privacy, my vote is for more and better location-based services.

    Photos: Art Kalinski