Tag: GeoIntelligence Insider

  • Geography Has Its Benefits and Liabilities

    Welcome to the geointelligence side of the Defense PNT and Geointelligence e-newsletter, a publication combining the staff, readership and subject matter of both its parents. We’ll alternate the two topic areas in this Insights column, while continuing to bring you news stories in every issue relevant to defense hardware, GPS/GNSS and PNT, and to the software and mapping side of the industry — geographic information systems (GIS) applied in defense, first responder and other government fields. That’s the geointelligence side, and I’m privileged this month to bring you the first column under that topic.

    I’m Art Kalinski, GPS World’s and Geospatial Solutions’ contributing editor for Geointelligence.  A career U.S. Navy officer, I established the Navy’s first GIS in the mid-1980s. I pioneered the use of oblique imagery for public safety and participated in numerous disaster-response actions including GIS/imagery support of the National Guard during Hurricane Katrina. I’ve worked for several companies in the imagery and mapping field.

    Next month we’ll focus on a defense hardware GNSS topic.  Now here I go on mine: how geography and mapping can correct the misperceptions of history and current public knowledge, and how GIS can support can be used in many areas including government policy and planning.

    One authoritative, properly documented map can expose and possibly correct widespread public misinformation about America, its culture and its role in history. For instance, most entering college students think America invented slavery and that the U.S. was a dominant center of slavery.

    Slavery can be considered a stain on our country’s history, but I believe this nation’s role in stopping it should also be a source of pride.

    I was shocked, although I probably should have known better, by numerous citizen-in-the-street interviews (Watters’ World, Jimmy Kimmel, etc.) showing remarkably detailed knowledge people have about popular culture such as “Dancing with the Stars” or singers and movie stars who will have absolutely no effect on the lives of those being interviewed. However, those same people seem oblivious to science, finance and politics that could have a significant impact on their lives. Some of this appalling lack of knowledge derives from a lack of familiarity with history and in particular with geography.

    One study, by Professor Duke Pesta of the University of Wisconsin, left me shaking my head. He found in his 11-year study that “Most entering college students think America invented slavery and that the U.S. was a dominant center of slavery.” Of course, Moses, the victims of the Romans, Genghis Khan, Alexander the Great, Vikings, not to mention Hitler, Stalin, Pol Pot, etc. would differ. Even at its height, the U.S. had less than 4 percent of the world slave population.

    Here is a graphic depiction showing the volume and geography of the slave trade, 1600-1900. This is from an article by Harvard Professor Henry Louis Gates, Jr., host of the PBS series “Finding Your Roots” and author of numerous papers about slavery and ancestry. The map and the data driving it originated with The Trans-Atlantic Slave Trade Database, and both are the products of an international research and collaboration endeavor.

    The project team worked with at least sixteen different data sets compiled by scholars working since the 1960s to  collect archival data on slave-trading voyages from unpublished sources and to code them into a machine-readable format. The team developed sophisticated search interfaces for three different kinds of data, as well as estimates of the size and direction of the trade. Its web site provides a range of ancillary material for educators, including lesson plans and maps, and provides an opportunity for researchers everywhere to continue to contribute their discoveries.

    Refer again to the map. It is truly a powerful document.

    My History

    Lest you think that I’m a disconnected observer of slavery let me share a little family history. I learned about slavery first-hand at my grandmother’s and uncle’s knee. They were both slaves.

    In the early twenties, my grandparents immigrated to the U.S. They worked hard, saved their money, had two boys born in Chicago and then moved back to Poland, buying a farm and sawmill with their life savings. In 1938, on his 18th birthday, my father chose to move back to the “New Country” so as not to lose his U.S. citizenship. That was a lucky move, since in 1939 when Hitler invaded Poland from the West, Stalin seized the opportunity and invaded Poland from the East. Stalin, like Putin today, wanted the very fertile farmland that was a lacking in Russia.

    (If you read my review of the geopolitical book The Accidental Superpower by Peter Zeihan, although large, Russia lacks adequate prime farmland and always coveted the very fertile region which is now Ukraine.)

    When Russian troops invaded, my grandfather was executed in his own front yard and my grandmother and uncle were given 15 minutes to pack their belongings and board cattle cars for Siberia. As part of Stalin’s massive land grab, 1.7 million Poles and Ukrainians were deported in sub-zero freezing weather to work as slave labor in concentration camps.

    Map from http://kresy-siberia.org
    Map from http://kresy-siberia.org

    The speed of the invasion and deportations was so fast and unexpected that it was very disorienting. With dead bodies everywhere and only 15 minutes to gather possessions, many residents were in shock and not thinking clearly. One example: A woman who packed opera gloves and glasses. My grandmother understood the geography she would face and had the good sense to pack warm clothing and a large down comforter, a decision that saved her and my uncle.

     

    Of the 1.7 million deported to the gulags, 100,000 died on the unheated train trips alone. Countless others died in the slave camps of Siberia, with less than 500,000 ultimately surviving. When the Russians, Brits and Americans became allies in 1942, my uncle was able to join the British Army and ultimately fought at Monte Casino and the Italian Campaigns. This photo shows the surviving members of his 60-man unit — my uncle, center front row.
    I wish I had been old enough to learn and understand all the details of their ordeal, but much of it wasn’t fit for young ears. I did gain a visceral appreciation of the horrors of war, and slavery in particular.

    The U.S. Civil War

    Northeast Alabama, Huntsville and Lake Guntersville in particular, is where my wife and I chose to retire. Perfect balance of weather, scenery, quality of life and, most important, the people. We’ve made many good friends here, and a few can still tie themselves to direct descendants of the Civil War. Many, including my wife, still feel pride in the bravery their family members exhibited, just as I feel pride for the World War II military service of my U.S. Navy dad and three uncles.

    According to historians, the South almost won the war had it not been for geography and the superior industrial base of the North. Additionally, those of you that have been in combat know that loyalty and personal bravery are seen at the unit level, and both American sides fought fiercely and bravely. Nationalism, philosophy and major political decisions are made at pay grades well above the unit level and are not in the forefront of a soldier’s mind during battle.

    Map from http://lincolnmullen.com
    Map from http://lincolnmullen.com

    There are some that claim that the Civil War was about states’ rights and not slavery. Ask John Brown and other abolitionists. Let’s be honest — the elephant in the states’ rights room was slavery. It pitted brother against brother. Even Ulysses S. Grant and Robert E. Lee were both classmates at West Point. Although on different sides, it took both sides to have the war, the bloodiest in our history. However, what both Union and Confederate troops created was an undeniable truth of American history and American exceptionalism.

    To the best of my knowledge, this is the only country in the history of the world that fought a war with itself to free its own slaves.

    Other countries have been conquered and slaves freed; in some, slaves revolted and freed themselves while other countries freed their slaves after seeing what the U.S. went through. But no other example matches the U.S. Civil War.

    One benefit of having served as a career naval officer is that it exposed me to many parts of the world — Europe, Middle East, Asia, Africa, Latin America, the Caribbean — and not just tourist destinations. The United States still isn’t perfect, but in all my travels around the world, one observation is dominant about life on this geoid.

    Whether you or your ancestors came here across the Bering Land Bridge, on the Mayflower, in the hold of a slave ship, through Ellis Island or on a 747, chances are pretty good that your life here is much much better than it would have been had your ancestors stayed where they were.

    So, “Johnny,” America didn’t invent slavery, it wasn’t even the major slavery player. But we sure did put a stake in the ground to stop it, and we’ve been freeing people around the world ever since. Instead of pointing to our slave history with shame, we should instead point to the 500,000 casualties that started the path toward freedom. Are life and attitudes in the U.S. perfect? Absolutely not, but look at what we stopped, and look at what we are perfecting.

  • What3words gets competition in Xaddress

    Last year, I wrote about a revolutionary addressing system called what3words. I thought that the concept was brilliant in its simplicity and was embarrassed that I didn’t think of it — or at least that someone with a GISP attached to their name didn’t think of it (certified geographic information systems professional).

    (Photo: what3words)
    (Photo: what3words)

    It was, in fact, invented by a musician who got tired of not being able to find the exact location of his next gig.

    What3words certainly made its mark. Since 2013, what3words has received numerous high visibility tech awards and raised more than $13.5 million to expand its use. It’s being used by the United Nations, many commercial shipping firms, Google and Esri. What3words even attracted the personal interest of Prince William and Kate.

    Some naysayers point to the lack of accuracy and precision (only as good as GPS, so not perfect), but what3words has opened a lot of eyes and has even become the addressing standard for the entire country of Mongolia.

    Although some parts of Mongolia are very modern, like the photo to the right, the majority of the country is still isolated with no street addresses, not to mention a nomadic population.

    Other challenging location problems include specific homes in third-world shanty towns, such as Rio’s favelas, or weekend tailgating locations at college football games.

    The bottom line is that we need reliable universal addressing primarily for locations that are not adequately served by conventional street addresses. Most agree that numeric Lat/Long coordinates are the simplest and shortest description of a position on Earth, but there is one big problem. Humans have a hard time remembering and relating to long strings of numbers. Additionally, communicating long number strings can be difficult with little or no way to error check the results other than maybe a checksum digit.

    Numerous systems have been developed to provide understandable and memorable addresses, but what3words seems to have received a lion’s share of the public interest. Others on the “me too” wagon included systems such as Geohash, Mapcode, Openlocationcode and Xaddress. All encode a set of coordinates into more humanly memorable descriptors.

    Although I’m pretty much sold on the utility of what3words, recently released Xaddress, which Paraguayan founder Roberto Dam placed into the public domain this year, has benefits that make it a strong contender.

    Why Xaddress?

    First, I have to preface that I’m not a programmer, and my experience with GitHub and the correspondingly technical community is limited. I struggled with the encoding and decoding process used in Xaddress, since its key selling point is that it is a process that doesn’t require a computer or even a smartphone.

    After reading and mucking around the internet, I ran through a number of rabbit holes and trails with geohash, hash-tagging and spatial math discussions that led me to mathematician Felix Klein and his famous Klein’s bottle (which has nothing to do with this issue, but in which I felt trapped).

    I then read discussions about the value of mnemonics and how it helps humans relate to complex numbers or other difficult memory tasks. This is where both what3words and Xaddress share a common trait — they both display locations using memorable words. But Xaddress adds four new wrinkles:

    1. Although the encoding and decoding of a location into an Xaddress is most easily done using the algorithm on a computer or smartphone, the process can be done manually. It’s not quick and easy, but it can be done.
    2. The Xaddress also contains a visual graphic object or avatar that is used as a visual error check. If you get the address slightly wrong, the avatar displayed will be completely different. Here is a sample showing slight differences in the number resulting in completely different avatars.
    3. Xaddress also adds the city/country to identify the rough location. (Of course, this could also be done with what3words.)
    4. Lastly, Xaddress is an open-source system, unlike the patented what3words system.

    xaddress-avatars-w

    There is much more to Xaddress than I can cover in this short column, so you may want to read Roberto Dam’s more detailed article describing the inner workings of Xaddress. (The numeric to word-encoding process is a bit hard to follow, but give it a chance.)

    There is extensive technical information, discussions and code on GitHub.

    Additionally, the Xaddress website has numerous other examples and references, and you can try encoding your own addresses.

    screen-shot-xaddress-w

    According to NGOs, the majority of the Earth’s population, an estimated 6 billion people, have no address. In third-world countries of Africa, the Middle East, South East Asia and Latin America, it’s difficult to do the things we take for granted, such as receiving mail, getting parts or supplies to start even a simple business, and — even more critical — getting emergency responders to a fire or medical emergency.

    Perhaps, like cellphone technology permitted third-world countries to skip the effort and expense of landlines, new addressing systems may be a shortcut to leapfrog universal addressing.

  • Metric oblique image collection with UAVs

    Combining the best of two technologies for rapid situational awareness

    Sometimes we get stuck looking in our own backyard for solutions, only to discover that those on the other side of the fence have been solving similar problems in a parallel effort. That was the case with metric oblique imagery when I joined Pictometry in 2007 and learned a little about the history of the players.

    idan-w
    Idan oblique imagery software ObliMapper.

    Seems that a year after Pictometry inventors and patent holders, John Champa and Steve Schultz, filed their patent in 2002, another company, Idan, located in Israel, came up with the same solution. Idan filed for a U.S. patent in 2003, only to learn that they were too late.

    Ironically, I learned from Joseph Freund, CEO and founder of Idan, that the Idan system was actually developed in 1996, but kept secret until declassified in 2003.

    Although too late for Idan’s patent application, a mutual respect grew between the oblique pioneers. Over the years, Idan and Pictometry worked a number of joint efforts. Idan brought an especially unique perspective to technology, because for them, it was a matter of life and death. When you are a country the size of New Jersey and surrounded by countries literally dedicated to your destruction, your collective mind gets focused very sharply. That was exactly the case with the geospatial firm Idan, who worked very closely with the Israeli Defense Force (IDF) to protect their country.

    Over the years, Pictometry became the leading collector of metric oblique imagery and focused on exploiting its vast image library for both public and private users. Today, after merging with Eagle View, Pictometry focuses on commercial application with remote roof measurement being its dominant business. Idan, however, never lost focus on its prime mission: defense. Idan continued to hone the technology and added new tools and hardware with the goal of building the most effective early-warning system with superb analysis capabilities.

    A Robust Viewer

    Idan developed and battlefield-tested tools to exploit oblique imagery. Its Oblivision viewer is different from other oblique image viewing systems in that it shows five synchronized views — an ortho view and four oblique views — with all views moving together as the operator shifts locations.

    At first, this can be a bit overwhelming, with a lot of movement and much data to take in. But with use, the rich visual environment becomes second nature and provides the operator with an effective visualization environment.

    In addition to multiple views, Oblivision provides measuring tools, both horizontal and vertical, GIS vector-data overlay, and analysis tools such as line-of-sight visibility, shadow and explosion vulnerability.

    Here is an interactive example of a joint effort using Oblivision Online to view oblique imagery of Sacramento captured by Pictometry.

    An interactive example of a joint effort using Oblivision Online to view oblique imagery of Sacramento captured by Pictometry.
    An interactive example of a joint effort using Oblivision Online to view oblique imagery of Sacramento captured by Pictometry.

    Improved Image Quality

    Freund explained that Idan’s image quality has seen steady improvement through a joint project with Simplex using Idan’s own-built oblique camera system based on the 100-mp Phase One iXU camera. This has resulted in image resolutions exceeding 3 centimeters ground sample distance (GSD) from flight altitudes of 450 meters.

    ObliMapper: The UAV link

    A shortcoming of most oblique capture systems is that image capture is a complex and cumbersome process not suited for nimble response. The cameras and aircraft require significant preparation, on-station time and extensive post processing. The need for rapid image capture with oblique capabilities prompted Idan engineers to test options that take advantage of small, rapidly deployed UAVs.

    Idan engineers developed a capture system capable of rapid focused area of interest image capture that fills the need: ObliMapper. Using compact georeferenced cameras mounted on COTS (commercial-off-the-shelf) UAVs, the ObliMapper system not only captures the imagery; the same system pre-plans and directs the flight of the UAV to optimize the entire capture process.

    dji-mavic-w
    The DJI Mavic UAV.

    Simply stated, the work process can be summed up as follows:

    • Flight planning
      • The user selects the area of interest and identifies the camera being used.
      • The system then creates a route file and uploads it to the drone.
    • Image capture
      • The drone flies autonomously according to the flight plan.
      • The camera captures the imagery.
      • The images are downloaded to the user’s computer.
    • Processing
      • The system automatically processes the images and metadata.
    • Analyze
      • The user views the up-to-date oblique images from all directions with accurate measurements on the oblique images and overlaid GIS data, contour lines, slopes, visibility, etc.

    Two YouTube videos provide an excellent overview of the system and process:

    https://youtu.be/SY1KaE3VfzY

    oblimapper-wNumerous enhancements of ObliMapper are being tested, including 3D model creation using Agisoft or Pix4D, image capture at night, and even the use of a swarm of UAVs to rapidly capture an area of interest in a single pass in hostile areas.

    The images captured by the system have a positional accuracy of 5-15 meters, but post processing can result in accuracies in the 30-60 centimeter range.

    Now that the Pictometry patents have expired, many companies are entering the oblique image market. I expect that improvements and new capabilities will follow regularly; however, from my view at this time, no one comes close to the vast oblique image library built by Pictometry (now over 4 Petabytes and 150,000,000 images) and no one seems to have the technical expertise that Idan has developed to exploit oblique imagery.

    For more information, visit the following websites:

  • A network in a box with GPS: Plum Case for challenging environments

    1-13_commandpost_exercise_lIf you are responding to a disaster that may have destroyed cell phone towers, and you have no power or otherwise limited connectivity, how will you work GIS data and imagery under these seemingly impossible conditions? Every map query, location shift, every zoom in/out requires a fresh query of the data from the server — precisely what you can no longer do. Now an inventor has come forward with a device that can provide phone or internet connectivity in environments that would be impossible for traditional equipment.

    As a frame of reference for this disaster scenario, five years ago when I was still working for Pictometry, I participated in a large DHS disaster response exercise in New York City. This was a full blown NIMS exercise that included more than 250 local, state and federal participants at the command center with even more personnel in the field. The exercise simulated a massive oil spill between Staten Island and Bayonne and was a full mobilization of personnel and equipment including the Coast Guard and related commercial businesses just as if it was a real event.

    The ad hoc command center was set up in a large ballroom of a Staten Island hotel and was organized and operated in accordance with “National Incident Management System” (NIMS) guidance. The Incident Command and Control Center was laid out as recommended by the Incident Command System (ICS). Standard NIMS procedures and communications were followed as the exercise ramped up with participants arriving at the hotel setting up their equipment. Most had cell phones, laptops and other communications devices.

    containership-grounding-in-new-york-harbor-investigation-report-figure-2For my part I had a computer and large LCD projector to display GIS data and high resolution oblique imagery of the disaster location on a large screen for all participants to see. I was getting a lot of oohs and aahs as the measureable high resolution imagery hit the screen. For a while I was the center of attention as everyone became familiar with the visual details of the disaster site and surrounding locations. I was using a an online capability developed by Pictometry and Lockheed Martin called Intelligence On Demand (IOD). The system accessed Pictometry servers containing over 4 petabytes of measureable ortho and oblique imagery overlaid with multiple layers of GIS vector and raster data. The system was very robust and was able to help participants build a common operational picture of the unfolding scenario. But my glory was short-lived since IOD had an Achilles heel.

    NEW YORK – U.S. Coast Guard is responding to fuel oil discharged from a barge in Kill Van Kull at Mariner’s Harbor, Staten Island N.Y., Dec. 15, 2012. The barge’s tank holds approximately 147,000 gallons of #6 fuel oil. Photo: Petty Officer 2nd Class Jetta H. Disco
    NEW YORK – U.S. Coast Guard is responding to fuel oil discharged from a barge in Kill Van Kull at Mariner’s Harbor, Staten Island N.Y., Dec. 15, 2012. The barge’s tank holds approximately 147,000 gallons of #6 fuel oil. Photo: Petty Officer 2nd Class Jetta H. Disco

    IOD relied on a continuous connection to the server. Every map query, location shift, every zoom in/out required a fresh query of the data from the server. This was no problem with a fast connection but as the number of participants grew the internet connection slowed to a crawl even with a T1 line serving the facility. With more than 250 participants all crowding the line, it was difficult to send even a simple email. I was dead in the water and learned a painful lesson.

    A had a similar experience several years ago during the multiple tornado outbreaks in northeast Alabama. With power out for over a week we experienced our own isolation with no cable service, limited TV and spotty sporadic cell phone service. We had to charge our phones using our cars but had to be frugal with that since area gas pumps were also out of commission.

    plum-caseI had numerous discussions with the Pictometry engineers asking if there was some way that at the start of an event, when we identify a disaster location, that we could cache the needed imagery of the location negating the need to keep hitting the server. Not sure if that’s been done yet.

    The engineers kept referring to new methods in the works to provide connectivity in lean environments. I’ve seen some of them ranging from portable towers, overhead aircraft, satellites and even aerostats but most are not cheap or quickly available.   Two month ago at a geospatial technology showcase I saw a device that may provide the answer: the Plum Case.

    I’m not a communications/internet expert so I’m relying on third party experiences and opinions that the Plum Case, developed by a retired communications CEO, seems to be a solution for many applications. It simply is a “network in a box” that can deliver cell phone service and fast internet connectivity in locations that may have weak or seemingly no service. It does that using an array of very sensitive antennas that nurse even the weakest signals and boost them to usable connectivity for the local users.

    Below is a video clip of the Plum Case being demonstrated at the recent TechVet conference.

    The inventor, Lee Williams, said he named it a Plum because Apple was taken. Simply put, the Plum Case is a network in a box with GPS. It can provide phone or internet connectivity in environments that would be impossible for traditional devices. It does that by jumping between four wireless services and choosing the best one or MU-MIMO (Multiple User – Multiple Inputs/Multiple Outputs).

    It can provide phone or internet connectivity in environments that would be impossible for traditional devices.  It does that by using highly sensitive vertical polarity antennas spaced in a specific arrangement that far exceeds most antenna systems such as those found in smartphones, wireless cards or dongles.  As a result, this “hyper-sensitive” receiving system can extract connectivity when all other equipment indicates “no signal. Additionally, the very robust connections result in very high data transmission rates.

    What this means is that if you are responding to a disaster that may have destroyed cell phone towers, no power or otherwise limited connectivity, the Plum Case will extract connectivity under seemingly impossible conditions. Contact the people at Plum Laboratories for additional information and current user experience and testimonies.

     

  • NGA hackathon creates new tools for disaster response

    Hackers-2-GEOINT-WThe National Geospatial-Intelligence Agency (NGA), GEO Huntsville and AEgis Technologies hosted a two-day inaugural hackathon May 2-3 at Cummings Research Park in Huntsville, Alabama, dubbed #GEOHackHSV.

    Most of you are familiar with hackathons, but this one was focused on geospatial solutions for first responders with NGA’s GeoQ as a foundation. The goal was to hack unclassified geospatial datasets and open-source tools to build effective solutions for disaster response and recovery.

    The foundation – NGA’s GeoQ

    Ray Bauer, who heads up the NGA GeoQ effort, was the keynote speaker. He explained how GeoQ meets the goals set by former NGA Director Latisha Long and current Director Robert Cardillo to take advantage of open-source data, applications and most important talent. Ray explained how the growing complexity of the GEOINT world forces NGA to take advantage of every geospatial resource available while keeping their classified work secure.

    Ray stated NGA’s hackathon goals, specifically:

    “We are interested in working with participants to identify and create new, interactive and efficient ways of reading, disseminating and analyzing tons of data from disparate systems. We highly encourage leveraging open-source tools and other software solutions participants bring to the table. This hackathon is not just for those entrenched in the geo world! We’re interested in everything from new mapping interfaces, mobile solutions, lightweight and portable information dashboards, hardware integrations with commercial off-the-shelf tools like sensors and UAVs, and everything in between!

    “The intent of this event is to think outside the box and employ new tools and alternative open-source data to more efficiently and accurately send the most relevant data to emergency responders quickly. Currently there are dozens of data sets that make it difficult to quickly search and integrate into a common operational environment, particularly across the sectors: firefighter, police, hospital, dispatcher, HEMSI, air evacuation, utilities, Department of Transportation, etc. How do we share information among these groups during disaster situations such as tornadoes, hurricanes, shootings, flooding, significant traffic events, chemical spills and other potentially catastrophic events?”

    For those of you not familiar with GeoQ, there is an excellent overview produced by NGA that is on Youtube.

    GeoHuntsville hackathon goals

    Hackers-1-GEOINT-WThe pre-event announcements listed the following goal.

    Combine commercial and proprietary hardware and software solutions to create unique concepts/solutions. Specifically:

    • Solve disparate data problems among current open source data sets (i.e. overlaying multiple shape files with real-time data from multiple sources such as emergency responder software, sensors in the field, social media, e.g.).
    • Recreate more aesthetically appealing user interfaces considering numerous data sets — to include mobile solutions.
    • Suggest new solutions leveraging a subset of currently available data. (Use the data we give you, use the data you bring, use the data we don’t know about — and create a solution to a problem we don’t know exists.)
    • Integrate new solutions or disparate data into open source tools, like GeoQ.
    • Identify ways to more efficiently and accurately receive and analyze updates from the field. (This could be anything from a tool an emergency responder uses or social media resources.)
    • Come up with a way to disseminate critical information across agencies and geographic locations.

    First responder involvement

    The aspect of this hackaton that was particularly valuable was the direct involvement of numerous Huntsville first responders. Policemen and firemen were able to explain their difficulties and needs face to face with the programmers and engineers who were participating in the hackathon, so the participants were not operating in a vacuum. See my interview with the Huntsville fire chief.

    Fueled with sodas, chips and snacks, the hackers worked overnight to accomplish the goals. At stake were three prizes, including a top prize of $1,000. The prizes were not huge, but they provided some incentive including bragging rights.

    Although some results were similar to existing applications, the different approaches were still very impressive for a two-day event. You may find one or two applications worth your further investigation for integration in your systems.

    The teams

    Mobile Damage Assessment

    Micah Cleveland and Larry Wilbourn provided firefighters with a way to directly report the status of damaged structures or casualties and triage via a smartphone.

    Situational Awareness

    The team of Larry Mason, Tyler Hughes and Michael Carroll built an application displaying real-time locations of all emergency vehicles and the display of preplan floor plans and imagery to show details such as electric and gas cut offs.

    Virtual Reality GIS Display

    Jason Rade and Jason Nofki demonstrated their system of displaying GIS data and imagery using a virtual reality headset. They indicated that the next step was to display the data as augmented reality.

    OpenSensorHub

    Steve Jones demonstrated a system to display Internet of Things (IoT) devices as live links on a map to display data, imagery and video from those sources. (Steve participated in the event, but did not enter into the competition.)

    WEBEOC data to current devices

    Two team members worked a problem proposed by Madison County Emergency Management Agency. They read legacy format WEBEOC data and converted the information into more modern device data structures.

    And the winners are…

    • First Place: Mobile Damage Assessment
    • Second Place: WEBEOC data to current devices
    • Third Place: a tie between Situational Awareness and Virtual Reality GIS Display

    A few gems developed at the hackathon may be useful with your applications effort. If you need additional information regarding the hackathon and participants, contact Chris Johnson of GeoHuntsville at [email protected].

  • Skyline PhotoMesh 3D: On-the-fly models while flying

    During my tenure as the GIS manager for the Atlanta Regional Commission, I had the opportunity to work with many first responders, primarily police, fire and E911. I always promoted the capabilities of GIS to develop a common operational picture.

    However, most first responders were not interested in becoming GIS experts, especially with traditional GIS software and ortho imagery. They just wanted easy and effective tools that would help them do their job better. Then Pictometry metric oblique imagery hit the scene. It was a game changer because it was easy to use and, most important, the oblique images provided a visual perspective that average users could grasp quickly. (See my 2008 column that explains why.)

    Soon, 3D model creation and navigation became common. In my opinion, 3D models are just a more robust way of viewing oblique views. 3D models are becoming more commonplace, but generating those models is more time consuming and resource intensive.

    A few of you may remember that four years ago, USSOCOM (U.S. Special Operations Command) had more than 20 — yes, 20 — different 3D model viewers. These were mostly proprietary systems from major contractors that required separate maintenance and support, and sometimes led to user confusion and delays, not to mention expense. USSOCOM appointed a team to evaluate and reduce the number of 3D viewers, and they got it down to two, with Skyline TerraExplorer being one of them.

    Building on that 3D reputation, Skyline Software Systems recently developed a 3D model creation capability that puts easy and rapid model creation in everyone’s toolbox. PhotoMesh is Skyline’s new 3D model creation software designed to build photorealistic 3D models as a fully automated process using auto-triangulation (AT) of multiple aerial images. Skyline can provide 3D model creation as a service or provide the software so customers can do the model creation in-house.

    Below is a screenshot of a sample model created using PhotoMesh from UAV video I shot. then geolocated by Remote GEO (see my February column). The below 3D model was processed locally by Skyline using a typical laptop, and the entire process was finished in under 35 minutes. However, if speed was critical, Skyline could generate the model in the cloud, with the whole process taking a minute or two.

    Here is a quick overview video that will give you an idea of the system capability.

    Live demo at GEOINT 2016

    While I was at GEOINT 2016 this May, I had had the chance to talk to Steve Marks, the director of business development at Skyline. He gave me an excellent video overview of PhotoMesh.

    Steve then provided additional detail in several aspects of PhotoMesh including:

    Other developers have come up with similar capabilities, but the Skyline system is the most robust I’ve seen, especially with the flexibility for very rapid model creation through the cloud or local creation in a disconnected environment. Additionally, unlike many other 3D model systems, the Skyline models do include trees and shrubs so viewshed and line-of-site analysis is very realistic and accurate.

    How would it be used?

    In actual use, I can envision first responders arriving at a scene. They could use legacy imagery such as Pictometry oblique images to build a historic as-built model. They could then launch UAV or manned aircraft and capture current geo-located video, selecting and processing images in PhotoMesh and getting back a current 3D model in minutes via the Skyline Cloud service.

    In a disconnected environment, the models could be generated locally but at a slower pace. The 3D models would permit horizontal, vertical and angular measurements. Other analyses could include: line-of-sight and viewshed, determination of blast zones and shielding, overhead hazards such as power lines.

    ince the system is so robust and easy to use, I can see it supplementing ortho and oblique imagery while providing a very user friendly common operational picture as well as very capable analytic tools.

    Retiring soon

    At age 70, I’m looking at real retirement later this year so I’m also looking for a relief. If you have an interest or know someone interested in taking over this monthly column, let me know. The folks at Geospatial Solutions and North Coast Media have been a pleasure to work with so I don’t want to leave without a replacement. You can email me at [email protected]

  • GEOINT 2016: The growing GEOINT revolution

    A few weeks ago, I attended GEOINT 2016. It was quite different from my first GEOINT in 2007. Back then, GIS and imagery were the focus of most exhibitors and presentations, with points, line and polygons plotted on paper being the norm. This year the tradecraft seems to have evolved exponentially to a broad and significantly more sophisticated collection of technologies both on the EXPO floor and in most presentations.

    New terms have solidly entered the geospatial lexicon: big data, big data analytics, exploiting social media, machine learning, activity based intelligence (ABI), predictive analytics (see my column last month), the internet of things (IoT) (see my January column), small sats, object based intelligence (OBI), cyber, human geography, open source, deep learning, machine to machine tipping & cueing, survivable space assets and the list continues to grow.

    I was pleased to hear something I believed for quite a while. There is a growing consensus that Cyber attacks need to be displayed as events with geospatial components (location of servers, nodes, networks, etc.). That kind of visualization should provide valuable insight into these growing and complex attacks.

    Keynotes

    National Intelligence Director James Clapper.
    National Intelligence Director James Clapper.

    The 75-year-old Director of National Intelligence (DNI) James Clapper poked fun at himself indicating that this would be his last year as DNI and he was counting down the days. He said that he was taught to always respect his elders but finding one was getting increasingly difficult. He also highlighted the same feeling I had that the GEOINT community has gone through some significant changes.

    Computers have evolved from IBM’s 1997 Deep Blue winning only one of four chess games against Gary Kasperov to the recent contest of Google AlphaGo against the world master of the much more complex Chinese board game “Go.” AlphaGo won four of five games primarily with moves that experts called inspired genius. It did that because it was programed not to just play but to learn as it played. So “machine learning” was a frequent topic at GEOINT with it becoming a real game changer in national intelligence work.

    Even imagery, the long standing bread and butter of GEOINT, is going through a revolutionary change. Citing NGA Director Cardillo, DNI Clapper indicated that we will soon evolve from limited overhead imagery available in certain locations at certain times to imagery of every spot on the globe every day of the year. You can watch Director Clapper’s full keynote.


    NOTE: More than 127 GEOINT related videos are posted on the USGIF website from the 2016 conference and the previous year with additional videos posted almost weekly. https://vimeo.com/trajectoryonlocation/videos/page:1/sort:date
    https://vimeo.com/trajectoryonlocation/videos/page:2/sort:date


    USGIF Award Winners

    The five USGIF award winners for 2016.
    The five USGIF award winners for 2016.

    Five awards were presented for 2016. Two of them had special interest for me — the Industry award winner ABACO Group shown in the EXPO section below and GeoHuntsville. Here is more information about the five USGIF award winners.

    Community Support Achievement Award for the GeoHunstville Exemplar City program

    GeoHSV
    The GeoHunstville Exemplar City program helps cities deal with disasters using new technology. Shown receiving the award for the GeoHunstville team are Chris Johnson and Joe Francica.

    I was thrilled to see my adopted geospatial city, Huntsville, win the Community Support Achievement Award. The GeoHunstville Exemplar City program which assists local governments in preparing, responding, mitigating and avoiding natural and manmade disasters using new technology.

    The system leverages geospatial tools including the new NGA open source collaboration environment GeoQ, UAVs and a broad array of internet accessible sensors through the IoT.

    Exhibit Hall Expo

    The conference attendance was over 4,000 with 250 exhibitors on the EXPO floor. You can view the full list of exhibitors at the GEOINT2016 website or by downloading the GEOINT 2016 smart phone app. The app has more information about the exhibitors including descriptions of their technology, contact info and website links. Here are samples of booths I found especially interesting.

    ABACO Group: ABACO of in the United Kingdom and Italy, was given the 2016 USGIF Industry Achievement Award. ABACO received the award for their augmented reality (AR) “Farm Visor,” to help farmers access big data. One aspect that caught a lot of attention was their very elegant “X-ray” tablet viewer. The user holds the tablet up and adjust the “Transparency” of the wall they are viewing and it looks like you are looking through the wall. In reality you are viewing a geo-registered image of the surrounding area that seems like you are looking through the wall. Because of exhibit hall lights and screen reflections the

    CYVIZCYVIZ builds easy to configure tactical operations centers that can display mixed media both classified and unclassified content in a common environment.

    DIFFEO: DIFFEO is an automated search assistant that uses proprietary algorithms to speed searches of Big Data even if the operator does not know what key words need to be searched.

    Hewlett Packard Enterprise Software: HP had a virtual off road driving experience. IT was not as enjoyable as Birdly, a little sickening in fact. I was told by one of the users that the reason was poor synchronization between the goggle imagery and head movement.

    International Spy Museum: The International Spy Museum, currently located on F Street in Washington DC will soon be building a much larger facility just south of the mall. They have also received considerable new material and collections for their exhibits.

    Lead’Air: Lead’Air shows several hardware configurations to capture lidar, ortho and oblique imagery.

    LizardTech: LizardTech highlighted the new ability to handle LiDAR data and display it in various ways including DEMs.

    PitneyBowes: PitneyBowes was showing their latest lossless imagery compression tools along with extensive business intelligence data.

    PLW Modelworks and Birdly: Most users consider PLW Modelworks the gold standard of digital 3D models. The PLW booth combined their superb 3B models with a virtual reality “flying machine” called Birdly. The machine uses Occulus Rift goggles with earphones for sound and even a fan blowing wind in your face to create a fairly realistic urban flight experience. The user can bank and turn or soar by flapping the wings. I tried it and it was nice.

    SigmaSpace: SigmaSpace was showing their single photon LiDAR. Their system is supposed to do a much better job discerning first and second level returns so collecting true ground elevation under a tree canopies is faster, more accurate with greater point density. Being a green laser it may also prove more effective in littoral work.

    TerraGo: TerraGo was demonstrating Edge as a tool to simplify data collection in the field using mobile devices.

  • Predictive analytics: A helping hand for first responders

    Last month I raised my anxiety level by writing about a revenant threat from terrorist-initiated biological attacks.

    The same concerns were also cited by Director of National Intelligence James Clapper during recent Congressional testimony. These “poor man’s nukes” could potentially be more devastating than 9/11 and reach into every community and even our own homes. Additionally, the threats are not easy to ferret out and just as difficult to stop in our very complex and interconnected world.

    From bioterrorism to natural disaster emergency management, predictive analytics used with geospatial tools and big data is proving to be a powerful new intelligence tool that may help counter global threats.

    TransVoyant Predictions

    TransVoyant CEO Dennis Groseclose.
    TransVoyant CEO Dennis Groseclose.

    Last year there was a lot of buzz at GEOINT surrounding a relatively new company in this field called TransVoyant. Several weeks ago, I visited TransVoyant’s Alexandria, Virginia, headquarters to learn more about their capabilities first hand. I was fortunate to be able to speak with TransVoyant CEO Dennis Groseclose, an Air Force Academy graduate who, with Tim Fleischer, a Naval Academy graduate and successful entrepreneur (Radian, PD Systems), co-founded TransVoyant.

    Previously, Dennis led industrial base optimization restructure for the $37 billion dollar unmanned space launch program for the U.S. Air Force; directed and implemented Worldwide Supply Chain Optimization for IBM; and served as vice president at Lockheed Martin. These experiences built his expertise to solve complex supply chain and global risk management problems using advanced analytical intelligence. In 2011, Dennis and Tim put their collective experience together to form TransVoyant, a company that specializes in creating live and predictive insights from real-time big data.

    The Internet of Things (IoT) has been a key component of their operation. In the mid-80s, connected remote sensors numbered in the thousands. In 2016 that number is expected to reach 6 billion connected “things” worldwide with estimates of 30 billion by 2020.

    TransVoyant collects, cleanses and analyzes over 200,000 external events around the world every minute (such as severe weather, natural disasters, labor strikes, inventory locations, news, terrorism incidents, disease outbreaks and energy prices) from real-time IoT data sources such as sensors, radar, GPS, satellites, smartphones and meters. It then continuously applies advanced data scientist-crafted analytics to these data streams to assess important current and future behaviors, impacts, correlations, patterns and exceptions that deliver live and predictive insights ranging from forecasts of port disruptions and precise shipment arrival times to forecasts of economic flows to real-time and predicted threats to people and assets. The resulting insights — provided via cloud services, system API connections, email and mobile applications — improve mission-critical decision making.

    The geospatial grid connection

    This was all sounding like science fiction and black magic until an “aha moment” for me, as Dennis explained how they use a “multi-dimensional grid cell mathematics” based data structure to apply complex algorithms to real-world data and events. This put the very complex process of continuous real-time machine analysis that “understands” normal and abnormal behavior, both current and future, into something that was familiar to me.

    Decades ago, I used the first release of ArcINFO GRID, now called ArcGIS Spatial Analyst, to complete my master’s thesis. For those of you that haven’t used a grid-cell-based GIS, let me highlight the differences between that and traditional GIS software.

    Traditional GIS software describes our world as points, lines or polygons with topology describing the mathematical spatial relationship between each geographic element and its linked record in a database. This topological model is somewhat cumbersome and slow because the shapes and topological relationships are complex.

    Grid: David Kidner, Mark Dorey & Derek Smith, University of Glamorgan, Wales, U.K. CF37 1DL
    Grid: David Kidner, Mark Dorey & Derek Smith, University of Glamorgan, Wales, U.K. CF37 1DL

    The other kind of GIS is a grid cell or raster-based GIS. The data model is significantly simpler because — unlike a traditional GIS of points, lines and polygons — the grid-based GIS world is broken up into simple uniform grid cells.

    The big advantage is that the data structure and tools lend themselves to very fast processing. Almost any mathematical formula can be used to operate on the individual or collective grid cells. Most grid-based systems use predefined mathematical operations such as shortest path analysis, interpolation including Kriging or very complex formulas using map algebra.

    So, very similar to the famous Napoleon Hill quote, “Whatever the mind can conceive… it can achieve.” With a grid cell GIS, if an analyst can think of a way to describe an analytical process and predictive results as a mathematic expression or formula, it can be done very quickly in the grid cell environment. (See two previous columns for more in-depth information — “GRID Cell Modeling” and “Topology is not Topography”.)

    So what does grid cell GIS look like in action?

    Evacuations during a flood.
    Evacuations during a flood.

    Proactive Emergency Response

    In my discussions with Dennis, a TransVoyant customer segment that caught my attention was support of first responders. Emergency responders are using TransVoyant to help with very early disaster response. One specific example is evacuation of invalid patients before a flooding disaster becomes life threatening.

    A hospital evacuation.
    A hospital evacuation.

    Using TransVoyant’s analytics on an extensive network of satellite imagery, 911 and 311 calls, water-stage sensors, street closures, weather forecasts, registries and more, responders can predict areas that are at high risk for flooding hours before flood waters rise. Among other essential emergency management actions, these early warnings provide emergency responders with the ability to identify specific neighborhoods and homes that have disabled residents who can be easily evacuated, increasing the safety and efficiency of their operations.

    Here is a screen capture of TransVoyant Continuous Decision Intelligence (CDI) predicting a flood event.

    TransVoyant Continuous Decision Intelligence (CDI) predicts a flood.
    TransVoyant Continuous Decision Intelligence (CDI) predicts a flood.

    Other Clients

    TransVoyant’s live and predictive insight solutions have attracted customers ranging from large multinational corporations to National Security and Intelligence agencies.

    I know that one hears echoes of Minority Report when reviewing the tools and capabilities of TransVoyant. However, given the serious threat we face for a situation far worse than 9/11, I have no reservations about using open-source data aggregation and brilliant analytics that correlate and uncover patterns of life and global anomalies to divine a threat.

    So, will predictive analytics be the tool that stops a bio terrorist or saves lives in critical emergency situations? I don’t know, but the potential threat is too grave not try every tool, including continuous precognition, in our collective toolbox.

    TransVoyant will be an exhibitor at GEOINT 2016 this month, so stop by and learn more.

    Since we are approaching Mother’s Day and Memorial Day, I’d like to call your attention to my May 2014 column. It’s the best column I ever wrote.

  • GIS and biological threats

    Longing for the good old days when we mostly worried about nukes

    Years ago, Navy colleague Commander Stephen Rose drew a lot of attention at the Naval War College with his essay entitled “The Coming Explosion of Silent Weapons.” The essay was awarded both the Colbert Memorial Award and the Joint Chiefs of Staff Writing Prize. I never thought that 27 years later his paper would seem so timely and highlight the critical need for the geospatial work being done by the NIH (National Institutes of Health), CDC (Centers for Disease Control), DTRA (Defense Threat Reduction Agency), U.S. Army and others.

    In his paper, Commander Rose reviewed emerging warfare technologies including chemical warfare, biological warfare, gene splicing, nano technology, remotely piloted vehicles (RPVs) and more. He compared the complexity and expense of a country trying to develop a nuclear capability compared to the relative ease and low cost of developing chemical and biological weapons, which were sort of a “poor man’s nuke.”

    Although, years later, the countries named in the paper have not changed significantly: Iran, Iraq, Syria and Libya. You can read the full paper at the Naval War College website.

    GEOINT-nuclear-O

    Worrisome at the time, most of us took comfort in the built-in deterrence that was intrinsic with chemical and, more so, biological weapons. It was a genie that with a slight change of wind direction could hurt friendly troops as easily as enemy troops. Even more problematic, biological agents could affect not only friendly troops but even the user’s families in their own home towns. So for the past 27 years we’ve whistled past the graveyard in the belief that no one would be crazy enough to use biologics.

    Although we were Cold War enemies, I knew that my Soviet counterparts shared most of my values. They enjoyed life, loved their families, relished their vodka and just wanted to go home and perhaps work on their Dachas. Even Star Trek Klingons were philosophically not that different from either of us. Enter the 21st century, and now suicide bombing has become a virtue with cash rewards paid to the surviving family members and a path to heavenly pleasures for the bomber. This, of course, changes everything.

    Congressional testimony by National Intelligence Director Clapper and others have pointed to a growing concern about chemical and biological attacks. Additionally, some terrorists are not intellectual lightweights. Recently, the former Iraq chemical and biological expert Sleiman Daoud al Afari was captured, and this week the number two man in ISIS, former physics professor Haji Imam, was killed. So is it just a matter of time before someone with the right knowledge, skills and relatively light resources builds a biologic that gets out of control?

    GEOINT-ebola-O

    Esri Federal GIS Medical Special Interest Group

    During the recent Esri Federal GIS Conference in D.C., I attended a session concerning GIS and global responses to pandemics and biological threats. The session was moderated by Dr. Este Geraghty, MD, MS, MPH, CPH, FACP, GISP, who is Esri’s chief medical officer.

    Although the discussion focused mostly on the Zika virus, much of the background information covered the geospatial aspects of the Ebola outbreak in Africa. According to one of the presenters, David Foster, a U.S. contractor and prior Air Force veteran who participated in the response, the world response was quick, but it was also a dizzying collection of government and non-government agencies with more than 80 different responding groups. Somewhat disconcerting was that no one was really in charge and communications was poor.

    Dr. Geraghty was kind enough to do a video interview, primarily focused on the concerns of this article and the need for a strong geospatial monitoring and analysis capability.

    One example: Early GIS at CDC

    In 199 when I retired from the Navy and became the GIS manager of the Atlanta Regional Commission, we established the region’s first Esri ArcView Learning Center. A number of CDC doctors and staff members took our ArcView II classes. Six months later, I was humbled with what those early students had accomplished. They used the relatively basic ArcView II to map disease outbreaks domestically and worldwide. The maps provided a valuable visualization tool that helped with understanding complex outbreaks and how to combat their spread.

    The growing need for more sophisticated spatial monitoring, analysis and display led to the creation of GRASP (Geospatial Research, Analysis and Services Program). CDC and the Agency for Toxic Substances and Disease Registry, Division of Toxicology and Human Health Sciences (ATSDR/DTHHS) worked to build the needed geospatial capability, and in 2013 Booz Allen Hamilton was awarded a competitive contract to build a unified and comprehensive GIS support system for CDC and ATSDR.

    GRASP program specifics include:

    • GIS analysis, research and geospatial statistics.
    • GIS remote sensing imagery analysis.
    • Cartographic design and production.
    • GIS web/desktop/mobile application design, development and maintenance.
    • GIS shared service design, development and maintenance.
    • GIS database design, development, management and maintenance.
    • GPS data-gathering, training and support.
    • GIS systems integration.
    • GIS training.
    • GIS project management.

    GRASP has grown into a sophisticated monitoring and analysis system. When a serious outbreak occurs, CDC responds like other emergency response organizations and stands up an Emergency Operations Center (EOC) in accordance with the National Incident Management System (NIMS). GRASP maps, imagery and visualizations help everyone understand the nature and scope of the threat by creating a common operational picture.

    This capability is further enhanced with new Esri tools such as Insight, easy geocoding, big-data deep analysis, tools for activating response teams, as well as sharing and collaboration with other federal agency and resources such as GEOINT, HUMINT (human intelligence), SIGINT (signals intelligence) and social media.

    Natural or man-caused, and who makes the call?

    Getting back to Commander Rose’s paper, one is left with the following points to ponder. Following a conventional or nuclear attack, a country instantly knows three things: that it’s been attacked, when it was attacked and where it was attacked. As a result, the subject country stands a good chance of figuring out who did the attack.

    Conversely, with a biological attack, a country may not know when or where the attack occurred, or if it was even an attack and not just a natural outbreak. This then becomes a tough decision for our analysts, because announcing a devastating outbreak as a biological attack could be tantamount to announcing a modern-day Pearl Harbor without the benefit of seeing burning ships or falling buildings. Additionally, the path from analysis to a definitive determination and by who may not be completely clear.

    Existential threat?

    So, are we in a Cornelian dilemma? Are we better off pulling back and lying low in hopes that “they” won’t hate us enough to initiate a suicidal attack that launches Armageddon? Or do we act preemptively with all our intelligence and military resources to beat down any group that shows the slightest inclination and potential to entertain this suicidal activity?

    Some politicians have stated that although we lost more than 3,000 people during 9/11, it was a relatively small percentage loss in the grand scheme of things; that the U.S. is so big and so powerful that we don’t face an “existential threat.” So one would have to ask if the loss of 10, 20 or 50 percent of our population would be existential enough?

    Complicating the issue, as some of my intel colleagues are fond of pointing out, is that if some actions we are currently taking or not taking seem to make no sense, it’s probably because you don’t know all the facts.

    Regardless, our monitoring and analysis capability may be one of the most important activities being done by our geospatial community. Additionally, we need to make sure that our protective agencies get what they need to do the monitoring and analysis to keep us safe. My hope is that we really are doing what needs to be done and not just dreaming of the good ol’ days when all we had to worry about was a nuclear attack.

  • Pictometry shares new developments at FedGIS 2016

    Ira Marcus of Pictometry describes the company’s new developments. He was interviewed by GeoIntelligence Insider columnist Art Kalinski for geospatial-solutions.com at the Esri Federal GIS Conference, held Feb. 24-25 in Washington, D.C.

  • First responder UAS video: Affordable geolocation and spatial indexing

    When I entered the civilian part of my GIS career as the GIS manager for the Atlanta Regional Commission, I tried to get first responders interested in GIS. Of course, in the early ’90s we were happy to be able to accurately draw points, lines and polygons on a piece of paper. Soon we had the luxury of ortho imagery as a backdrop for our GIS data, but I still couldn’t build a lot of enthusiasm among those first responders.

    That changed completely when we started using metric oblique imagery provided by Pictometry. I realized that since we live in an oblique/3D world many non-GIS users had real difficulty visualizing objects or locations using two-dimension visualizations such as drawings, blueprints, maps or even ortho imagery.

    By contrast, oblique views made visualization much easier for the vast majority of non-GIS users, and use of oblique imagery coupled with GIS tools exploded. Since then, many of us have been searching for faster, easier and cheaper ways to collect oblique imagery and video, and build 3D models.

    For more than a decade, major defense contractors developed leading-edge systems to capture and exploit aerial imagery and video. Although effective, as one would expect of new custom technology, the systems were very expensive and out of reach for most local government agencies. Remote GeoSystems seems to have developed a system that leverages current technology to provide capabilities that may address some of those needs at a reasonable price.

    Remote GeoSystems is in the business of capturing, displaying and managing “georeferenced” video and imagery. The company has designed and built high-end geospatial video recording systems for full motion video (FMV) and GIS mapping software primarily aimed at regulatory compliance of energy corridors, grids and critical infrastructure inspection applications.

    Fortunately, my UAV is a DJI Inspire 1. I chose the Inspire because of its reputation, and because it seems to be the best combination of features needed for first-responder work at a prosumer price (about $3,500). The Inspire can record up to 4K video/12-mp stills, has a 94-degree field of view so there is no wide angle “fish-eye” distortion typical of an action camera, and has “Lightbridge” technology that permits positive control up to 3 miles and the ability to stream live 720p video (now 1080p) back to the ground controller.

    The controller can feed large-screen video for command center group viewing via an HDMI output. Most important, the Inspire records GPS position data and altitude along with the video/imagery stream. (The DJI Phantom 3 Pro is a cheaper alternative that also records telemetry data, but if one upgrades to a 4K camera and the Lightbridge transmitter/receiver, the price approaches the integrated Inspire 1 price.)

    An .srt file.
    An .srt file.

    Since I’m always leery of marketing pieces and company demos, I wanted to try the system myself, and Remote Geo was happy to oblige. My first hands-on test was very satisfying. The LineVision software downloaded, unpacked and loaded quickly with no problems. I then recorded some aerial video of our condo building on Lake Guntersville near Huntsville, Alabama. I chose this building because it was convenient, safe to fly and a multi-story building in the open.

    In addition to recording the video, one needs to turn on the DJI Inspire metadata recording to generate the .srt file. This is done in the DJI application “General Settings/Camera” by toggling “Video Caption” on. The .srt file was initially designed to provide altitude and location data as on-screen captions, but the data can be used as needed for other purposes.

    When done with the flight and recording, transfer the video file and .srt file to your computer. Make sure the video file .mov/.mp4 and .srt file are in the same folder. Open LineVision and you will see an ArcGIS window. From the pull-down menu, load the video and you will instantly see the video play in a separate window with red position dots on the ArcMap view. As the video plays, the dot associated with the location of the UAV will turn yellow. If you click on any dot, the video will jump to that location/position on the video.

    Here are screen captures of LineVision showing the ArcGIS view of an ortho image with red dots illustrating the path of the UAV:

    LineVision 1
    LiveVision screen capture.
    LineVision 2
    Another LineVision screen capture.
    LineVision 2 Zoom
    Closeup showing the UAV track detail.

    One advantage of LineVision for first responders is that it is a complete package with ArcGIS embedded, all for a price well below $1,500. There is no need for a separate ArcMap license. Additionally, although LineVision Esri ArcGIS can display GIS data from online sources, if you have GIS data for your location loaded on your computer the system will operate in a disconnected remote environment. These sample screengrabs don’t do the system and video justice, since I recorded at 1080p rather than 4K. My laptop, this website and the reader’s playback equipment limit accurate playback of 4K content, so I did my work at 1080p.

    I can envision a disaster-response scenario where the response team arrives on site, launches a UAV, and starts recording the scene. The captured video could then be loaded, viewed, indexed and cataloged with GIS data overlays on a laptop all in a matter of minutes, even in a disconnected environment. Hours, days or months later, finding the right video clip for analysis or forensics should be significantly easier and faster.

    With the explosion of UAV hardware and software, it’s going to be an exciting year as new smaller, cheaper and more capable systems hit the market. Remote GeoSystems is working with UAV manufacturers to make LineVision capability available for many of the newcomers.

    Leveraging UAV and LineVision capability, Skyline has worked with Remote GeoSystems to bring yet another capability: rapid 3D model creation. Taking appropriate geo-located frames of the video, Skyline uses its PhotoMesh software to build fully metric 3D models in short order. The full capability of this system and its 3D viewer TerraExplorer is so extensive that I will cover it in a future column, after this month’s ESRI Federal Users’ Conference. If you see me at the UC Feb. 24-25, please stop me and say hello.

    Media: Remote GeoSystems

  • OpenSensorHub: Tackling a modern geospatial ‘Tower of Babel’

    Last summer at the Space and Missile Defense Symposium, GEO Huntsville held its annual GEOINT workshop including a keynote by NGA (National Geospatial-intelligence Agency) Deputy Director Sue Gordon. One of the sessions, presented by Mike Botts, focused on the OpenSensorHub and related information published on GitHub.

    His topic: clearing the path for use of geospatial-capable devices via the Internet, thus preventing a geospatial Tower of Babel.

    In the mid-80s, I purchased my first personal computer from Sharper Image, a 286 with a monochrome monitor. The PC was not bad for its time, and I learned a lot about personal computing, but hooking up a dot-matrix printer at the time was a nightmare. There were numerous types of printer cables — 25-pin parallel, 36-pin Centronics, 15-pin, etc. Additionally, some printers needed changes to the pin configurations, so nothing about the process was easy.

    Then, after the mechanical connections were made, proper drivers had to be loaded, not to mention operating system and software configuration. Today, you simply plug in a USB cable or go wireless and are off and running thanks to “plug and play.” However, plug and play is only common in popular mass-market devices such as printers, scanners and cameras. Most other devices, even commercial consumer devices, can still present maddening connection challenges.

    One example: About five months ago, I tested more than a dozen different Internet video security cameras for a special project. All the cameras I tested touted quick and easy connection. Some were quite nice, while others were installation torture — I returned those after a few days.

    One well-known consumer brand was especially bad. I spent more than three hours with hard-to-understand tech support in India, and after countless different IP configurations and tests, I gave up. I decided that my remaining life is too short to waste that much time on a poorly designed camera system.

    (By the way, the FLIR FX and Netgear Arlo were my top choices. Both connected fast and easy, both have especially nice cloud applications and both are wireless, including power. The FLIR is rechargeable, but the battery life of the Arlo seems remarkable, although some reviewers differ, especially outdoors and in freezing weather. In my test, after three months of flawless operation indoors, the Arlo is still on the original set of batteries at 60 percent, so it gets my top nod.)

    OpenSensorHub

    What is OpenSensorHub, and what are they doing to help achieve universal plug and play? By their own definition:

    “OpenSensorHub is a license free, open source software platform for geospatial (FOSS4G) sensors that allows you to easily, rapidly and affordably network sensors into a seamless SensorWeb of real-time, location-aware, interoperable, web accessible services. With OpenSensorHub, these OGC compliant SensorWebs can be enabled across all manner of space-based, airborne, mobile, in situ and terrestrial remote sensors — including your basic mobile device. OpenSensorHub finally makes it possible to integrate location-aware sensors into the geospatial mainstream.”

    (FOSS4G — Free and Open Source Software for Geospatial — is an annual recurring global event hosted by OSGeo growing out of the GRASS and MapServer communities. OSGeo — Open Source Geospatial Foundation — promotes open source software and resources. OGC — Open Geospatial Consortium — promotes open geospatial standards for both open source and proprietary software.)

    The OpenSensorHub evolved from the early work of Mike Botts of Botts Innovative Research and Alex Robin of Sensia Software for NASA. They very laboriously designed and developed systems and software to connect sensors and actuators into an interoperable and integrated environment. They also realized that this connectivity and integration process had to become streamlined and not a custom programming effort every time for every device. Thus was born the idea of Sensor Model Language (SensorML) and, thanks to NASA funding in 1999, it became a reality.

    Over the years, many scientists and engineers worked to develop connectivity for devices that could be queried and controlled through the Internet, called the Internet of Things (IoT). However, a key missing element of IoT was location awareness, so in 2000, SensorML was brought to the Open Geospatial Consortium (OGC) and served as a catalyst for the creation of a suite of open standards to support location-enabled discovery, access and tasking of sensors through web services and XML encodings. They named it the OGC Sensor Web Enablement (SWE) standards, or SWE for short.

    The SWE standards, now in version 2.0, have been adopted worldwide supporting scientists, emergency responders and the military. Although SWE opened the door to geospatial integration, much work still remains to achieve true plug-and-play connectivity of thousands of devices. In my mind, SWE is standardizing communication protocols between sensor and actuator devices, much like USB standardized interactions between disparate devices.

    However, what really enables us to plug in a USB cable and have instant and effortless communication between various devices, is the software and hardware that implement the USB standard protocols. This, in essence, is the focus of the OpenSensorHub community, to provide open software and hardware that fully implement the SWE vision and enable us to have effortless interaction between IoT devices.

    This is also where the OpenSensorHub community needs your help. In addition to helping improve the significant capabilities of the OpenSensorHub Core, the OpenSensorHub community is looking for those interested in deploying sensors and in developing adaptors and adaptor technologies for adding new sensors, actuators, and processes.

    If you’d like to learn more about the technology and ways that you can contribute, check out the OpenSensorHub website or contact the team at [email protected].

    Other useful links include demo videos and source code.