Category: Receivers

  • Real-Time 3D Models

    The Penultimate Visualization System?

    By Art Kalinski, GISP

    Last month we looked at old and new providers of oblique imagery.  I mentioned what a strong proponent I am of oblique imagery because it’s such a powerful visualization tool, easily comprehended by non-GIS users. My experience with police, firefighters and the Atlanta Regional Commission demonstrate that many first responders and politicians have difficulty reading blueprints, technical drawings or maps, but can visualize an area of interest much faster with oblique imagery.

    Jack Maguire, a colleague and GIS Manager for Lexington County South Carolina, coined a very descriptive phrase. He said that most non-GIS people have “map blindness,” in that they have difficulty comprehending maps even if merged with ortho imagery. However, those same users will have no difficulty getting oriented viewing an oblique image. (See my July article for a more detailed explanation). That’s why both Google Earth and MS Bing now include oblique views and even some interactive 3D models for a growing number of urban areas.

    Most oblique imagery data sets are generally limited to four cardinal directions along with an ortho view. That’s why I believe 3D models are a notch above, because they offer infinitely adjustable oblique views for even better visualization. It’s the oblique views that are the key attraction of 3D models. If you observe someone using an interactive 3D model, they almost always look at multiple oblique views. I’ve never seen a 3D model user navigate to the ortho view and stay there as they navigate around a city.

    PLW Modelworks

    There are many ways to create 3D models, ranging from manually produced models using CAD/CAM/BIM/GIS programs to fast simple 3D modeling tools such as Google Sketch Up. Over the years there have been many vendors in the business of building 3D models, some extremely detailed and sophisticated. In my opinion the best 3D models being produced are from PLW Modelworks.  Their models are very detailed, photo realistic and photo accurate. There is a precision and “correctness” to their models that is missing from many other models I’ve seen.

    Most of their models are built from measurements taken directly from Pictometry metric oblique imagery. The same oblique imagery is then “draped” on each building face resulting in 3D models that are true to life and fully measurable, including length, width, height and even angular measurements from one building roof to another. This YouTube video will give you an appreciation for their models.

    One aspect of PLW models important to first responders and military operators is that no part of any building in their models is cloned, textured or faked. The buildings are draped with the actual building image. If all or part of a building is occluded, then the PLW people indicate that as a black “no-data” area that looks like a black shadow. That way operators know that any window or door that is visible on a building is actually there and measurable.

    Street Factory

    A recent addition to 3D modeling is Street Factory by Astrium Services, which does automated 3D models as complex TINs built from existing oblique imagery. The process is advertised as photogrammetrically corrected for high accuracy with a quick turn-around in the range of several hours. Unlike PLW models where each building is a separate object in the database, Street Factory models are one continuous surface requiring extra processing tools to extract individual buildings/features and link to attributes. See the brochure for additional information. I hope to personally see their system and products soon and will let you know what I learn and observe.

    Although PLW and Street Factory models are the state of the art, there are some limitations. It does take time to build the models ranging from hours to weeks if the area is large and complex. If new imagery has to be captured, the aerial flights can add significantly more time to the entire process. So, for my GIS budget, the ultimate “holy grail” of visualization would be accurate, high resolution, full color, interactive and measurable 3D models that are easy to produce and close to real time.

    Well, hang on to your surveyor’s helmet; that time has arrived.

    Ball Aerospace FLASH LiDAR

    For several years, I’ve observed refinements of a technology developed by Ball Aerospace called FLASH LiDAR. Simply put, Ball Aerospace created the ability to capture continuous rapid multiple LiDAR images/point clouds merged with continuous high-resolution optical images to create full-color 3D models in real time. Yes, real-time full motion video resulting in interactive geo-referenced metric 3D models.

    Shown here are screen shots of the system software showing the LiDAR data colored by height, the optical image captured at the same time, and the resultant full-color 3D model of the merged data in real time.

    The first time I saw the system was at GEOINT 2010 where the Ball engineers had their FLASH LiDAR running in sync with a video camera creating continuous 3D fused images. That first demonstration was somewhat crude but I could see the significant potential. They’ve continued to refine the system to a point where the models now look extremely good. This is one technology that needs to be viewed as video clips which you can access through the Ball Aerospace website.

    Since the capture process is fully automated, complexity is not an issue as both simple buildings and complex trees are modeled at the same speed. Since the resultant 3D model is assembled from multiple views, trees look like trees and not like bushes. Additionally, since the very accurate LiDAR point cloud is an intrinsic part of the capture process, relative and real positional accuracy suitable for targeting is continuously maintained. Another benefit of the integrated system design is that mounting the camera pod is not complex nor does the aircraft have to be modified. Installation is quick and easy on large or small fixed-wing aircraft and helicopters.

    The optical sensor can be a RGB, IR, low light, night vision or multi-spectral cameras. The resultant models can be down-linked to ground computers or hand held devices for real-time viewing and analysis.

    According to Roy Nelson, Ball’s Senior Advanced Systems manager, FLASH LiDAR is tailor made for time critical 3D mapping for critical missions, enhanced situational awareness, battlefield characterization, tactical mission planning and improved targeting. For emergency responders it can help with disaster response planning and event forensics. Roy also cited a discussion he had with an EOC manager who indicated that the real-time models could be a valuable tool to communicate with the public via television, kiosks or the Internet. Since the real time 3D/oblique images are easily comprehended by the public, he could show the actual progress of a fire or flood and communicate to the public evacuation needs and routes.

    The Future

    So, what will be the ultimate word in visualization? I saw two possibilities at recent GEOINT conferences. First, immersive virtual reality and augmented reality keep improving and are making deep inroads in many different applications. Second, Zebra Imaging, producers of compelling 3D holograms, may eventually have the real “killer” visualization product. Their ZScape holographic motion displays are full motion holographic 3D video displays that are still in the early stages of development. I can easily imagine where this Star Wars technology will be in five years when combined with real-time full motion 3D models.

  • GRW Purchases Optech Gemini ALTM LiDAR Sensor

    GRW has purchased an Optech Gemini Airborne Laser Terrain Mapper (ALTM), adding to the company’s full realm of geospatial mapping solutions, including Digital Aerial Photography, Aerial LiDAR, ground-based Stationary Terrestrial Laser Scanning (STLS), and Mobile Terrestrial Laser Scanning (MTLS).

    “The Optech Gemini will meet the increased demand for aerial acquisition, providing our clients with the latest advancements in LiDAR technology,” said Jeremy Mullins, CP, GRW’s LiDAR manager. “We have seen a substantial growth in the LiDAR market over the last several years.”

    Ben Fister, PE, PLS, PSM, is principal‐in‐charge of the firm’s Geospatial Division. “GRW has always been committed to providing our clients with the best available solutions tailored to their project goals. After careful evaluation, we appreciate the technical advancements that the Optech Gemini has provided in the field of advanced aerial LiDAR solutions. It is a perfect addition to GRW’s arsenal of equipment,” Fister said.

    The sensor will be utilized for a variety of projects and industries, including aviation, coal, forestry, transportation, 3D engineering design projects, and related federal, state, and municipal mapping projects.

  • Tallysman Introduces Dual-Frequency Antenna Series

    Tallysman Introduces Dual-Frequency Antenna Series

    TW3802 Shown with flat radome.  Conical radome also available.
    TW3802 Shown with flat radome. Conical radome also available.

    Tallysman Wireless Inc. has added the dual-frequency TW3800 series to its high-quality precision line of antenna products.

    The TW3800 series antennas feature a circular stacked patch antenna for improved axial ratio, yet are small and light, and have the extended bandwidth required for L1/L2 GPS & G1/G2 GLONASS, the company said. The operating voltage range is from +2.5 to 16 VDC. The antennas have a temperature compensated LNAs and operate from -40 to +85o C to provide reliable performance in most any environment. The TW3800 is packaged in a through hole mount making it suitable for mobile applications.

    The TW380x is suited for many applications, including:

    • Anti-jamming GPS
    • Mission-critical GPS timing
    • Military and security
    • Network timing and synchronization
    • Precise tracking
    • High signal availability

    The TW3805 is the OEM version of the TW3802, and can be custom tuned to provide optimal performance inside virtually any housing, Tallysman said.

    “The circular patch design of the TW380X antennas permits precision custom tuning with excellent axial ratios.”  said Gyles Panther, president of Tallysman Wireless. “This flexibility, combined with the very wide operating voltage enables this antenna to work with virtually any receiver on the market.”

    The Tallysman TW3805HR antenna.
    The Tallysman TW3805HR antenna.

     

  • GIS Integrates with Tracking Sensors for Threat Assessment

    INTRUSION SENSORS strive to have a high detection rate and low false alarm rate.
    INTRUSION SENSORS strive to have a high detection rate and low false alarm rate.

    By Eric Olson and Steven Pisciotta

    Ongoing threats from terrorist activities at critical facilities require early detection before the threats can reach their target and complete their mission. This has produced the need for advanced security systems to effectively detect terrorist activity, while reducing alarms caused by normal friendly activity. Automatic Threat Assessment, also referred to as Identify Friend or Foe (IFF), is the ability to automatically acknowledge alarms created by friendly assets. It can be achieved with a security system that uses GPS and geospatial data to go beyond the typical intrusion-sensor-only configuration.

    The addition of a tracking system associated with friendly vehicles and personnel can provide the missing information necessary to tighten security and reduce the need to take action on alarms caused by friendly targets, and reduce the material and personnel cost of threat assessment. Tracking systems and intrusion sensors can worktogether to automatically classify an actual intruder with high confidence and without operator intervention.

    The Verification Problem

    Typical intrusion sensors include intelligent fences, ground proximity sensors, radar, LIDAR, and video analytics. The role of the intrusion sensor is to identify a breach and notify security personnel so they may perform verification. Table 1 shows the formal alarm types received from intrusion sensors, which strive for a high detection rate and a low false-alarm rate. For this reason, the nuisance alarm can be problematic as it reflects a real event for the intrusion sensor, but often a non-event for the security operator.

    These typical sensors only provide a “suspected intruder” list. The follow-on task is to decide whether or not to reclassify a suspected intruder as an actual intruder. This process is typically a manual task and can be difficult, confusing, and time-consuming.

    For instance, a landscape crew will trigger alarms. Even for very accurate systems that can uniquely track the object over a long period, it is highly likely that over the period of time the landscapers are in the area, the track will be lost, causing the system to re-alarm on the same person or vehicle, as it represents a potential intrusion.

    If the landscaping crew needs to open a gate, and that gate is integrated into the facility’s access control system via a dry contact or beam breaker device, it may continuously alarm while left open, or at a minimum, in the case of the beam, each time one of the workers or the vehicle passes through the entrance. In these situations, security will either need to validate each alarm by verifying it on a camera or having an officer follow the landscaping crew throughout their route.

    The existence of a friendly alarm event that needs continual validation can lead to compacency of security personnel, either not verifying it, or not verifying it in a timely manner.

    Table 1. Alarm types.
    Table 1. Alarm types.

    Combined Detection, Location

    A GPS tracking system combined with the intrusion sensors can help identify friends. Tracking systems consist of two main types of locating devices: GPS-enabled devices and wireless transponders.

    Modern, low-cost GPS receivers can achieve an accuracy rating of less than 3 meters, provide an update once per second, and do not require visibility to the open sky. Wireless communication transmits the GPS data to the C2 system. A typical data set includes time, date, latitude, longitude, altitude, heading, speed, and quality of GPS signal.

    The combination of intrusion sensors and tracking systems can produce automatic threat assessment. Routine situations requiring significant security involvement, such as the landscaping scenario, can be automatically managed by the system. The command and control system has the ability to know friendly targets and their location.

    Further, the system can perform a check before actually alarming. In the case of a perimeter alarm, it now has the intelligence to understand, within a level of confidence, that the object detected by the intrusion sensors is the same friendly item being tracking by the tracking system. If the system determines the targets to be the same object, the alarm can be suppressed, eliminating the need for security to verify the event.

        THE COMBINATION of intrusion sensors and a tracking system allows for Automatic Threat Detection.
    THE COMBINATION of intrusion sensors and a tracking system allows for Automatic Threat Detection.

    Common Operating Picture

    The integration of these types of systems is not complex in terms of how to coordinate data. Interface documents exist for these types of integration and are done on a regular basis. Typical position and target information is communicated over XML in a standard format. However, to gain these benefits, the tracking systems and intrusion sensors must all work within a common geospatial operating picture.

    Advantages of geospatial or geo-referenced systems systems include the ability to easily display and control data in a map-based format, allowing tracking systems and intrusion sensors to synergistically perform automatic verification. This combined knowledge of the target’s track also allows the fusing of the GPS data and the intrusion sensor data into a single object and path, aiding security by reducing target and track clutter on his command and control or PSIM (perimeter security information system).

    Take for example a guard enabled with a tracking device, performing a tour around a fence protected by video analytics enabled cameras. On a typical PSIM, a normal guard tour would result in two icons on the display, one friendly from the tracking system and one unknown from the video analytics. This scenario would also result in two similar object tracks. Security would need to review the situation and understand that this symbology represents a single target and a single track.

    Integrating the tracking system with the video analytics system allows for a fusing of this data, and the resulting command-and-control symbology is a single target and a single track.

    Other considerations when combining a tracking system with intrusion sensors include update rate, time and location accuracies, and overlapping coverage.

    Ideally, all sensors would be synchronized when it comes to timing aspects, but this is typically not the case. Different timing between data updates and time inaccuracies can result in the inability for the systems to confidently conclude that two tracks were created by the same target. Transport delay, the transmission of the GPS data through the satellite, can also be an issue. For tracking devices, it’s vital for the data to be received by the C2 system with a repeatable transport delay. Variability in the transport delay also decreases the ability to automatically verify the threat.

    Geographic accuracy of both the GPS tracker and the intrusion sensor is another important factor in data fusion. Typical GPS trackers have an accuracy rating of 3–10 meters. Actual accuracy varies based upon the visible GPS satellites, tall buildings, body worn, and RF interference. Intrusion sensors also possess an inherent accuracy. Radar surveillance may have a resolution of 1 x 1 meter at close range, but it expands at far range to 1 x 20 meters.

    Intelligent fence sensors and video analytic systems can have resolutions that vary from 1 to 25 meters, based on the type of sensor and the terrain. These geographic inaccuracies can be handled to some degree by considering other factors, including heading, speed, and previous track, but it’s important to understand where these inaccuracies can occur.

    Overlapping coverage of surveillance sensors also affects data fusion. In the case of track fusion, this ability is only available is areas where both a geospatial intrusion sensor exists and a tracking system is operational. If there are gaps in overlapping coverage, or areas that do not include geospatial- based intrusion sensors, then fusion is not possible in those regions.


    Eric Olson is vice president of Marketing at PureTech Systems.

    Steven Pisciotta is president of Remote Tracking Systems.

  • Lockheed Martin Delivers Antenna Assemblies for First GPS III Satellite

    Lockheed Martin has completed and is preparing to install the navigation, communication, and hosted payload antenna assemblies for the first satellite of the next-generation GPS III.

    Seven antenna assemblies, produced at Lockheed Martin’s Newtown, Pennsylania, facility were delivered to the company’s GPS III Processing Facility (GPF) near Denver, Colorado, on June 14.  The antennas will be installed on the first GPS III space vehicle (SV01), which Lockheed Martin will deliver to the U.S. Air Force on schedule, “flight-ready,” in 2014.

    The new antennas for GPS III SV01 will provide the satellite’s capability to send and/or receive data for Earth-coverage and military Earth-coverage navigation; a UHF crosslink for inter-satellite data transfer; telemetry, tracking and control for satellite-ground communications; and data acquisition and communication for the nuclear detection system hosted payload. The antenna designs enable three to eight times greater anti-jamming signal power to be broadcast to military users across the globe when compared to previous GPS generations.

    “These antennas on the next generation of GPS III satellites will transmit data utilized by more than one billion users with navigation, positioning and timing needs,” explained Keoki Jackson, vice president of Lockheed Martin’s Navigation Systems mission area. “We have become reliant on GPS for providing signals that affect everything from cell phones and wristwatches, to shipping containers and commercial air traffic, to ATMs and financial transactions worldwide.”

    GPS III is a critically important program for the Air Force, affordably replacing aging GPS satellites in orbit, while improving capability to meet the evolving demands of military, commercial and civilian users. GPS III satellites will deliver three times better accuracy, include enhancements which extend spacecraft life 25 percent further than the prior GPS block, and a new civil signal designed to be interoperable with international global navigation satellite systems.

    The production of the first GPS III satellite continues on schedule. Recent testing of the SV 01 bus — the portion of the space vehicle that carries mission payloads and hosts them in orbit — assured that all bus subsystems are functioning normally and that they are ready for final integration with the satellite’s navigation payload.
    This milestone follows February’s successful initial power on of the SV01 spacecraft bus, which demonstrated  the electrical-mechanical integration, validated the satellite’s interfaces and led the way for functional electrical hardware-software integration testing.

    Lockheed Martin is under contract for production of the first four GPS III satellites (SV01-04), and has received advanced procurement funding for long-lead components for the fifth, sixth, seventh and eighth satellites (SV05-08).

    The GPS III team is led by the Global Positioning Systems Directorate at the U.S. Air Force Space and Missile Systems Center. Lockheed Martin is the GPS III prime contractor with teammates ITT Exelis, General Dynamics, Infinity Systems Engineering, Honeywell, ATK and other subcontractors. Air Force Space Command’s 2nd Space Operations Squadron (2SOPS), based at Schriever Air Force Base, Colorado, manages and operates the GPS constellation for both civil and military users.

  • LizardTech Launches GeoExpress 9 at Esri Conference

    LizardTech, a provider of software solutions for managing and distributing geospatial content, announced the launch of GeoExpress9 at this week’s Esri International User Conference in San Diego, California, where the company is also a Platinum Imagery Sponsor and exhibitor in booth number 1704.

    GeoExpress enables geospatial professionals to compress and manipulate satellite and aerial imagery and the latest version features a significant performance improvement from previous versions, LizardTech said. The latest version is four times faster than before with support for spanning multiple jobs across multiple cores. This increase in speed enables users to complete projects faster than ever before within the application.

    This release also introduces Intelligent Encoding, with the software automatically reconfiguring itself for optimal performance. GeoExpress 9 automatically chooses to Encode, Optimize or Update based on the encoding operations that the user chooses, which results in high performance with minimal training, LizardTech said.

    In addition, Jon Skiffington, LizardTech’s director of product management, will introduce GeoExpress 9 to the Esri attendees by giving a Demo Theater presentation titled “LizardTech – What’s New with MrSID and GeoExpress” on Wednesday, 1:30 p.m. – 2:30 p.m. at the Imagery Island Exhibit in Exhibit Hall C.

    “This is going to be an exciting week for LizardTech,” said Skiffington. “We’re launching the latest version of our flagship product, GeoExpress with its new features, faster performance and updated user interface. We look forward to showing our customers the new features and receiving feedback from our users and partners.”

    LizardTech will also host product demonstrations in its booth to showcase the new features of GeoExpress 9. These presentations will be held on Tuesday and Wednesday at 10 a.m., 1 p.m. and 3 p.m., with a final presentation held on Thursday at 10 a.m. Product demonstrations of Express Server software for high-performance delivery and publication and LiDAR Compressor software, which turns giant point cloud datasets into efficient MrSID files will also be available.

  • Oblique Imagery: The New Kids on the Block

    Last month I covered current vendors of ortho imagery with some pros and cons regarding the different sources. There wasn’t room to also include oblique imagery, so I’m covering that topic this month.

    I’ve been a very strong proponent of oblique imagery for many years based on my experience as the GIS manager for the Atlanta Regional Commission, where I found that there was no single geospatial tool that had such a positive and dramatic impact on our first responders as oblique imagery. (See my 2008 article that describes why.) I felt so strongly that it could make our troops more effective and help save lives that I joined Pictometry for a few years to help promote oblique imagery military projects. At that time, Pictometry was the only oblique game in town, since it had patent protection dealing with much of the technology. However, the patent protection is ending and many new players are entering the field.

    A Graflex camera circa World War I.
    A Graflex camera circa World War I.

    Early History

    Few people realize that the first serious aerial surveillance collections were oblique images taken with old Graflex cameras held out of a biplane cockpit. The images were good but users soon learned that it was a nightmare to try to assemble the oblique perspective images into a large mosaic. So analysts switched to ortho imagery that could be stitched together nicely, and we’ve been pretty much stuck in that straight down world. Fortunately, sophisticated algorithms and digital image processing have changed all of that.

    The underlying reason that oblique imagery works so well for visualization compared to ortho imagery is a function of our mind-eye vision referred to as anamorphic illusion.  Our eyes can look at 2D images and perceive them as 3D objects if the right visual cues are present. There are some interesting examples of anamorphic illusions on the web.

    So let’s look at the current sources of oblique imagery.

    Pictometry International, Corp.

    Pictometry has been the dominant force in oblique imagery capture for more than a decade, thanks partially to patents and surrounding technology the company has developed. Not only does Pictometry have the tools and technology to capture, serve and exploit the oblique imagery, it also amassed a huge library of images covering almost 90 percent of U.S. populated areas. Pictometry has desktop viewing software that permits users to view and measure almost any aspect related to the oblique image — x,y location, length, width, and very accurate heights, while also displaying overlaid GIS data including elevation data and contour lines. Pictometry does this by re-projecting the GIS vector data to match the trapezoidal footprint of a perspective oblique image. Pictometry also serves its extensive library of images, over two petabytes, through an online service called POL (Pictometry On Line). Users can view imagery and do the same measurements as with the desktop software.

    Pictometry's desktop viewing software.
    Pictometry’s desktop viewing software.

    My experience showed that the positional accuracy ranged in the 3- to 15-foot range. To meet USGS National Map standards, Pictometry developed AccuPlus, which includes ground surveys and image correction of the ortho view to meet USGS’s 30-cm product specification.

    For users who want to view and use the oblique imagery inside the ortho footprint ArcGIS environment, the Pictometry engineers developed a transform tool that effectively stretches the back of the trapezoidal oblique footprint to a rectangular image that can be used just like an ortho image but with an oblique view. The only downside is that without perspective the image looks a little funny. Note this example and the fact that the garage is the same width in front as in back. This is what happens when the perspective is removed. This transform tool is now part of ESRI’s ImageServer so users can import an oblique image and the transformation is automatic. Pictometry also supplies oblique imagery for Microsoft Bing, called the Birdseye View.  The imagery supplied for Bing has slightly less resolution and cannot be measured, as with Pictometry software.

    The Pictometry transform tool.
    The Pictometry transform tool.

    Woolpert, Inc.

    Woolpert has been in the oblique imagery capture business almost as long as Pictometry, but it uses a completely different technology, the push broom method. Most oblique capture systems take five oblique single frame photos — north, south, east, west, and straight down.  Those oblique images show natural perspective so the image footprint is a trapezoid. Woolpert uses a three-camera system – one ortho and a forward and aft oblique image scanner. The continuous 45-degree scanning has a big benefit in that the system produces an oblique image with a true ortho footprint right out of the box, so the resultant oblique image can be viewed by GIS software as if it was an ortho image. The down side of push broom capture is that the geometry of tall buildings is distorted so that some of the buildings seem to lean toward each other.

    The Sanborn Map Company, Inc.

    Sanborn is a large and well-established aerial imagery firm now getting into the oblique business. Although I haven’t had any broad experience with its imagery and navigation tools, the online demo has a very slick interface and very nice quality imagery.  Try it yourself.  As an oblique newcomer, Sanborn’s coverage is limited, and I can’t judge its accuracy, but it has a strong reputation of producing quality work and products so it is a company to watch. Some of the company’s imagery is credited as part of Google Maps, but both are secretive as to the extent or parameters.

    Fugro EarthData, Inc.

    I’ve had no personal experience with Fugro data and software, but I did see a trade show demo of its software, PanoramiX. The software and imagery looked good, but as a newcomer its image library is limited and the accuracy of its imagery is unknown.

    GEOSPAN, Corp.

    On its website, GEOSPAN lists oblique imagery capture in addition to Street level imagery, orthophotography, 3D models, street centerline creation, and GIS feature extraction. There is no information available as to coverage or accuracy.

    ControlCam

    ControlCam is the newest entry into the oblique market. It is a Florida-based aerial imagery company that pioneered and perfected a process of identifying cable TV leaks through the use of aerial surveillance. The company owns and manages its own fleet of aircraft  capturing both orthogonal and oblique imagery. ControlCam will soon launch a software platform, including a mobile app, that will permit clients to have quick and seamless access to the imagery with measurement tools.  The sample image shown here is 2-inch GSD, very nice for a newcomer to the oblique business.

    A ControlCam image.
    A ControlCam image.

    Microsoft Bing and Google

    If you have any doubt about the popularity and value of oblique imagery, just look at Bing Maps and Google Maps, the two elephants battling for eyes-on-site time. Both have incorporated oblique imagery in their viewers. Both bring up the oblique views as you zoom in from a high-level ortho image, then transition to street-level imagery. The key difference is that Bing uses Pictometry oblique images, which show a natural perspective, and Google uses oblique imagery from different sources. Bing shifts from one optimal oblique to another while Google stitches together multiple oblique images. This multiple-image stitch is good at ground level, but causes funny building lean similar to a push-broom capture (see the sample images). Both are very good for their intended purpose, but neither permits measurement, nor do they include accurate metadata.

    By their own admission and licensing agreements, neither Bing nor Google claim to be authoritative GIS data sources. So be cautious how you use their imagery. Note the problem I cited in my article last month about a police SWAT team raid using Google. Another issue for federal users is FARS and licensing restrictions, so make sure your legal staff reads the fine print.

    A Google oblique image.
    A Google oblique image.
    A Bing oblique image.
    A Bing oblique image.

    Other Systems

    If you’d like to do a deep dive into oblique cameras and capture systems including overseas operations, I recommend reading “Systematic Oblique Aerial Photography Using Multiple Digital Cameras” by Professor Emeritus Gordon Petrie of the University of Glasgow. In his presentation he quotes the ISPRS 2008 Congress that “There is a strong movement towards combining traditional nadir images with oblique images acquired at high angles to build 3D models of cities with the texture of building walls taken from the oblique photos. For non-specialists in the emergency services (military, police, fire and ambulance), the combination of oblique and nadir images improves their interpretation while special software allows simple measurements on the oblique photos.”

    The Future

    I have no doubt that within a few years the zoom-in from space to orthos, obliques, accurate 3D models, ground-level imagery, and interiors of buildings will be smooth and seamless. Ultimately, accurate, detailed and up-to-date 3D models draped with actual imagery, not textures, will be optimal. This will be especially important if 3D or holographic display technology reach acceptable quality levels. 3D model creation keeps improving, and I believe that the merging of ortho imagery, oblique imagery, LiDAR, and ground-level photos with more powerful computers and software will make accurate 3D models practical and ubiquitous.

    For some closing amusement, somewhat related to our current discussion, take a look at what 360 Cities is doing with very high resolution fixed panoramic cameras.  Note the 80 gigapixel photo of London and this zoom-in to a London Eye giant Ferris wheel pod.  Although coverage is limited to one viewer location, I could see this being one of several resources to drape 3D modes.

    Contact me at [email protected].

    A zoom-in on the London Eye with 360 Cities.
    A zoom-in on the London Eye with 360 Cities.
  • Visual Intelligence Offers iOne Infrastructure Mapping System

    Visual Intelligence unveiled its new geoimaging solution, iOne Infrastructure Metric Mapping System (iOne IMS), which it calls a major technological milestone for infrastructure metric mapping and surveying. iOne IMS allows aerial imaging companies to capture more imagery and data at a fraction of the up-front investment and operating cost of competing products, allowing them to do much more for less, the company said.

    POWERPole12
    Oblique Imagery of Transmission Tower Insulators from iOne IMS Sensor.
    Courtesy: Visual Intelligence

    According to the announcement, when installed on aircraft, the iOne IMS collects ortho, stereo, forward and backward oblique, multispectral 4-band and point cloud product generation—all in a single pass. Visual Intelligence is launching the iOne IMS today at RIEGL LIDAR 2013 during the International Airborne, Mobile, Terrestrial and Industrial User Conference in Vienna, Austria. Visual Intelligence President and CEO Dr. Armando Guevara is a featured speaker at the event where he will present “The Making of the iOne IMS + Riegl: From Design to Delivery.”

    “Sensor solutions for infrastructure metric mapping and surveying have traditionally been expensive, single-purpose devices that are not scalable, not flexible, hard to work with, and difficult to service and maintain,” said Guevara. “But iOne IMS represents a new generation of standards-based, multi-purpose sensor solutions that delivers the performance, quality and precision that mapping and surveying professional need to grow their businesses.”

    The company reports that iOne IMS is based on Visual Intelligence’s award-winning iOne Sensor Tool Kit Architecture (STKA), which is a next-generation software/hardware foundation for high-performing, multi-purpose 2D-3D geo-imaging sensors for aerial, terrestrial and mobile applications. iOne IMS is highly scalable both in terms of collection and functionality. Customers can easily expand from a medium-format iOne system to a large-format system. Customers can also buy only the functionality they need in the short term and then add more functionality as needed later on. Traditional solutions force customers to buy more functionality than they need, which increases capital equipment purchase and maintenance cost.

    iOne IMS can be mounted on airplanes, helicopters and UAVs to support a wide range of projects:

    •           Cadastral inventory
    •           Roads and rails surveys
    •           Construction surveys and monitoring
    •           Oil and gas pipeline corridor mapping
    •           Coastal surveys and environmental monitoring
    •           River and body of water surveys and water quality control
    •           Vegetation inventory and classification
    •           Forest and agricultural monitoring
    •           Disaster rapid response
    •           And many others

    Finally, the company reported that the iOne IMS will be optimized for UAV, UAS and Mobile applications. Miniaturized versions will be usable in interior mapping, Building Information Management (BIM) and other mobile close range photogrammetry (3D) applications that leverage cell phone technology.

  • Innovation: GNSS Spoofing Detection

    Innovation: GNSS Spoofing Detection

    Correlating Carrier Phase with Rapid Antenna Motion

    By Mark L. Psiaki with Steven P. Powell and Brady W. O’Hanlon

    GPS World photo
    INNOVATION INSIGHTS by Richard Langley

    IT’S A HOSTILE (ELECTRONIC) WORLD OUT THERE, PEOPLE. Our wired and radio-based communication systems are constantly under attack from evil doers. We are all familiar with computer viruses and worms hiding in malicious software or malware distributed over the Internet or by infected USB flash drives. Trojan horses are particularly insidious. These are programs concealing harmful code that can lead to many undesirable effects such as deleting a user’s files or installing additional harmful software. Such programs pass themselves off as benign, just like the “gift” the Greeks delivered to the Trojans as reported in Virgil’s Aeneid. This was a very early example of spoofing. Spoofing of Internet Protocol (IP) datagrams is particularly prevalent. They contain forged source IP addresses with the purpose of concealing the identity of the sender or impersonating another computing system.

    To spoof someone or something is to deceive or hoax, passing off a deliberately fabricated falsehood made to masquerade as truth. The word “spoof” was introduced by the English stage comedian Arthur Roberts in the late 19th century. He invented a game of that name, which involved trickery and nonsense. Now, the most common use of the word is as a synonym for parody or satirize — rather benign actions. But it is the malicious use of spoofing that concerns users of electronic communications.

    And it is not just wired communications that are susceptible to spoofing. Communications and other services using radio waves are, in principle, also spoofable. One of the first uses of radio-signal spoofing was in World War I when British naval shore stations sent transmissions using German ship call signs. In World War II, spoofing became an established military tactic and was extended to radar and navigation signals. For example, German bomber aircraft navigated using radio signals transmitted from ground stations in occupied Europe, which the British spoofed by transmitting similar signals on the same frequencies. They coined the term “meaconing” for the interception and rebroadcast of navigation signals (meacon = m(islead)+(b)eacon).

    Fast forward to today. GPS and other GNSS are also susceptible to meaconing. From the outset, the GPS P code, intended for use by military and other so-called authorized users, was designed to be encrypted to prevent straightforward spoofing. The anti-spoofing is implemented using a secret “W” encryption code, resulting in the P(Y) code. The C/A code and the newer L2C and L5 codes do not have such protection; nor, for the most part, do the civil codes of other GNSS. But, it turns out, even the P(Y) code is not fully protected from sophisticated meaconing attacks.

    So, is there anything that military or civil GNSS users can do, then, to guard against their receivers being spoofed by sophisticated false signals? In this month’s column, we take a look at a novel, yet relatively easily implemented technique that enables users to detect and sequester spoofed signals. It just might help make it a safer world for GNSS positioning, navigation, and timing.


    “Innovation” is a regular feature that discusses advances in GPS technology andits applications as well as the fundamentals of GPS positioning. The column is coordinated by Richard Langley of the Department of Geodesy and Geomatics Engineering, University of New Brunswick. He welcomes comments and topic ideas. To contact him, see the “Contributing Editors” section on page 4.

    The radionavigation community has known about the dangers of GNSS spoofing for a long time, as highlighted in the 2001 Volpe Report (see Further Reading). Traditional receiver autonomous integrity monitoring (RAIM) had been considered a good spoofing defense. It assumes a dumb spoofer whose false signal produces a random pseudorange and large navigation solution residuals. The large errors are easy to detect, and given enough authentic signals, the spoofed signal(s) can be identified and ignored.

    That spoofing model became obsolete at The Institute of Navigation’s GNSS 2008 meeting. Dr. Todd Humphreys introduced a new receiver/spoofer that could simultaneously spoof all signals in a self-consistent way undetectable to standard RAIM techniques. Furthermore, it could use its GNSS reception capabilities and its known geometry relative to the victim to overlay the false signals initially on top of the true ones. Slowly it could capture the receiver tracking loops by raising the spoofer power to be slightly larger than that of the true signals, and then it could drag the victim receiver off to false, but believable, estimates of its position, time, or both.

    Two of the authors of this article contributed to Humphreys’ initial developments. There was no intention to help bad actors deceive GNSS user equipment (UE). Rather, our goal was to field a formidable “Red Team” as part of a “Red Team/Blue Team” (foe/friend) strategy for developing advanced “Blue Team” spoofing defenses.

    This seemed like a fun academic game until mid-December 2011, when news broke that the Iranians had captured a highly classified Central Intelligence Agency drone, a stealth Lockheed Martin RQ-170 Sentinel, purportedly by spoofing its GPS equipment. Given our work in spoofing and detection, this event caused quite a stir in our Cornell University research group, in Humphreys’ University of Texas at Austin group, and in other places. The editor of this column even got involved in our extensive e-mail correspondence. Two key questions were: Wouldn’t a classified spy drone be equipped with a Selective Availability Anti-Spoofing Module (SAASM) receiver and, therefore, not be spoofable? Isn’t it difficult to knit together a whole sequence of false GPS position fixes that will guide a drone to land in a wrong location? These issues, when coupled with apparent inconsistencies in the Iranians’ story and visible damage to the drone, led us to discount the spoofing claim.

    Developing a New Spoofing Defense

    My views about the Iranian claims changed abruptly in mid-April 2012. Todd Humphreys phoned me about an upcoming test of GPS jammers, slated for June 2012 at White Sands Missile Range (WSMR), New Mexico. The Department of Homeland Security (DHS) had already spent months arranging these tests, but Todd revealed something new in that call: He had convinced the DHS to include a spoofing test that would use his latest “Red Team” device. The goal would be to induce a small GPS-guided unmanned aerial vehicle (UAV), in this case a helicopter, to land when it was trying to hover. “Wow”, I thought. “This will be a mini-replication of what the Iranians claimed to have done to our spy drone, and I’m sure that Todd will pull it off. I want to be there and see it.” Cornell already had plans to attend to test jammer tracking and geolocation, but we would have to come a day early to see the spoofing “fun” — if we could get permission from U.S. Air Force 746th Test Squadron personnel at White Sands.

    The implications of the UAV test bounced around in my head that evening and the next morning on my seven-mile bike commute to work. During that ride, I thought of a scenario in which the Iranians might have mounted a meaconing attack against a SAASM-equipped drone. That is, they might possibly have received and re-broadcast the wide-band P(Y) code in a clever way that could have nudged the drone off course and into a relatively soft landing on Iranian territory.

    In almost the next moment, I conceived a defense against such an attack. It involves small antenna motions at a high frequency, the measurement of corresponding carrier-phase oscillations, and the evaluation of whether the motions and phase oscillations are more consistent with spoofed signals or true signals. This approach would yield a good defense for civilian and military receivers against both spoofing and meaconing attacks. The remainder of this article describes this defense and our efforts to develop and test it.

    It is one thing to conceive an idea, maybe a good idea. It is quite another thing to bring it to fruition. This idea seemed good enough and important enough to “birth” the conception. The needed follow-up efforts included two parts, one theoretical and the other experimental.

    The theoretical work involved the development of signal models, hypothesis tests, analyses, and software. It culminated in analysis and truth-model simulation results, which showed that the system could be very practical, using only centimeters of motion and a fraction of a second of data to reliably differentiate between spoofing attacks and normal GNSS operation.

    Theories and analyses can contain fundamental errors, or overlooked real-world effects can swamp the main theoretical effect. Therefore, an experimental prototype was quickly conceived, developed, and tested. It consisted of a very simple antenna-motion system, an RF data-recording device, and after-the-fact signal processing. The signal processing used Matlab to perform the spoofing detection calculations after using a C-language software radio to perform standard GPS acquisition and tracking.

    Tests of the non-spoofed case could be conducted anywhere outdoors. Our initial tests occurred on a Cornell rooftop in Ithaca, New York. Tests of the spoofed case are harder. One cannot transmit live spoofing signals except with special permission at special times and in special places, for example, at WSMR in the upcoming June tests. Fortunately, the important geometric properties of spoofed signals can be simulated by using GPS signal reception at an outdoor antenna and re-radiation in an anechoic chamber from a single antenna. Such a system was made available to us by the NASA facility at Wallops Island, Virginia, and our simulated spoofed-case testing occurred in late April of last year. All of our data were processed before mid-May, and they provided experimental confirmation of our system’s efficacy. The final results were available exactly three busy weeks after the initial conception.

    Although we were convinced about our new system, we felt that the wider GNSS community would like to see successful tests against live-signal attacks by a real spoofer. Therefore, we wanted very much to bring our system to WSMR for the June 2012 spoofing attack on the drone. We could set up our system near the drone so that it would be subject to the same malicious signals, but without the need to mount our clumsy prototype on a compact UAV helicopter. We were concerned, however, about the possibility of revealing our technology before we had been able to apply for patent protection. After some hesitation and discussions with our licensing and technology experts, we decided to bring our system to the WSMR test, but with a physical cover to keep it secret. The cover consisted of a large cardboard box, large enough to accommodate the needed antenna motions. The WSMR data were successfully collected using this method. Post-processing of the data demonstrated very reliable differentiation between spoofed and non-spoofed cases under live-signal conditions, as will be described in subsequent sections of this article.

    System Architecture and Prototype

    The components and geometry of one possible version of this system are shown in FIGURE 1. The figure shows three of the GNSS satellites whose signals would be tracked in the non-spoofed case: satellites j-1, j, and j+1. It also shows the potential location of a spoofer that could send false versions of the signals from these same satellites. The spoofer has a single transmission antenna. Satellites j-1, j, and j+1 are visible to the receiver antenna, but the spoofer could “hijack” the receiver’s tracking loops for these signals so that only the false spoofed versions of these signals would be tracked by the receiver.

    Figure 1. Spoofing detection antenna articulation system geometry relative to base mount, GNSS satellites, and potential spoofer.
    Figure 1. Spoofing detection antenna articulation system geometry relative to base mount, GNSS satellites, and potential spoofer. Photo: Mark L. Psiaki with Steven P. Powell and Brady W. O’Hanlon

    The receiver antenna mount enables its phase center to be moved with respect to the mounting base. In Figure 1, this motion system is depicted as an open kinematic chain consisting of three links with ball joints. This is just one example of how a system can be configured to allow antenna motion. Spoofing detection can work well with just one translational degree of freedom, such as a piston-like up-and-down motion that could be provided by a solenoid operating along the za articulation axis. It would be wise to cover the motion system with an optically opaque radome, if possible, to prevent a spoofer from defeating this system by sensing the high-frequency antenna motions and spoofing their effects on carrier phase.

    Suppose that the antenna articulation time history in its local body-fixed (xa, ya, za) coordinate system is ba(t). Then the received carrier phases are sensitive to the projections of this motion onto the line-of-sight (LOS) directions of the received signals. These projections are along  Eq-rj1Eq-rj, and  Eq-r-j+1 in the non-spoofed case, with Eq-rj  being the known unit direction vector from the jth GNSS satellite to the nominal antenna location. In the spoofed case, the projections are all along Eq-rsp, regardless of which signal is being spoofed, with Eq-rsp being the unknown unit direction vector from the spoofer to the victim antenna. Thus, there will be differences between the carrier-phase responses of the different satellites in the non-spoofed case, but these differences will vanish in the spoofed case. This distinction lies at the heart of the new spoofing detection method. Given that a good GNSS receiver can easily distinguish quarter-cycle carrier-phase variations, it is expected that this system will be able to detect spoofing using antenna motions as small as 4.8 centimeters, that is, a quarter wavelength of the GPS L1 signal.

    The UE receiver and spoofing detection block in Figure 1 consists of a standard GNSS receiver, a means of inputting the antenna motion sensor data, and additional signal processing downstream of the standard GNSS receiver operations. The latter algorithms use as inputs the beat carrier-phase measurements from a standard phase-locked loop (PLL).

    It may be necessary to articulate the antenna at a frequency nearly equal to the bandwidth of the PLL (say, at 1 Hz or higher). In this case, special post-processing calculations might be required to reconstruct the high-frequency phase variations accurately before they can be used to detect spoofing. The needed post-processing uses the in-phase and quadrature accumulations of a phase discriminator to reconstruct the noisy phase differences between the true signal and the PLL numerically controlled oscillator (NCO) signal. These differences are added to the NCO phases to yield the full high-bandwidth variations.

    We implemented the first prototype of this system with one-dimensional antenna motion by mounting its patch antenna on a cantilevered beam. It is shown in FIGURE 2. Motion is initiated by pulling on the string shown in the upper left-hand part of the figure. Release of the string gives rise to decaying sinusoidal oscillations that have a frequency of about 2 Hz.

    Figure 2. Antenna articulation system for first prototype spoofing detector tests: a cantilevered beam that allows single-degree-of-freedom antenna phase-center vibration along a horizontal axis. Photo: Mark L. Psiaki with Steven P. Powell and Brady W. O’Hanlon
    Figure 2. Antenna articulation system for first prototype spoofing detector tests: a cantilevered beam that allows single-degree-of-freedom antenna phase-center vibration along a horizontal axis. Photo: Mark L. Psiaki with Steven P. Powell and Brady W. O’Hanlon

    The remainder of the prototype system consisted of a commercial-off-the-shelf RF data recording device, off-line software receiver code, and off-line spoofing detection software. The prototype system lacked an antenna motion sensor. We compensated for this omission by implementing additional signal-processing calculations. They included off-line parameter identification of the decaying sinusoidal motions coupled with estimation of the oscillations’ initial amplitude and phase for any given detection.

    This spoofing detection system is not the first to propose the use of antenna motion to uncover spoofing, and it is related to techniques that rely on multiple antennas. The present system makes three new contributions to the art of spoofing detection: First, it clearly explains why the measured carrier phases from a rapidly oscillating antenna provide a good means to detect spoofing. Second, it develops a precise spoofing detection hypothesis test for a moving-antenna system. Third, it demonstrates successful spoofing detection against live-signal attacks by a “Humphreys-class” spoofer.

    Signal Model Theory and Verification

    The spoofing detection test relies on mathematical models of the response of beat carrier phase to antenna motion. Reasonable models for the non-spoofed and spoofed cases are, respectively:

    Eq-1b  (1a)

    Eq-1a(1b)

    where Eq-0jk is the received (negative) beat carrier phase of the authentic or spoofed satellite-j signal at the kth sample time Eq-tjmk . The three-by-three direction cosines matrix A is the transformation from the reference system, in which the direction vectors Eq-rj  and Eq-rsp are defined, to the local body-axis system, in which the antenna motion ba(t) is defined. λ is the nominal carrier wavelength. The terms involving the unknown polynomial coefficients Eq-Bj0, Eq-Bj1 , and Eq-Bj2 model other low-frequency effects on carrier phase, including satellite motion, UE motion if its antenna articulation system is mounted on a vehicle, and receiver clock drift. The term Eq-nj0k is the receiver phase noise. It is assumed to be a zero-mean, Gaussian, white-noise process whose variance depends on the receiver carrier-to-noise-density ratio and the sample/accumulation frequency.

    If the motion of the antenna is one-dimensional, then ba(t) takes the form Eq-ba1, with Eq-ba being the articulation direction in body-axis coordinates and ra(t) being a known scalar antenna deflection amplitude time history. If one defines the articulation direction in reference coordinates as Eq-ra , then the carrier-phase models in Equations (1a) and (1b) become

    Eq-2a   (2a)

    Eq-2b  (2b)

    There is one important feature of these models for purposes of spoofing detection. In the non-spoofed case, the term that models the effects of antenna motion varies between GPS satellites because the Eq-rj direction vector varies with j. The spoofed case lacks variation between the satellites because the one spoofer direction Eq-rsp replaces Eq-rj for all of the spoofed satellites. This becomes clear when one compares the first terms on the right-hand sides of Eqsuations (1a) and (1b) for the 3-D motion case and on the right-hand sides of Equations (2a) and (2b) for the 1-D case.

    The carrier-phase time histories in FIGURES 3 and 4 illustrate this principle. These data were collected at WSMR using the prototype antenna motion system of Figure 2. The carrier-phase time histories have been detrended by estimating the Eq-Bj0, Eq-Bj1 , and Eq-Bj2 coefficients in Equations (2a) and (2b) and subtracting off their effects prior to plotting. In Figure 3, all eight satellite signals exhibit similar decaying sinusoid time histories, but with differing amplitudes and some of them with sign changes. This is exactly what is predicted by the 1-D non-spoofed model in Equation (2a). All seven spoofed signals in Figure 4, however, exhibit identical decaying sinusoidal oscillations because the Eq-rsp-tra term in Equation (2b) is the same for all of them.

    Figure 3. Detrended carrier-phase data from multiple satellites for a typical non-spoofed case using a 1-D antenna articulation system.
    Figure 3. Detrended carrier-phase data from multiple satellites for a typical non-spoofed case using a 1-D antenna articulation system.

     

    Figure 4. Multiple satellites’ detrended carrier-phase data for a typical spoofed case using a 1-D antenna articulation system.
    Figure 4. Multiple satellites’ detrended carrier-phase data for a typical spoofed case using a 1-D antenna articulation system.

    As an aside, an interesting feature of Figure 3 is its evidence of the workings of the prototype system. The ramping phases of all the signals from t = 0.4 seconds to t = 1.4 seconds correspond to the initial pull on the string shown in Figure 2, and the steady portion from t = 1.4 seconds to t = 2.25 seconds represents a period when the string was held fixed prior to release.

    Spoofing Detection Hypothesis Test

    A hypothesis test can precisely answer the question of which model best fits the observed data: Does carrier-phase sameness describe the data, as in Figure 4? Then the receiver is being spoofed. Alternatively, is carrier-phase differentness more reasonable, as per Figure 3? Then the signals are trustworthy.

    A hypothesis test can be developed for any batch of carrier-phase data that spans a sufficiently rich antenna motion profile ba(t) or ρa(t). The profile must include high-frequency motions that cannot be modeled by the  Eq-Bj0, Eq-Bj1 , and Eq-Bj2quadratic polynomial terms in Equations (1a)-(2b); otherwise the detection test will lose all of its power. A motion profile equal to one complete period of a sine wave has the needed richness.

    Suppose one starts with a data batch that is comprised of carrier-phase time histories for L different GNSS satellites: Eq-0jk for samples k = 1, …, Mj and for satellites j = 1,…, L. A standard hypothesis test develops two probability density functions for these data, one conditioned on the null hypothesis of no spoofing, H0, and the other conditioned on the hypothesis of spoofing, H1.  The Neyman-Pearson lemma (see Further Reading) proves that the optimal hypothesis test statistic equals the ratio of these two probability densities. Unfortunately, the required probability densities depend on additional unknown quantities. In the 1-D motion case, these unknowns include the Eq-Bj0, Eq-Bj1 , and Eq-Bj2 coefficients, the dot product Eq-rsp-tra, and the direction Eq-tra  if one assumes that the UE attitude is unknown. A true Neyman-Pearson test would hypothesize a priori distributions for these unknown quantities and integrate their dependencies out of the two joint probability distributions. Our sub-optimum test optimally estimates relevant unknowns for each hypothesis based on the carrier-phase data, and it uses these estimates in the Neyman-Pearson probability density ratio. Although sub-optimal as a hypothesis test, this approach is usually effective, and it is easier to implement than the integration approach in the present case.

    Consider the case of 1-D antenna articulation and unknown UE attitude. Maximum-likelihood calculations optimally estimate the nuisance parameters  Eq-Bj0, Eq-Bj1 , and Eq-Bj2  for j = 1, …, L for both hypotheses along with the unit vector Eq-tra for the non-spoofed hypothesis, or the scalar dot product Eq-nsix for the spoofed hypothesis. The estimation calculations for each hypothesis minimize the negative natural logarithm of the corresponding conditional probability density. Because  Eq-Bj0, Eq-Bj1 , and Eq-Bj2 enter the resulting cost functions quadratically, their optimized values can be computed as functions of the other unknowns, and they can be substituted back into the costs. This part of the calculation amounts to a batch high-pass filter of both the antenna motion and the carrier-phase response.

    The remaining optimization problems take, under the non-spoofed hypothesis, the form:

    find:      Eq-tra    (3a)

    to minimize:       Eq-Jnonsp  (3b)

    subject to:             Eq-rasmall   (3c)

    and, under the spoofed hypothesis, the form:

    find:      η    (4a)

    to minimize:   Eq-Jspn      (4b)

    subject to:     Eq-111 .   (4c)

    The coefficient Eq-rj44 is a function of the deflections Eq-Pat for k = 1, …, Mj, and the non-homogenous term Eq-zj4 is derived from the jth phase time history Eq-0jk for k = 1, …, Mj. These two quantities are calculated during the  Eq-Bj0, Eq-Bj1, Eq-Bj2 optimization. The constraint in Equation (3c) forces the estimate of the antenna articulation direction to be unit-normalized. The constraint in Eq. (4c) ensures that η is a physically reasonable dot product.

    The optimization problems in Equations (3a)-(3c) and (4a)-(4c) can be solved in closed form using techniques from the literature on constrained optimization, linear algebra, and matrix factorization. The optimal estimates of Eq-tra and η can be used to define a spoofing detection statistic that equals the natural logarithm of the Neyman-Pearson ratio:

    Eq-y-small(5)

    It is readily apparent that γ constitutes a reasonable test statistic: If the signal is being spoofed so that carrier-phase sameness is the best model, then ηopt will produce a small value of  Eq-Jsp-nbecause the spoofed-case cost function in Equation (4b) is consistent with carrier-phase sameness. The value of Eq-Jnonsp-r, however, will not be small because the plurality of  Eq-rj directions in Equation (3b) precludes the possibility that any Eq-tra estimate will yield a small non-spoofed cost. Therefore, γ will tend to be a large negative number in the event of spoofing because Eq-Jnonsp-r >> Eq-Jsp-n is likely. In the non-spoofed case, the opposite holds true: Eq-ropt  will yield a small value of Eq-Jnonsp-r, but no estimate of η will yield a small Eq-jspn2, and γ will be a large positive number because  Eq-Jnonsp-r<< Eq-Jsp-n.

    Therefore, a sensible spoofing detection test employs a detection threshold γth somewhere in the neighborhood of zero. The detection test computes a γ value based on the carrier-phase data, the antenna articulation time history, and the calculations in Equations (3a)-(5). It compares this γ to γth. If γγth, then the test indicates that there is no spoofing. If γ < γth, then a spoofing alert is issued.

    The exact choice of γth is guided by an analysis of the probability of false alarm. A false alarm occurs if a spoofing attack is declared when there is no spoofing. The false-alarm probability is determined as a function of γth by developing a γ probability density function under the null hypothesis of no spoofing p(γ|H0). The probability of false alarm equals the integral of p(γ|H0) from γ = Eq-infinity to γ = γth. This integral relationship can be inverted to determine the γth threshold that yields a given prescribed false-alarm probability

    A complication arises because p(γ|H0) depends on unknown parameters, Eq-tra  in the case of an unknown UE attitude and 1-D antenna motion. Although sub-optimal, a reasonable way to deal with the dependence of p(γ|Eq-tra,H0) on Eq-tra is to use the worst-case Eq-tra for a given γth. The worst-case articulation direction Eq-rawc maximizes the p(γ|Eq-tra,H0) false-alarm integral. It can be calculated by solving an optimization problem. This analysis can be inverted to pick γth so that the worst-case probability of false alarm equals some prescribed value. For most actual Eq-tra values, the probability of false alarm will be lower than the prescribed worst case.

    Given γth, the final needed analysis is to determine the probability of missed detection. This analysis uses the probability density function of g under the spoofed hypothesis, p(γ|η,H1). The probability of missed detection is the integral of this function from γ = γth to γ = +Eq-infinity2. The dependence of p(γ|η,H1) on the unknown dot product η can be handled effectively, though sub-optimally, by determining the worst-case probability of false alarm. This involves an optimization calculation, which finds the worst-case dot product ηwc that maximizes the missed-detection probability integral. Again, most actual η values will yield lower probabilities of missed detection.

    Note that the above-described analyses rely on approximations of the probability density functions p(γ|Eq-tra,H0) and p(γ|η,H1). The best approximations include dominant Gaussian terms plus small chi-squared or non-central chi-squared terms. It is difficult to analyze the chi-squared terms rigorously. Their smallness, however, makes the use of Gaussian approximations reasonable.

    We have developed and evaluated several alternative formulations of this spoofing detection method. One is the case of full 3-D ba(t) antenna motion with unknown UE attitude. The full direction cosines matrix A is estimated in the modified version of the non-spoofed optimal fit calculations of Equations (3a)-(3c), and the full spoofing direction vector Eq-bsp is estimated in the modified version of Equations (4a)-(4c). A different alternative allows the 1-D motion time history ρa(t) to have an unknown amplitude-scaling factor that must be estimated. This might be appropriate for a UAV drone with a wing-tip-mounted antenna if it induced antenna motions by dithering its ailerons. In fixed-based applications, as might be used by a financial institution, a cell-phone tower, or a power-grid monitor, the attitude would be known, which would eliminate the need to estimate Eq-tra or A for the non-spoofed case.

    Test Results

    The initial tests of our concept involved generation of simulated truth-model carrier-phase data Eq-0jk using simulated Eq-Bj0, Eq-Bj1 , and Eq-Bj2 polynomial coefficients, simulated satellite LOS direction vectors Eq-rj for the non-spoofed cases, a simulated true spoofer LOS direction Eq-rsp for the spoofed cases, and simulated antenna motions parameterized by Eq-tra and ρa(t). Monte-Carlo analysis was used to generate many different batches of phase data with different random phase noise realizations in order to produce simulated histograms of the p(γ|Eq-tra, H0) and p(γ|η,H1) probability density functions  that are used in false-alarm and missed-detection analyses.

    The truth-model simulations verified that the system is practical. A representative calculation used one cycle of an 8-Hz 1-D sinusoidal antenna oscillation with a peak-to-peak amplitude of 4.76 centimeters (exactly 1/4 of the L1 wavelength). The accumulation frequency was 1 kHz so that there were Mj = 125 carrier-phase measurements per satellite per data batch. The number of satellites was L = 6, their Eq-rj LOS vectors were distributed to yield a geometrical dilution of precision of 3.5, and their carrier-to-noise-density ratios spanned the range 38.2 to 44.0 dB-Hz. The worst-case probability of a spoofing false alarm was set at 10-5 and the corresponding worst-case probability of missed detection was 1.2 ´ 10-5. Representative non-worst-case probabilities of false alarm and missed detection were, respectively, 1.7 ´ 10-9 and 1.1 ´ 10-6. These small numbers indicate that this is a very powerful test. Ten-thousand run Monte-Carlo simulations of the spoofed and non-spoofed cases verified the reasonableness of these probabilities and the reasonableness of the p(γ|Eq-tra, H0) and p(γ|η,H1) Gaussian approximations that had been used to derive them.

    The live-signal tests bore out the truth-model simulation results. The only surprise in the live-signal tests was the presence of significant multipath, which was evidenced by received carrier amplitude oscillations that correlated with the antenna oscillations and whose amplitudes and phases varied among the different received GPS signals. As a verification that these oscillations were caused by multipath, the only live-signal data set without such amplitude oscillations was the one taken in the NASA Wallops anechoic chamber, where one would not expect to find multipath. The multipath, however, seems to have negligible impact on the efficacy of this spoofing detection system.

    FIGURES 5 and 6 show the results of typical non-spoofed and spoofed cases from WSMR live-signal tests that took place on the evening of June 19–20, 2012. Each plot shows the spoofing detection statistic γ on the horizontal axis and various related probability density functions on the vertical axis. This statistic has been calculated using a modified test that includes the estimation of two additional unknowns: an antenna articulation scale factor f and a timing bias t0 for the decaying sinusoidal oscillation eq-pa. The damping ratio ζ and the undamped natural frequency wn are known from prior system identification tests.

    Figure 5. Spoofing detection statistic, threshold, and related probability density functions for a typical non-spoofed case with live data.
    Figure 5. Spoofing detection statistic, threshold, and related probability density functions for a typical non-spoofed case with live data.

     

    Figure 6. Performance of a typical spoofed case with live data: spoofing detection statistic, threshold, and related probability density functions.
    Figure 6. Performance of a typical spoofed case with live data: spoofing detection statistic, threshold, and related probability density functions.

    The vertical dashed black line in each plot shows the actual value of γ as computed from the GPS data. There are three vertical dash-dotted magenta lines that lie almost on top of each other. They show the worst-case threshold values γth as computed for the optimal and ±2σ estimates of t0: t0opt, t0opt+2σt0opt, and t0opt-2σt0opt. They have been calculated for a worst-case probability of false alarm equal to 10-6. An ad hoc method of compensating for the prototype system’s t0 uncertainty is to use the left-most vertical magenta line as the detection threshold γth. The vertical dashed black line lies very far to the right of all three vertical dash-dotted magenta lines in Figure 5, which indicates a successful determination that the signals are not being spoofed. In Figure 6, the situation is reversed. The vertical dashed black line lies well to the left of the three vertical dash-dotted magenta lines, and spoofing is correctly and convincingly detected.

    These two figures also plot various relevant probability density functions. Consistent with the consideration of three possible values of the t0 motion timing estimate, these are plotted in triplets. The three dotted cyan probability density functions represent the worst-case non-spoofed situation, and the dash-dotted red probability functions represent the corresponding worst-case spoofed situations. Obviously, there is sufficient separation between these sets of probability density functions to yield a powerful detection test, as evidenced by the ability to draw the dash-dotted magenta detection thresholds in a way that clearly separates the red and cyan distributions. Further confirmation of good detection power is provided by the low worst-case probabilities of false alarm and missed detection, the latter metric being 1.6 ´ 10-6 for the test in Figure 5 and 7 ´ 10-8 for Figure 6.

    The solid-blue distributions on the two plots correspond to the ηopt estimate and the spoofed assumption, which is somewhat meaningless for Figure 5, but meaningful for Figure 6. The dashed-green distributions are for the Eq-tra estimate under the non-spoofed assumption. The wide separations between the blue distributions and the green distributions in both figures clearly indicate that the worst-case false-alarm and missed-detection probabilities can be very conservative.

    The detection test results in Figures 5 and 6 have been generated using the last full oscillation of the respective carrier-phase data, as in Figures 3 and 4, but applied to different data sets. In Figure 3, the last full oscillation starts at t = 3.43 seconds, and it starts at t = 2.11 seconds in Figure 4. The peak-to-peak amplitude of each last full oscillation ranged from 4-6 centimeters, and their periods were shorter than 0.5 seconds. It would have been possible to perform the detections using even shorter data spans had the mechanical oscillation frequency of the cantilevered antenna been higher.

    Conclusions

    In this article, we have presented a new method to detect spoofing of GNSS signals. It exploits the effects of intentional high-frequency antenna motion on the measured beat carrier phases of multiple GNSS signals. After detrending using a high-pass filter, the beat carrier-phase variations can be matched to models of the expected effects of the motion. The non-spoofed model predicts differing effects of the antenna motion for the different satellites, but the spoofed case yields identical effects due to a geometry in which all of the false signals originate from a single spoofer transmission antenna. Precise spoofing detection hypothesis tests have been developed by comparing the two models’ ability to fit the measured data.

    This new GNSS spoofing detection technique has been evaluated using both Monte-Carlo simulation and live data. Its hypothesis test yields theoretical false-alarm probabilities and missed-detection probabilities on the order of 10-5 or lower when working with typical numbers and geometries of available GPS signals and typical patch-antenna signal strengths. The required antenna articulation deflections are modest, on the order of 4-6 centimeters peak-to-peak, and detection intervals less than 0.5 seconds can suffice.

    A set of live-signal tests at WSMR evaluated the new technique against a sophisticated receiver/spoofer, one that mimics all visible signals in a way that foils standard RAIM techniques. The new system correctly detected all of the attacks. These are the first known practical detections of live-signal attacks mounted against a civilian GNSS receiver by a dangerous new generation of spoofers.

    Future Directions

    This work represents one step in an on-going “Blue Team” effort to develop better defenses against new classes of GNSS spoofers. Planned future improvements include 1) the ability to use electronically synthesized antenna motion that eliminates the need for moving parts, 2) the re-acquisition of true signals after detection of spoofing, 3) the implementation of real-time prototypes using software radio techniques, and 4) the consideration of “Red-Team” counter-measures to this defense  and how the “Blue Team” could combat them; counter-measures such as high-frequency phase dithering of the spoofed signals or coordinated spoofing transmissions from multiple locations.

    Acknowledgments

    The authors thank the following people and organizations for their contributions to this effort:  The NASA Wallops Flight Facility provided access to their anechoic chamber. Robert Miceli, a Cornell graduate student, helped with data collection at that facility. Dr. John Merrill and the Department of Homeland Security arranged the live-signal spoofing tests. The U.S. Air Force 746th Test Squadron hosted the live-signal spoofing tests at White Sands Missile Range. Prof. Todd Humphreys and members of his University of Texas at Austin Radionavigation Laboratory provided live-signal spoofing broadcasts from their latest receiver/spoofer.

    Manufacturers

    The prototype spoofing detection data capture system used an Antcom Corp. (www.antcom.com) 2G1215A L1/L2 GPS antenna. It was connected to an Ettus Research (www.ettus.com) USRP (Universal Software Radio Peripheral) N200 that was equipped with the DBSRX2 daughterboard.


    MARK L. PSIAKI is a professor in the Sibley School of Mechanical and Aerospace Engineering at Cornell University, Ithaca, New York. He received a B.A. in physics and M.A. and Ph.D. degrees in mechanical and aerospace engineering from Princeton University, Princeton, New Jersey. His research interests are in the areas of GNSS technology, applications, and integrity, spacecraft attitude and orbit determination, and general estimation, filtering, and detection.

    STEVEN P. POWELL is a senior engineer with the GPS and Ionospheric Studies Research Group in the Department of Electrical and Computer Engineering at Cornell University. He has M.S. and B.S. degrees in electrical engineering from Cornell University. He has been involved with the design, fabrication, testing, and launch activities of many scientific experiments that have flown on high altitude balloons, sounding rockets, and small satellites. He has designed ground-based and space-based custom GPS receiving systems primarily for scientific applications.

    BRADY W. O’HANLON is a graduate student in the School of Electrical and Computer Engineering at Cornell University. He received a B.S. in electrical and computer engineering from Cornell University. His interests are in the areas of GNSS technology and applications, GNSS security, and GNSS as a tool for space weather research.

    VIDEO

    Here is a video of Cornell University’s antenna articulation system for the team’s first prototype spoofing detector tests.

    FURTHER READING

    • The Spoofing Threat and RAIM-Resistant Spoofers

    “Status of Signal Authentication Activities within the GNSS Authentication and User Protection System Simulator (GAUPSS) Project” by O. Pozzobon, C. Sarto, A. Dalla Chiara, A. Pozzobon, G. Gamba, M. Crisci, and R.T. Ioannides, in Proceedings of ION GNSS 2012, the 25th International Technical Meeting of The Institute of Navigation, Nashville, Tennessee, September 18–21, 2012, pp. 2894-2900.

    Assessing the Spoofing Threat” by T.E. Humphreys, P.M. Kintner, Jr., M.L. Psiaki, B.M. Ledvina, and B.W. O’Hanlon in GPS World, Vol. 20, No. 1, January 2009, pp. 28-38.

    Vulnerability Assessment of the Transportation Infrastructure Relying on the Global Positioning System – Final Report. John A. Volpe National Transportation Systems Center, Cambridge, Massachusetts, August 29, 2001.

    Moving-Antenna and Multi-Antenna Spoofing Detection

    Robust Joint Multi-Antenna Spoofing Detection and Attitude Estimation by Direction Assisted Multiple Hypotheses RAIM” by M. Meurer, A. Konovaltsev, M. Cuntz, and C. Hattich, in Proceedings of ION GNSS 2012, the 25th International Technical Meeting of The Institute of Navigation, Nashville, Tennessee, September 18–21, 2012, pp. 3007-3016.

    “GNSS Spoofing Detection for Single Antenna Handheld Receivers” by J. Nielsen, A. Broumandan, and G. Lachapelle in Navigation, Vol. 58, No. 4, Winter 2011, pp. 335-344.

    Alternate Spoofing Detection Strategies

    “Who’s Afraid of the Spoofer? GPS/GNSS Spoofing Detection via Automatic Gain Control (AGC)” by D.M. Akos, in Navigation, Vol. 59, No. 4, Winter 2012-2013, pp. 281-290.

    “Civilian GPS Spoofing Detection based on Dual-Receiver Correlation of Military Signals” by M.L. Psiaki, B.W. O’Hanlon, J.A. Bhatti, D.P. Shepard, and T.E. Humphreys in Proceedings of ION GNSS 2011, the 24th International Technical Meeting of The Institute of Navigation, Portland, Oregon, September 19–23, 2011, pp. 2619-2645.

    Statistical Hypothesis Testing

    Fundamentals of Statistical Signal Processing, Volume II: Detection Theory by S. Kay, published by Prentice Hall, Upper Saddle River, New Jersey,1998.

    An Introduction to Signal Detection and Estimation by H.V. Poor, 2nd edition, published by Springer-Verlag, New York, 1994.

  • Blue Marble Releases Global Mapper 14.2

    Blue Marble Geographics announces the release of Global Mapper version 14.2. This update to the company’s desktop GIS software offers many new and improved features and functions. Some of the major improvements include several scripting updates, improved Volume Measurement tools, new right-click option to the vector data Search dialog, many LiDAR enhancements and of course many new formats. Blue Marble’s geospatial data manipulation, visualization and conversion solutions are used worldwide by thousands of GIS analysts at software, oil and gas, mining, civil engineering, surveying, and technology companies, as well as governmental and university organizations.

    GlobalMapper_Augusta_LiDAR

    According to the announcement, the Global Mapper 14.2 release introduces many scripting updates and additions, including support for calculating attributes, splitting layers, interactively prompting users for files and folders, to name just a few. Global Mapper is a great tool for behind the scenes processing, whether it is simply batch data conversion or complex extract, transform and load processes such as attribute or geometry merging, clipping or editing. Users can find scripting samples with Global Mapper documentation, with the ability to edit and create them in any text editor. To make this work more easily, Global Mapper workspace files also can be saved as scripts.

    The company reports that the 14.2 release also includes many LiDAR enhancements such as search by elevations and the ability to color by return value, which allows users to easily see when there are multiple return values. This feature is excellent for performing vegetation analysis. There are also new point loading slider bar and reporting tools for point cloud density. 14.2 also has improved import and export options as well as support for exporting point clouds to DXF and DWG format files. 14.2 also introduces support for the new MrSID format files and exporting XYZI (XYZ + Intensity) files, typically from LiDAR data.

    “Certainly we are focused on continuing to expand our support for LiDAR and more geospatial formats,” stated Blue Marble President Patrick Cunningham. “But this release has some great new scripting capabilities and we like to remind our users that Global Mapper is a powerful extract, transform and load tool as well.”

  • San Jose Battles Food Insecurity with Geospatial Tech

    In an ambitious geospatial project, San Jose State University and local non-profit Garden to Table joined forces to connect families in need with excess local produce. This urban-forestry-meets-agriculture project enabled the group to more than double its collection and distribution of fresh produce, feeding the hungry with fruits grown locally in private yards and gardens.

    Food security is a growing social and economic challenge that knows no political boundaries. Even in the United States, an astonishing 18 million households were labeled “food insecure” in 2011 because they lacked the means at some point during the year to feed all of their members. The negative impacts of food insecurity can range from poor academic performance and rising healthcare costs to increased crime and social unrest.

    San Jose State University (SJSU) in California has teamed with Trimble Navigation Ltd. to deploy a high-tech solution that enhances the local community’s ability to put fresh food on the tables of families in need. Leveraging a variety of web-based GIS, geospatial, and mobile GPS technologies, the solution makes it easier for local organizations to manage productive forestry and agriculture programs in the urban setting.

    Fruit-Tree-Survey
    Garden to Table volunteer collects fruit tree data with the Trimble Juno handheld.

    “Bringing food production back into our cities and suburbs has significant environmental, economic and social benefits,” said Hilary Nixon, associate professor in the SJSU Department of Urban and Regional Planning. “A healthier community is one of those benefits.”

    SJSU and the City of San Jose have jointly formed an organization they call CommUniverCity that brings together students, faculty, city staff and members of the local community to assist nearby neighborhoods in a variety of initiatives. One of these is Garden to Table, which deployed the Trimble Urban Forestry solution to feed the hungry with fruits grown locally in private yards and gardens.

    Because of the increased efficiencies achieved by superior data collection and organization, Garden to Table was able to halve the amount of time it took to catalog, organize, and map Central San Jose’s Fruit Trees, leading to more time in the field, and a projected increase of 100 percent more fruit in 2013, or roughly 25,000 pounds. Plans call for all of the fruit being delivered to families within a couple of miles of where it is grown.

    Greater consumption of locally grown healthy foods isn’t the only advantage of improved urban forestry, explained Nixon. She believes the same technology used by SJSU and Garden to Table to feed the needy in San Jose can be used by local governments to better manage trees in public spaces along residential streets and in city parks, further contributing to a healthier community.

    Gathering Leftover Fruit

    The mild climate and generous rainfall in San Jose are ideal for fruit trees, many of which were planted decades ago on residential properties. Now mature, these trees typically yield more citrus and stone fruits than one household can possibly consume, the remainder often rotting on the branches or on the ground. Concerned by the fact that much of fruit went to waste, an informal group called Neighborhood Fruit Pickers sought permission of property owners to glean the excess for distribution to food banks.

    Garden to Table offered to support the Pickers in 2011 seeing an opportunity to leverage the university’s GIS resources to make the urban harvesting process more productive, said Zach Lewis, Garden to Table’s project coordinator and a graduate student in SJSU’s Urban Planning Department.

    “We started mapping the fruit trees with pen and paper, walking the streets and collecting data—address, tree type, productivity and size,” said Lewis. “Then I would geocode the data and drop it into the GIS…that was incredibly time and labor intensive.”

    Although the City of San Jose shared up-to-date parcel layers from its GIS for the university to use in its own ArcGIS system, the field data collection proved to be a flaw in overall efficiency. Not only was field work time consuming, mistakes were being made both in inconsistent data collection and in the entry of field notes into the GIS back on campus. These notes included hand-written location coordinates for each tree captured in the field with a simple hand-held GPS unit.

    Despite these issues, Lewis and fellow volunteers mapped 930 trees on private properties within a mile radius of campus in the first year. Personnel time in the field and at the keyboard totaled more than 300 hours. Although the mapping and subsequent GIS analysis helped improve efficiency of the harvests, Lewis and Nixon saw potential in further automating
    the process.

    With close ties to SJSU, Trimble developed a three-part solution with a mobile GIS for data collection, a back-office application for geospatial data analysis, and a tree canopy monitoring segment for long- term planning.

    More Efficient Tree Mapping

    To create an integrated solution, participants contacted Cengea, a Trimble company in Vancouver, Canada, which offers a data management and visualization package specifically for forestry. This solution, called Cengea Forest, needed only minor customization to provide both mobile field and back-office analysis functionality for Garden to Table. The solution was up and running in less than two weeks.

    “The mobile client application ran on handheld Trimble Juno SB GPS data collectors,” said Patrick Lefebvre, Cengea Manager of Customer Solutions. “Field crews were guided by a simple menu system that helped them record and inventory trees in the study area that could be harvested…accurately recording GPS location and key attributes such as species, size and productivity.”

    The Cengea Forest app.
    Cengea Urban Forest displays Garden to Table fruit tree locations on a parcel base map layer.

    Training the volunteers to use the mobile data collectors took just a few minutes because the attribute menus were mostly point-and-click. These sessions focused on educating the crews to correctly identify San Jose’s nearly two dozen species of fruit trees, each named in the pull-down menu. Jotting down location coordinates for each tree was eradicated because the mobile GIS application on the Juno automatically recorded those points as feature attributes. Collected data was uploaded by Wi-Fi into the back-office piece of the application.

    According to Garden to Table’s Lewis, efficiency and accuracy saw immediate improvements in the tree mapping portion of the project. Compared to pen-and-paper, the crews gathered tree data much faster in the field, and errors in transcription
    were eliminated by digital upload to the database.

    “With the mobile solution, we mapped 1,400 trees and did that in roughly 160 hours,” said Lewis, noting this represented almost 50 percent more trees mapped in half the number of hours, and in only four weeks compared with 18 months the previous time. The process of collecting data in the field and then integrating it into the GIS manually was condensed into a single step thanks to digital data collection making it easy to pick-up and go.

    Participants believe the most significant advantage of the automated solution will come this year with a boost in harvest productivity.

    Running the Cengea data analysis and visualization application on the GIS, Garden to Table will query the tree inventory to show the most productive trees of a specific type on the digital parcel map layer. This will help them concentrate the volunteers in neighborhoods where the most fruit can be picked.

    HappyGirls
    Community food bank recipients helped out with the harvest.

    Further, the Cengea application contains background information on fruit tree species including peak production times which could be correlated with specific tree locations by street address on the parcel layer. Each week of traditional harvest times, Lewis will generate custom maps of the project area along with address lists showing his teams exactly where to go and glean fruits ready to pick.
    “The application revolutionizes the way we are able to look at our tree data,” said Lewis.

    Among the attributes collected during field work were condition and health of the trees. As a favor to participating citizens with fruit trees on their properties, Garden to Table will also create customized pruning schedules by species. Volunteers may use this information to notify the owners when their trees should be tended. The charitable organization hopes that better maintenance will improve yields in the future.

    “Garden to table will use Cengea management tools to improve harvest and prune yields in the future because in the past Lewis printed maps and manually created routes,” said Trimble’s Rick Gosalvez. “With Cengea, he can query by fruit, by season, condition, and by productivity of inventory to make more informed decisions.”

    Analyzing tree canopy for Future Growth The City of San Jose and Garden to Table share a common long-term goal of increasing the total number of trees in the San Jose area. While both organizations understand that more fruit trees will ultimately yield larger harvests, the university is eying a classic win-win situation for the community at large.

    “Trees really make the city livable,” said Ralph Mize, San Jose’s City Arborist who serves as an advisor to the project. “They provide many positive benefits.” The concept of urban forestry dovetails perfectly with a green initiative started by the San Jose mayor in 2009. One of its goals is to plant 100,000 new trees across the city. SJSU’s Nixon explained that a rich and lustrous tree canopy in the urban and suburban setting has a positive impact on the local economy, environment and society. Trees boost property values, reduce air pollution, improve storm water drainage, and even encourage people to exercise more outdoors.

    With fruit tree canopy inventory and monitoring in mind, the project team turned to Equinox Analytics Inc. of Bismarck, N.D., to add another component to the solution. Working with the Trimble eCognition software, the firm created a script that calculates fruit tree canopy coverage by analyzing high-resolution aerial orthoimagery and airborne LiDAR elevation data that had been acquired over San Jose and provided by the City to Trimble for the project.

    “The Trimble eCognition software is ideal for performing complex analysis of large, high-resolution spatial data sets,” said Aaron Smith, Equinox Analytics President. First, the eCognition script identified areas of vegetation in the digital orthoimagery using information from the visible green spectrum. But this spectral information included all green vegetation – tree canopies, grass, and bushes. To separate out the trees, the script then correlated the visible green spectral class with the elevation points in the LiDAR data, eliminating vegetation shorter than five feet in height.

    “This allowed us to calculate total tree canopy coverage in the [Garden to Table] project area,” said Smith. “We refined the analysis to focus on trees [with fruit] accessible by ladder, so the script eliminated trees taller than 25 feet.”

    Trimble eCognition canopy and building footprint extraction in Five-Wounds Brookwood Terrace study area.
    Trimble eCognition canopy and building footprint extraction in Five-Wounds Brookwood Terrace study area.

    Smith output the tree data as a geo-referenced profile across the project area and provided this file to SJSU and Garden to Table. Nixon and Lewis hope to input the data into the GIS and cross- referenced known fruit tree locations with the canopy profile. From this information, they expect to more accurately measure the size of specific tree canopies, greatly enhancing their estimates of potential fruit production.

    “The profile also showed where the tree canopy was particularly dense in other parts of the city, giving them an idea of where to focus their efforts to find fruit trees that hadn’t been mapped,” said Smith.

    Lewis said that Garden to Table will use the fruit tree canopy map in the future as it moves into the next phase of its project — encouraging the planting of new fruit trees. Just as the canopy map shows where the trees are concentrated, it also reveals gaps where new ones would thrive. Nixon and Lewis plan to work with both city officials and private landowners to encourage planting trees where they can provide the most benefit.

    Trimble’s Gosalvez sees the tree canopy monitoring piece of the solution as having significant long-term benefits for overall urban forestry/agriculture efforts in any city. The application provides a baseline of canopy coverage and then enables the end users to make rapid change detection measurements in the future to assess the success of policy initiatives designed to foster tree growth.

    “This integrated solution provides all the tools needed for communities to beautify their environments, battle food insecurity and support healthier living in the face of a changing climate,” said Gosalvez.

    (This feature originally appeared in Informed Infrastructure.)

  • New Generation GeoPDF Maps: TerraGo Evolves with GIS and Big Data

    By Art Kalinksi

    Three weeks ago I had a chance to visit the offices of TerraGo Technologies in Atlanta. I first used their technology in the early 2000s, when I was the GIS manager for the Atlanta Regional Commission. For those of you that may not remember GIS and mapping before GeoPDF maps, it was a real challenge to provide interactive maps to users outside your organization. A GIS author had to ship the data layers, attribute tables, symbol sets and layouts as a package to a user who had to have compatible GIS software. One then had to hope that the user pointed to each data layer correctly and had a good sense of cartography to create maps that told the story. If the user chose inappropriate lines, colors or symbology, the resultant map could look terrible at best, misleading at worst.

    Esri tried to solve the problem with Map Publisher which maintained the author’s cartography, but if any data layers were corrupted or not pointed to correctly, the map failed. GeoPDF maps solved that problem since all the data layers and even the map layout/cartography were preserved as one single PDF file that could be read and interactively queried by anyone using a simple Adobe Acrobat reader. A user could turn layers on or off, zoom in/out and query attributes. TerraGo also added the TerraGo Toolbar that enhanced the map with measurements, geo-locations and the ability to collaborate with others on the same GeoPDF map.

    GeoPDF maps and imagery were quite a leap in map publishing capability and soon became ubiquitous with key federal users and a de facto standard for map publishing within the Department of Defense (DOD) and the U.S. Geological Survey (USGS). Anyone can download many GeoPDF maps free of charge, including U.S. topo maps from the USGS Store.

    For federal and DOD users, the U.S. Army Geospatial Center (AGC) has published more than 200,000 maps of locations around the world. Some samples, including 3D GeoPDF maps, can be viewed by the public. In 2009 TerraGo opened “geospatial PDF” technology to all users. As a result you can create “geospatial PDFs” directly from ArcGIS and other geospatial software and display them with the TerraGo Toolbar. TerraGo, however, retained the enhanced functionality of GeoPDFs, including many new additional features and enhancements.

    The term “GeoPDF” refers to map and imagery products created by TerraGo software applications. GeoPDF maps and imagery use a geospatial PDF as the container for maps, imagery, and other data used to deliver an enhanced user experience in TerraGo applications. However, GeoPDF products conform to published specifications, including both the OGC best practice for PDF georegistration as well as Adobe’s proposed geospatial extensions to ISO 32000, making them consumable by applications such as Adobe Acrobat, Adobe Reader, Global Mapper, and others. GeoPDF products often include other advanced PDF features such as layers and object data that can add significant GIS functionality to the file, particularly when used with the TerraGo plugin to Adobe Reader or other TerraGo clients. TerraGo even has the capability to create navigable 3D GeoPDF models. Here is an example of a 3D GeoPDF model of the Bin Laden compound. Click to experience the interactive PDF (requires TerraGo Toolbar.)

    bin laden

    TerraGo’s geospatial collaboration software and GeoPDF maps and imagery are a powerful solution to produce, access, update and share geospatial information and applications with anyone, anywhere. TerraGo solutions enable enterprises to extend, exchange, collaborate and exploit georeferenced maps, imagery, audio, video, forms and other intelligence in connected or offline environments. I repeat: connected or offline. This is a key GeoPDF capability that cannot be overemphasized.

    I learned the hard way during numerous emergency response exercises and events that as the number of responders ramps up, local internet connectivity degrades to the point that it’s difficult to send and receive even simple emails, let alone large data sets such as imagery. GeoPDF technology permits users to collect and assemble large data sets at the early stage of an event, use them and collaborate on the GeoPDF map locally without the need to continually reload the same data from a remote server. Building on this strength, TerraGo developed numerous related products, but the company is evolving in a more fundamental way. According to TerraGo CEO Rick Cobb, the company is moving from a product-centric organization to a workflow solutions company by expanding some of its technology, providing its solutions as APIs and SDKs for integration with high-end systems and using innovative methods to bring its capabilities to remote users even in fringe, disconnected environments.

    Part of this evolution included expansion of three technologies:

    • increased emphasis on use of locally connected mobile devices,
    • enhancing the capabilities of “Composer 3D” that integrates 3D data such as LiDAR point clouds with 2D data in the GeoPDF environment, and
    • the acquisition of GeoXray, a “big data” exploitation tool that automates the process of discovering, geospatially visualizing, monitoring and sharing relevant unstructured information from any source.

    GeoXray is a web-based software application that allows users to search the Internet and social media sites for content relating to a geographic area and filtering the results by place, time and topic. TerraGo demonstrated interoperability by allowing a user to access GeoXray directly from a GeoPDF map. TerraGo’s Michael Bufkin indicated that the next step in this interoperability will be to cache the GeoXray-discovered content within the GeoPDF map when it is created, thus enabling access to the content directly from the TerraGo Toolbar. Users would then be able to discover GeoXray content even if not connected to the Internet, while using the same tools that they use for map display and collaboration.

    GeoXray

    It’s hard to fully describe the GeoPDF/GeoXray integration in this short column but picture a sample scenario which was demonstrated for me at GeoINT 2012. A hypothetical analyst needed to determine a probable location of a kidnap victim in a remote country. The analyst first used the general mapping capabilities of the GeoPDF map to identify key geographic locations. Then, using a broad array of “big data” contents such as news, blogs and social media, the analyst was able to narrow his efforts to a few key locations through the discovery and filtering capabilities of GeoXray. Combining and layering the physical geography with mapped locations of relevant GeoXray data, the analyst was able to significantly narrow sites of interest. Further viewing and local collaboration by agents in the field using mobile devices to view and collect additional data could refine the location even more.

    This was quite an elegant and robust merging of GIS and “big data” in an easy-to-use application. I look forward to this tool set being a valuable addition for DOD, businesses and any agency that needs fast collaboration in complex environments both domestically and in remote locations.

    TerraGo will be an exhibitor at the ESRI Federal Users Conference this week. I’m looking forward to seeing what other new developments exhibitors will be showing at the UC.  Please stop me and say hello.