GPS World

Author: Art Kalinski

  • Geospatial Technology 2015: One Man’s View of Life’s Swinging Pendulum

    Navy OCS Newport. (Photo by Photographer's Mate Second Class Mark A. Ebert)
    Navy OCS Newport. (Photo by Photographer’s Mate Second Class Mark A. Ebert)

    In 1971, I was traveling from Navy boot camp to OCS at Newport, Rhode Island.  While walking through Logan Airport, I passed some Vietnam protesters. A young hippie girl came up to me from the group and looked at my red National Defense service ribbon (a generic ribbon given to everyone for merely being in the service). Flicking the ribbon she scowled and asked “How many babies did you kill to get that medal?” Taken aback by her question, I answered the only way I could to someone so naive and clueless. I said, “To be honest with you, I lost count.”

    Fortunately, the public-perception pendulum swung back, reaching a high point after Desert Storm and more so after 9/11. Everyone remembers what they were doing when the Twin Towers were hit. I was in the middle of teaching an ArcView II class at the Atlanta Regional Commission. That week, I made three predictions to my colleagues.

    1. We are going to war. We did.
    2. We are going to take a 10% economic hit. We did, although later than I thought.
    3. Although almost everyone, including Rosie O’Donnell, was waving the flag, wearing NYPD caps, and extolling the virtues of our first responders and the military, I predicted that within 7-10 years they would forget the horror and be calling us baby killers again. The recent dissing of the NSA, CIA and, most recently, the police, is putting us on track for that prediction.

    Although real statistics show that life continues to get better for everyone despite the doom and gloom media, I do believe that we will see setbacks as the world faces numerous asymmetrical threats. So what does all this have to do with our geospatial community? A lot. No matter where the pendulum is, our country has to use every intel tool at our disposal to maintain vigilance. Killing bad guys with drones and taking no prisoners certainly doesn’t help our HUMINT (human intelligence) efforts, so more has to be accomplished by other means, with geospatial technology playing a key role. In 20 years we’ve seen significant changes in geospatial technology, and 2015 should be no exception.

    Oblique Imagery and 3D Models

    I believe that 2015 will see an explosion of oblique imagery and 3D models. Moore’s Law proves valid as hardware speed and capabilities expand. There are numerous overhead and ground-capture systems, manned and unmanned, that are driving costs down and resolution up, with significantly more imagery available. Countless programmers are working night and day to develop the preeminent tool to build 3D models. 3D navigation and exploitation tools should also continue to improve.

    I’ve written on how many people have difficulty orienting themselves with abstract maps or even ortho imagery. By contrast, oblique imagery and 3D models help non-GIS personnel with rapid perception of an operational picture. Some ask why bother with the expense and effort needed to create 3D models when four-way obliques are almost as good? The key reason is police, military and first responders frequently need to be able to measure angles, distance, lines of sight and visibility within a 3D environment, such as one rooftop to another. That’s difficult to do without a metric geo-referenced 3D model. Additionally, if UAVs, micro UAVs, and even nano UAVs see expanded use, interior navigation will be critical. Perhaps someone will finally develop a reliable interior-location tracking system with LiDAR data, BIM Models or accurate 3D models as the navigation map.

    For over a decade, Pictometry International has been the key provider of georeferenced metric oblique imagery, but the Pictometry patents have expired and many new players are entering the market with both aerial and ground-capture systems, plus 3D model creation. Here is a partial list of oblique and 3D model players to watch in 2015:

    • Acute3D. This French company offers software that produces high-resolution 3D models from simple photographs, without any human intervention.
    • AEgis Technologies Group, Inc. Builders of detailed 3D models for military and major security applications.
    • Agisoft LLC. A Russian company that created Agisoft PhotoScan, a photogrammetric software for 3D reconstruction, visualization, surveying and mapping.
    • Ball Aerospace & Technologies Corp. This Denver-based office developed a new technology that creates real-time 3D models by shooting and merging a co-bore-sighted LiDAR and optical image to create real-time 3D models.
    • BlomOBLIQUE. A former Pictometry partner now on its own, primarily in Europe.
    • CyberCity 3D, Inc. CyberCity 3D specializes in 3D GIS buildings focused on urban planning and analysis, visualization, real estate, solar, rainwater, and sustainability.
    • CycloMedia Technology, Inc. A Dutch-based U.S. firm doing ground-level metric oblique imagery. I wrote about them in February.
    • Euclideon Geoverse. An Australian firm that developed tools that permit almost instant access to massive point cloud or imagery data. Watch the video.

      • Fugro. Fugro’s PanoramiX imagery and PX Mapper software look promising.
      • GEOSPAN, Corp. This firm is capturing imagery of Cook County Illinois and planning to release automated 3D modeling software this year.
      • ICAROS. This well-established mapping firm has expanded into metric oblique imagery. Watch the video.

    • IDAN Computers Ltd. An Israeli company that developed the tools to capture metric oblique imagery almost at the same time as Pictometry, but were only a few months behind Pictometry in filing a patent. IDAN’s Oblivision technology has seen extensive use overseas, and its IMPS (IDAN Mission Planning System) was used in real-world homeland security and military actions in the Middle East. IDAN was recently awarded a U.S. patent for automatic generation of 3D models of structures using real facade textures obtained from its geo-referenced oblique images. Watch the video.

    • MosaicMill, Ltd. This geospatial technology company in Finland was established in 2009. The company is the developer of the EnsoMOSAIC aerial survey system and EnsoMOSAIC photogrammetric software designed for UAV captured data.
    • NearMap. This Australian firm has been doing very high refresh rate ortho imagery focused on construction, but is now getting into the oblique market. Read more here.
    • Pix4D. This company has generated a lot of buzz related to its Pix4Dmapper, which automatically creates 3D models from imagery captured by any type of camera or platform, including small UAVs.
    PLW Modelworks 3D model of San Francisco.
    PLW Modelworks 3D model of San Francisco.
    • PLW Modelworks. In my opinion, PLW Modelworks 3D models are still the gold standard of 3D models. Although not quick or cheap, nothing comes close to these photo-realistic and photo-accurate 3D models. Note their key role in Birdly, discussed below.
    • Raytheon. I wrote about Raytheon’s automated system to build 3D models from satellite imagery in August.
    • Sanborn. Founded in 1866, the Sanborn Map Company is expanding significantly into oblique imagery and 3D models.

    The Cloud

    No discussion of 2015 would be complete without mention of “The Cloud.” I wrote about one cloud-based application last year. We still have a long way to go to achieve the grand vision, but the Carbon Project may come closer to the dream than any application I’ve seen so far.

    The Carbon Project is building a unified cloud-based system for the State of North Carolina that will roll out this spring. The project addresses two key issues that have been a problem for years — data disparity from multiple sources and loss of connectivity. The system will continuously ingest geospatial data from all NC counties and seamlessly correct formats and data labels to one standard without changing the original data. Additionally, for those of us who have experienced paralysis during critical events due to loss of connectivity, the Carbon Project can automatically cache data locally once an area of interest is defined.

    Note this example using Carbon Project technology to test an Electronic Flight Bag for the FAA. Some pilots no longer have to lug around a 40-pound case of paper charts and manuals, just a tablet.
    Note this example using Carbon Project technology to test an Electronic Flight Bag for the FAA. Some pilots no longer have to lug around a 40-pound case of paper charts and manuals, just a tablet.

    Social Media / Cyber Warfare

    Initially, it seemed like “location” wouldn’t be a factor in the cyber world other than to monitor threats to our infrastructure such as the power grid, but we’ve all learned differently. There is a growing capability and need to map networks, nodes and server locations. Additionally, many tools have been developed that can identify location components within the content of social media, and the technology will continue to improve and grow in importance, especially for the intel community as HUMINT dries up.

    A seemingly small improvement comes from ClearTerra with its product LocateXT. LocateXT rapidly scans unstructured textual documents searching for location information such as geo-coordinates or place names, then automatically creates formatted geospatial files such as Shapefiles and KMLs. On first glance, this doesn’t seem like that big of a deal, until one realizes the man-hours that manual searches and conversion would take on thousands of documents, including massive social-media files.

    birdly2Augmented / Virtual Reality

    So, what is this young lady doing? She is flying through a virtual but real-life 3D model. See what happens when you merge GIS, ortho/oblique imagery, PLW Modelworks 3D models, Occulus Rift 3D goggles, UAVs, GPS and virtual reality. By the way, don’t put this in the same category as a video game. Gamers use a lot of cloning and textures, so they don’t have to handle real-life data files. Birdly, a bird-flight simulator, uses photo accurate geo-referenced imagery and models. Perhaps Birdly is the future of UAV control and remote data capture. Learn more about Birdly:

    With this column, I felt like one of the blind men trying to describe an elephant, since my view of the geospatial community is limited. Most likely you have a different view based on your position and experience. Please share your predictions for 2015 in the comments section based on your view of our community.

    Hopefully, the public perception pendulum will start swinging back this year.

  • Is College Worth the Price? Yes, If Your Major is Geospatial

    Two weeks ago, CNN had a special airing of the two hour documentary Ivory Tower. The movie, which was released earlier this year, dealt with the growing problem of the increased cost of going to college, growing student debt — now approaching 1.3 trillion dollars, and the inability of students to find employment in their field. The movie raised some important issues and used the plight of the prestigious but small 950-student Cooper Union College in New York City as an example.

    The private engineering, architecture and arts college established in 1859 was funded by a very large endowment, and up until last year tuition was free for those lucky students who could get in. However, construction of a $170 million building, high administrative costs (the college president’s salary was reported at $750,000) and some less-than-ideal management decisions resulted in financial disaster and the need to start charging tuition last year. That action prompted a student revolt that is still unresolved.

    Original Cooper Union building.
    Original Cooper Union building.
    New classroom building.
    New classroom building.

    A Politically Incorrect Omission

    This example was used to highlight that perhaps colleges have lost their way by concentrating more on prestige rather than education. The size and cost of administration has risen significantly. Universities seem to be competing for bragging rights with each other through massive and luxurious construction projects while state funding diminishes. More time is spent doing high profile research by the faculty members while part time graduate students or adjunct professors actually teach the classes.

    The disappointing thing about the Ivory Tower movie was the hand-wringing and focus on the high cost and poor job opportunities. However, they seemed to avoid the gorilla in the room — the choice of majors. One would think that someone smart enough to go to college would be smart enough to research job opportunities resulting from chosen majors. I had a colleague who lamented that his daughter graduated from a well-known New England college $80,000 in debt and was only able to land a $28,000 a year position — her major, journalism. I heard similar stories for other non-technical graduates.

    It’s painful and it may not be politically correct, but some degrees are harder to earn and do pay more. I fault colleges for painting a rosier picture than is deserved for many non-technical majors. My son struggled through engineering school and his friends through computer science, accounting and pharmacy schools, but all got hired quickly and are doing quite well even in this weak economy. The real-life lesson, get a degree in a difficult and needed profession.

    Thanksgiving

    So what does this have to do with the geospatial community? This Thanksgiving I was thankful again that in 1989 I made the decision to pursue a master’s degree in GIS. I struggled with some of the course work, programming and learning ArcInfo 3.0 which was especially confusing at the time because it operated on Sun, DEC or Silicon Graphics workstations running UNIX, so one had to mentally separate the AI commands from the equally unfamiliar UNIX commands. For those of us who finished the master’s program it’s been full employment ever since. However, like other professions, the learning can’t stop, and we in the geospatial community are especially lucky, since there are many education opportunities ranging from brick and mortar schools to online and non-traditional education in subjects related to geospatial. Geospatial is also different from some professions in that there are many entry-level positions that don’t require a four-year college degree. Experience in those positions can be leveraged and ultimately expanded with online, college and graduate-level work to higher level positions.

    When I started work in GIS in the early ’90s, we were happy just to be able to digitize paper maps and reprint them with needed updates. We did some limited analysis using buffers and overlays but not at the level found today. Today, geospatial technology has evolved to a point of ubiquity. We regularly collect a variety of imagery sources including satellite, aerial, LiDAR, UAV and ground collection with optical/multispectral sensors. Operations and analysis include the use of multiple online data sources, live AVL GPS tracking, advanced statistical methods, social media overlays, interactive 3D models and virtual reality simulations. Delivery has evolved from single thick client workstations to web services and mobile device apps. All of this requires computer programming skills that are evolving daily.

    So?

    So what does this mean to you? First, if you have the ear of high school students, try to steer them to an education that will actually get them a job. An easy major may facilitate a lot of partying, but they may be living with their parents for years after graduation. On the flip side, not everyone is suited for college and there are many trades that pay extremely well and offer rewarding and secure careers including geospatial technology.

    Second, if you are in the geospatial field, don’t rest on your initial training. We all need to stay relevant, and there is a growing list of non-traditional online education that can build the skills and capabilities of new and existing geospatial professionals. When I was the GIS manager for the Atlanta Regional Commission in the ’90s. we needed someone who was an expert in dynamic segmentation, routes and linear referencing for our transportation planning and modeling. We didn’t have that talent in-house, and I would have hired anyone with that specific skill set — degree or no degree. We were fortunate in finding a graduate student with both the needed skills and broad GIS experience.

    Emerging Education Opportunities

    There has been a growing list of online education opportunities. For years Esri has been offering GIS classroom and online software courses, Microsoft programming courses and the Kahn Academy expanded online education with MOOC’s (Massive Open Online Courses) in many subject areas. More recently, edX, Coursera and the well-publicized Udacity, co-founded by Sebastian Thrun inventor of Google Glass. Udacity offers many technical online classes including a Georgia Tech Massive Online Master’s Degree in Computer Science. Add to this UnCollege, a social movement aiming to change the notion that “going to college is the only path to success,” and you can see that traditional colleges are in a potentially disruptive environment. Just like Uber and transportation.

    Penn-State-GEOINT-W

    GEOINT Education Success Story

    For many years, Pennsylvania State University has been a leader in online geospatial education. Penn State offers both a United States Geospatial Intelligence Foundation (USGIF) accredited post-baccalaureate certificate in GEOINT applications and a graduate certificate in GEOINT analytics. Continuing the tradition of providing open educational resources, recently Penn State began to provide free geospatial MOOCs through Coursera.

    The joint effort of Dr. Max Baber of USGIF and Dr. Todd Bacastow of Penn State puts Penn State among the eight universities that have achieved USGIF academic accreditation including Northeastern University, University of Redlands, the University of Utah, West Point, U.S. Air Force Academy, the University of Texas at Dallas, George Mason University and the University of Missouri.

    According to Bacastow, a West Point graduate and retired Army major, Penn State’s for-credit program has served more than 5,000 students with about 2,500 of these students having already completed. The mapping MOOC has served more than 70,000 students. The GEOINT MOOC will open on January 14, 2015. You can view a video of Dr. Bacastow explaining the GEOINT MOOC here.

    He cited numerous success stories including: a wife of a deployed sailor who earned her certificate and is now a lead geospatial architect at a three-letter agency; a severely injured Iraq Army vet who is now a contractor for NGA; a former infantry officer who now fills a key geospatial position at CENTCOM; and the stories continue with NGA currently trying to fill more than 1,000 positions.

    Bottom line — don’t stop learning.  The opportunities are there, especially geospatial.

    P.S. Lest you think that I don’t take my own medicine, I felt that I was behind the power curve regarding social media and just getting by, so I signed up for a comprehensive online social media course so I could do a deep dive into the systems.

     

  • Orator Plus: Small Improvement Creates Strong Operations Center

    This screenshot of an Orator Plus session shows live GPS tracking (upper left), an interactive GIS application (lower left), a live video feed (upper right), an imagery service (lower middle) and other window launch buttons (lower right).
    This screenshot of an Orator Plus session shows live GPS tracking (upper left), an interactive GIS application (lower left), a live video feed (upper right), an imagery service (lower middle) and other window launch buttons (lower right).

    Little things can be frustrating. For decades I struggled with a silly irritation — finding a can opener that worked well. I tried many different styles — push types, camp knives, rotary types and even several electric models, but none were satisfying. I assumed that that was that. Then I came across one that seemed too good to be true, a hand crank Swing-a-Way version that used a 1938 patent in which the serrated drive wheel and cutting wheel were interconnected with simple drive teeth.

    The original design Swing-a-Way without drive teeth.
    The original design Swing-a-Way without drive teeth.

    This seemingly small improvement made a world of difference. The manual Swing-a-Way was smooth, easy to operate and never stalled. My wife and I threw away all our other can openers and have never looked back. The patent has long expired, so many foreign-made openers use the same design, with EZ-DUZ-IT being the only remaining U.S. manufacturer of the original design.

    A Swing-a-Way with drive teeth.
    A Swing-a-Way with drive teeth.

    The addition of those simple drive teeth made the difference. Orator Plus is similar — it’s an improvement over traditional presentation software that is more than just a “dog-and-pony show” creator. Orator Plus robustly displays multimedia, web feeds, and live applications on one screen with an overarching whiteboard in a completely stable, collaborative environment.

    Sharing Geospatial Information

    In geospatial work, we frequently need to display GIS applications, imagery, diverse data sources and other applications to an audience in a non-linear format. Additionally, we may need to create an emergency operations center or industry logistics management center that can reliably access multiple data sources in an easy-to-use environment that is more robust, versatile and stable than simple presentation software. Orator Plus does that.

    Most of us have made extensive use of PowerPoint, leading to pushback and jokes about PowerPoint poisoning. There are also quite a few competitors to PowerPoint, including the non-linear Prezi, GoAnimate, Google Docs, SlideSnack, Zoho Show, and PowToon. PowerPoint and others are mostly designed to do presentations in a linear fashion. A user can also include hotlinks to outside content and even the ability to launch third-party applications from within PowerPoint while jumping from slide to slide. The limitation is that the systems are not designed to run multiple applications while jumping from one to another in an operational collaborative environment. It’s easy to get lost, trip or choke the system.

    In an alternate approach, some software environments that permit the use of multiple windows such as Windows itself or specialized systems such as DexPot. The very Mac-like Windows 10 will also have the same kind of multiple virtual windows. However, in my experience, the ability to customize and manipulate the multiple virtual windows also makes the system potentially confusing, corruptible and not reliably stable.

    Orator Plus

    Orator Plus is designed to overcome the above limitations with a simple authoring and display environment. The best way to understand Orator Plus is to view a video overview of the system. Also, here are 12 video clips that show the system in use by the Department of Homeland Security and the FBI, as well as in other applications.

    Orator Plus operation starts with an authoring tool that imports electronic content, including still images, still panoramas, maps, floor plans, 3D models, LiDAR data, archived video/audio files, live video/audio feeds, sensor data such as NBC, thermal, shot detectors, etc., document files of any format, Flex applications, GIS services, GPS vehicle tracking, websites, online databases, interactive panoramic video routes. and much more.

    Once loaded, users can manage objects individually or in groups. Relationships can be established between discrete objects, information, files, and more. The look and feel of the system can be customized. When finished authoring, the user can create a portable executable file that is ready to run on any PC, laptop, tablet, or smartphone. Although the Orator Project Files are web-enhanced, they are not web or network dependent. If connectivity is lost, the Orator Project Files can run on a stand-alone basis with available local data.

    According to the Orator Plus team, the following Orator Plus features are unique enough to permit sole-source procurement:

    1. Portability — Orator Project Files will run on any laptop or PC, or stream to a tablet or smartphone with no pre-configuration required. Project Files can be transferred or conveyed in any manner the owner desires. Orator Project Files are web-enhanced and enriched, but they are not web-dependent. When there is no network access, Project Files can operate on a self-contained basis.
    2. Integrated viewers — Any type of video, audio, sensor, or application can be run within an Orator Project File with no plug-ins or downloads required. Fully integrated viewers and engines are designed to support all content accessed through the Project File. Viewers for images, video, or any panoramic still image, including GigaPan, and panoramic video are integrated.
    3. Touch interactive — Orator Project Files can be driven by a standard mouse, a gyro or “air” mouse, a stylus used in conjunction with an e-beam, or using a finger on a smart board or any other touch-enabled screen. No special software is required to use Orator Plus in any touch-enabled environment.
    4. Zero installation and zero footprint — Orator Plus Project Files are fully contained executable files that install nothing and simply run, but when removed, leave no trace behind.
    5. Facilitates rapid analysis for decision support — With the intuitive, icon-based file menu display, even “big data” is easy to filter and sort, enabling fast access to whatever a user desires in support of any requirement.
    6. Multiple screen capability — With four dynamic windowpanes that can be resized and used simultaneously with either stand-alone or with interactive, related content, the Orator Plus operating environment allows users to “anchor” their activity in one window pane and use the others to support, enhance, explain, and quickly move from the micro to the macro without losing continuity in pursuit of their objective.
    7. Integrated security features — The Orator Project File owner can stipulate any level of security desired. The entire Project File can be secured, as can discrete content contained within. Additionally, the Orator Project File can be “time-bombed” to self-scrub from the user’s device based on parameters such as start dates, end dates, time of day, number of times the file is used, and more.
    8. Integrated white-board feature — Every Orator Project File contains a robust white-board feature that is simple to use. Designed as a collaborative, multi-purpose tool, the white board supports single-screen or full event capture so that scenarios can be developed or incidents and events can be managed real-time and then played back in after-action reviews. Individual white-board projects allow for multiple layers so scenarios can be pre-loaded for training and exercises, making the white board a powerful instructional tool. White-board projects can be saved outside the Orator Project Files but can only be opened by authorized users who have been issued copies of the originating Project File.

    A short list of real-world uses:

    • Advanced site surveys
    • Route analysis and documentation
    • Operation center or common operational picture
    • Table-top exercises
    • Tactical response planning
    • Interactive training and CBT modules
    • Forensic scene documentation and presentation
    • Facility crisis response plans

    Orator Plus has a strong user base, including federal, state, and local agencies. Clients include the United States Secret Service; Federal Bureau of Investigation; Department of Homeland Security; Transportation Safety Administration; Bureau of Alcohol, Tobacco, Firearms and Explosives; Central Intelligence Agency; and others. If you are looking for an operations center as well as a collaboration and presentation system, Orator Plus may be worth your consideration.

  • ION GNSS+ 2014: Indoor Location Technology Takes a Step Forward

    Tampa Convention_Ctr

    A few weeks ago I attended ION GNSS+ 2014 in Tampa. The conference is called ION GNSS (Institute of Navigation / Global Navigation Satellite Systems) because the days of simple U.S.-built GPS are gone. There are now several countries that have put up their own satellite arrays: the original United States GPS, the Russian GLONASS, the European Galileo, the Chinese BeiDou and soon Indian and Japanese systems. So rather than the limited term “GPS,” everyone is using the more general term GNSS. The “plus” symbol additionally denotes that “all” new location technology, not just satellites, will be considered.  Although the GNSS conference was loaded with highly technical presentations and exhibits that were over my head, there were many items of interest to us geospatial people.

    The opening plenary session Tuesday night included a series of very short “ignite” presentations that were moderated by Alan Cameron of GPS World. Ignite or “Pecha Kucha” sessions are usually done in the middle or end of a conference to let presenters who weren’t selected for full presentations to at least get on the program and be heard. This was different in that key presenters who were giving full sessions were also given an opportunity to “plug” their session by whetting the appetite of attendees with a four-minute preview. I’m completely sold on the concept of these short ignite presentations since they were quick, kept my interest, and drew my attention to sessions that I might not have attended. All conferences should start with this kind of quick preview of things to come.

    As you would expect, many sessions and exhibits covered complex technical issues and equipment. There was so much information presented in the sessions and expo that I can only provide some highlights that caught my attention. I recorded a number of short video clips of exhibitors that will give you a sample of some of the technical subjects.

    Alan

    Many sessions focused on jamming, spoofing and interference. I didn’t realize how much of a problem this had become.  There were many examples of equipment designed to spot, identify and counter the problem. Although considerable attention was given to GNSS as used in UAVs, there was also concern that FAA restrictions on UAV flights was going to severely limit their use despite increased precision and effectiveness.

    Most top-end systems demonstrated at the show incorporate RTK (real-time kinematic) to achieve very high accuracies. Gone are the old days when the GPS signals were deliberately modified to degrade the accuracy with a system called Selective Availability (SA). This was done to prevent enemies from using GPS for targeting. However, when needed, the U.S. military could override SA to greatly improve accuracy when they needed it for targeting. To get decent accuracy, civilian users had to set up fixed base stations at known locations to measure the GPS location errors and apply those corrections to field GPS receivers through post processing. RTK uses measurements of the phase of the GPS signal’s carrier wave and a single reference station to provide real-time corrections which provide centimeter accuracies without the need for post processing.

    One topic that caused a lot of buzz at the conference was the incorrect orbit insertion of two European Galileo satellites using Russian rockets. Although the satellites are working perfectly, the wrong orbit makes them essentially useless, and the error occurred at about the same time as the Ukrainian/Russian military action and subsequent sanctions. Is this a coincidence or just poor rocket science? No one knew for sure, but the loss of two critical satellites was a major setback for the European system.

    An especially interesting live demo session by several exhibitors showed indoor location technology. Some were not at all “ready for prime time,” a few showed promise, and some were quite refined. Most systems used GPS to fix a user’s location while outside a building, then, as the user entered a building and lost the GPS signal, two approaches were dominant. Several systems used IMUs to measure a user’s movement from the GPS starting point. All those systems suffered from IMU drift, which caused increasing errors the longer the user moved without GPS correction. The other systems used devices in the building such as RFID tags or Wi-Fi transmitters to fix subject locations inside the buildings. Some of these worked quite well, but the systems had to be preinstalled in a building to do the tracking.

    The ability to accurately and reliably track a firefighter in a building not equipped with tracking systems is still a dream, but one system by Trusted Positioning, Inc., of Calgary, Alberta, Canada, might be on a viable path. The company uses a technique of identifying overlapping radio and Wi-Fi signals in the air to create an electronic “map” of a given area. Using this footprint as a reference, the system then combines a subject’s movement derived from the motion-detection capability of a smartphone to measure the steps taken by the subject thus providing a surprisingly accurate track.

    The Trusted Portable Navigator (T-PN) is touted as being the first navigation software to use motion sensor data from multiple mobile/wearable devices to more accurately locate a person indoors. The software collects movement information from the user’s phone, tablet, watch, wearable or glasses to better position how a person is walking when GPS is unavailable in places such as shopping centers, airports or urban centers. Note this example from their demonstration video that shows a subject walking through a parking lot (red track), then two loops indoors. This is pretty amazing, considering the fact that the system uses only software, a smartphone worn by the subject, and ambient radio signals.

    Trusted Positioning

    This was the most exciting technology I saw, because I see the potential to save a lot of firefighters, first responders and military service members in hostile locations.

  • ION GNSS+ Blog: Ignite Presentations Spark Interest

    Art Kalinski Blogs from ION GNSS+ in Tampa

    I’m attending ION GNSS+ 2014 in Tampa, Florida, this week. Although this is a GPS conference, there are topics that will be of interest to us geospatial people. The opening plenary session Tuesday night included a series of short “Ignite” presentations that were moderated by Alan Cameron of GPS World.

    I am completely sold on the concept of short “ignite” presentations, which are a preview of full sessions to come later in the conference. It was quick, kept my interest, and drew my attention to sessions that I may not have attended.

    All conferences should start with this kind of quick preview of things to come.

  • NGA Workshop and ‘The Center’: Growing Opportunities for Our Geospatial Community

    Several weeks ago, I attended a National Geospatial-Intelligence Agency (NGA) Workshop conducted in Huntsville, Alabama. Of the numerous presentations, I found two especially interesting.

    The first was a session by Sandra Broadnax, the director of the Small Business Programs Office for NGA. She gave a refreshingly energetic presentation about NGA’s efforts to build opportunities for small businesses in the geospatial community. The reason is twofold — NGA needs to meet federal guidelines to provide opportunities for small business, but even more important, NGA knows that there is a wealth of creative talent in the small-business sector that can address its requirements. So, if your firm is a small business, there may be some wonderful opportunities listed by NGA. And, very important, The agency is willing to help you get started. Go to www1.nga.mil, and click “Partners” and “Small Business Interaction” to get started. NGA also lists scholarships, internships and many unfilled full time positions.

    Colonel Grimes
    Colonel Grimes

    A second session, conducted by retired Army Colonel John Grimes, J.D. of the University of Alabama in Birmingham (UAB), caught me by surprise since it was so broad in scope and stretched everyone’s concept of how geospatial science fits into our increasingly complex and treacherous cyber world. Col. Grimes, a seasoned Army Intelligence Officer who oversaw a staff of 180 intelligence analysts in Afghanistan, is now part of a broad interdisciplinary team started at UAB in 2011 addressing the growing field of cyber crime and intelligence. This center of excellence is simply called “The Center,” and it brings together a wide collection of professors, students and professional partners across many disciplines. Their focus is simple: “Making the world a safer place for citizens of the 21st century.”

    This broad effort is supported by experts in cyber, geospatial, human factors, data systems, forensics, psychology, medicine, chemistry and many others with financial support from Google, Facebook, Microsoft, eBay, UPS and even the FBI. You have to have a “dizzying intellect” just to wrap your head around their collective work, which is too complex to explain in this short article. But I’ll give you a brief summary of their organization, which is divided into divisions called Pillars:

    INFORMATION ASSURANCE/SECURITY — The division deals with the basic design of information/data systems. Are the systems designed with security in place? Does the system provide access to authorized users while excluding those who are not? Do the systems protect the confidentiality, integrity, and availability of information and systems that process, store, and/or transmit data. This is the underpinning of secure data systems and unfortunately most are less than perfect and continually under attack. When attacked, the action becomes a cyber crime.

    CYBER CRIME – This division is the pillar that addresses attacks on information systems. As you know, these attacks are becoming more frequent, more creative, significantly more disruptive and potentially very dangerous. I was surprised to learn that more than 85% of the world’s email is spam, and more than 20,000 phishing websites are created every month. So this really is the core of the work at The Center.

    "The Center" at UAB.
    “The Center” at UAB.

    INTELLIGENCE ANALYTICS – This is the division headed up by Col. Grimes. As a lawyer and intelligence expert, he completed numerous cyber-security projects for major banks and businesses, and this hands-on real-world experience prepared him to build The Center team that analyzes cyber crimes using a variety of tools, including human behavioral patterns and anomalies, electronic intelligence, imagery and unique digital signatures. This team determines the nature and scope of cyber-attacks. They work not only to identify the “content” of attacks and criminals, but to understand the more complicated, interwoven and far reaching “context” of the action in the big picture cyber world.

    FORENSIC SCIENCE — This division has been doing traditional crime scene forensics for many years using lab forensics that many of us have seen on television. With the growth of cyber crime, the division has evolved and expanded its tradecraft into the digital domain, requiring the development of completely new tools and techniques that combine unique biological and electronic “signatures” and patterns of cyber criminals.

    HEALTH INFORMATICS is a newly developed division that will deal with cyber crime issues related to healthcare and associated professions. This could be significant, since pundits have voiced concerns that the Affordable Care Act seems to have weak web security in place.

    DATA SCIENCE is another new division focusing primarily on “Big Data” ranging from social-media data mining to video and persistent surveillance analysis and crowd sourcing.

    Dr. Parcak at The Center.
    Dr. Parcak at The Center.

    GEOSPATIAL SCIENCE is the division that I and most of you will find especially interesting. The division is headed up by Dr. Sarah Parcak, FSA who is also associate professor in the Department of Anthropology and CEO of SpectralGlobe technologies, a company that specializes in the use of remote-sensing technologies. Dr. Parcak brings an impressive resume to the division, including extensive experience using remote sensing to identify archeological site looting, a major terrorist revenue source. A graduate of Yale University, she went on to earn her Ph.D. at Cambridge University, is a 2012 TED fellow, and has appeared on the Discovery Channel, BBC and CNN. She also a National Geographic Society Fellow.

    The Geospatial Science team uses a combination of high-resolution aerial/satellite imagery coupled with traditional GIS vector data to map and analyze the Earth’s surface. Operating in the cyber realm, team members also map and analyze data that was not even on our GIS radar a decade ago — data such as cyber networks, nodes and servers, social media footprints and temporal changes using traditional imagery, and persistent surveillance imagery and video.

    The team also leverages its key industry partnerships to use the most cutting-edge software and approaches to analyze layers of image data to detect subtle patterns that otherwise may be overlooked.

    WORKFORCE DEVELOPMENT is an ultimate goal of The Center. Dealing with 21st-century criminals will require a workforce with skills and collections of skills that didn’t even exist 20 years ago. The students learn necessary technology and cyber skills to prepare them for entry-level and advanced positions in public and private organizations.

    Opportunity

    Talking with colleagues and staff at USGIF, there are other geospatial programs that have interdisciplinary collaborations with geospatial technology. However, UAB seems to have wrapped its arms around a powerful collection of talent and expertise to fill an urgent need while training cyber talent that is in great demand.

    This column is a much-abbreviated description of The Center, so I strongly encourage you to visit the website, which contains a rich collection of information, papers and videoclips that describe the work and organization in detail. For more information contact Col Grimes at [email protected] or Dr. Parcak.

    If you are a geospatial professional looking for a growing segment of our community, this looks like a very promising and most interesting career path.

  • 3D Models from 2D Imagery: Raytheon’s Intersect Dimension

    As you may know from previous columns, I’m a big proponent of oblique imagery and 3D models for non-GIS users such as first responders or the general public. The primary reason is that most non-geospatially-trained people have a hard time getting oriented when viewing only abstract maps or ortho imagery. Oblique views are the way we navigate our natural 3D world, so anything less is not ideal. 

    Many products and services provide oblique imagery and 3D models. Pictometry, Bing (Pictometry imagery), and Google provide oblique views. Numerous companies build 3D models such as AEgis Technologies, Esri with City Engine, Cyber City 3D, and PLW Modelworks, which builds probably the most photorealistic and photo-accurate models.

    Each company builds its 3D models or views with slightly different technology and methods. This year at GEOINT, Raytheon caught my attention with a 3D-model creation process that uses only 2D imagery, even satellite imagery of locations that are not accessible by ground or air. The system, called Intersect Dimension, doesn’t use LiDAR, but leverages passive 2D and other remote-sensing imagery sources to automatically create high-accuracy 3D models very quickly and for a fraction of the expense of current multi-dimensional modeling solutions. Dimension uses a Raytheon-patented technology to automate optimal image selection and geometric registration to build models with high positional accuracy and optimal resolution.

    Unlike LiDAR-generated 3D data, Dimension’s passive 3D point clouds offer several advantages, including

    • global coverage in airborne-denied geographies or in areas with outdated flyover information
    • extensive coverage from multiple data sources
    • compatibility with a broader selection of data sources, including archived (historic) images
    • faster turn-around times with fully-automated renderings requiring no human intervention
    • compatibility with existing investments in people, training and enterprise visualization/exploitation tools and systems.
    Here is an example of a limited access location in Tripoli colored by elevation and alternately colored with true color RGB. Intersect Dimension, © Raytheon Company 2014 , Includes material © CNES 2014, Distribution Astrium Services / Spot Image Corporation, USA, all rights reserved, Pleiades Source Imagery
    Here is an example of a limited access location in Tripoli colored by elevation and alternately colored with true color RGB (see below).
    Intersect Dimension, © Raytheon Company 2014,
    Includes material © CNES 2014, Distribution Astrium Services / Spot Image Corporation, USA, all rights reserved,
    Pleiades Source Imagery
    The true color option of the above.
    The true color option of the above.
    Intersect Dimension, © Raytheon Company 2014,
    Includes material © CNES 2014, Distribution Astrium Services / Spot Image Corporation, USA, all rights reserved,
    Pleiades Source Imagery

    Dimension performs extraction of vertical feature points to build true-to-life models with walls that are perpendicular and details like tall, thin buildings, light poles and antennas accurately represented without tilting or a “melted chocolate” look.  Additionally, all extracted 3D features are geo-referenced with horizontal and vertical accuracy touted by Raytheon to be better than the original image sources. The image collections are processed using algorithms in a proprietary, patented photogrammetric bundle adjustment that increases the accuracy of XYZ locations.

    ere is a screen capture of QT Modeler showing tower to tower measurements in front of the Beijing “Bird’s Nest Stadium” that is colored by height. Intersect Dimension, © Raytheon Company 2014, Includes copyrighted material of DigitalGlobe, Inc, Viewer courtesy of Applied Imagery
    Here is a screen capture of QT Modeler showing tower to tower measurements in front of the
    Beijing “Bird’s Nest Stadium” that is colored by height.
    Intersect Dimension, © Raytheon Company 2014, Includes copyrighted material of DigitalGlobe, Inc., Viewer courtesy of Applied Imagery

    Multiple images are used to create the models. In fact, the more images the better for a final product. Metadata is maintained so users can understand the source and dates of the imagery used to build the models. The resultant models permit accurate measurements in three directions, XYZ, and angular measurements from one high point to another, such as towers or rooftops. Since the model is fully georeferenced, GIS vector data can be accurately overlaid on the model, and data layers such as flood planes can be displayed while showing where the plane intersects buildings.

    The Dimension process is extremely fast. In a typical operational environment, Dimension can automatically produce a large-area photorealistic and photo-accurate model in minutes or hours, a process that typically could take weeks or even months using older technology.

    The Intersect family of solutions enhances Dimension with data fusion, processing, analysis, visualization and automation capabilities using almost any data source or system, including full-motion video (FMV), activity-based intelligence (ABI), social-media tracking and multi-source data integration. Dimension allows for the addition of new analytics, rich content and augmented-reality data while enabling the fusion of data from public and private/proprietary data sources.

    Here is a snapshot of a Turkish open-pit mine of a temporal 3D model built from multiple video images. The models are fully metric, permitting rapid change detection and measurement. Intersect Dimension, © Raytheon Company 2014, Includes copyrighted material 2014 © Skybox Imaging, Inc., All Rights Reserved
    Here is a snapshot of a Turkish open-pit mine of a temporal 3D model built from multiple video images. The models are fully metric, permitting rapid change detection and measurement.
    Intersect Dimension, © Raytheon Company 2014, Includes copyrighted material 2014 © Skybox Imaging, Inc., All Rights Reserved
    Here is a snapshot of a Turkish open-pit mine of a temporal 3D model built from multiple video images. The models are fully metric, permitting rapid change detection and measurement. Intersect Dimension, © Raytheon Company 2014, Includes copyrighted material 2014 © Skybox Imaging, Inc., All Rights Reserved
    A second shot of the same Turkish mine as above.
    Intersect Dimension, © Raytheon Company 2014, Includes copyrighted material 2014 © Skybox Imaging, Inc., All Rights Reserved

    Each point on the 3D model can be colorized with electro-optical data from source imagery, or points can be colored manually using external sources. Imagery can be used from any time of year or any time of day, is not constrained by collection angles, and is not limited to stereo pair collection.

    Dimension models are compatible with existing enterprise investments in people, training, and visualization and exploitation tools. The models can be viewed, and interactively rotated, zoomed, measured and navigated, using many legacy 3D viewers such as Google, Skyline, and Autodesk. Occlusions or “no data” areas are left blank, but similar data can be cloned to fill in gaps if the customer desires the cloning. Trees are modeled similar to other types of reflective surface models. Since these are standard format digital models, a user can create wireframes or bare-earth models if desired.

    You can contact the people at Raytheon for samples of even higher resolution models and additional information at [email protected]. They also have video clips that demonstrate the system in operation so you can get a feeling of the system speed and operation in a more visually compelling way. The engineers at Raytheon have built quite a strong addition to our geospatial toolbox and they deserve your serious consideration.

  • RPScan: Rapid Laser Interior Facility Plans

    Two weeks ago, GEOHuntsville held a mini conference for emergency responders hosted by Chris Johnson of A Visual Edge, Inc., Joe Francica of Directions Magazine, and AEgis Technologies.  The conference covered work being done under “The Blueprint for Safety” (BfS), a pilot effort of GEO Huntsville to support local public safety agencies with geospatial technology in the event of area emergencies.

    The goal of the pilot is to integrate existing and emerging geospatial technologies to improve multi-jurisdictional rapid response. One part of the system being used is a new on-demand, online, self-service toolset created by the National Geospatial-Intelligence Agency’s (NGA) Integrated Working Group – Readiness, Response, and Recovery (IWG-R3).  The pilot will also employ crowdsourcing, gamification, and RFID management while assembling all information in an Event Page to enhance information gathering and sharing during critical events.

    BfS

    RPScan

    One emerging technology that I found especially interesting at the conference was from Robotic Paradigm Systems, LLC of Huntsville, Alabama. It is in the business of creating rapid facility layouts using a laser scanning system. I get excited when I see technology that addresses a need using an elegant approach that is simple, effective, and low cost while also having a “light footprint.” RPScan seems to be such a technology.

    As you know, many laser scanning systems do a superb job building interior and exterior 3D models. Some systems produce such high-resolution 3D models that they look almost photorealistic, showing every minute detail. Those systems, by necessity, are also somewhat cumbersome and intrusive for the customer. The resultant models are also large and can be difficult to manage.

    Robotic Paradigm Systems took a more pragmaticm user-oriented approach. The team there realized that many users, especially emergency responders, don’t need extremely detailed 3D models that are only available for a few facilities.  What they need are “good enough” 2D models of as many facilities as possible, as soon as possible.

    RPScan Operation

    That has been the driving force behind RPScan.  RPScan is a very light, wearable backpack with an elevated sensor that “sees” above most furniture and even people in a room. Many current 3D scanning systems require stationary equipment firmly mounted on a stand in the center of a room. By comparison, RPScan captures data as the operator simply walks through the rooms in a building.  The continuous data capture is displayed on a wrist-mounted display, so verification of complete data capture is available to the operator real time. RPScan quickly maps indoor spaces, providing data that is then used to create accurate dimensional floor plans.

    rpscan capture
    Here the operator walks briskly through a church capturing 2D floor plan data.
    rpscan wrist
    The wrist-mounted screen shows the captured data as collected, thus providing continuous quality control.

    RPScan is a lightweight and mobile system that can rapidly create accurate dimensional layouts of large complex facilities. It captures spatial data of occupied buildings at an approximate rate of 75,000 square feet per hour, with roughly two hours more needed to convert the raw data to CAD floor plans depending on conditions and desired CAD details. The hardware ergonomic design is also very comfortable and unobtrusive. Watch this RPScan video of a capture session to see it in operation.

    Traditional 3D scanning systems typically use stationary hardware suites that are set up in a room. Frequently the operator has to work during off hours or ask occupants to leave the room during scanning. This stationary method of scanning is relatively easy since all measurements are captured from a fixed point and reference angle. By comparison, a mobile system, like RPScan, is more complicated because the location, position and attitude, are continuously changing during the capture process. To operate under these conditions, the system has to capture data while also accurately tracking and compensating for the equipment/operator movement. This is a proprietary feature of RPScan and the key to its efficient data-capture capability.

    Since RPScan is capturing a horizontal “slice” of data, adjusting the height of the scanner provides several advantages. Fixing the scanner height above the heads of occupants, data capture can be done without the need to evacuate rooms. Building occupants can go about their business with minimal interruption. This is especially important in facilities like hospitals that cannot easily stop operations or move occupants. The operator can quickly and unobtrusively move from room to room with only minimal disruption. Conversely, lowering the scanner height permits the capture of cubical walls or fixed furnishings such as benches and pews. Furniture can remain in rooms because it’s not necessary to view all walls in their entirety. During post-processing, continuous walls are obvious in the laser images so conversion to architecture CAD models is fairly easy.

    rpscan displayReal-Time Display

    A unique feature of RPScan is that the 2D layout is continuously displayed on a touchscreen attached to the operator’s arm.  As the operator walks through the interior space, continuous data capture is displayed as the layout image is being assembled. This real-time rendered display is more than just a convenience. It is the key to complete data capture and quality control. During the scanning process, it’s important to see areas that haven’t been scanned or areas that may need to be scanned more thoroughly. Since scanning efforts typically involve onsite data collection followed by off-site post processing, seeing results immediately builds confidence that the visit to the facility has been thoroughly and properly detailed.  This minimizes the possibility of a return trip to recapture an area that may have been missed or poorly scanned.

    Another valuable feature of RPScan is that it can simultaneously record linked audio and video during the entire capture process.  This linking of audio, video, and location is a powerful capability and could be used to enhance first responder pre-plans by permitting virtual walkthroughs.

    Uses of 2D Data

    The high cost of 3D scanning systems and software can become a barrier for use in many applications. Some users cannot justify the complexity and cost of high-end 3D data capture and modeling when a 2D model would suffice. Some examples where 2D data has proved effective include:

    • Interior design
    • Firefighter pre-plans
    • Architectural firms (initial survey and proposal)
    • Building remodel/renovation
    • Real estate sales
    • Homeland security (interior mapping, tactical response, rescue, recovery)
    • In-store people tracking for marketing
    • In-store marketing material placement
    • Archeology
    • Facility management 

    Future Applications

    There have been significant advancements in GPS, IMUs, RFIDs, and other micro-technologies embedded in mobile devices, but much of this new capability also needs a “base map” to register the tracked locations. Thanks to overhead and ground-level imagery assembled by national agencies, Google, and Microsoft, we have very rich data sets of our exterior world. However, to fully exploit indoor tracking technology, we will need equally robust building interior maps. Until we have BIM models of all buildings, I believe that 2D mapping will fill that void faster than other options. Robotic Paradigm Systems, with its RPScan system, seems well positioned to lead the indoor mapping effort.

    For more information contact:

    Tim Coddington
    [email protected]
    (256) 694-3940

    Lynn Coddington Gilbert
    [email protected]
    (678) 428-0935

    P.S. I’m always looking for new technology to share with my readers, but my view is limited. If you know of new technology that others might find interesting, please drop a note in the comments section so I can investigate and possibly provide some visibility for the technology.

  • Alta Systems Balloon: Oblique Imagery Capture with a Light Footprint

    Alta balloon.
    Alta balloon.

    Three weeks ago, GPS World / Geospatial Solutions held a webinar highlighting new technologies for imagery and data capture. The webinar had four presenters: Paul Smith of CycloMedia, Ted Ralston with Soft Power Solutions, Peter VanAmburgh from IIF Data, and John Ciampa CEO of Alta. You can view a YouTube video of the session. Because webinar time is limited, we couldn’t cover the technologies in detail, so I’m covering some of the technologies one column at a time.

    In February, I devoted my column to CycloMedia, so you may want to review that material if you want more detail. This month I want to delve into the Alta balloon system that was presented by John Ciampa, the CEO of Alta. John was the original patent holder of Pictometry, the revolutionary high resolution geo-referenced metric oblique imagery system. He and Steve Schultz took the concept from theory to a practical functioning system that has been an industry standard for over 10 years.

    John continues his research, dividing his time between the Rochester Institute of Technology (RIT) and Florida International University (FIU) while also working with the National Science Foundation (NSF). Although Pictometry was very successful, he also understood the limitations and cost of a manned aircraft as a capture system, especially for disaster response. Pictometry was a very capable system, but John felt that what was needed was a system that had a “lighter footprint” figuratively and literally. John took his knowledge and experience, and combined it with the latest developments in micro-miniaturized technology, to develop a system that was elegant in its simplicity and usefulness.

    The Platform

    Simply put, the Alta balloon is a steerable oblique geo-referenced camera system attached to a weather balloon. By using a balloon, John solved several problems associated with manned aircraft — cost, image quality, and accessibility. A balloon is cheaper than an aircraft, doesn’t require a licensed pilot, is more easily deployable, and can “fly” at lower altitudes.

    Even a small aircraft is expensive, and requires a trained pilot and complex support logistics. A small used aircraft can run $50,000 to several hundred thousand dollars. Additionally, most high-end aerial imagery systems generally require expensive FAA-approved modifications of the airframe. This adds cost, and limits the aircraft that can be used. Equipped with Pictometry cameras and electronics, a total aircraft capture system can easily cost $300,000 and up.

    A significant factor during disaster response events is transportability and support. Past experience has shown that it can be very difficult to transport and operate even small aircraft in disaster regions, especially if the damage is widespread.  Fuel and ground support in disaster sites can also be a serious limitation. By comparison, a balloon system can be carried in a suitcase, shipped quickly, and set up in less than an hour.  Since the cost is in the range of several thousand dollars, multiple systems are practical and can be deployed in numerous remote locations. Equally impressive is that operators can be trained in less than an hour.

    But don’t get the impression that Alta is as simple as strapping a digital camera to a balloon. Achieving the image quality, accuracy and dynamic performance of the Alta system requires a very sophisticated package, including the balloon, controls, communications and sensors. The balloon system is actually two balloons, one within the other, an outer balloon and inner lift gas balloon. The outer balloon provides some external protection while presenting a consistent profile. The inner balloon provides the lift and is filled with either hydrogen or helium.

    The altitude is remotely controlled by venting lift gas to descend or by dumping water ballast to ascend.  An onboard computer and sensors can also maintain altitude autonomously. When the balloon is brought down, a tethered weight drops to several feet under the balloon. The weight contacts the ground first and “anchors” the balloon and payload for retrieval. This keeps the balloon and payload off the ground, and also makes it easier to spot.

    There are several modes of operation that are determined by the operator prior to launch:

    • “Path Mode”: The balloon is released, ascending to the programmed altitude, then drifting with the wind currents before descending back to the ground.
    • “Patch Mode – single tether”: Used to launch and retrieve the balloon. The balloon ascends to altitude, and its position is downwind based on the strength of the wind acting on both the balloon and tether.
    Patch mode with single tether.
    Patch mode with single tether.
    • “Patch Mode – multiple tethers”: Very precisely controls the location of the balloon over a limited area. This is very similar to the overhead cameras used in televised football games but in reverse, since the balloon wants to fly up.
    Patch mode with multiple tethers.
    Patch mode with multiple tethers.

    The system can also be equipped with a parachute for emergency landings, a solar trickle charger for extended missions, and even a quadcopter that can steer the balloon to specific target areas. The lift capability of the balloon permits significantly longer duration flights than a quadcopter alone. A detailed operator’s manual is available for review at the Alta website — look for the Operators Manual.

    The Payload

    The modular payload is complex, but also lightweight and compact thanks to the latest developments in miniaturization. It consists of a precision GPS unit, inertial measurement/navigation unit (IMU), an onboard computer, environmental sensors, Wi-Fi communications, and an aimable high-resolution camera on a stabilized gimbal. The camera can be RGB, night vision or even multi-spectral. The imagery is downloaded as captured and delivered almost real-time.

    Modular payload.
    Modular payload.

    The Output

    Because the balloon floats at low altitudes, image resolution is an impressive “game changer.” Here is just one example comparing a 4-inch pixel Pictometry/Bing image taken from 3,000 feet to a 1-centimeter pixel Alta image of the same location taken from several hundred feet.

    Bing (left) and Alta images of stadium seats, compared.
    Bing (left) and Alta images of stadium seats, compared.

    Similar to Pictometry, the system uses GPS and IMUs to very accurately determine the camera location and attitude. That information, linked via algorithms to the captured imagery, results in imagery that is geo-referenced, measurable and available with full metadata, including the time of capture.  I can’t over emphasize how important this is. Having instant access to imagery is nice, but having that imagery already geo-referenced means that the imagery can be quickly and easily imported into a GIS and overlaid with legacy GIS data for instant analytics.

    The system has been used for many mundane applications such a real estate, agriculture, construction/engineering and event planning. More critical applications include crime-scene monitoring, surveillance and disaster response. Recently, in response to a South Florida Mall shooting, police launched an Alta balloon to view the crime-scene location. The imagery was instantly and continuously sent to police station computers and mobile devices of responders en route to the mall for pre-planning of their response. Viewing rooftops and walkways for victims and perpetrators, a near real-time operational picture was provided to police before putting themselves and others in harm’s way.

    Actual image from an ALTA Balloon used in SWAT team maneuvers. Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m
    Actual image from an Alta balloon used in SWAT team maneuvers.

    Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m.

    The Potential

    I’m especially excited about the potential lifesaving use of Alta balloons. On numerous occasions I was involved in emergency response actions, and the dominant overarching need was high-quality imagery that could be combined with legacy data and imagery as close to real-time as possible. This system answers that need, and at a low cost. I could envision several Alta systems in every county nationwide ready to deploy on a moment’s notice. I believe that these units would be especially valuable for disaster response in second- and third-world countries. Dozens of Alta systems and trained operators could be delivered on short notice to major disaster sites, providing almost real-time common operational pictures for first responders. The added advantage is the very light need for logistics and support.

    Military applications could be equally important. The silence of balloons coupled with a small visibility profile, including almost total invisibility at night, makes them ideal for reconnaissance and surveillance.  The relatively low cost of the platforms also permits them to be expendable. In a tethered mode, the persistent “eye in the sky” could serve as a deterrent, or at a minimum make hostile activity more complicated for the perpetrators as they try to hide activities from the balloon.  The “light” logistics and fast operator learning curve are just added benefits.

    A key question raised during the webinar was FAA control. John indicated that the FAA does not consider the Alta balloons in a tethered mode subject to their control, and is currently reviewing it in a drift mode.  John further amplified that the very low altitude of operation and dual control of descent should also exempt the drifter from FAA involvement. Alta could provide a significant advantage where UAS operations are restricted or not practical.

    In a recent book, “Smaller Faster Lighter Denser Cheaper” by Robert Bryce, reviewed in the Wall Street Journal, the author argues that a similar dynamic, making less do more, drives virtually every technological change that has created the modern world, from cars and airplanes to advanced medicine, strategic metals and the iCloud. Alta balloons are certainly a good example.

    I was an early proponent of Pictometry because, unlike abstract GIS data and ortho imagery, the metric oblique imagery was easily understood by non-GIS users. I saw many examples where it saved lives because police and firefighters were able to form and exploit a common operational picture quickly. Alta has me equally excited because it brings that same capability to users with a much simpler system that delivers almost real-time imagery at a cost anyone can afford. This technology is going to help a lot of people.

  • Alta Systems Balloon: Oblique Imagery Capture with a Light Footprint

    Alta balloon.
    Alta balloon.

    Three weeks ago, GPS World / Geospatial Solutions held a webinar highlighting new technologies for imagery and data capture. The webinar had four presenters: Paul Smith of CycloMedia, Ted Ralston with Soft Power Solutions, Peter VanAmburgh from IIF Data, and John Ciampa CEO of Alta. You can view a YouTube video of the session. Because webinar time is limited, we couldn’t cover the technologies in detail, so I’m covering some of the technologies one column at a time.

    In February, I devoted my column to CycloMedia, so you may want to review that material if you want more detail. This month I want to delve into the Alta balloon system that was presented by John Ciampa, the CEO of Alta. John was the original patent holder of Pictometry, the revolutionary high resolution geo-referenced metric oblique imagery system. He and Steve Schultz took the concept from theory to a practical functioning system that has been an industry standard for over 10 years.

    John continues his research, dividing his time between the Rochester Institute of Technology (RIT) and Florida International University (FIU) while also working with the National Science Foundation (NSF). Although Pictometry was very successful, he also understood the limitations and cost of a manned aircraft as a capture system, especially for disaster response. Pictometry was a very capable system, but John felt that what was needed was a system that had a “lighter footprint” figuratively and literally. John took his knowledge and experience, and combined it with the latest developments in micro-miniaturized technology, to develop a system that was elegant in its simplicity and usefulness.

    The Platform

    Simply put, the Alta balloon is a steerable oblique geo-referenced camera system attached to a weather balloon. By using a balloon, John solved several problems associated with manned aircraft — cost, image quality, and accessibility. A balloon is cheaper than an aircraft, doesn’t require a licensed pilot, is more easily deployable, and can “fly” at lower altitudes.

    Even a small aircraft is expensive, and requires a trained pilot and complex support logistics. A small used aircraft can run $50,000 to several hundred thousand dollars. Additionally, most high-end aerial imagery systems generally require expensive FAA-approved modifications of the airframe. This adds cost, and limits the aircraft that can be used. Equipped with Pictometry cameras and electronics, a total aircraft capture system can easily cost $300,000 and up.

    A significant factor during disaster response events is transportability and support. Past experience has shown that it can be very difficult to transport and operate even small aircraft in disaster regions, especially if the damage is widespread.  Fuel and ground support in disaster sites can also be a serious limitation. By comparison, a balloon system can be carried in a suitcase, shipped quickly, and set up in less than an hour.  Since the cost is in the range of several thousand dollars, multiple systems are practical and can be deployed in numerous remote locations. Equally impressive is that operators can be trained in less than an hour.

    But don’t get the impression that Alta is as simple as strapping a digital camera to a balloon. Achieving the image quality, accuracy and dynamic performance of the Alta system requires a very sophisticated package, including the balloon, controls, communications and sensors. The balloon system is actually two balloons, one within the other, an outer balloon and inner lift gas balloon. The outer balloon provides some external protection while presenting a consistent profile. The inner balloon provides the lift and is filled with either hydrogen or helium.

    The altitude is remotely controlled by venting lift gas to descend or by dumping water ballast to ascend.  An onboard computer and sensors can also maintain altitude autonomously. When the balloon is brought down, a tethered weight drops to several feet under the balloon. The weight contacts the ground first and “anchors” the balloon and payload for retrieval. This keeps the balloon and payload off the ground, and also makes it easier to spot.

    There are several modes of operation that are determined by the operator prior to launch:

    • “Path Mode”: The balloon is released, ascending to the programmed altitude, then drifting with the wind currents before descending back to the ground.
    • “Patch Mode – single tether”: Used to launch and retrieve the balloon. The balloon ascends to altitude, and its position is downwind based on the strength of the wind acting on both the balloon and tether.
    Patch mode with single tether.
    Patch mode with single tether.
    • “Patch Mode – multiple tethers”: Very precisely controls the location of the balloon over a limited area. This is very similar to the overhead cameras used in televised football games but in reverse, since the balloon wants to fly up.
    Patch mode with multiple tethers.
    Patch mode with multiple tethers.

    The system can also be equipped with a parachute for emergency landings, a solar trickle charger for extended missions, and even a quadcopter that can steer the balloon to specific target areas. The lift capability of the balloon permits significantly longer duration flights than a quadcopter alone. A detailed operator’s manual is available for review at the Alta website — look for the Operators Manual.

    The Payload

    The modular payload is complex, but also lightweight and compact thanks to the latest developments in miniaturization. It consists of a precision GPS unit, inertial measurement/navigation unit (IMU), an onboard computer, environmental sensors, Wi-Fi communications, and an aimable high-resolution camera on a stabilized gimbal. The camera can be RGB, night vision or even multi-spectral. The imagery is downloaded as captured and delivered almost real-time.

    Modular payload.
    Modular payload.

    The Output

    Because the balloon floats at low altitudes, image resolution is an impressive “game changer.” Here is just one example comparing a 4-inch pixel Pictometry/Bing image taken from 3,000 feet to a 1-centimeter pixel Alta image of the same location taken from several hundred feet.

    Bing (left) and Alta images of stadium seats, compared.
    Bing (left) and Alta images of stadium seats, compared.

    Similar to Pictometry, the system uses GPS and IMUs to very accurately determine the camera location and attitude. That information, linked via algorithms to the captured imagery, results in imagery that is geo-referenced, measurable and available with full metadata, including the time of capture.  I can’t over emphasize how important this is. Having instant access to imagery is nice, but having that imagery already geo-referenced means that the imagery can be quickly and easily imported into a GIS and overlaid with legacy GIS data for instant analytics.

    The system has been used for many mundane applications such a real estate, agriculture, construction/engineering and event planning. More critical applications include crime-scene monitoring, surveillance and disaster response. Recently, in response to a South Florida Mall shooting, police launched an Alta balloon to view the crime-scene location. The imagery was instantly and continuously sent to police station computers and mobile devices of responders en route to the mall for pre-planning of their response. Viewing rooftops and walkways for victims and perpetrators, a near real-time operational picture was provided to police before putting themselves and others in harm’s way.

    Actual image from an ALTA Balloon used in SWAT team maneuvers. Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m
    Actual image from an Alta balloon used in SWAT team maneuvers.

    Dolphin Mall Sweetwater Florida, May 14, 2014, 6:05 a.m.

    The Potential

    I’m especially excited about the potential lifesaving use of Alta balloons. On numerous occasions I was involved in emergency response actions, and the dominant overarching need was high-quality imagery that could be combined with legacy data and imagery as close to real-time as possible. This system answers that need, and at a low cost. I could envision several Alta systems in every county nationwide ready to deploy on a moment’s notice. I believe that these units would be especially valuable for disaster response in second- and third-world countries. Dozens of Alta systems and trained operators could be delivered on short notice to major disaster sites, providing almost real-time common operational pictures for first responders. The added advantage is the very light need for logistics and support.

    Military applications could be equally important. The silence of balloons coupled with a small visibility profile, including almost total invisibility at night, makes them ideal for reconnaissance and surveillance.  The relatively low cost of the platforms also permits them to be expendable. In a tethered mode, the persistent “eye in the sky” could serve as a deterrent, or at a minimum make hostile activity more complicated for the perpetrators as they try to hide activities from the balloon.  The “light” logistics and fast operator learning curve are just added benefits.

    A key question raised during the webinar was FAA control. John indicated that the FAA does not consider the Alta balloons in a tethered mode subject to their control, and is currently reviewing it in a drift mode.  John further amplified that the very low altitude of operation and dual control of descent should also exempt the drifter from FAA involvement. Alta could provide a significant advantage where UAS operations are restricted or not practical.

    In a recent book, “Smaller Faster Lighter Denser Cheaper” by Robert Bryce, reviewed in the Wall Street Journal, the author argues that a similar dynamic, making less do more, drives virtually every technological change that has created the modern world, from cars and airplanes to advanced medicine, strategic metals and the iCloud. Alta balloons are certainly a good example.

    I was an early proponent of Pictometry because, unlike abstract GIS data and ortho imagery, the metric oblique imagery was easily understood by non-GIS users. I saw many examples where it saved lives because police and firefighters were able to form and exploit a common operational picture quickly. Alta has me equally excited because it brings that same capability to users with a much simpler system that delivers almost real-time imagery at a cost anyone can afford. This technology is going to help a lot of people.

  • Mother’s Day and Memorial Day Tribute

    How a Haunting Memory Shaped My GIS Career

    In the mid ’80s I set up the Navy’s first Geographic Information System (GIS) to accomplish the 1987 base closure study, now called the BRAC (Base Realignment Commission). That first experience with GIS convinced me to pursue GIS as my second career after retiring from the Navy. Fortunately, I was able to land an ideal final tour of duty as the Commanding Officer of the Naval and Marine Corps Reserve Center in Charlotte, N.C. I worked to get this position since at the time the University of North Carolina at Charlotte was one of the few universities starting a GIS master’s program, and taking some evening classes helped with my transition. Jack Dangermond, who I hadn’t heard of at the time, was the keynote speaker for program kick off.

    That was a nice assignment after years of sea duty and other demanding assignments over an 18-year career, but one aspect would make this assignment hauntingly unforgettable. As the only active-duty Naval Officer within 50 miles of Charlotte, one of my collateral duties was to act as the Navy’s Casualty Assistance Calls Officer (CACO). A CACO is the official representative of the Secretary of the Navy who notifies immediate family members in the event of a service member’s death or severe injury. Unlike some depictions in movies, military branches take special care to notify immediate family members in person not by phone. I did several of these notifications and learned to take a chaplain and corpsman with me in case there was traumatic reaction by the family members to the news.

    It was an especially clear spring day when I received a message to notify a family of the death of their only son. He was a young man living his dream as a Navy diving officer. He worked hard to get there by earning an engineering degree from Duke University while also participating in the NROTC program. He was serving as the diving officer on a submarine rescue ship in the Mediterranean when he was killed in the line of duty. My job was to notify the family.

    The chaplain, corpsman and I arrived at the home just as the mother and father returned from grocery shopping. As I knocked on the screen door the mother looked up and with a surprised smile on her face seeing the three of us in uniform she happily said, “Oh, you’re in the Navy!” and within a half second her voice dropped to a low painful tremble, “Oh no….my son is in the Navy.” She knew. She knew. In a half second she knew the Navy doesn’t send three uniformed people to deliver good news. The only thing I remember as she and her husband collapsed to the floor holding each other was her repeating “Oh no” “Oh no” and mention of her daughter-in-law, who was expecting.

    I could only imagine how she felt after receiving the most horrific news a mother of an only child could receive. I felt like I had just plunged a long jagged dagger into her heart and each piece of additional information just twisted that dagger around further. I pictured her life as a mother racing before her — childbirth, his first steps, school, graduation, his wedding, pending fatherhood. Soon neighbors, friends and their local minister arrived to comfort the family.

    Over the next several days, while the flag draped coffin made its way to North Carolina, I worked with the funeral home and family preparing for the graveside ceremony. I rehearsed our Navy team in preparation — six pall bearers, a firing squad, bugler, chaplain and myself. The day of the ceremony I inspected our sailors and as expected each man was inspection perfect. We loaded up the bus and headed out. The ride to the site was quiet, we all knew that this funeral was different from the numerous retiree funerals we had done. This young man was one of us, gone in the prime of his life serving his country.

    The ceremony went perfectly. The six sailors in their dress uniforms carried the flag-draped coffin to the burial site and stood at attention next to the coffin. Seven members of the firing squad positioned themselves several hundred feet away. We all stood at attention as the chaplain spoke. When he finished I nodded to the six pall bearers; they slowly grabbed the flag, lifted it, and stretched it out over the coffin. That was the signal for the seven-member firing squad to fire three volleys immediately followed by the playing of taps.

    I know of no military member who doesn’t get choked up at the crack of the rifles followed by the melancholy playing of taps. As taps was playing, the pall bearers were folding the flag with precision. The goal is to fold the flag into a perfect tight triangle with only white stars and dark blue showing by the time taps is complete. They did a perfect job, and the lead petty officer then handed the flag to me. It was my task to walk over to the family and present the flag. “On behalf of grateful nation and proud Navy, I present this flag to you for the honorable service of your son and husband.” And that was it, the final capstone to a short and honorable life, or so I thought.

    The funeral director then announced that all were invited to the fellowship hall for a potluck luncheon. I dismissed the funeral team and we all headed over to the fellowship hall. The mood was less somber as family members and friends recalled the good times. It was nice to relax a bit and hear some fond memories of our departed shipmate. Soon it was time for us to go. While my team headed to the bus, I went to pay my last respects to the wife and parents. I shook hands with the wife, the father, and then as I offered my hand to the mother, she held it with both hands and said something that has haunted me to the core ever since.

    Holding my hand ever so tightly she said, “I just wanted to let you know… how bad I felt for you having to deliver the news to me.” Her comment floored me. Three days before I had delivered the most painful news a mother could ever receive. I plunged a dagger into her heart that would never heal….and she felt bad for me? Speechless, I nodded and squeezed her hand back. I left shaking my head in disbelief. I had never met someone so selfless.

    That was over 25 years ago, and the memory of her is just as fresh today. I don’t think that a week goes by without me thinking about her, and every time I do, I still shake my head in disbelief. She definitely left a mark on me. I’ve tried my best to honor her memory in my small way by doing the same thing many of you in the geospatial community do, working hard to provide the tools that may help minimize future flag-draped coffins. I’ve seen our geospatial tradecraft save lives — GIS, imagery, human geography, and now social media and cyber. So whether it’s the intelligence specialist in a Special Operations team, a cyber-analyst in D.C., a geospatial contractor in Huntsville, or the countless GIS personnel supporting first responders in local governments around the country, you all can feel great pride in your life-saving work.

    Over the years I’ve come to realize that there are many people just like her who live quite decent lives doing their best and leaving indelible marks on the hearts and souls of those they meet. Mothers like her may not bask in limelight, but they have provided us with some remarkable citizens and military service members, and I understand the pain that each mother feels when we lose one of our shipmates. I was blessed to meet her and will never forget her.

  • GEOINT Coverage, Day 4: More clips from the Expo

    GEOINT 2013* — Day Four

    Here are more videoclips from the GEOINT Exposition Hall.

    VGo replicates a person in a distant location. A user can see, hear, talk and move around as if there. It was designed for healthcare staff such as doctors, and students or remote workers. Using VGo, an NGA staff member in Washington, D.C., was able to virtually attend the GEOINT Expo.

    LOGOS Technologies‘ KESTREL is a wide-area persistent surveillance sensor for aerostats to do real-time surveillance, day and night for continuous 360° intelligence collection. See the interview below, and a YouTube video of the system in operation.

    KESTREL in operation:

    There were numerous discussions by attendees about how the use of real location data and imagery could help greatly in  training and practice for real operations, providing a strong immersive environment.