Author: Art Kalinski

  • Interservice/Industry Training, Simulation & Education Conference

    By Art Kalinski, GISP

    The I/ITSEC (Interservice / Industry Training, Simulation & Education Conference) held in Orlando is not a GIS conference but GIS is playing an increasing role in training and simulation. With over 5,000 attendees and over 500 exhibitors this is the conference of the year for those in the training and simulation business. This is a large conference that can’t be taken in by one person so the following are some snap shots taken from a GIS perspective.

    I/ITSEC demonstrated that the bar is being raised in all aspects of this multi-million dollar technology industry. The early days of training simulation was exemplified by LINK trainers which were early aircraft trainers that trained thousands of pilots during WWII. The trainers were estimated to have saved thousands of lives and millions of dollars in aircraft. Now the current generations of trainers have moved well beyond the simple stick, pedals and crude instruments that were the hallmark of the early LINK trainers but the objective is still the same. Substitute training simulators for real hardware and save lives and millions of dollars in the process.

    IITSECThe aircraft trainers demonstrated at I/ITSEC are as specialized and sophisticated as the aircraft they simulate. The simulators are no longer gee whiz video games. The current trainers approach realism that in some cases is indistinguishable from reality. Some simulators that were on display even simulate G forces through tactile sensations created by the seats. I tried one out and the affect was compelling but still not the real thing. If you are a video-gaming enthusiast this conference is a “Candy Store.” The hardware is absolutely real and most of the simulators use very high powered computer environments.

    GIS plays an increasing role as engineers seek to create training simulators that are not only used for generic training but actual mission rehearsal. The simulators need to accurately display features, terrain, navigation and communication while also displaying different weather conditions. One can see the blurring of the line between being in an actual aircraft, being in a trainer or remotely piloting a UAV.

    In the training simulation business they use the term “database” slightly differently that we do in GIS. Their database includes all the GIS type vector data of the flight environment but also includes, ground elevation models, draped imagery, 3D structure models, the objects and skins that populate the models and all the underlying physics that make the models behave realistically.

    Fast accurate 3D model creation is major requirement of our military for training but increasingly more important for mission rehearsal. 3D modeling is becoming more sophisticated and robust with four vendors PLW, IAVO, Cogent3D and Clear Edge 3D approaching the “Holy Grail” of modeling, an automated process to create 3D models from ortho, oblique and ground level images with minimal human intervention.

    I saw improvements in display technology, nothing really new but significant refinements. Large HD flat screens have replaced smaller LCD monitors. More air and ground simulators now use spherical and wrap around projection screens. There are also significant improvements to the imagery as they refine the optics to take full advantage of the screens and reduce distortion. JVC and Sony both displayed extremely high resolution and very high refresh rate digital projectors that showed no signs of blurring on even fast moving objects. They made me want to scrap my Blu-ray / 1080p home theater until I saw the price tag. Yes, if you have to ask you probably can’t afford it. With the new displays they can accurately show fast moving aircraft from an initial pinpoint on the horizon to a Mach 3 fly by.

    The blurring of the lines between the gaming industry, simulation and GIS continued on the ground with numerous ground combat simulators. Avatars are becoming so realistic in motion and detail that they rival video of actual players. Avatars not only move with fluid motion but their movements have built in physics so they behave appropriately when running and jumping with back packs and other loading conditions. Many of the ground simulators work with real geo-referenced data and actual building imagery. Even more impressive are recognizable emotions on the Avatar faces.

    One group of tools that has been used to create realistic avatars is motion tracking devices. Even here the bar has been raised. Last year one company demonstrated the ability to make an Avatar move in perfect synchronization to movements of a live actor wearing a suite with sensors that were tracked by computer. This year two companies were displaying the same capability and both were upstaged by a new company, Organic Motion, that did the same avatar mimicking but without wearable sensors. They instead used multiple video cameras and computers to analyze the motion of objects in 3D space and then immediately mimic the motion with avatars.

    Organic motion.
    Organic motion.

    A Canon distributor was demonstrating a Canon mixed media set of 3D goggles. This is a significant refinement of an experimental display I saw several years ago at a GIS conference. Those goggles displayed GIS or CAD drawing data overlaid on the real world view. The hard part was maintaining registration of the abstract data with the real world despite head movements. The early version did that by placing a GPS receiver on the head piece to constantly serve as a geo-reference. It was crude but I could imagine that some day construction workers would wear these kinds of goggles to “see” buried cables and piping prior to digging. Obviously GIS data accuracy, integrity and verification would be paramount.

    The new Canon mixed media goggles were a significant leap in quality. The resolution and optics were superb. When I put them on I could still see the real world but overlaid in my field of vision were 3D objects that looked like they were actually their. I’m not sure where this will lead but the viewing of GIS data on the real world is certainly now possible.

    Canon Mixed Media.
    Canon Mixed Media.

    Professor Amela Sadagic and Marine Corps Captain Aaron Burciaga of the Naval Postgraduate School were demonstrating a Virtual Sand Table that combines projected imagery and computer notations onto a table with 3D physical models.

    Virtual Sand Table.
    Virtual Sand Table.
    Sand Table 2
    Sand Table.

    The trainers are not only visually impressive but are providing very realistic tactile feedback. Some are as simple as a video firing range that not only provided a realistic video image but provided a realistic kick back by using a CO2 cartridge within the fake magazine. I tried the Glock 19 and it felt exactly like firing my own gun on a range but without the ammo cost and a more realistic target environment. Even Segways have entered the training and simulation business with Marathon Robotics demonstrating human sized mannequins that can move about a training environment through wireless control. The robots even have on-board intelligence to react to unexpected situations.

    Marathon Robotics.
    Marathon Robotics.

    A very gratifying volunteer event in the Exhibit hall was Lockheed Martin’s purchase of cases of personal items needed by our troops in-theater. They set up a “Fill the Box” production line staffed by conference attendees who moved down the line filling a box that was finished with a personal note to a service member. The boxes were sealed and shipped by Lockheed Martin whose motto is “We never forget who we’re working for” and in my personal experience they really mean it. This was a good close to a very interesting conference.

    Lockheed Martin.
    Lockheed Martin.
  • GEOINT 2009

    The place to be if your job is intelligence and why what is where.

    By Art Kalinski

    When I was in graduate school at the University of North Carolina at Charlotte, Dr. Jerry Ingalls shared a succinct description of the “new” geography. He stated that old geography was merely the study of where everything was. However, new geography, with its spatial analysis tools, had significantly expanded the field of the study to “why what is where”  and knowing why we can start predicting new “wheres” based on known facts. That, of course, is where geospatial intelligence is today, and some of those tools and techniques identified the location of Iranian nuclear facilities long before they became public knowledge.

    IMG_0775Learning about the latest tools and techniques is the primary reason for conferences, and there is agreement in the geospatial community that GEOINT is the place to be. Organized by the United States Geospatial Intelligence Foundation (USGIF), attendance at the San Antonio conference was the highest it has ever been, according to USGIF President Keith Masback. Even with a weak economy, the over-arching opinion of all attendees was that the intelligence business will continue to grow regardless of world politics. By its nature, this conference really had many more “chiefs” than “Indians,” and many exhibitors spared no expense at the conference, knowing that they were reaching key decision makers.

    USGIF, a nonprofit educational organization created by the geospatial intelligence community, is the organizing force behind the conferences. There is heavy participation by the National Geospatial-Intelligence Agency (NGA) and other intelligence agencies, so the conference attracts top executives in the geospatial industry. The speaker and attendee list reads like a who’s who of the geospatial and intelligence fields.

    General Clapper, the Under Secretary of Defense for Intelligence, was a keynote speaker. He stated his belief that regardless of geopolitical decisions, he sees no decrease in the need for intelligence in Afghanistan and many other locations around the world. He further addressed the need for much faster turn-around of actionable intelligence and cited the joint efforts between the SIGINT (Signals Intelligence) and GEOINT (Geospatial Intelligence) communities.

    General Clapper discussed some of the work of the ISR (Intelligence, Surveillance, Reconnaissance) Task Force, which is seeking new technology and the Holy Grail of intelligence, automated target identification in complex environments. He also spoke about the benefits of commercial imagery sources and its use in an impressive NATO Fusion Center he toured.

    The second keynote speaker was Representative C. A. Ruppersberger, D-MD, chairman of the House Technical/Tactical Intelligence Subcommittee. The congressman addressed his concern that the U.S. is in danger of losing its preeminence in space because regulations are hampering development. He specifically addressed a need to overhaul International Trade in Arms Regulations (ITAR) that are hurting the U.S. commercial satellite industry. He also stated the need for additional research and development funding like the ones that built the U.S. space program and a greater emphasis on technical education. A troubling statistic he cited is that China has 440,000 engineers compared to the USA’s 65,000.

    Vice Admiral Murret, head of NGA, then spoke of his agency’s support not only for the military but humanitarian assistance in natural disasters such as flooding and earthquakes. He talked about the new NGA facility at Fort Belvoir and about how one third of his agency now works in St. Louis.

    In the exhibit hall close to 200 exhibitors demonstrated their latest efforts. Some highlights include:

    Cogent3D and Lockheed Martin demonstrated the release of GeoSketch, a plug-in for Google Sketch Up.  GeoSketch permits military users to build 3D models using the easy to use Google Sketch Up software. The tool permits users to import military UAV video imagery, oblique imagery, and other photo sources to rapidly build 3D models even if geo-referencing data or camera models are missing. The models can then be exported in common formats such as Google, Multipatch, or OpenFlight.

    Digital Globe announced the successful launch of its newest high-resolution satellite, WorldView 2. Imagery from the new satellite will be available in a few months, doubling Digital Globe’s image-collection capability, including multi-spectral imagery.

    LEXISNEXIS news open source highlighted the tremendous wealth of data that it makes available to intelligence analysts. Appistry and NJVC had extensive information on cloud computing and their ability to deliver mission-critical data, including legacy data, to users around the world.

    Pictometry and Lockheed Martin announced their alliance and creation of a new service, Intelligence on Demand (IOD). IOD promises to be a game changer. (See October’s column for details.)

    Every conference I attend there is always a new technology that really catches my eye.  Ball Aerospace was demonstrating such a technology, Flash LIDAR. Flash LIDAR has been a laboratory curiosity for a while but Ball Aerospace has made it a functional tool. Most current LIDAR collections use a laser to scan the ground with the return being sampled resulting in a collection of points on the ground that provide elevation data from which a DEM or contour lines are created. Although this is a rapid process it is sequential and not instantaneous.  The resulting data can be very coarse or fine depending on the sampling interval.

    Flash LIDAR is what the name implies; an entire area is imaged in one nano-second flash. The laser is diffused over an area and flashed once. The resultant image is a broad but dense sample taken at the same instant rather than through a scanning process. Since the image is taken from the same point at the same instant, the data can be used to create accurate 3D models. Those models can then be draped with photographic images or even video frames. The process is so fast that 3D models can be created almost in real time.

    The below images are a practical demonstration of the Ball Aerospace process using Flash LIDAR combined with a live video camera. As each frame of the video image is taken, a simultaneous Flash LIDAR image is also taken from the co-located LIDAR unit. The photo shows the live video and point representations of the Flash LIDAR 3D surface and the resultant 3D image draped on the moving 3D model.

    It’s hard to tell from these still 2D photos but seeing this system in operation was impressive since the Flash LIDAR and resulting 3D models were continuous and perfectly registered. The only limitation of this demonstration was that human flesh is not a good “Reflective Surface.” Note that in the photo the Ball representative was very animated. This stop-action screen-capture shows him as he jumped up.  In all cases the Flash LIDAR kept up with the dynamic movements.

    Point cloud.
    Point cloud.
    Point cloud.
    Point cloud.
    Point cloud.
    Point cloud.
    Wire-frame image.
    Wire-frame image.

    This was an impressive conference that suffered from too much in too short a time.  Two tools that were very helpful was a daily newspaper, the Show Daily, that recapped the previous day along with the current day’s schedule. It was published, printed, and placed under our doors as we slept. The other useful tool was a daily video show with key presentations and interviews for those that were unable to be in two places at the same time. It was available at several break locations and on our in-room TVs. This has been done at other conferences but not as well as the execution of USGIF.

    The USGIF team deservers a “Well Done!”

  • Intelligence on Demand (IOD)

    Oblique Imagery Online a Significant Game Changer for Federal Agencies

    By Art Kalinski, GISP

    A new technology service has just been initiated that may affect almost every federal employee who needs to view high resolution oblique imagery in the United States and key locations around the world. This service is a joint effort between Pictometry International and defense partners.

    First, in full disclosure, I’m a consultant for Pictometry. I debated if I should write this article, have someone else write it or leave it alone. Discussing it with my editor we decided that it was too timely and important not to cover and I was clearly the best person to do the article because of my first hand experience and knowledge of the topic. I’ll try my best not to sound like a commercial but I will present you with the facts as I know them.

    To put this article in context I want to share by background with those of you not familiar with it. I learned about GIS in the mid eighties when I was tasked to do a base closure study for the Navy including the desire to close 10-20 percent of the Naval Reserve Centers nation-wide. The reserve centers were the most challenging because each required a detailed analysis of reservist assignment, travel and per diem costs for centers that were closed. Congressional pressure to not close facilities in local districts was a significant issue. Time was very tight and traditional paper map analysis would have been impossible until I learned about GIS. GIS permitted me to do ring studies of over 100 reserve centers involving 30,000 reservists very quickly and very accurately.

    GIS proved to be such a powerful technology that I earned a Masters degree in GIS upon retirement from the Navy. I then joined the Atlanta Regional Commission as its GIS Manager for over 14 years. During my tenure we set up an ESRI ArcView Learning Center and taught over 1000 students during the 8 years of operation. One disappointment over those years is that even though we would occasionally get a police officer or firefighter through the class I never felt that GIS gained any strong traction with first responders. I got the feeling that it was just too hard and no one got proficient enough to use it in emergency situations.

    Then everything changed. In 2006 we were exposed to a new technology that provided high resolution oblique imagery that was geo-referenced and very accurately measurable. It was extremely easy to use, could be overlaid with our GIS data and provided a visual operational picture that was not matched by even high resolution ortho imagery. (See my GSS column “The Whys of Oblique Imagery” April 8, 2008 for a scientific explanation why oblique imagery has proved to be so effective compared to using only ortho imagery.)

    Police and firefighters took to it instantly. The technology was such an improvement over traditional GIS data with ortho imagery that we were seeing measureable improvements in the effectiveness of firefighters and other first responders.

    The technology was being used by firefighters to preplan their action on the way to fires. The common operational picture permitted them to view and measure all aspects of their attack on a fire including access to the site, measuring the lengths of needed fire hoses and even measuring the heights of buildings to determine the lengths of ladders that would be needed. It was so effective and easy to use that over the past two years of keeping statistics one large county determined that they have reduced the attack time on a typical fire by 60-90 seconds. Police SWAT teams and 911 Call Centers also experienced similar success and believe that they have saved lives in the process.

    The technology took root and soon most counties in the region were using it. It had an unprecedented impact on GIS. Most counties experienced a 10 to 20 fold increase in GIS usage in the more user friendly and understandable oblique environment.

    After two years of hands-on experience with Pictometry, I was approached by them to promote and manage military projects. I was surprised the technology was not already used by the military and jumped at the chance to help. The opportunity to put the technology in the hands of the military and first responders means much more to me than just a job. While I was still on active duty I had the painful task of presenting the Flag on three separate occasions to family members of sailors lost in the line of duty. I can tell you first hand that presenting the flag to parents or young family members is one of those life changing moments that you never forget. So when Pictometry presented me with the opportunity to perhaps in some small way minimize the potential loss of yet another service member I was thankful for the opportunity. I jumped at the opportunity and feel privileged to be able to contribute and help those that may be in harms way.

    What I soon learned is that the technology was very difficult for federal agencies to acquire. This difficulty stemmed from the business model used by Pictometry, flying and selling counties. In the early days, Pictometry would fly and sell imagery county by county. This worked extremely well for local governments, even those with limited budgets. The imagery was very cost effective and was a significant boon to tax assessors and first responders. So effective was this effort that their customer base includes 90% of the US Urban Areas. Overseas users have been equally impressed with partners operating in 137 countries and territories. Overseas users have been equally impressed with major cities in over 142 countries imaged.

    This business model had a serious limitation for state and federal customers since it was very difficult to scale up to state and federal levels. No one had budgets to buy hundreds of counties let alone the entire country. I remember an early visit to a national bureau that clearly highlighted the problem. Most agencies don’t have budgets to buy imagery of the entire country. They can never predict where the next security event or emergency will occur and have to respond anywhere instantly. What they needed was access to all the imagery on an as-needed basis. This is what IOD (Intelligence-on-Demand) provides.

    IOD is a service based on the successful online commercial service that Pictometry has been providing to the civilian sector for over a year, called Pictometry Online (POL). The POL service provides a variety of solutions, from real estate to engineering to golf. Large insurance companies use it as well as hundreds of roofing companies that can view and measure roofs and provide estimates to customers during their initial phone request.

    Below is an example of how the Pictometry imagery differs from other imagery sites that only show ortho imagery. Although the straight down view shows Big Ben, it’s really difficult to make it out in this “ortho view.” The IOD image shows a very recognizable oblique view of Big Ben and the users can view it from five directions, north, south, east, west and straight down. Additionally since all historic imagery is also on file many locations will have several years of imagery that can be selected to show changes over time.

    Big Ben ortho Big Ben oblique

    But these are not just “pretty pictures.” As the name Pictometry implies the images are metric – each pixel is fully geo-referenced. Users can easily overlay GIS data and perform rapid on-screen measurements of objects in the image with little to no training. Measurements such as length, area, ground elevation, lat/long, bearing, and locations can be made with the simple click of a mouse. And unique to oblique imagery, the height of objects can also be measured without the need to do stereo analysis – just click on the base of the object and drag upward to measure the height.

    Wisconsin Image Wisconsin-2

    Note that even thin vertical features such as whip antennas, guy wires, stanchions and even signal flag halyards are visible in this sample image of the USS Wisconsin on historic display in Norfolk, Virginia.

    The natural question is how IOD differs from the commercial access imagery sites. First, Bing Maps (previously Microsoft Virtual Earth), which uses Pictometry images, only has viewing capability — users cannot make measurements nor can they overlay GIS data layers or export annotated images. There are also limitations of image quality and coverage. Additionally, this system is accessed over non-secure HTML connections at a commercial site, meaning it is easy for a third party to view where a federal user may be paying special attention – a big issue for many federal customers.

    IOD was set up to address many of these limitations. The IOD team has installed 2-petabytes worth of secure server storage to provide the entire Pictometry image library to federal users via a trusted cloud through secure but unclassified (SBU) access. And since the data center is being built in a SCIF, it is possible to provide higher classification access via SIPRnet or JWICS, should a customer require it. The additional advantage of operating in a secure environment is that a federal customer could initiate a sensitive or secure image collection and make it available through the same system as all of the commercial data.

    The secure sites permit users to view all the imagery, overlay GIS data, perform accurate measurements, annotate images and export those annotated images to other users. This will be especially important in responding to natural disasters such as hurricanes since the Pictometry capture and processing technology is so rapid that Pictometry was able to provide geo-referenced imagery to FEMA a day after Hurricane Ike hit Galveston, Texas.

    galveston galveston after ike

    Pictometry is now testing a real time capability to download the geo-referenced imagery from aircraft directed from the ground.

    Another service that can be ordered online is the automated generation of reflective surface 3D models. These models have been used to help determine volume of debris fields to more sophisticated flight simulator databases that are not only photo-realistic but measurable and photo-accurate. This is an especially important factor for use in tactical planning and mission rehearsal.

    But the key decision factor is cost. This is where IOD solves several cost issues by charging an unusually low monthly per seat license. As a secure web service IOD answers several issues that have been important to many federal agencies including NGA. Since the secure servers house the imagery with remote back up, agencies eliminate the need for additional hardware and software. All users need is a URL. This imagery also satisfies the congressional mandate to save money by taking advantage of commercial off-the-shelf products (COP).

    Most important to me is that this entire effort has led to testing of Pictometry cameras in military aircraft. Hopefully this will put the technology in the hands of people who need it the most, troupes in-theater, domestic security planners and first responders. As the image libraries expand and are updated they will be instantly available to all designated federal users.

    The grand unveiling of IOD will be this month at GEOINT 2009 in San Antonio. To learn more see the Pictometry booth or contact Pictometry. My experience with this technology in the Atlanta region was an eye opener. Since it was very easy to use GIS usage jumped 10-20 fold and the most dramatic beneficiaries were first responders. If my Atlanta experience is any indicator, this technology will be a “game changer” for many Federal agencies. Most important, I know this service and technology is going to save lives.

  • IGI&S 2009: Getting Back to Basics and Our Roots

    Earlier this month I attended the Defense Installation GeoSpatial Information and Services (IGI&S) conference in Dallas. Although not a large conference, it is tightly focused and aimed directly at the GIS community that supports military installations. The conferences were initially started by the Air Force, but attendance by other branches has grown since they all have common issues and many have joint chains of command. The first keynote speaker was Lora Muchmore, director of Business Enterprise Integration, Office of the Deputy Undersecretary of Defense for Installations and Environment. She addressed the historic difficulty that DOD had keeping track of buildings, equipment, and personnel. The problem was exacerbated because each branch had their own inventory systems that were not interoperable with systems of other branches. Mrs. Muchmore concluded by emphasizing the increasingly important role that IGI&S is playing to improve the Department’s real property inventory, literally transforming the way resource and management decisions are made at the highest levels.

    David LaBranche, the Defense Installation Spatial Data Infrastucture (DISDI) program manager, addressed how DISDI is working with the National GeoSpatial Intelligence Agency (NGA) to put IGI&S data and systems in place that are complimentary but of course different from intelligence community needs. They are working toward interoperability between the joint services and encouraging greater use of unclassified, shared, off-the-shelf products to build “installation situational awareness” without the expense of custom products and services.

    The complexity of joint bases, base realignments and closures (BRAC), environmental issues, and interrelated activities with other federal agencies such as Department of Homeland Security (DHS), DEA, CDC and others highlighted the need for interoperability and shared spatial data. However, the opposite has occurred as systems grew in size and complexity. So the overarching theme of the conference was getting back to basics with standards and consistent base-to-base data and systems.

    This concept of snapping back to where we started reminded me of a dysfunctional ship that I was assigned to early in my Navy career. The ship was a mess with poor morale, poor performance, and a very unhappy crew. A new CO arrived who made no immediate changes but instead carefully studied the ship for two months. He then called us officers together in the wardroom and gave us a very simple order. He told everyone to get a copy of the ship’s SORM, read it and put each division and department back in line with it. The SORM stands for Standard Organization and Regulations of the U.S. Navy. The long standing but continuously updated Navy manual is a guide that clearly identifies how a Navy ship should be organized and operated. It was created through decades of lessons learned and practical experience. Our new CO explained how any organization will morph over time away from it roots. Sometimes the changes grow out of operational necessity and some changes are driven by the personalities and talents of crew members. Regardless of the source, these changes can ultimately twist the organization into dysfunction.

    As a junior officer, I was somewhat skeptical that this would have any major effect but I was wrong. Within three months the ship was functioning like a fine watch and there was actually harmony in the wardroom and among the crew. Of course this wasn’t the only change; the CO was a very gifted and uplifting leader with a superb memory. In that same three month period, through his “management by walking around” he learned the name, home town and family situation of every member of the 300 man crew. The CO became so respected and admired that eventually any crewmember would walk off a cliff for him. Getting back to the SORM roots certainly helped.

    Many of the conference sessions addressed the same themes of interoperability and cleaning up the basics. The Marine Corps GeoFidelis program was highlighted by David LaBranche as a model, built with a focus on interoperability while also addressing the institutional issues of data handling and organization. Frances Railey, the GeoFidelis GIO, explained the details of the Marine Corps system and how it was designed to meet customer needs including a very detailed Data Access & Release Guide. Peter Len, the Gi&S manager for the Naval Facilities Engineering Command (NAVFAC) Pacific, explained the unique challenges he faces with facilities scattered across the Pacific including Guam and the Marianas. He discussed how GIS was used for encroachment planning and other base management issues.

    The conference also included 22 vendors who demonstrated new products and services that also addressed the conference themes of interoperability. AutoDesk, which is one of the leaders in BIM modeling, had personnel demonstrating new tools that bridge the gap between CAD and GIS into the BIM environment. Bentley, another leader in BIM modeling, demonstrated BIM solutions that addressed life cycle facility management including energy and lighting. Their OGC compliant systems work with many different BIM model formats. NGA staffers demonstrated Palanterra, a Google-like online system used by emergency management people such as DHS for special event planning and response.

    Woolpert demonstrated a new capability that can quickly create 3D building interior models from video clips taken from different view angles. I’ve seen this done with laser point clouds but this was the first time I saw video used to build 3D models. Kaya explained their GIS services including web engineering applications for facility and installation management as well as tools to build real property master plans. Pictometry demonstrated a new image service that will be launched this summer. Through the web service federal users will be able to view or download all Pictometry imagery, both ortho and oblique views, through secure portals. The service will be very affordable because imagery is accessed only when and where needed. This should be a boon for emergency responders.

    ERDAS demonstrated web services that reduce a series of complex image/spatial analysis functions to simple and intuitive user tools and products. This screen capture below is an example intended for use by a tank commander. In one operation this service combines slope data, image analysis vegetation data, and feature data to build “drive/no drive” zones. This is very similar to work many of you have done using ESRI’s Model Builder with Spatial Analyst, but the ERDAS system is faster and takes full advantage of their 30 years experience in image analysis. “Wiping” the image shows the drive/no drive areas over a topo map.

    ERDAS Apollo – WPS in Action.
    ERDAS Apollo – WPS in Action.

    The one nagging concern I had that seemed to need more attention was emergency preparedness. When I addressed the topic with attendees and presenters they talked about how their IT people had remote backup systems for installation data and how backups occurred regularly. I have this little gut twitch that occurs when I hear that IT people are backing up my data. Please take this first hand experience from someone who almost lost 10 years of GIS data because of an administrative error.

    In a previous assignment our agency had a catastrophic server farm failure that resulted in the total loss of our entire SDE database. Backup? There was no backup. Some IT personnel view GIS data, especially imagery, as a huge data set that doesn’t need to be backed up often, if at all. They don’t see GIS data in the same light as financial data and may treat it differently so, through a misunderstanding, the IT people were not backing up the SDE database.

    Luckily, a year before the loss, we placed all our GIS data and imagery on portable hard drives as part of our portable emergency GIS we set up in support of regional disaster preparedness and mutual aid. One set of those hard drives was in our emergency GIS locker in our office; the other set was 25 miles away in a secure location (see my January 2008 Geointelligence Insider column, What Can You Do for Your Country). At the risk of sounding like a broken record, or for those of you born in the post-vinyl period, “a continuously looping file,” I say what many others have said: “back up your data.”

    Stepping down from my soap box, I can say that this conference was an exceptional conference that was rich in information and not overwhelming like some of our mega-conferences. For the vendors many good leads were generated and for the participants a lot of useful information was presented.

  • The Mortgage Crisis and GIS

    Was the FGDC Mortgage Crisis Meeting a Silver Lining on a Huge Cloud?

    By Art Kalinski, GISP

    On May 7, I attended a special meeting addressing the mortgage crisis hosted by the Federal Geographic Data Committee (FGDC) and the International Association of Assessing Officers (IAAO). The purpose of the day long meeting was to discuss the use of land parcel data in managing mortgage related issues. The meeting focused on how GIS can monitor and manage these issues and to get feedback from leaders on which specific data elements are important to the mortgage industry and its financial oversight. The meeting was held at the American Institute of Architects Building in Washington, D.C.

    The participants included representatives from banking, finance, credit, and mortgage firms as well as members of federal regulatory agencies. Also present were GIS professionals, private sector solution providers, and land parcel data producers. The meeting was opened by Dr. David Moyer, the meeting facilitator; Mike Howell, OMB and vice chair of the FGDC Steering Committee; Bob Ader, co-chair of the FGDC Cadastral Committee; and Dr. Josephine Lim, president of the IAAO.

    Key presenters in the morning sessions were Anne Hale Miglarese of Booz Allen Hamilton, the chair of the National Geospatial Advisory Committee (NGAC); Dr. Dave Cowen, a leading GIS educator; and Dr. Nancy von Meyer who has worked on cadastral issues for over 20 years, including her current work for the U.S. Bureau of Land Management (BLM).

    According to the presenters, some analysts and GIS professionals saw the mortgage crisis coming but there was also a lot of “whistling past the grave yard,” as people hoped that the trend would not turn into a crisis. The rise in distressed mortgages, foreclosures, and decreasing real estate values were visible long before the crisis became a crisis. Key to monitoring the issues was good parcel level data. Unfortunately, even though we have high tech tools such as GIS, there are institutional barriers that limited the effectiveness of those tools. There was a lack of consistency and interoperability of key datasets at a national level.

    I personally experienced two such frustrations related to the post office and to the census. When I first joined the Atlanta Regional Commission (ARC) as the GIS Manager in 1993, I learned that ARC published zip code maps as a service to the regions’ economic development offices. My response was “why don’t they get them from the post office?” After all, during my graduate work at the University of North Carolina we constantly used zip code marketing data for site selection and trade area analysis. I assumed that the zip code polygons came from the source, the U.S. Postal Service. I was wrong.

    In the pre-GIS age, when zip codes were created, the purpose was to build delivery routes not defined polygons. As a result, the zip code boundary files we use are very fuzzy and the polygons only approximate boundaries. I was so incredulous, that I personally drove up one major road in Cobb County to conduct my own survey. What I saw were businesses in one long block on the same side of the street that had alternating zip codes as one progressed up the street. I was told that this happened because the business where given a choice of having a Marietta city address or a Kennesaw city address. This, of course, is one example of one street in one county, but my understanding is that this is a system wide issue. Even today the Postal Service doesn’t publish zip code maps but instead refers users to commercial vendors who create zip code maps. Of course these commercial maps come with disclaimers regarding the validity and positional accuracy of the data.

    The second frustration was helping with the U.S. Census 2000 Local Update of Street Addresses (LUCA). Under this census program, local talent was used to update TIGER street data and addresses. The key limitation was that we all had to sign confidentiality agreements that any data collected and any data sets that were enhanced with this collection effort would also be confidential. That meant that if I sent staff to a new neighborhood and identified new streets and news addresses, not even houses, just address locations, that information was confidential and if I used the information to update our massive ARC street centerline database that file also became confidential.

    I could then send the same people out on a different day to the same location to collect the same data but if the data collection was not in the name of LUCA, it was not confidential and we could use it. Yes, I fully appreciate privacy but the mere existence of a street address tells you nothing about the parcel or the building, if there is one, or even the inhabitants, if there are any. In fact, most of this data in even greater detail is already available from commercial sources. These are just two examples that hurt data collection and interoperability, but there are more when it comes to parcel level data. Now I’m about as conservative as one gets, but this silliness in the name of privacy defies common sense and is an example of how we twist ourselves into knots to our own detriment.

    The afternoon sessions were facilitated by David Stage of the FGDC Cadastral Subcommittee, Susan Marlow of Smart Data Strategies, and Roger Clark of IAAO. The meeting focused on obtaining feedback from users in the mortgage industry as to specific data they need to do their job effectively. The list of data elements included factors that one would expect. There was a large list related to the property descriptions, such as lot and building size, construction — several attendees highlighted the need for street level or oblique imagery of each property, and annotation of the condition of improvements. George Donattelo of IAAO indicated that these were especially needed if IAAO AVM and Mass Appraisal Standards are used. Financial factors included the type of mortgage, equity, and terms of the mortgage. Geospatial factors such as nearness to water, flood plains, neighborhood comparable appraisals, demographics, and regional economic factors such as employment levels added even more complexity to the analysis.

    The discussions all pointed to the need for timely analysis using comprehensive data. We know that spatial analysis of all factors, perhaps with regression analysis, could help with future forecasting, but analysts need data that is detailed, accurate, and most importantly, consistent. There was a general consensus that just a small portion of the rescue funds should be devoted to creation of comprehensive data collection efforts. All agreed that this should be the message from this meeting to our leaders.

    I’m hoping that this economic crisis will open everyone’s eyes to the need for consistent and comprehensive data if government is going to insert itself into the market. Homer Simpson one stated: “Beer, the cause of and solution to life’s problems.” … Dare I substitute “government” for “beer?” Maybe with superb data and competent analysis we can look back on this crisis with open eyes and not repeat our mistakes. Perhaps the realization that we need good data and GIS analysis will be the silver lining.

    For additional information, please contact Don Buhler, Department of Interior, Bureau of Land Management, [email protected], (202) 452-7781. The meeting details are posted on the Cadastral Subcommittee’s website at www.nationalcad.org.

  • Duty, Honor, Country — and GIS

    The U.S. Military Academy at West Point was born of unique geography; more than 200 years later, it’s teaching modern mapping methods.

    By Art Kalinksi, GISP

    Last week, I had the privilege of meeting with members of the GIS Program of the U.S. Military Academy at West Point. The security guards at the gate greet visitors with the academy motto, “Duty, Honor, Country,” which permeates all endeavors at West Point. The Academy has produced distinguished graduates for more than 200 years, and is known for its extremely rigorous academic and military training program. The cadets may get a free education, but it requires dedication and a full-time commitment, as well as eight years of service as a commissioned Army officer upon graduation.

    The oldest engineering school and military academy in the United States got its start during the Revolutionary War, thanks to the unique geography of West Point. General George Washington was concerned that the Hudson River could provide dangerously easy access to areas north of New York and New Jersey, where the British could group to split the colonies. However, a narrowing and S-curve in the Hudson at West Point made British ships vulnerable, forcing them to drop their sails as they slowly maneuvered the tight passage. Thus were born the fortifications at West Point, and ultimately, the U.S. Military Academy.

    Today, West Point relies on GIS, which is focused in two Academy organizations: the Geospatial Information Science Program within the Department of Geography and Environmental Engineering, and the Geospatial and Environmental Services Division within the Department of Housing and Public Works. The operational GIS division is headed up by Kris Brown working through Essex, a Northrop Grumman business unit. Kris and his staff support significant public works projects, security, and emergency services. They also provide support for the military training ranges, as well as environmental and archeological efforts.

    Tools and Training

    The primary software environments used at the Academy include Autodesk CAD software and the ESRI suite of GIS applications. Pictometry oblique imagery and software seem to be the dominant choice for public works estimators, base police, and firefighters. The police frequently use of the oblique imagery for incident reporting, but only as simple annotated images. They don’t yet use the heads-up digitizing and shapefile creation ability, but are content to provide that information to the GIS staff for inclusion in the database.

    The Geospatial Information Science Program uses many of the same GIS resources, but for a different goal — the education and training of Army officers and future leaders. The program is led by Dr. John Brockhaus, and includes Colonels Michael Hendricks and Steven Fleming, both of whom have earned their PhDs and have extensive field experience. In addition, the program includes three rotating military faculty members with master’s degrees, and this year includes Michael Tischler, who is on loan from the Army’s Topographic Engineering Center (TEC, recently renamed the Army Geospatial Center [AGC]). Michael also has an extensive education and strong hands-on experience.

    All Academy attendees are exposed to GIS, but based on their major, some cadets expand their GIS education. Students learn GIS theory, but also have to complete hands-on projects that demonstrate their ability to accomplish tasks with the data and software. The program includes the traditional vector-based GIS of points, lines, and polygons, as well as grid/raster-based GIS with work in projections, topology, geodatabases, DEMs, LIDAR, and other topics. Since almost all graduates will be producers or consumers of intelligence products, there is a heavy emphasis on integration of remote sensing, CIR, radar, and imagery, both ortho and oblique. Although computer-based GIS forms the core of the program, cadets must also demonstrate the ability to use traditional paper maps, and even a compass.

    The West Point GIS Lab.
    The West Point GIS Lab.

    The program includes training in GIS software and applications from vendors such as ESRI, ERDAS, TerraGo, Pictometry, LizardTech, Trimble, Google, Microsoft, Oracle, Adobe, and many others. In addition, training in cartography and the use of experimental equipment is offered, including 360-degree video capture systems, LIDAR point cloud analysis systems, and integrative survey collection tools and techniques (such as ike-504 and NOMAD).

    Efficiency in Education

    To be selected for West Point, a cadet must be among the top one percent in terms of academics, drive, and motivation. But the clock and calendar are the real limiting factors of the program. Not only do cadets carry a very heavy academic load, they also have extensive military, sports, and leadership duties. The program is so tight that almost every hour is planned, with each minute important and accounted for. The bottom line is that no one can afford to waste time. Even the dining hall is an example of efficiency; 4,400 cadets are fed during one 30-minute seating.

    This highly disciplined use of time is apparent in the classroom as well. I sat in on a class Colonel Hendricks was teaching — what an eye-opener! In just one class, he covered three topics normally covered in three or more sessions at other schools: Boolean logic related to intersections, joins, and unions; SQL database selections; and grid cell input/output layer selections (map algebra). Covering this much material in one class is a challenge, but the handouts and the clear progression of the classroom session showed a thoroughness and forethought that I have rarely seen.

     Led by Colonel Hendricks, cadets learn about the details of GIS operations.
    Led by Colonel Hendricks, cadets learn about the details of GIS operations.

    Most of us have suffered through classes taught by inexperienced graduate assistants, and many PhD college professors, although knowledgeable, are not very good instructors. That’s not good enough for the tight timelines at West Point — delivery of clear and concise classes that maximize learning is mandatory. It was evident that a lot of planning and thought went into each aspect of this robust GIS program.

    Colonel Fleming explained unique training elements that are part of the West Point curriculum, but not found in typical GIS programs. They include exposure to services and resources available to the military from sources like NGA, USGS, ACE, TEC (AGC), including tools such as GeoPDFs, BAE Systems’ SOCET SET, and others.

    GIS Enables Future Combat Systems

    The Army has always relied heavily on maps, and that has not changed. What has changed is the form those maps are taking, and the speed of communication needed to coordinate modern operations. So where is all this heading? Future Combat Systems (FCS). (For those of you unfamiliar with FCS, there are several compelling YouTube videos that show the concept; search for the phrase “FCS Vanguards.”)

    The impact of FCS is apparent in the curriculum. Just as the Navy moved to Aegis systems that link every ship, aircraft, sensor, and weapons system into an integrated fighting machine, the Army is making each piece of battlefield equipment — and every soldier — a data collector and data user. FCS ties everything together, and GIS is the spatial data integration environment. For you old Star Trek fans, think of the Borg. The big difference is that although cadets are taught to work as well-coordinated teams, they are also taught to think for themselves and show leadership.

    For more than two centuries, West Point has trained our military leaders. During that time, mapping and other technologies have changed significantly, and they continue to evolve rapidly. What hasn’t changed is the West Point commitment to excellence, and to “Duty, Honor, Country.”

     

  • Touched by a Multi-Touch World

    2009 ESRI Federal Users’ Conference – Washington DC

    By Art Kalinski, GISP

    The ESRI Federal User Conference, held February 18-20 this year, was a good forum for GIS practitioners and vendors to share new information — and to commiserate. Since the event took place in Washington, D.C., it was no surprise that the economy worked its way into most informal discussions.

    Many attendees that I talked with indicated mixed experiences: although some budgets are shrinking, putting certain projects on hold, the proposed massive federal spending on infrastructure bodes well for GIS usage. Overall, the prognosis was positive; the current economic situation promises a slight silver lining for GIS. The example of hardware stores doing well in a good economy, and even better in a poor economy, seems an appropriate analogy.

    Although there were no significant new “tools” in the “hardware store,” there were many refinements of existing software on display. ESRI and other spatial application builders continue the path toward integration, with GIS being a desktop, server, mobile device, or Web application.

    Both Google and Microsoft had expo booths demonstrating applications that integrate with ESRI products, bringing the best of both worlds together. The ESRI/Microsoft Silverlight integration of Virtual Earth was especially compelling. The result is GIS functionality in a much more graphically engaging environment. The big release of this integration will take place later this month, at the ESRI Developer Summit.

    What’s in Store for ArcGIS

    Dangermond and his staff demonstrated some of the new features and performance improvements in ArcGIS 9.3.1, which is planned for the second quarter of this year. They also discussed version 9.4, scheduled for release within a year.

    An especially interesting new capability that is currently available through the Web but will be part of version 9.4 is the Layer Package, which I’d describe as a GeoPDF “slice.” By that I mean that a user can create a map layer in ArcGIS and then export that layer as a complete package, including the data, the layer, and the symbology and cartography. So just as MAPublisher or GeoPDFs preserve the cartography, Layer Packages do the same, but for only one layer. This should be a great help to those that are cartographically challenged. Users will be able to e-mail the Layer Packages as well as publish them on CDs, or through ArcGIS Online for mash-up applications.

    Other aspects of version 9.4 include cartographic templates (another crutch for the cartographically challenged), CAD integration, better image integration, and 3D analytics to compete in the BIM world. There’s also something called “sketching” — a geographic design tool to display not what is, but what could or should be.

    The Magic Touch

    It looks like the multi-touch-screen environment will become commonplace, especially with the upcoming release of Windows 7. ESRI already has preliminary applications being tested for that environment. Is multi-touch just gee-whiz technology, or will it actually help people “raise the bar”? I don’t know; the jury is still out. I had the same uncertainty about oblique imagery, until I saw the significant positive impact it had on non-GIS professionals.

    DiamondTouch Table being operated by two users.
    DiamondTouch Table being operated by two users.

    One impressive device I saw in the expo that fits this new multi-touch environment was the DiamondTouch table from Circle Twelve. I’ve seen many similar devices, including the first-generation touch tables from Northrop Grumman, numerous other tables, touch-screen computers, a huge touch wall from Lockheed Martin, and even the iPhone. What separated the DiamondTouch table from most others was its price — it was in the $10,000 range, compared to the six-figure prices of earlier tables — and that it’s very intuitive.

    The DiamondTouch is able to keep track not only of multiple touches, but also multiple users. The upshot of that is that a group of people can gather around the table to collaborate on a project. Each member of the group can work on the table, which is able to distinguish the different users. But it doesn’t end there; these tables can be networked so the collaboration and identification of users can be maintained in remote locations. This would be a tremendous tool for emergency command centers, and since the operation is so intuitive, the technology could improve communication rather than interfere with it.

    Annotations are shown in different colors, depending on which user made them.
    Annotations are shown in different colors, depending on which user made them.

    Adam Bogue, the president of Circle Twelve, explained that the table was successful because of the ability to accommodate multiple users and because users had very fine and precise control when working on the table. The touch can be as precise as a mouse-click. Note the data in the picture below, which is normally not visible to the table’s users. It shows how precisely the table “sees” each user and interprets their inputs. Perception of the touches is very sensitive: a fine finger movement is interpreted differently from a fist or palm swipe.

     Touch, as the table sees it. Note the fine increments that define the touch.
    Touch, as the table sees it. Note the fine increments that define the touch.

    Bogue explained how a command center set up two tables, one horizontal and one vertical, as a visualization and collaboration tool. Ortho imagery was placed on the horizontal table, while oblique imagery was placed on the vertical. The ability to look down on the ortho and then up at the oblique felt very natural and speeded the perception of the common operational picture. Bogue also indicated that Circle Twelve’s software is designed to integrate with ArcGIS so multiple users could each create annotations, which are automatically saved as separate Shapefiles. He also indicated how useful the tables are for WebEx conferences. This is one of those technologies that is really quite helpful when done right, and Circle Twelve nailed it.

    Looking Forward — and Back

    Although there were more presentations than any one individual could attend due to the multiple tracks, this conference still seemed more digestible than ESRI’s annual mega-event: the International User Conference. There were only 3,000 attendees in D.C., compared to the 13,000 who will be in San Diego this summer. Despite the crowds, I will be there, and I’ll be sure to report on what I learn.

    One note from last month’s column on voxels: I was properly taken to the woodshed (or Bosun’s Locker, for us Navy people) by one of my readers last month regarding voxels. Robert Meyer of NASA’s Jet Propulsion Laboratory in Pasadena, California, pointed my attention to a 1995 paper by Alvy Ray Smith titled, “A Pixel Is Not a Little Square! (And a Voxel Is Not a Little Cube)” The full screed can be downloaded from ftp://ftp.alvyray.com/Acrobat/6_Pixel.pdf.

    In his paper, Smith correctly states that although we display our data as little grid squares or phosphorous rectangles, these are representations of a sample point — and a point, as any GISP should know, is not a polygon. And by extension, a point is also not a cube. I feel chastised, but somewhat honored and relieved that I was corrected by no one less than a rocket scientist. Thank you, Robert — the beers are on me next time I’m in Southern California.

     

  • Voxels: Not Your Daddy’s GIS

    Can statistics and GIS build a more accurate geospatial picture?

    By Art Kalinski, GISP

    I’m a little late with this month’s column, but it was for a good reason: I had the responsibility (and honor) of swearing in my daughter at her Navy Officer Candidate School graduation in Newport, Rhode Island. It was a bizarre feeling seeing her stand on the same drill deck where I stood 37 years ago.

    Seeing all those fine young men and women at the ceremony reminded me what a privilege it was to serve. I may not have thought so at the time, but now, years later, I know it was. Since you won’t hear it enough, to all of you who are or were on active duty: Thank you for serving your country.

    Of course, there are other ways to serve as well, such as creating technologies that can support our first responders and military personnel. A few months ago, I learned about one that was new to me: voxels. With computers growing in power and speed, and richer, more complex datasets being developed, it will surely become more commonplace.

    The term “voxel” grew from the words “volumetric” and “pixel”; it describes resolution in volumetric 3D space, not camera or flat-screen resolution. Think of it as the difference between a checkerboard and the construction toy Legos. Voxels are spatial data structures that not only describe 3D space, but can also display statistically fuzzy data.

    3D Models: Simulation vs. Reality

    For those of you not familiar with voxels, let’s start with GRID or Spatial Analyst, which is a grid cell-based GIS. (If you need a refresher, see my column in the June 2008 edition of GeoIntelligence Insider.) Spatial Analyst is similar to a checkerboard: a 2D space consisting of square cells with values defined in the cells by the checkers. You can even show 3D-like effects by raising or extruding each cell based on elevation data, and then draping an ortho image over the resultant surface.

    People call this 3D, but it really isn’t; no matter which way you look at the model, the draped image is still a 2D photo. The other limitation is that, for the most part, all the elevation starts from a theoretical ground plane. There is no easy way to show holes in the space such as overhanging cliffs, caves, bridge underpasses, etc. (Yes, I know there are ways to get around this limitation, but not elegantly.)

    There have been efforts to create 3D models of buildings using ortho imagery by extruding the buildings from their footprints, but since the side views of the buildings are limited, the quality is poor and limited to one side, if any. This is where geo-referenced oblique imagery has benefited 3D model creation. Since the geo-referenced oblique images show each side of a building in very high resolution and contain the data needed to automatically generate the 3D wireframes, the resultant models are very easy to create and are not only photo-realistic, but photo-accurate.

    Although the application is still in its infancy, 3D models are also where voxels show the greatest potential. Since each volumetric cell is a 3D object in 3D space, complex 3D objects are easy to define. Just like the Legos example, you can build almost any 3D object with voxels. But Legos are solid little cubes, whose presence and location are not ambiguous; they can be there, or not there, period. They are never “maybe there” or fuzzy in their location.

    Voxels have another key benefit: they can be statistically defined. By that I mean that each voxel can display the probability that it exists. If you have data that clearly defines a particular area, that region will have a very solid and unambiguous appearance. But if the data is missing, weak, or sparse, the area will appear porous instead. This is where the human observer’s mind can — and does — fill in the voids. The observer automatically understands that there is incomplete data in those places.

    Building Body Models

    Voxels have been around for a while in the video gaming industry, for the very reason that caves and overhangs can be displayed. Their most serious use, however, has been in building the images created from MRI (magnetic resonance imaging). There they have been a boon to physicians, who can manipulate the 3D images, viewing them from any direction. Additionally, each voxel can have varying degrees of transparency, aiding the physician in comprehending the objects he or she is reviewing.

    This is an ideal environment for voxels, since the MRI scan creates very complete datasets to populate the voxel space. Each MRI scan, like the one shown at left, is a 2D “slice” of the 3D object. Assembling all the slices creates an almost perfect 3D model.

    Image courtesy of Lockheed Martin.
    Image courtesy of Lockheed Martin.

    Voxels and Imagery

    There are many more ways of building 3D models that are not as easy as assembling finite, regular slices of a 3D object, and this is where things get complicated and messy. Kirk Smedley and Mark Pritt of Lockheed Martin are leading a team of researchers exploring ways to apply voxel technology to transform the traditional “TCPED” imagery chain. (For more information on this subject, you can contact Smedley at [email protected].) TCPED (short for tasking, collection, processing, exploitation, and dissemination) is shorthand for the well-established life cycle of imagery, from capture all the way to desktop application.

    Lockheed’s work is based on the groundbreaking research of Dr. Joseph Mundy at Brown University, who continues to work very closely with Lockheed. The Lockheed/Brown team is performing some very sophisticated investigations into 3D voxel model creation using multiple imagery and data sources. None are as clean as the regular slices of an MRI, but instead are statistical products that generate probability distributions. Think principal component analysis, factor analysis, and Eigen value decomposition.

    Yes, it hurts my brain to even think about those long-forgotten statistical methods, but for the brave few who are comfortable in those environments, the voxel is ideal — it can display very complex and imperfect data sets. Not only complex in size, shape, and location, but complex as temporal values and abstract probability distributions.

    This ability to display incomplete or imperfect data accurately in a 3D model is important to Lockheed’s clients. There are many video games or training simulators that provide photo-realistic environments; much of the imagery they use is simulated by cloning or modifying textures or images from real life. However, this technique is unacceptable for use by mission planners or first responders in combat or tactical situations. With lives at stake, they need to know exactly what they will face. The 3D model has to show true reality, and display unknown areas as “unknown” or “no data.” For example, in the 3D models that are created by Pictometry and PLW, if there is no satisfactory imagery available for part of a building, that part is shown as a plain, black surface. One can’t add in a fake window or door that has no counterpart in the real world. It’s much better to show the unknown as such.

    Voxels are especially well suited to show fuzziness or incomplete data not just as black, no-data representations, but as probability displays that can show fuzzy data as incomplete or semi-transparent voxels.

    The varying transparency of voxels can indicate the relative completeness of data.
    The varying transparency of voxels can indicate the relative completeness of data. Image courtesy of Lockheed Martin.

    Voxels are also ideally suited to create temporal models (which some prefer to call 4D models). Here again, the ability of voxels to display data as probability distributions is even more important for temporal data, which may be fuzzy in some locations and vary in fuzziness over time. Researchers are now looking at the possibility of populating voxel space with multiple images (ground stills, oblique aerial images, video, LIDAR, interior stills, CAD, GIS) in a kind of 3D statistical summary version of Microsoft PhotoSynth.

    We may eventually see a seamless environment, inside and out, with accurately represented data that was statistically assembled. This is not your father’s “points, lines, and polygons” GIS. Are you imagining the potential for the GIS community? I see this as yet another example of the CAD, GIS, imagery, and BIM worlds coming together for the benefit of first responders and the military.

  • A Clear Presentation Danger

    Will Pecha Kucha Rescue Us?

    By Art Kalinski, GISP

    Over the past year I’ve attended over a dozen GIS related conferences and sat through over a hundred presentations, most of them PowerPoint.  Just like the Dilbert cartoon below I’ve reached my limit of poor PowerPoint presentations and I feel compelled to get on my soap box.

    It’s been years since PowerPoint made its entrance but over the past year I still found myself suffering through absolutely horrible presentations. Several years ago there was a Dilbert cartoon in which Dilbert was explaining his side number 397. An audience member, who was actually paying attention, could take it no more and with a scream passed out.  Wally, who had been sleeping, examined him and declared “PowerPoint Poisoning!”  This may be funny but it strikes too close to reality.

    image001

    Over the past year, I’ve attended more than a dozen GIS-related conferences and watched at least a hundred presentations, most of which were conducted in Microsoft PowerPoint. It’s been years since this now-ubiquitous software made its entrance, yet I still find myself suffering through absolutely horrible presentations. PowerPoint has made slide creation so easy that neurotic presenters with no skills, no taste, and no judgment are free to make us squirm in our seats. I’ve finally reached my limit, and I feel compelled to get on my soapbox.

    First, a little history from an old guy who did presentations in the early eighties the hard way: with a grease pencil on overhead projector glass. In the late eighties I was lucky enough to be at a command where the graphics department could create professional-looking transparencies or 35-millimeter slides. The slides looked good, but because of the cost and hassle involved, presenters thought through their points carefully and used the slides sparingly.

    In the early nineties, Harvard Graphics and PowerPoint hit the streets along with LCD projectors, and what should have been a wonderful tool quickly became a curse to many. Edward Tufte, the well-known author and Yale professor of information design, railed against PowerPoint. He used the famous 1869 graphic by Charles Joseph Minard of Napoleon’s march to Moscow as a superb example of the right way to communicate data graphically. This graph is still considered the single best example of elegant simplicity in using a map to display spatial and temporal data.

    Charles Joseph Minard created this "figurative map" of Napoleon's march to Moscow. The image shows the route of the army's march, the temperature, and personnel attrition over time. The brown band represents the men who enter into Russia, and the black band represents those who leave it.
    Charles Joseph Minard created this “figurative map” of Napoleon’s march to Moscow. The image shows the route of the army’s march, the temperature, and personnel attrition over time. The brown band represents the men who enter into Russia, and the black band represents those who leave it.

    That’s how it was done in olden times: slow, deliberate, and thoroughly thought out. PowerPoint has facilitated the exact opposite behavior, with legions of presenters using the high-tech tool as a toy. I remember sitting thorough a presentation given by a senior executive of a major power company in Georgia. It was about a year after Microsoft added sound effects and the bullet fly-in feature to PowerPoint, and this presenter had each bullet fly in with a unique animation and sound effect. After a few minutes, no one was paying attention to the content; the audience chuckled and murmured, trying to predict which effect would come next. The only thing that presenter was missing was a big red nose and floppy shoes.

    Worth a Thousand Words

    In the GIS community, we are especially lucky, because most of our content is a graphic representation of spatial data. I think that’s what attracted me to GIS — its graphic visual nature. In GIS classes I’ve taught, I frequently pointed to a universal human characteristic: our learning, memory, and perception are very much graphically oriented. As an example, I cited the work of scientists who determined that the average person has almost 200,000 discrete human faces in their mental database. That’s pretty amazing, considering the relatively minor differences between faces; we have such discerning powers of observation that even Hollywood impersonators can’t fool most viewers. Of the thousands of Elvis impersonators, many come close to the real thing, but I have yet to see one that’s spot-on.

    So I encourage people to take advantage of that human trait and use graphs, maps, imagery, and photos — not text — as visuals in their communication. Most PowerPoint trainers recommend using very little text, and limiting a presentation to no more than 35 slides and no more that 25 words on any given slide. They also caution to never, ever read the slides aloud. The slides are supposed to enhance the presenter’s presentation, not replace the presenter. My feeling about any presenter that reads his slides aloud is: Save yourself the trip! Stay home and just e-mail me your PowerPoint.

    Good Tools, Bad Results

    One problem with computers is that anyone can produce content that is technically perfect, such as documents, maps, or slides. But technically nice lines and fonts don’t guarantee a good-looking or effective end result. I learned that when I was the GIS Manager for the Atlanta Regional Commission (ARC). In the mid-nineties we started publishing our GIS data on CD so our ARC users could create their own maps. The results were some of the worst maps I’ve ever seen. We quickly learned that when wielded by someone with no cartographic or artistic skills, even sophisticated GIS tools could result in horrid presentations.

    The same held true for Internet projects. In the early years of the Web, the new technology was difficult to master quickly, so we hired a computer firm specializing in Web site creation. I remember asking the company owner about the challenge of finding good HTML programmers. He surprised me with his answer: it was relatively easy to find programmers, but he couldn’t teach them how to be artists and create content that looked good. He said it was easier to start by hiring good artists, and then teach them the programming skills needed to create Web sites.

    And that’s the problem with PowerPoint: Learning the software doesn’t guarantee good presentations. In addition to knowledge of the software, good presentations require artistic talent, a command of the material, and exceptionally good judgment as to how to communicate with your audience.

    I think that many people who overdo PowerPoint do it out of insecurity; they want to show everyone how complicated their job is, and how much stuff they handle. While I was at ARC, I tried countless times to convince our planners that more is less. Frequently they would conduct slide shows containing 80 to 90 slides, with many slides containing more than 100 words each. When these “planning shows” were scheduled, you could see the look of dread on the faces of our board members. The old “I just got a silent-ring cell phone call and I have to leave the room” trick was used frequently.

    Trimming the Fat

    Thankfully, some of these problems have been partially addressed. Good-looking, interactive GIS maps can now be created using ESRI’s MapPublisher, TerraGo’s GeoPDF, or some of the Adobe PDF map formats. All permit the preservation of color schemes, fonts, line widths, symbology, and other cartographic elements in the interactive environments.

    Many companies and conference organizers try to improve the artistic aspect of PowerPoint presentations by requiring presenters to use a standard conference template. But that only standardizes the look, without affecting the content or the way it’s delivered. Now, there’s finally hope that tediously long presentations may get reined in as well.

    There is a relatively new trend you’ve probably heard of called Pecha Kucha (Japanese for “chitchat”). Many pronounce it the way it looks, although the proper pronunciation is “peh chach ka.” This patented presentation method was started by architects Mark Dytham and Astrid Klein. While working in Japan, they would hold shows for young designers. Since they wanted to give many designers the opportunity to show their work, they developed a fast-paced format that limited each presenter to 20 slides and only 20 seconds per slide. The end result was a short presentation: just six minutes and forty seconds.

    Think about the ramifications of this. Just like a “thirty-second elevator pitch,” presenters had to really think through their presentations and distill their material down to only the key points. Currently, most conferences give presenters twenty minutes, plus another five to ten minutes for questions. With a seven-minute limit per session, there can be more time for questions, or for more presentations. The trend is spreading like wildfire: Autodesk is hosting Pecha Kucha nights during conferences, and Bentley and some universities are doing the same. ESRI has tested the format at some local conferences, and the 2009 Annual URISA Conference will have a Pecha Kucha night that I’m looking forward to participating in. My current PowerPoints have fewer than thirty-five slides, and fewer than forty words total, but I’m working to whittle that number down to twenty.

    If you want to learn more, check Google or YouTube, which have many examples to choose from. I promised myself that every time I’m subjected to a poor PowerPoint presentation, I’m going to give the presenter a copy of this article. Maybe you could do the same, and we can collectively raise the bar and see fewer bad presentations in the coming year.

    Well, it’s time to get off the soapbox. So, if you aren’t neurotic, and you’re confident with your knowledge and position, try giving your audience more by giving them less — adopt Pecha Kucha and help cure PowerPoint Poisoning.

     

  • GIS Gives Simulators More Realism

    IITSEC 2008.
    IITSEC 2008.
    What is a GIS guy doing at a training simulation conference? Having a lot of fun — and learning that GIS makes everything better.

    By Art Kalinski, GISP

    Last week I attended the Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) in Orlando, Florida. It was an international gathering of more than 16,000 attendees, both military and civilian, that featured some 550 exhibits focusing primarily on military-related training and simulation. I know that Geospatial Solutions is a GIS-focused publication and that most of you are GIS professionals, but this conference clearly demonstrated the merging of many disciplines in formerly unrelated communities, including GIS.

    When we hear the word “simulators,” we generally think of flight simulators — and there were many of those on display — but the exhibits also included ground combat, medical, logistic, and cultural immersion simulators. This conference demonstrated the most realistic and up-to-date training and simulation tools available in the world today, and GIS played a fundamental role as the underpinning of many applications. Autodesk, ESRI, and 3D model builders Precision Lightworks all had booths at the four-day event.

    One interesting terminology quirk that I noticed is the difference in usage of the term “database.” We GIS folk generally use the word to describe our vector data and attributes, with imagery as separate layer. But in the training environment, the term is used to describe all the datasets that feed the simulators, including maps, imagery, GIS data, DEMs, CAD drawings, photos, objects, characters, TINS, wireframes, draping textures, skins, etc. The overlap with the video gaming community is significant, but GIS is growing in importance as many applications strive for real-world connectivity.

    Experiencing the Exhibit Hall

    Some of the exhibits showed a significant investment, not just in the technology but in the displays themselves. It was apparent that training and simulation is a big business, with lots of dollars at stake. One exhibitor summed it up this way: “With aircraft and ships costing tens and hundreds of millions each, simulators are a low-cost way of building competence without risking expensive equipment.” The same holds true for soldiers in the field. Actual combat is not the place to conduct training, and everyone is striving to create training that is so realistic that it is indiscernible from actual combat.

    Many exhibitors showcased new display technology, such as very high-resolution projectors from Sony. Most simulators used large flat screens, tripled in some cases to provide panoramic views. One flight simulator used nine separate screens, but even more impressive were large concave screens similar to IMAX. that provided realistic and seamless images, even in 3D.

    Big screen display technology.
    Big screen display technology.

    Some trainers used head-mounted displays (HMDs) for combat action scenarios, but an unusual addition was a 10-foot spherical cage for humans that resembled a giant hamster ball. The subject enters the cage wearing a wireless HMD, and can move in any direction responding to the HMD display and program. The cage was so well designed that it moved with just light finger pressure. Users indicated that getting used to walking or even running in the cage became natural quite rapidly.

     Users indicated that walking in the cage — or even running — became natural quite rapidly.
    Users indicated that walking in the cage — or even running — became natural quite rapidly.

    Some of the exhibits showed significant expense, not just the technology but the displays themselves.  The Augusta Westland helo trainer was one example.

    The Augusta Westland helo trainer.
    The Augusta Westland helo trainer.

    It was apparent that training and simulation is a big business with lots of dollars at stake. One exhibitor summed it up stating, “With aircraft and ships costing tens and hundreds of millions each, simulators are a low cost way of building competence without risking expensive equipment.” The same holds true for soldiers in the field.  Actual combat is not the place to conduct training and everyone is striving to create training that is so realistic that it is indiscernible from actual combat

    I expected to see more simulators that imitated the movement of flight, but as one of the exhibitors told me, the motion and G forces of jet fighters are so great that simulators can’t even come close — so they replicate other aspects of the experience instead. Two motion simulators that were effective included a helicopter flight and gunner simulator, and a Hummer simulator that recreated the motion of a vehicle struck by an improvised explosive device (IED). The shock and rollover over of the vehicle trained soldiers how exit a turned over vehicle while under fire, the goal being to simulate and practice what could happen so there were no surprise situations.

    Vehicle rollover trainer.
    Vehicle rollover trainer.

    Lockheed Martin featured a shipboard engine-room simulator that enabled the training of engineering personnel by simulating various casualties and damage control actions, without risk to people or equipment. The operation was very similar to a video game, with realistic characters responding to the commands of the trainee. As a former Navy Surface Warfare Officer I had to try my hand at the Kongsberg ship bridge simulator. I can attest that not only did the simulator look good, the physics, behavior and reaction of the ship was dead on accurate.

     As a former U.S. Navy surface warfare officer, I had to try my hand at the Kongsberg ship bridge simulator. I can attest that not only did the simulator look good, but the physics, behavior, and reaction of the ship were dead-on.
    As a former U.S. Navy surface warfare officer, I had to try my hand at the Kongsberg ship bridge simulator. I can attest that not only did the simulator look good, but the physics, behavior, and reaction of the ship were dead-on.

    There were numerous small arms trainers and ranges on display that were capable of training individuals, multiple trainees, and even groups acting as teams within a combat environment. I also saw countless examples of wearable gear that permitted simulation of small arms combat using of laser weapons to simulate hits. Numerous urban building mock-up trainers incorporated video displays, realistic sounds, and even explosions and smoke.

    Weapons team training.
    Weapons team training.

    Medical simulation included traumatic injuries and triage scenarios played via video screens. Sickeningly realistic moulage kits imitated all types of injuries, complete with exposed bones and spurting blood. There were many exhibits of peripheral equipment and supplies such a carrying cases, communication gear and even very high quality surface coated mirrors for projectors and displays. One little gem that I hands-on tested at the ESRI booth was a 3D mouse by 3D Connexion.  The “Space Navigator” was the smoothest, most intuitive, most precise, quality feeling mouse I’ve ever used.  I’m getting one.

    3D mouse.
    3D mouse.

    An area I found fascinating — because I didn’t expect to see it — featured exhibitors that focused on human simulation and cultural immersion. DI-Guy and MetaVR were displaying human simulations of crowds that looked realistic and could be programmed to behave in various ways, with each character acting as both an individual and part of the group. The photo shows a Mideast group walking toward an infantry squad while hiding two terrorists in their midst.  Some of the video characters are a little blocky, but new techniques derived from the video gaming industry include draping “skins” on mesh frames instead of boxes or tins. The end result is smoother-looking characters and objects, such as flowing robes.

    Computer generated crowd.
    Computer generated crowd.

    One exhibitor that displayed human motion capture tools used by Hollywood to create animations. They had a young dancer wearing a capture suit whose motion was transferred to a character on a video display. She won the unofficial endurance record since she danced continuously during the four-day exhibit hall operation.

    Human movement capture.
    Human movement capture.

    Another exhibitor, the Tatitlek Corporation, takes cultural immersion to the extreme with live, culturally correct role players that recreate Middle Eastern environments. The live players create the look, sounds, and feel of being in the region, so that it’s not a shock for our troops when they arrive in-theater. Tatitlek displayed one example of their cultural simulations: a sheik’s tent complete with rugs, seating, accessories, and even staged arguments and police intervention.

    Live cultural immersion.
    Live cultural immersion.

    Enhancing Reality with GIS and Imagery

    So how does GIS fit into this community? As I learned from people that have been in this business for years, training simulation first evolved from physical mock-ups to computer-based, CAD-like “cartoon” environments that were only loosely tied to reality. It was considered a challenge to get an image up on the screen that represented reality and make it move around in response to the trainee, but that’s no longer good enough. Now imagery and GIS-referenced data is enhancing the entire environment.

    Lockheed Martin was a big presence at the conference, and created a buzz with flight simulation systems that incorporated photo-realistic and photo-accurate oblique imagery and 3D models into geo-referenced applications that simulate weather conditions and even provide night-time views. This kind of accurate simulation achieves realism not previously seen, and now has captured the attention of mission planners, who have significantly different needs from trainers. The mission planners, as their title implies, plan real missions just before actual execution. For their work they need up-to-date information that is accurate, geo-referenced, and measurable. They cannot tolerate made-up data or imagery — it may be perfectly fine for training, but could be disastrous if relied upon for real execution. The bar has been raised.

    Attending I/ITSEC, I could see the growing convergence of GIS, CAD, BIM models (see my August column for the BIM – GIS convergence), computer display technology, and the training/simulation applications. It’s amazing to watch how everything is coming together. An especially interesting system displayed by the Navy was a flight simulator that collected brain wave data and recorded images of the pilot’s eyeball movements.

    Human factors flight simulator.
    Human factors flight simulator.

    As I viewed this rig I couldn’t help but recall a photo I saw at Moody Air Force Base of an early flight trainer crafted from plywood and broom handles. Imagine how alien this new Navy system would look to the designer of that plywood trainer. I wonder where we will be in 20 more years.

     

  • Right Oblique . . . March!

    A complex base-mapping project spawns new techniques — and brings the power of oblique imagery to the military.

    By Art Kalinski, GISP

    When I started basic training and learned the marching command “right oblique march,” little did I know that the term “oblique” would become a capstone of my GIS career. As most readers know, I was a career naval officer who set up the Navy’s first GIS in the mid-eighties. After military retirement and graduate work at the University of North Carolina, I served as the Atlanta Regional Commission (ARC) GIS Manager until I retired early to join Pictometry last year.

    I did so because, much to my surprise, oblique imagery was not being used by the military. In Atlanta, we saw such a dramatic improvement in the effectiveness of first responders using oblique imagery that I felt compelled to help bring this technology to our troops in the field. The first major oblique imagery project that I managed was imaging all Marine Corps Bases in the continental United States.

    The United States Marine Corps contracted Pictometry International and the engineering firm PBS&J to image every USMC base in the continental U.S. with high-resolution ortho and oblique imagery. The imagery was captured from late 2007 through early 2008 and delivered to Marine Corps headquarters for installation in the East and West Coast GeoFidelis GIS systems. Capturing the imagery was uneventful, except for scheduling flights around base exercises and a solving a technical issue that was keeping us from shooting the high-altitude Marine Corps Mountain Warfare Training Center in Bridgeport, California.

    We assisted with the installation of the imagery and software at the East and West GeoFidelis computer centers in a CITRIX environment. After the installation, eighteen user-training classes were held at ten Marine Corps bases.

    Students in the USMC user-training classes learned about oblique imagery, the viewing software, and ESRI ArcGIS integration.
    Students in the USMC user-training classes learned about oblique imagery, the viewing software, and ESRI ArcGIS integration.

    The contract also called for a Public Works Implementation Plan and a Fire Protection Implementation Plan. Several other projects — including a 3D interactive model for security use, an oblique mosaic of a base to replace a large wall photograph lost in a major fire, and a proof of concept demonstrating the integration of oblique imagery with TerraGo GeoPDFs — were also completed.

    Quality Control

    I personally reviewed all the imagery for completeness of coverage, and individual images were spot-checked for image quality. The initial Quantico imagery had too much snow cover to be useful; it was reshot later in the season when the snow had melted. Snow obscures ground details, and the white reflections create excessive contrast that diminishes the visibility of adjoining features.

    All imagery from five directions — north, south, east, west, and ortho — had complete coverage, with the exception of the west view imagery of Miramar. Heavy winds had caused the aircraft to drift off course, resulting in a gap in the oblique imagery from the west view. The other views fully cover the two-square-mile area, and although this falls within quality standards, it will be reshot later this year. This is an error rate of only .02 percent.

    Technical Difficulties

    Oblique imagery had never been collected at the high altitudes needed to photograph the Mountain Warfare Training Center, located about 30 miles east of Yosemite Park. The problem was that the hard drives used to record the imagery couldn’t operate above 10,000 feet. Hard-disk magnetic recorders require a minimal air density in order to separate the record heads from the magnetic media with a microscopic air layer. Low air pressures at 14,000 feet cause the record heads to “crash,” or come in contact with the magnetic surface of the record media. Significant engineering time and experimentation ultimately solved the problem.

    The initial solution was to use pressurized rotating media with high-altitude specifications. This solution functions at up to approximately 16,000 feet above mean sea level, but is not fully reliable. The drives also have slower transfer rates, so more drives were needed in the aircraft for efficient capture. There are other limitations of the rotating technology that are not desirable for a long-term solution, but the capture was accomplished. Engineers are currently testing a more promising technology for high-altitude capture using high-speed, solid-state drive technology. Early examples of this technology proved to be too slow for efficient capture, but new versions of the equipment are showing more promise.

    There were concerns that a CITRIX deployment of the imagery and viewing software could have speed problems. Additionally, the Marine Corps is moving to ArcServer technology, so engineering time was devoted to alternative solutions. Engineers developed thin-client viewing software that could be used if needed.

    Something New: An Oblique Mosaic

    During the course of the contract, a feasibility question was raised: Was it possible to merge individual oblique images to create a base-wide oblique image? This idea was prompted by the loss, during a building fire, of a large traditional aerial photograph. Engineers developed a technique to tile and seamlessly merge multiple oblique photographs to form what looks like a single high-altitude — yet high-resolution — oblique image. This was especially challenging since oblique images don’t edge-match easily; each image has a different perspective, with each pixel being a different size and not rectangular in shape. Those challenges were overcome, and a single base-wide oblique image was created to replace the destroyed aerial photograph. Since the large mosaic was created from many low-altitude, high-resolution obliques, the final large oblique image had very fine resolution throughout.

    3D Models

    One of the deliverables requested under this contract was an interactive 3D model of a high-visibility location in the Washington D.C. area. The location presents security and logistics challenges, so an interactive 3D model will be very useful. The “wire frame” model was created from multiple oblique images by Precision Light Works (PLW) with a semi-automated process similar to stereo pair analysis.

    Once the wire frame is created, the same imagery is automatically draped on the 3D model to create not only a photo-realistic model, but a photo-accurate model — meaning that features are accurately located on the models. The 3D model created by PLW can be used in various software viewers, including Google Earth. Some 3D viewers can also do measurements within the 3D model.

    Public Works Report

    PBS&J worked with Pictometry engineers to develop an implementation plan using oblique imagery for public works applications. One public works application surfaced because there was a need to conduct a survey of runway approaches to determine whether trees had grown into the glide paths or if unauthorized construction had occurred within the glide paths.

    The traditional method to accomplish this task was with survey crews sighting and measuring objects on site — a time-consuming task. The ability to measure heights of vertical features made oblique imagery a natural choice for this application. PBS&J tested the concept and demonstrated the feasibility of doing surveys with the imagery, but more work will be needed to test the accuracy of this method and ultimately receive certification.

    Fire Protection and Emergency Response Report

    Another use of oblique imagery, which received significant publicity, is its use as a planning tool for firefighters en route to a fire. The imagery permits the firefighters to get the lay of the land, measure distances to fire hydrants, and view accessibility.
    Many counties using the oblique imagery have statistically measured a reduction in fire attack time of 60 to 90 seconds.

    This is a significant improvement, and the Marine Corps wanted to provide this advantage to their firefighters. The contract called for a firefighting implementation plan, and we had veteran Battalion Fire Chief Wayne Harper on our team to develop one. Paper reports have always left me cold, so I asked Harper, Why not deliver a functioning laptop, similar to those used by other firefighters, as a deliverable with the plan? We did exactly that, and delivered a fully functional Toughbook laptop configured with oblique imagery, GIS data, and software that could be used in fire trucks for tactical planning. This hands-on working example went further than just a paper report, and should facilitate the installation of similar capabilities on all USMC fire trucks.

    Taking the Lead

    Usually the Marine Corps is at the “tip of the spear” in world conflicts and combat situations, but rarely are they in the lead when it comes to technology. With this oblique imagery project, the USMC has certainly moved to the forefront with oblique imagery technology.

    Although not part of the Marine Corps contract, the development work done to complete the contract underpinned potential war fighter applications. The research and testing clearly points the way to make this technology available to deployed combat units in-theater in an operational mode that could provide near-real-time imagery to ground troops. To this end, Pictometry recently signed an alliance partnership with a leading defense contractor to work on a number of related military projects.

    Photos: Art Kalinski

     

  • GEOINT Transitions to the Future

    By Art Kalinski, GISP

    Attending the GEOINT 2008 conference was like drinking from a fire hose: too many superb sessions by top leaders in the field, and more than 120 exhibitors on the show floor. In a short amount of time, this community has transformed itself. Just three years ago there were many contractors offering data and imagery, but very little in the way of integration and analysis tools. This year almost all efforts were pointed toward integration, with fast evaluation and response.

    Keynote speaker Retired Air Force Lt .Gen. James R. Clapper, Jr.
    Keynote speaker Retired Air Force Lt .Gen. James R. Clapper, Jr.

    The opening session keynote speaker was the current Undersecretary of Defense for Intelligence, retired Air Force Lt .Gen. James R. Clapper, Jr. He addressed the need for integration of intel sources and explained how difficult it is to achieve, because of security concerns about sharing data among agencies and coalition forces. He expressed apprehension about managing the flood of data — how will we sort out meaningful information from the torrent? Clapper discussed the growing uneasiness over our vulnerability to cyber attacks, and noted that new developments in biometrics make identification of terrorists easier, but complicate the ability of our forces to infiltrate hostile groups.

    General Clapper then compared the Cold War, which presented us with an enemy that was static and predictable, with the irregular warfare of today. Gone is the old environment that permitted the intel community to take days to identify and evaluate threats; now we must identify threats in mere hours by observing patterns of life and individual behavior. Clapper stated that we have become very good at precise attacks, but we still have a long way to go to prevent attacks.

    Integration on Display

    In the exhibit hall there were countless examples of improvements to existing technology, with many efforts toward data integration. There were also a few new developments on display.

    Image_003
    BAE Systems created a significant buzz — including strong mention by another keynote speaker, Maj. Gen. John M. Custer — with its new SOCET GXP system. The system grew out of SOCET SET and breaks down the wall between image analysis and geospatial analysis to an environment that the company calls Extreme Analysis. It combines imagery, geo data, metadata, attributes, and analysis tools into one unified package.

    Image_004Lockheed Martin demonstrated a very interesting capability. Starting with 3D models created by PLW with Pictometry imagery, Lockheed transforms the models with complex algorithms to reflect night-time views or varying weather conditions, with very realistic results.

    Speaking of Lockheed, the aerospace company used the conference to announce that it has signed an agreement to collaborate with Pictometry. The two companies will develop next-generation visualization tools for both domestic applications and in-theater, near-real time oblique imaging and 3D model creation using manned and unmanned aircraft.

    FortiusOne demonstrated its Web-based service that bridges GIS and GeoWeb services with very user-friendly tools that access a huge global database of coverage designed for non-GIS-trained users. The Web service not only permits the viewing of maps and data, it also allows viewers to add their own data. One example was flood maps that could be enhanced with local data and then saved as printed documents or PDFs.

    I also saw a demonstration of Zebra Technologies’ holographic video table, which displays full-motion video as a 3D hologram similar to the still holograms that Zebra has previously developed. While viewing the holodeck-style platform, I half-expected to see Princess Leia appear and ask for help. The technology is still a long way from prime time, but it was amazing to see full-motion video as a hologram.

    Getting Results

    The most impressive keynote session was given by Maj. Gen. John M. Custer, Commander of the U.S. Army Intelligence Center at Ft. Huachuca. He was probably the most passionate speaker, and clearly had a sense of urgency about his mission. He heads the intel training efforts for the U.S. Army, and described how they transformed training of intel people to be as realistic as possible so that soldiers leaving the training can hit the ground running.

    General Custer addresses the crowd during his keynote speech.

    That’s one thing about military training that impressed me early in my career: they have to get results. You can’t pretend to get a ship under way, you have to actually do it on schedule. You can’t philosophize about getting rounds on target, you have to actually do it. Having an education background, I was completely dumbfounded when I joined the Navy and saw 19-year-old kids do more effective teaching than I had experienced in high school and college. There is no better example than the work done at Ft. Huachuca.

    General Custer played a very fast-paced video showing the results; it depicted intel specialists in the field supporting their own unit under fire. They were receiving intel from many sources — satellite imagery, database from interrogations, intercepted communications, aerial imagery, down-linked video, and video from field robots in hostile fire locations — all of which were integrated and analyzed into actionable intelligence that saves lives and accomplishes the mission.

    Getting there was not easy, and the General had to overcome many hurdles, including getting live data feeds so the soldiers could train on current, real-life data. Custer’s goal was to have a training environment that was absolutely indistinguishable from the actual combat environment. He indicated that all tools are moving from thick clients to thin clients and that UAVs are playing and increasing roll in the battlefield. Brigades will be working with up to 32 UAVs, with 18 of them in the air. As a result, their data centers will be dealing with petabytes of data. Custer cited an interesting statistic he developed. He observed that in each war cycle since WWII the number of troops was only 10 percent of the previous war, but the needed data bandwidth increased 100-fold.

    The video was powerful, and Custer shared how he had personally presented the flag at over 25 military funerals to grieving widows and parents — a life-changing event. I can tell you from personal experience that he is absolutely correct. It’s one thing to attend a funeral of someone that has lived a long and fulfilling life. It’s totally different to see very young children standing in front of the boots and helmet, knowing that they will never know their dad who died for his brothers and to keep the rest of us safe. General Custer received the longest, strongest standing ovation that I’ve seen in years.

    As I looked around at the crowd I reminded myself that these are the people that have been instrumental in preventing another major attack on this county. I was reminded of the Irish Republican Army after a thwarted bombing of 10 Downing Street. The spokesman was quoted saying that Scotland Yard was lucky this time, but the Yard will have to be lucky every time — and the IRA will only have to be lucky once. I’m hoping that with everyone’s hard work we will make our own luck.