The WeWALK cane attachment and app was produced with partnerships with Microsoft and Imperial College London. (Image: WeWALK)
While some may only think of GPS technology as a convenience when driving a car or hiking, for many, GPS is a necessity. Through navigation devices, adaptable software, and mobility aids, GPS technology has become a vital part of accessibility efforts to support people with hearing loss, deafness, or visual impairments.
The World Health Organization estimates that at least 2.2 billion people are living with a vision impairment, and 430 million people are living with a disabling level of hearing loss. For these billions of people, everyday tasks such as navigating a new city or using public transportation can be a challenge. GPS technology gives people the independence needed to meet these challenges with confidence.
Damato
GPS technology in handheld navigation devices and adaptable software promotes accessibility and assists individuals with daily tasks. Accessibility features that rely on GPS technology can give users turn-by-turn directions to any destination, detailing the terrain, surroundings, and even relevant bus or metro stops along the way. Vibration signals complement voice directions to help users navigate busy areas and intersections regardless of visual or hearing abilities. These accessibility features make new spaces more accessible to people with vision and hearing loss by leveraging the ease and accuracy of GPS navigation technology.
Through innovative technologies and accessibility features, GPS also enables users to explore their surroundings. The “around me” feature on many GPS applications will read aloud descriptions of, and distances to, businesses, street names, and transportation options in the surrounding area. These resources allow individuals with hearing or vision loss to explore their communities and complete daily tasks worry-free. Interactive applications let users move their fingers along a screen while the device reads out street names and provides directions, helping users find their way in unknown locations. This ensures users have all the information they need to be confident exploring new places on their own.
In addition to helping individuals with vision and hearing loss navigate their surroundings, GPS technology also promotes safety and ensures individuals can be quickly located in the event of an emergency. For example, location tracking apps allow users to share their exact location with family and caretakers, promoting individual autonomy while also ensuring safety. If an emergency does occur, GPS technology helps emergency services quickly and accurately locate individuals and provide care.
From navigational accuracy to safety monitoring, the GPS Innovation Alliance (GPSIA) is proud to support the role of GPS technology in creating a safe, more accessible world for individuals with hearing or vision loss. Innovations in GPS technology, such as real-time location information and direction signaling, are changing the field of accessible technologies. GPSIA will continue to advocate for policies that promote and support the application of GPS in this field, encouraging all individuals to confidently lead an independent life.
UAvionix Corporation’s aircraft AV-30-C panel display has received STC (Supplemental Type Certification) approval from the U.S. Federal Aviation Administration. The AV-30-C offers pilots an effective and affordable altitude indicator (AI) or directional gyro (DG) replacement with additional features.
AV-30-C is installable as either an AI or DG and adds a suite of in-flight information to the panel out of the box, including GPS navigational data, a probeless angle of attack indicator, baro-corrected altitude, indicated/vertical/true airspeed, non-slaved heading, bus voltage, G load and more with additional features to be announced.
AV-30-C is designed to fit into nearly any aircraft with a three and one-eighth inch round instrument slot without cutting or modifying the panel. By mounting from behind the panel, AV-30-C preserves the aircraft’s original classic look while bringing the latest that modern avionics has to offer to the panel.
The AV-30-C STC provides authorization to install in FAR Part 23 Class 1 and Class 2 aircraft (singles and twins weighing less than 6000 lbs) that are listed on the AV-30-C Approved Model List (AML), containing 635 Aircraft models including Cessna, Piper, Beechcraft, American Champion, Maule, Boeing, Swift, Mooney, Aviat and others. The full AML is available at uAvionix.com/AV-30.
AV-30-C works as a single primary instrument or by installing two units, one as an AI and another as a DG. The aircraft’s original failure-prone vacuum pump system can be removed to further benefit from a fully digital primary instrument cluster.
AV-30-C extends its functionality outside the cockpit as the companion to tailBeaconX, the latest 1090/ES ADS-B transponder with Aireon support for worldwide use and future mandated airspaces. Upon tailBeaconX TSO certification, AV-30-C can double as tailBeaconX’s control interface, allowing the pilot to set the mode and squawk easily, while maintaining AV-30’s existing feature set. tailBeaconX with AV-30-C removes the need to drill additional holes in the airframe to satisfy requirements in countries outside the U.S. and keeps installation costs to a minimum.
“uAvionix is creating avionics with fundamental engineering advantages,” said COO, Ryan Braun. “These are beautiful, no-compromise certified avionics designed to deliver an affordable total cost of ownership. The AV-30-C provides an innovative probeless angle-of-attack and non-slaved directional gyro, both designed to dramatically lower the cost of installation without compromising performance. Where other avionics seem designed to be replaced, the AV-30-C will get better with age. We’re actively developing ADS-B In, electronic flight bag, transponder, and autopilot integrations to ensure AV-30-C becomes an indispensable instrument for every panel.”
AV-30-C will support third-party autopilot systems via the APA-MINI adapter, interfacing AV-30’s heading bug with legacy autopilots. The APA-MINI autopilot adapter is expected to be released in early 2021, with more advanced autopilot integrations to follow.
Harris Corporation’s Jason Hendrix discusses the company’s capabilities for GPS navigation satellites at ION GNSS+ 2018, which took place Sept. 24-28 in Miami.
Aerial refueling requires highly precise relative navigation. (ILLUSTRATION: Charles Park)
Future UAVs will require relative navigation capability to fulfill a broad range of assisted manned and unmanned missions. A new approach, demonstrated in application to aerial refueling, provides access to accurate relative time-space positioning information (R-TSPI) between platforms.
By Shahram Moafipoor, Jeffrey A. Fayman, Lydia Bock and David Honcik
The advent of unmanned aerial vehicles (UAVs) highlights the importance of precise relative navigation information for safe use of UAVs in many application areas. Future military and civilian UAV applications will increasingly require capabilities such as
sense and avoid
swarming
vehicle-to-vehicle (V2V) platooning
docking
autonomous landing and
autonomous aerial-refueling,
all of which require access to accurate relative time-space positioning information (R-TSPI) between platforms.
In this article, we present the foundation for a generic approach to relative navigation capable of meeting the full range of relative assisted manned and unmanned operations. We present a relative extended Kalman filter (R-EKF) that integrates line-of-sight relative observations from GPS as well as non GPS-based onboard sensors measuring relative bearing and/or relative distance. Multi-sensor fusion provides enhanced system integrity and robustness to partial or total lack of GPS-satellite navigation (GPS-denied). The relative navigation system described here uses these technologies, providing up to 100 Hz R-TSPI with an accuracy of up to ±1.0 m (a function of relative distance), ±0.1 m/s velocity and ±0.5º attitude. The system can be applied to a variety of relative navigation applications; here we focus on its use in aerial refueling.
132d Air Refueling Squadron. A Boeing KC-135R Stratotanker refuels an F-22A Raptor. (Photo: USAF)
AERIAL REFUEL CHALLENGES
Automated aerial refueling for manned and unmanned platforms is a challenging problem requiring accurate R-TSPI. The Geo-RelNAV system provides a key measurement for aerial refueling: the vector closure rate, the differential velocity between the tanker and refueling aircraft. The closure rate is monitored in real time onboard the tanker. The measurement can be used to:
maintain safety-of-flight by ensuring refueling aircraft do not exceed a certain velocity,
determine whether or not a refueling aircraft is approaching the tanker with sufficient velocity, and
provide data to drogue-control engineers to improve control law design.
As a GPS/INS system, Geo-RelNAV can produce a relative navigation solution at a faster sample rate than GPS alone. Solutions are available via serial and/or Ethernet (both TCP and UDP) providing input to external systems as well as the tools for analysis engineers to monitor the data in real time using standard monitoring and recording tools. The system provides R-TSPI in different frames, including the body frame of the platforms, local navigation frame (wander-azimuth) and Earth-fixed frame, as well as transferring the solution to arbitrary points of interest on the aircraft such as the refueling aircraft’s refueling probe.
RELATIVE INERTIAL NAVIGATION
We use the terms primary and secondary in this article to identify the platforms for which R-TSPI data is being generated. R-TSPI is always provided for the primary with respect to the secondary. Referring to Figure 1, the tanker is considered the primary and the refueling aircraft, the secondary (or vice versa, depending on the location of the control segment). Data is always transmitted through the data link from the secondary to the primary. Figure 1 summarizes the geometric relations, where the primary body frame is labeled p-frame and the secondary body frame is labeled s-frame. The body frame fixed to the primary (P) is shown by (xPp,yPp,zPp), and body frame fixed to the secondary (S) is shown by (xSs,ySs,zSs).
Fgure 1. Primary/secondary geometry and corresponding body frames fixed to the vehicle body.
The relative navigation equation is set up for the state of the secondary with respect to the state of the primary in the center of the body frame of the primary, p-frame:
(1)
where xPp is the primary position vector established in the p-frame, and xSp is the secondary position vector defined in the p-frame. Note that these vectors can also be obtained from the primary/secondary strapdown inertial navigation solutions after transferring to the reference (eccentric) point. Equation (1) represents the fundamental equation, from which the relative navigation equations are derived. Once the relative kinematic model of the position and velocity are established, the next step is to develop the relative attitude kinematic model. The relative attitude, denoted by the quaternion qpS, is used to map vectors in the s-frame to vectors in the p-frame:
(2)
where qp and qs are the quaternion attitudes of the primary and secondary with respect to the i-frame, qp* is the conjugate of qp, and is the quaternion multiplication operator.
Hardware for the relative navigation system.
RELATIVE EXTENDED KALMAN FILTER
To establish the R-EKF, we must derive the relative inertial error equations. The R-EKF has 21 basic states including nine for relative position, δΔxpPS , relative velocity, δΔvpPS , and relative attitude, Ψpps, and 12 to model the primary’s gyro and accelerometer bias (non-constant) and non-linear scale factors. Since the relative distance between the secondary and primary is small compared to the radius of the Earth, the gravity terms are negligible. Thus, in the linearized terms, the relative gravitational terms are ignored. It should be noted that the secondary states are assumed to be known for retrieving the absolute primary TSPI information. Since Equations (1) and (2) can only provide the general dynamic model for a nonlinear state model, all these equations must be linearized using Taylor series about nominal values (neglecting the higher-order terms). After perturbation state equations are established, they should be discretized from a continuous-time to a discrete-time sequence. The final solution to the state equation can be expressed as:
(3)
with:
(4)
FPpS is the Jacobian matrix, and the perturbation elements are all related to the primary:
(5)
RELATIVE GPS MEASUREMENT MODEL
When GPS is available, high-accuracy relative positions are derived from the use of carrier-phase differential GPS, a technique commonly used in static positioning applications such as surveying. However, unlike those applications, in this case the reference receiver is not stationary; it is located on a moving platform (secondary) creating a moving baseline. The relative GPS measurement in our system is provided by epoch-by-epoch (EBE) differential carrier-phase processing, which measures accurate relative position between the secondary and primary systems. The EBE relative position has a typical accuracy better than 3 cm (1-sigma horizontal) and 6 cm (1-sigma vertical). Testing of the relative measurement was conducted using two ground vehicles configured with 10-Hz dual-frequency GPS sensors. The mean difference was less than 5 cm. As a conclusion, the GPS relative mode was shown to provide accurate relative positions between the platforms. Once the relative position is measured, the R-EKF observation model can be established as:
(6)
The (ΔxpPS )GPS term is the relative position measured by using GPS data, and the term (ΔxpPS)INS is the relative position, which is predicted by using the last updated inertial solutions. Note that in order to use this relative observation, the lever-arm vector between the GPS and IMU of both the primary and the secondary must be accurately measured and applied (see Figure 2).
Figure 2. Relative observation model.
Here, the observation model is represented on the condition that the vector of observations has yielded certain values based on an assumed linear relationship to:
(7)
Equations (3) and (7) are the fundamental equations of the R-EKF.
SYSTEM ARCHITECTURE
Relative navigation is computed and provided at one of the units, designated the primary unit. This requires data from the secondary unit to be transferred to the primary unit over a data link. The primary unit uses this transmitted data to calculate its position, velocity and attitude relative to the secondary unit. Figure 3 summarizes the architecture and data-flow. Mathematically, the data from the secondary unit used in the relative calculations are assumed to be errorless.
Figure 3. Geo-RelNAV architecture.
OPERATIONAL ENVIRONMENT
We distinguish the following three relative navigation stages, illustrated in Figure 4, where each phase utilizes a unique processing mode.
Fgure 4. Relative navigation phases.
In the Approach phase, the data link between primary and secondary units is not closed. An autonomous navigation solution for both the primary and secondary units is computed on each platform independently. This information will be later used when the system transitions to the Engagement phase to initialize the R-EKF.
In the Engagement phase, the data link between primary and secondary units is closed, and the R-TSPI solution is computed between the platforms. Sensor observations are transmitted across the data link from the secondary unit to the primary unit. The primary unit implements the R‑EKF to produce the R-TSPI solution.
In the Departure phase, the activity requiring R-TSPI (that is, refueling) is complete, and the secondary platform pulls away from the primary platform. In this phase, we transition from the R-EKF back to the autonomous independent navigation system.
The Approach phase is as important as the Engagement phase in attenuating the initialization error in terms of position, velocity and attitude. To initialize the R-EKF, the autonomous TSPI solution from the secondary unit is transferred to the primary unit, where the initial relative position, velocity and attitude are estimated.
There are three conditions under which this initialization must occur:
upon transition from the Approach phase to the Engagement phase,
when in the Engagement phase and the system experiences a data link dropout, and
when there is a large latency in the data link. If the data link latency is too large, the data arriving at the primary can no longer be used.
VALIDATION TESTING
Several system tests were conducted including static bench testing, dynamic ground vehicle testing and flight testing. We discuss the results for the static and bench testing here.
For static bench testing, the system was set up on two points with a measured fixed displacement. The sensor configuration included dual-frequency GPS receivers, ring laser gyro-based IMUs, and a data link operating in the 900-MHz frequency band.
The results show that relative position held to the fixed offset with a standard deviation of less than 0.1 m in North, East and Up. Relative velocity held to zero with a standard deviation less than 0.01 m/s, and relative attitude was also maintained with the accuracy up to the gyro bias stability of the ring laser gyro IMU (1°/hr for a stationary platform).
The overall performance of the system in static bench test confirms the stability of the hardware and software of the system, when it is not exposed to any dynamics, and the sensors are in close proximity (no data link latency or data dropouts).
Dynamic Drive Test. In a more realistic test to simulate the operational phases described in Figure 4, the drive test followed a scripted path. As shown in Figure 5, the two platforms left Geodetics’ facility and drove separately (simulated Approach) until they met each other at the Fiesta Island test site, where the data link was closed for the Engagement phase. The primary and secondary navigation systems operated independently during the Approach phase.
Figure 5. Drive test ground trajectory of the primary (blue) and secondary (red).
Once the data link was closed at the test site, the R-EKF engaged, using initialization information transmitted from the secondary to the primary platform. To provide a “truth source” for evaluating the performance of the relative navigation solution, both autonomous GPS/IMU systems were fed data from an external reference receiver. Table 1 shows the statistical data analysis in the form of mean and standard deviation for the collected data.
Average RMS of fit in the relative position, velocity and attitude of approximately 1.0 m, 0.1 m/s and 0.3º, respectively, were computed for the entire relative navigation period. In this dynamic test, we encountered frequent data link dropouts, data link latency, as well as GPS outages, causing discontinuity in the R-EKF measurement updates until GPS was reacquired. During these periods, the R-EKF prediction model, updated with the last calibrated IMU data, provided the R-TSPI. This test help confirm that system performance is at the expected levels, even in the presence of real-world data link and GPS problems.
Table 1. Statistical analysis of the R-TSPI solution.
GPS-DENIED OPERATIONS
Over-reliance on GPS has exposed vulnerabilities associated with this technology. For example, GPS is easily jammed and spoofed. While spoofing can be addressed with Selective Availability Anti-Spoofing (SAASM) technology, and advances such as M-code will mitigate other vulnerabilities, systems of the future must be robust to partial or total lack of GPS. Advanced sensor-fusion technologies are necessary to provide capabilities in conjunction with, and in the absence of, GPS.
In the context of aerial refueling, sensors such as active and passive vision systems can be used as complimentary observations by the system, providing a GPS-free relative distance observation in situations where GPS is blocked due to airframe masking, jamming, and so on.
Data from both active (lidar) and passive (camera) vision sensors were added to the system, providing significant advantages in the process flow. The use of vision sensors provides the relative distance observation in GPS-denied conditions for continuity in R-EKF updating. In addition, vision-based relative distance allows for the detection of outliers by evaluating the redundancy contribution of the measured GPS-based relative distance, and enables the transfer of the R-TSPI solution from the secondary refueling center to the on-the-fly probe-drogue system, as shown in Figure 6.
Figure 6. Vision sensor aiding increasing the integrity
For the active vision system, we leveraged a fully integrated lidar mapping payload as shown in Figure 7 (left). For the passive sensor, we utilize a stereo camera. Figure 7 (right) shows the test area and the simulated drogue. Imagery observations from the passive camera and the lidar system were processed with independent algorithms appropriate to each data type and the relative distance between each of the two sensors, and the simulated drogue was measured with an RMS error of less than 10 cm.
Figure 7. Geo-MMS (left) and its application (right) for measuring relative distance.
INTEGRITY
While outside the scope of this article, in addition to supplying a GPS-free relative distance observation, the use of vision sensors was applied to the task of increasing system integrity. This includes, in general, the capability to indicate when the system should not be used for the intended operation. We focused on two aspects: outlier detection (inner reliability), and the effect of undetected outliers (outer reliability).
To properly address the reliability and integrity requirements, a quality testing mechanism was designed to assess the estimated/predicted relative distance observations before passing them in to the R-EKF module.
CONCLUSIONS
An autonomous relative navigation, in its application for the aerial refueling problem, places special attention on system architecture so that it can handle most possible real-world scenarios, including frequent data link dropouts, data link latency and GPS outages. The core of the system is a relative extended Kalman filter, which uses GPS and IMU measurements of the primary and secondary platforms to estimate the relative inertial navigation states. The system is able to provide relative TSPI at the IMU sample rate with an accuracy of ±1.0 m position, 0.1 m/s velocity and ±0.5º attitude.
An added benefit of the system architecture is the ability to add observation models that do not rely on GPS. Thus, redundancy can be introduced using sensors such as vision systems.
SHAHRAM MOAFIPOOR is a senior navigation scientist at Geodetics, focusing on new sensor technologies, sensor-fusion architectures, application software, embedded firmware and sensor interoperability in GPS and GPS-denied environments. He holds a Ph.D. in geodetic science from The Ohio State University.
JEFFREY A. FAYMAN serves as Geodetics’ CTO. He holds a Ph.D. in computer science from the Technion Israel Institute of Technology and has published more than 40 papers in robotics, computer vision, computer graphics and navigation systems.
LYDIA BOCK serves as Geodetics’ president and CEO. She has more than 35 years of industry experience spanning a variety of high-tech industries including electronics, semiconductors and telecommunications. She has a Ph.D. from the Massachusetts Institute of Technology.
DAVID HONCIK, Geodetics’ director of engineering, has more than 30 years of experience in software/hardware integration and structured software design for real-time embedded systems, Windows programs, graphics, telecommunications, aerospace, flight simulation and airborne instrumentation.
The integrated lidar mapping payload referenced is Geodetics’ Geo-MMS system.
A new system developed by Universidad Carlos III de Madrid (UC3M) researchers uses sensors to improve the ability of GPS to determine a vehicle’s position compared to use of conventional GPS devices by up to 90 percent.
The prototype can guarantee the position of the vehicle to within 1 or 2 meters in urban settings, the researchers said.
Sensor Fusion. The prototype system incorporates a conventional GPS signal with those of other sensors (accelerometers and gyroscopes) to reduce the margin of error in establishing a location. “We have managed to improve the determination of a vehicle’s position in critical cases by between 50 and 90 percent, depending on the degree of the signals’ degradation and the time that is affecting the degradation on the GPS receiver,” said David Martín, a researcher at the Systems Intelligence Laboratory (LSI – Laboratorio de Sistemas Inteligentes) at UC3M. The system was jointly designed and developed by LSI and the Applied Artificial Intelligence Group (GIAA – Grupo de Inteligencia Aplicada Artificial).
The margin of error of a commercial GPS, such as those that are used in cars, is about 15 meters in an open field, where the receiver has wide visibility from the satellites. However, in an urban setting, the determination of a vehicle’s position can be off by more than 50 meters, due to the signals bouncing off of obstacles like buildings, trees, or narrow streets. In certain cases, such as in tunnels, communication is lost, hindering the GPS applications reaching Intelligent Transport Systems, which require a high level of security.
“Future applications that will benefit from the technology that we are currently working on will include cooperative driving, automatic maneuvers for the safety of pedestrians, autonomous vehicles or cooperative collision warning systems,” the scientists comment.
Integration of GNSS antenna of rover receiver and IMU in a platform over the roof of the vehicle.
The greatest problem presented by a commercial GPS in an urban setting is the loss of all satellite signals. “This occurs continually, but commercial receivers partially solve the problem by making use of the urban maps that attempt to position the vehicle in an approximate point,” Martín said. “These devices can indicate to the driver approximately where he is, but they cannot be used as a source of information in an Intelligent Transport System like those we have cited.”
The basic elements that make up this system are a GPS and a low-cost inertial measurement unit (IMU). The latter device integrates three accelerometers and three gyroscopes to measure changes in velocity and maneuvers performed by the vehicle. Then, everything is connected to a computer that has an application that merges the data and corrects the errors in the geographic coordinates. Enrique Martí of UC3M’s GIAA explains, “This software is based on an architecture that uses context information and a powerful algorithm (an unscented Kalman filter) that eliminates the instantaneous deviations caused by the degradation of the signals received by the GPS receiver or the total or partial loss of the satellites.”
The current prototype can be installed in any type of vehicle. It is already working on board the IVVI (Intelligent Vehicle based on Visual Information, pictured above), a car that has become a platform for research and experimentation for professors and students at the university.
The LSI and UC3M researchers working on this “intelligent car” can capture and interpret all of the information available on the road, and that drivers use. To do this, the team is using optical cameras, infrareds and lasers to detect whether drivers are crossing the lines on the road, or whether there are pedestrians in the vehicle’s path, as well as to adapt the speed to the traffic signals and analyze the driver’s level of sleepiness in real time.
Next Steps. The researchers will analyze the possibility of developing a system that makes use of the sensors that are built into smartphones, because intelligent telephones are equipped with more than ten sensors, such as an accelerometer, a gyroscope, a magnetometer, GPS and cameras, in addition to Wi-Fi, Bluetooth or GSM communications.
“We are now starting to work on the integration of this data fusion system into a mobile telephone,” said Enrique Martí, “so that it can integrate all of the measurements that come from its sensors in order to obtain the same result that we have now, but at an even much lower cost, since it is something that almost everyone can carry around in his pocket.”