Tag: heads-up display

A virtual reference station network covering a metropolitan area supplies position corrections to commuter buses equipped with a driver-assist system to enable safe operation, even under harsh weather conditions, along high-volume roadways.

By Craig Shankwitz

Bus-only shoulders on major traffic arteries enable a bus to travel on typically unused road right-of-way, bypassing congestion during peak rush hours. As the shoulder is typically only centimeters wider than the bus itself, lane-keeping becomes a key factor, and is accomplished in a pilot Minnesota project using dual-frequency, carrier-phase differential GPS (DGPS) as its primary positioning technology. DGPS provides position estimates accurate to 5–8 centimeters at a rate of 10 Hz, and is used to determine vehicle position and heading. An on-board map database is used to determine the position, orientation, and trajectory of the vehicle relative to the roadway.

Use of the shoulder as a busway offers several construction and operational advantages:

• Ease of Implementation. The shoulder exists; there is no need to acquire and develop additional right of way.
• Low Costs. The cost to strengthen and modify an existing road shoulder is significantly less than constructing a new busway.
• Routing. Because bus-only shoulders follow existing routes, no changes to bus routes, bus stops, or transit stations are needed to support bus-only shoulder operations.
• Customer Satisfaction. Transit customers who travel on buses that use a bus-only shoulder perceive a travel-time saving two to three times greater than actually realized. Keeping the bus moving at all times offers a significant psychological advantage.
• Increased Ridership. A 1997 study of bus-only shoulders in the Twin Cities analyzed more than nine bus-only shoulder routes for two years and found a 9.2-percent increase in ridership along these routes. At the same time, total ridership had decreased by 6.5 percent.

However, the use of bus-only shoulders imposes additional stress and strain on a driver. The narrow bus-only shoulder leaves a driver very little margin of error. Operating within this small margin is difficult even during the best traffic and weather conditions, and degrades to nearly impossible during heavy traffic and poor weather conditions, which are frequent during Minnesota’s notoriously hard winters.

During difficult weather and traffic conditions, the use of the bus-only shoulder offers its greatest transit advantage. If a driver is unable to utilize the bus-only shoulder, this advantage is lost. A properly designed and executed driver-assist system (DAS) enables a driver to use the shoulder under all conditions, thereby increasing schedule adherence and, as a result, rider satisfaction.

Under the U.S. Department of Transportation’s Urban Partnership Agreement, the University of Minnesota’s Intelligent Vehicles Lab (IV Lab) and HumanFIRST program, the Minnesota Valley Transit Authority (MVTA), and Schmitty and Sons Transportation will soon deploy DAS on 10 Gillig low-floor transit buses. These buses will provide express service between Apple Valley and downtown Minneapolis, a 22-mile, one-way trip.

Driver-Assist History

The IV Lab has developed and deployed DGPS-based DAS since 1995. The first deployment on public roads occurred in 2001, as part of the DOT’s Intelligent Vehicle Initiative Generation Zero Field Operational Test. The DGPS-based lane-keeping assistance was integrated with forward-looking radar for collision avoidance, enabling safe vehicle operation in zero-visibility conditions.

Two separate deployments took place in Alaska. The first occurred in 2003 with a snowplow and a snowblower which clear the Thompson Pass on the Richardson Highway. These vehicles are still in use. Because of this success, the State of Alaska installed the DAS in two more vehicles at Deadhorse Airport.

During the summer of 2010, the two original Thompson Pass systems will be upgraded with new computational hardware, and three new systems will be installed on three new highway maintenance vehicles. The value of the driver-assist system has been proven, and those who use it have grown to rely on its all-weather capabilities. It has functioned reliably for seven years in extremely harsh conditions.

Driver-Assist for Transit

The DAS provides two primary capabilities for transit applications: lane-keeping and collision awareness. The system provides assistance only; a driver is always responsible for control of the vehicle. Figure 1 shows the components comprising the DAS.

DGPS-Based Lane-Keeping. The primary positioning sensor used aboard the buses is a dual-frequency, carrier-phase GNSS receiver, providing centimeter-accurate position measurements at 10 Hz. With the exception of the DGPS augmentation system described later, all other DAS system processes are synchronized with the arrival of DGPS position updates.

Realtime CMR+ DGPS corrections are provided over the 3G cellular network from the IV Lab VRS network. The IV Lab VRS network is based on six receivers located around the perimeter of the Twin Cities Metro area. These six receivers are connected via landlines to a server system located in the IV Lab at the University of Minnesota, running GPSnet and RTKnet applications. To ensure GPS correction reliability, an integrity manager software issues alerts for both short-term and long-term aberrations in the data provided by the six base stations. This ensures accurate corrections are sent to the buses using the narrow shoulders.

The onboard receiver also plays a crucial role in accurately estimating vehicle body heading. In rural applications where GPS augmentation is unnecessary, GPS velocity heading estimates provided directly from a GPS receiver serve as a sufficiently accurate body-heading estimate. However, in GPS-denied environments where an augmentation system is needed to provide accurate position and heading estimates when GPS is lost, velocity heading from an onboard receiver is an insufficiently accurate estimate of vehicle heading. To support such navigation, the IV Lab developed a technique, described later, by which body heading can be estimated with errors less than 0.1 degree.

Map Databases

Lane-keeping uses DGPS with an onboard map database describing the location and type of lane boundaries and other relevant roadway elements to an accuracy of approximately 10 centimeters. These map databases can be constructed in one of three ways:

• from sufficiently accurate photogrammetric data,
• by driving centerlines and using known road-construction standards to d
  etermine the location of lane boundaries and other relevant elements relative to the lane centerline, or
• by using a combination of laser scanners, DGPS receivers, and cameras to determine the global location of the reflective markings that bound lanes and shoulders.

Lane-keeping information is continuously provided to the driver; lane-departure alerts and warnings use a comparison of vehicle speed and heading to the map database to determine when alerts and warnings should be issued.

The alerts and warnings are provided via a multi-modal human-machine interface (HMI), illustrated in Figure 2, through three modes:

• graphically, through a head-up display (HUD) that gives a virtual view out the windshield when environmental conditions limit visibility;
• haptically, through a torque-actuated steering wheel giving a restorative torque on the steering wheel in the event of lane drift; and
• tactically, through a seat equipped with actuators that vibrate on the side of the seat to which the lane is being departed.

Lane-departure warnings come in stages. As the vehicle-trajectory estimator determines that the likelihood of a lane departure is sufficiently high, a lane-departure warning is issued to the driver through the HUD: a change in lane boundary color from white or yellow to red. Should the driver contact the lane boundary, a seat-based warning is activated; the side of the seat corresponding to the direction of lane departure vibrates, warning the driver. If the driver fails to respond to these two stimuli and continues past the lane boundary, the steering motor torque is applied. This multi-stage approach captures the drivers’ attention, but if they respond in a timely fashion, their annoyance is limited.

The torque applied by the steering servo motor is limited, and cannot deliver sufficient control action to autonomously steer the vehicle. This is by design; the driver is responsible for operating the bus. The level of torque applied to the steering wheel is analogous to an automotive front-end misalignment; it is sufficient to capture the drivers’ attention, but not to steer a bus off the road.

Forward-Collision Awareness. Sensing for forward-collision assistance is provided by a front bumper-mounted multi-plane scanning LIDAR sensor. Forward-collision alert and warning information is provided in two stages to the driver through the HUD. As now configured, if the obstacle detected is in the present shoulder of travel, the obstacle is represented as a red, open rectangle, with red indicating a warning status. If an object is located in an adjacent lane, the obstacle is represented as a white, open rectangle, with white indicating an alert status.

Obstacle-detection processing is enhanced by the presence of the onboard map database used for lane-keeping. Obstacle target information provided by the LIDAR sensor includes range, range rate, and azimuth angle to the target. The bus position and heading is provided by either DGPS or the DGPS augmentation system. Through a coordinate transformation, LIDAR information in the vehicle coordinate frame is transferred to the global coordinate frame. This allows the LIDAR target to be placed on the map database; if the target is in the vehicle lane of travel, it can be considered a threat, but if the LIDAR target is not in the same lane as the bus, then at that time the target is not a threat to the driver.

Side-Collision Awareness. Side collision awareness is enhanced by multi-plane LIDAR scanners mounted on on the front bumpers on both the left and right sides of the bus, and connected to a pneumatic actuator.

Side-collision awareness information is provided to the driver via an LCD panel mounted on the left front A-Pillar (see Figure 2). This display is touch-sensitive, and can be used by the driver to log in (only certified, trained drivers can operate the system) to select feedback modalities (choose any or all of the available feedback modes) and to check system status.

Suburban and Urban

Although the rural implementation of the DAS operates in extremely harsh weather conditions, these implementations are technically less problematic than suburban and urban implementations. In rural applications such as the snowplows, DAS-equipped vehicles typically operate with a single occupant in a small geographic area, travel on relatively low traffic-volume roads, and enjoy a clear view of the sky. Suburban and urban applications carry passengers, operate across a wider geographic area, travel on high-volume roads, and suffer from periods where view of GPS satellites is either partially or completely blocked.

These operational differences require substantial changes to the DAS subsystems for urban/suburban use.

DGPS Base Stations. In rural areas, DAS-equipped vehicles typically operate over a relatively small geographic area; a single GPS base station will provide adequate coverage as the maximum baseline between rover and the base station remains less than 25 miles. Suburban applications cover a much wider area, and a network of DGPS correction stations is needed to keep baselines low.

For the UPA project, the IV Lab operates a six-station virtual reference station (VRS) network. This network covers the greater Twin Cities Metropolitan area, and supplies compact measurement record (CMR) corrections to each DAS-equipped bus. Satellite observables are sent from each base station receiver to both the VRS server at the IV Lab and to a VRS server at the Minnesota Department of Transportation.

Broadcast of DGPS Corrections. In rural areas, the DAS system has served to keep roads passable in inclement weather conditions. This has been viewed as a safety application, and as such either UHF or VHF channels in the public safety bands have been used to broadcast DGPS corrections. In urban areas, no single UHF or VHF frequency is available to cover an entire metropolitan area. Therefore 3G cellular data communications are used to provide DGPS corrections to DAS-equipped vehicles.

Use of 3G cellular data communications brings the transit customer an added benefit: free Wi-Fi. The provision of DGPS corrections, using the CMR+ correction format, requires approximately 10 Kbit/second. This bandwidth is assigned high priority by the onboard router. The remaining 700 Kbit/s of 3G bandwidth is made available, at a lower priority, to bus passengers. On an express route service, passengers can e-mail and surf the web on their daily commute, making productive use of
time that might otherwise be lost.

The VRS server provides a unique correction to each DAS-equipped bus. Communication between the bus and the VRS server is initiated by the bus when it sends its coarse (uncorrected) position to the server. The server replies with a correction optimized for that coarse location. Corrections are sent at one-second intervals. Every two minutes, the bus sends its current position, and the VRS server responds with corrections optimized for that new location. With this scheme, the baseline between the VRS and the roving bus is never more than two miles. The two-mile limit maintains position accuracy without consuming excessive wireless or computational bandwidth.

DGPS Redundancy. In rural applications, the view of the sky is generally unobstructed, and FCC licenses provide adequate effective radiated power from the DGPS base stations. This assurance of access to both satellite and corrections signals generally suffices to support uninterrupted vehicle positioning. Both base-station and onboard GPS hardware have proven to be robust and reliable. With these local operating conditions, public agencies have found no need to augment DGPS for rural applications.

Suburban and urban applications, however, require an augmentation system to support DAS operation when DGPS is unavailable due to outages caused by overpasses, overhead road signs, tree canopies, and so on. Passenger safety and the need to provide reliable schedule adherence require that positioning be provided even when DGPS is unavailable, by a vehicle-based DGPS augmentation system.

Vehicle-Based Augmentation

The vehicle-based augmentation system (VBAS) uses direct measurements of ground velocity, a measure of vehicle yaw rate, and an accurate estimate of the vehicle position and heading at the time DGPS is lost to estimate vehicle position and heading for the duration of signal loss.

A commercial off-the-shelf sensor designed for measuring vehicle and/or tire slip measures vehicle 2D velocity. Yaw rate can be measured either with an inertial rotational rate sensor or a second 2D velocity sensor. Yaw rate measured using a pair of these 2D sensors eliminates the rate bias and rate bias drift associated with inertial sensors. Figure 3 shows both configurations.

An accurate measure of vehicle heading at the time GPS positioning is lost is critical to the augmentation process. A performance goal of 20 centimeters tolerable error at the end of a 15-second outage for a vehicle traveling at 25 miles per hour (11.2 meters/second) requires a heading estimation error of no more than 0.07 degrees (that assumes the only source of error is attributable to the heading).

GPS outages (time from loss of position to reacquisition) attributed to passing under overpasses range from 7 seconds (single bridge) to 9 seconds (double bridge). The IV Lab augmentation system reliably provides sufficiently accurate position and heading estimates to carry through these outages. At the present level of performance, should an outage last more than 15 seconds, the accuracy of the augmentation system cannot be guaranteed. In this event, the driver is alerted, and the DAS is deactivated until a DGPS position fix is reacquired. Fortunately, since new receiver firmware was installed, no instances of an outage exceeding 15 seconds have occurred during two months of test, evaluation, and driver training.

Figure 4 illustrates the accuracy of the VBAS system. At the time the fix solution is reacquired on the exit ramp, the lateral error between the fix solution and the position estimated by the VBAS is approximately 10 centimeters. This accuracy is sufficient to allow a driver to travel on the entrance ramp even during zero-visibility conditions.

Driver Training

Bus-only shoulder operation has proven itself safe and, in fact, safer than normal transit operations, according to recent data. The goal of driver training is to prepare drivers to use the DAS system to enable them to safely use the bus-only shoulders in conditions under which they normally would not.

A rigorous training protocol developed in cooperation with the University of Minnesota HumanFIRST program, Schmitty and Sons Transportation driving instructors, and MVTA involves both simulator-based and on-road training.

Simulator-Based Training

Beefore using driver assist systems, bus drivers are continually taught that the driver controls the bus and is responsible for both the passengers and vehicle. Drivers take this responsibility seriously, and as such, develop skills and techniques that guarantee safe passage under all conditions, even when running on narrow, bus-only shoulders.

To best prepare drivers for using the DAS under difficult conditions, a high-fidelity driving simulator was commissioned. A DAS was installed in the simulator, and an interface to the simulator was created. In this context, a driver has the ability to train in normal and abnormal (low to zero visibility) conditions before beginning on-road DAS training and use.

In the simulator, the driver learns that the system only provides assistance; responsibility for the safety of the bus and passengers still resides with the driver. Experience with Alaskan snowplow operations, where formal training is limited to a few on-road test drives, has shown that a driver may take a few winter seasons to fully accept the system. This delayed acceptance is in part attributable to the fact that for six months per year a driver has no opportunity to train with the system. Acceptance gained over one winter season is lost during the summer.

The simulator installed at an MVTA bus garage uses a seat-based motion platform to achieve realistic vehicle dynamics. The DAS installed in the simulator allows a driver to train in all weather and traffic conditions on a geospecific roadway before transitioning to a DAS-equipped bus. Geospecificity is achieved through the creation of virtual worlds based on roadway data collected by the mapping vehicle shown earlier.

On-Road Training

After a driver both demonstrates an
d acknowledges comfort and competence with the DAS in the simulator, training transitions to the actual route on which the buses will operate. Each of the 10 buses is equipped with a six-camera data-acquisition system. The six cameras capture not only the driver’s actions (hands, face, feet), but also views of the road (front, left, and right sides.)

Drivers travel with an instructor. The onboard data acquisition system can be used to reconstruct particular scenarios as a means to offer advice as to how the driver and system can better interact in difficult driving and traffic conditions.

On-road training benefits system developers as well. Training offers a driver an opportunity to test the system in real-time on an actual road. The perspective a driver brings is generally different than that of the developer, and the insights the end user provides typically produce a better system. As an example, driver experience with the system during the initial training period produced the staged approach to lane-departure alerts previously described.

Conclusion

The IV Lab, MVTA, and Schmitty and Sons Transportation will soon release 10 DAS-equipped buses into revenue service to support narrow bus-only shoulder service between downtown Minneapolis and Apple Valley, Minnesota. Although the IV Lab has deployed a number of DAS-equipped vehicles, this UPA deployment represents the first time that the system has been used to transport passengers. This deployment should prove that although DGPS systems are susceptible to periodic outages, a properly designed and executed augmentation system will provide a sufficiently robust system that will be accepted by both drivers and passengers. It will also demonstrate to other transit agencies that even narrow rights of way offer significant transit advantages at low cost, and that potential operational difficulties can be overcome through the use of DAS technologies.

Manufacturers

The buses carry Trimble R7 receivers and Ibeo Lux multi-plane scanning LIDAR sensors. The IV Lab VRS network is based on six Trimble NetR5 receivers. The server runs Trimble’s GPSnet and RTKnet applications, with the Trimble Integrity Manager.

---

Craig Shankwitz is the director of the Intelligent Vehicles Laboratory at the University of Minnesota.