Remote Driving Station: Steering The Future

IGEN D+ID

Parker Gu, Tony Jiang, Rowan Zawadski, Mankanwar Singh and Harrison Narvey

Our project

We designed the Remote Driving Station with the goal of integrating a human-assisted decision-making system into autonomous vehicles. 

While artificial intelligence excels at recognizing patterns and predicting events based on observed data, the situations encountered on our roadways are often unpredictable. Human intuition, judgment and the ability to understand social cues are still necessary to navigate complex scenarios. For example, Waymo, an autonomous taxi in San Francisco, has been involved in numerous incidents, such as stopping on a fire hose during a fire and driving through a crime scene. 

Through our project, we empower human operators to remotely connect to autonomous vehicles, enabling them to assist in making decisions in situations that AI struggles to handle.

IGEN project

Our process 

This complex project integrated mechanical, electrical and software engineering disciplines. It involved constructing a scaled-down model of the Cybertruck, developing a remote driving station, and creating a user interface. 

IGEN project demonstration

 

We designed and 3D-printed a 1:4 scale Cybertruck to serve as our test vehicle, using a custom-fitted chassis on a repurposed kid's ride-on car. To simulate real driving conditions, our vehicle included essential features such as headlights, steering and turn signals. It collected real-time images through front and rear USB cameras and used a GPS-based telemetry system for location and speed data. We also equipped the vehicle with radar on both sides for blind spot detection. 

All data collected by our car was sent to our driving station via an onboard computer installed inside the vehicle, connected through Wi-Fi/cellular. 

IGEN project station

 

The driving station included a Logitech G29 Driving Force Racing Wheel and Floor Pedals, along with a laptop featuring a dual-monitor setup (one for GPS navigation and one for the dashboard and camera feeds). 

The user interface (UI) was specifically designed for the driver, providing a comprehensive and intuitive control system. The real-time camera feed was crucial for the UI, offering immediate visual feedback and enhancing the overall driving experience. Our remote system operated ROS2 (Robot Operating System) as its backend, ensuring low-latency communication between the car and the driving station. 

IGEN Poster

The challenges we faced

One of the biggest challenges we faced was minimizing the delay between the driver's actions in the driving station and the car's response. 

Achieving low-latency (below 50ms) required addressing the bandwidth-intensive nature of camera feed transmission. Initially, the raw camera feeds (1080p, 60FPS) consumed up to 10MB/s when the car was in motion, leading to significant delays.

To tackle this issue, we processed the raw camera feeds through ROS2 using the H264 algorithm. This optimization resulted in reliably transmitting a 720p front camera feed and a 240p rear feed, each at 30FPS, consuming under 60 KB/s. This represented a significant improvement of 99.41% in bandwidth utilization.

What we’re most proud of

Our final prototype successfully demonstrated the reliability of our remote system, operating smoothly throughout Design and Innovation Day without encountering any technical issues. Each member of our team brought sophisticated expertise in their respective fields, demonstrating dedication to the project with high-quality finishes. 

Furthermore, our mechanical team implemented a systematic car modeling process, employing 3D printing technology to construct the scaled-down Cybertruck.

IGEN team photo

 

Our project’s future

We aim to continue our exploration of expediting the advancement of autonomous vehicles by positioning our project as an intermediary step. Our next phase will focus on implementing our remote-control system across a wide range of vehicle types on a larger scale. 

A UBC integrated engineering student describing her capstone project named iGrow.

Integrated Engineering

Integrated Engineering graduates excel in diverse fields of engineering including construction, product/project management, manufacturing, advanced technology development and resource industries.

Integrated Engineering

Discover Student Experiences

UBC Applied Science students are people who are passionate about their chosen field — architecture, landscape architecture, community and regional planning, engineering and nursing — and those that inspire others by making meaningful contributions to the betterment of society.

Browse Student and Alumni Spotlights
An engineering student at the Design and Innovation day exhibit

Want to know more about UBC Engineering?

Sign up to receive emails from us, and every few weeks we’ll keep you up to date on topics to help you learn more.

Subscribe now

UBC Crest The official logo of the University of British Columbia. Arrow An arrow indicating direction. Arrow in Circle An arrow indicating direction. Caret An arrowhead indicating direction. E-commerce Cart A shopping cart. Time A clock. Chats Two speech clouds. Facebook The logo for the Facebook social media service. Social Media The globe is the default icon for a social media platform. TikTok The logo for the TikTok social media platform. Calendar Location Home A house in silhouette. Information The letter 'i' in a circle. Instagram The logo for the Instagram social media service. Linkedin The logo for the LinkedIn social media service. Location Pin A map location pin. Mail An envelope. Telephone An antique telephone. Play A media play button. Search A magnifying glass. Arrow indicating share action A directional arrow. Speech Bubble A speech bubble. Star An outline of a star. Twitter The logo for the Twitter social media service. Urgent Message An exclamation mark in a speech bubble. User A silhouette of a person. Vimeo The logo for the Vimeo video sharing service. Youtube The logo for the YouTube video sharing service. Future of work A logo for the Future of Work category. Inclusive leadership A logo for the Inclusive leadership category. Planetary health A logo for the Planetary health category. Solutions for people A logo for the Solutions for people category. Thriving cities A logo for the Thriving cities category. University for future A logo for the University for future category.