profile photo

Dhruv Sharma

I'm a computer vision researcher at Huawei's Noah's Ark Research lab working with Bingbing Liu and Yuan Ren. My research revolves around perception for autonomous driving: 3D Reconstruction, Neural Radiance, Simulation, etc. Specifically I am working on application of Neural Radiance methods to driving settings to enhance simulation capabilities. I obtained my MSc degree from the Department of Computer Science at the University of Toronto where I was a part of Robot Vision and Learning Laboratory. I was advised by Florian Shkurti at RVL.

Prior to UofT, I have worked at NVIDIA as a Software Engineer in their autonomous driving team at New Jersey reporting to Urs Muller and Beat Flepp. I am interested in general in autonomous robotics and specifically in perception for autonomous robots. During my time at Waterloo, I have worked at numerous different companies such as NVIDIA, Capital One, Diebold Nixdorf in capacity of Software Engineer, Data Scientist, Deep Learning Intern, etc.

d32sharm[at]gmail.com  /  CV  /  LinkedIn  /  GitHub

..Research
Conference Papers
clean-usnob Augmenting Imitation Experience via Equivariant Representations
Dhruv Sharma*, Alihusein Kuwajerwala*, Florian Shkurti
International Conference on Robotics and Automation (ICRA), 2022 | Philadelphia, USA
PDF / Poster / Project Site

Behavriour cloning comes with the covariate shift problem, i.e. an autonomous agent fails if the data seen at the test time is different from that seen at training time. This is usually addressed using additional sensors to collect data to train the agents. This work proposes a method to train robust behaviour cloning policies using the concept of image equivariance.

clean-usnob Facial Recognition with Encoded Local Projections
Dhruv Sharma, Sarim Zafar, Morteza Babaie, H.R. Tizhoosh
IEEE-Symposium Series on Computational Intelligence, 2018 | Bengaluru, India
PDF

This paper attempts for the first time to utilize ELP descriptor as primary features for facial recognition and compare the results with LBP histogram on the Labeled Faces in the Wild dataset. We have evaluated descriptors by comparing the chi-squared distance of each image descriptor versus all others as well as training Support Vector Machines (SVM) with each feature vector. In both cases, the results of ELP were better than LBP in the same sub-image configuration

Theses
clean-usnob Augmenting Imitation Experience via Equivariant Representations
Dhruv Sharma*, Florian Shkurti
Department of Computer Science, University of Toronto, 2021 | Toronto, CA
PDF

My MSc. graduate work examines the problem of covariate shift in behavriour cloning. Covariate Shift is when an autonomous agent fails if the data seen at the test time is different from that seen at training time. This is usually addressed using additional sensors to collect data to train the agents. This work proposes a method to train robust behaviour cloning policies using the concept of image equivariance.

..Work Experience
clean-usnob Computer Vision Researcher
Huawei Canada, Noah's Ark Research Lab
June 2022 - Present | Toronto, Ontario

Research & development for lidar based perception for autonomous driving. Research focus: 3D Reconstruction, Neural Radiance, Volume Rendering, Simulation

clean-usnob Graduate Researcher
Robot Vision and Learning Lab, University of Toronto
Sept 2019 - March 2021 | Toronto, Ontario

Research & development at the intersection of robotics, AI, and computer vision. Developed techniques to enhance visual navigation using imitation learning while using less data. Used concept of image equivariance to improve visual navigation policies.

clean-usnob Software Engineer - Autonomous Driving
NVIDIA | Advised by Dr. Urs Muller and Dr. Beat Flepp

Oct 2020 - Oct 2021 | Holmdel, NJ

Worked on the NVIDIAs research group developing end to end deep networks for NVIDIAs AI Car. Developed the self driving simulator as well as additional infrastructure to train and test networks.

clean-usnob Research Engineer
Waterloo Self Driving Car Project, University of Waterloo
July 2018 - Sept 2018 | Waterloo, Ontario

Performed simulation based research in autonomous driving using Copelia Robotics V-rep simulator and Unreal Engine based simulator. Integrated the dynamic vehicle model of the vehicle in the simulation pipeline.

clean-usnob Deep Learning Intern
NVIDIA | Multiple Internships
Jan 2016 - Sep 2017 | Santa Clara & New Jersey Research Lab

Worked on developing autonomous driving technology on NVIDIA Drive hardware. Contributed to deep learning and robotics pipelines. Trained and tested on road deep neural netwrks to run the car. Contributed to demo video shoots.

clean-usnob Data Scientist Intern
Capital One, Capital One KW Lab
May 2015 - Aug 2015 | Kitchener, ON

Created an NLP pipeline to classify and analyze customer feedback. Helped improve company's net promoter score KPI.

clean-usnob Software Developer Intern
Diebold Nixdorf, Prev. Phoenix Interactive Inc.
Sept 2014 - Dec 2014 | London, ON

Software development for Phoenix's flagship VisaATM terminal software. Developed new functionalities and implemented testing using Google frameworks.

clean-usnob M.S.c in Computer Science
Department of Computer Science, University of Toronto
Sep 2019 - Jan 2021 | Toronto, ON

Ontario Graduate Scholarship
clean-usnob B.A.Sc in Mechatronics Engineering
Faculty of Applied Science and Engineering, University of Waterloo
Sep 2013 - May 2018 | Waterloo, ON

President's Research Award
NSERC Undergraduate Research Award
Dean's Honour List - 2015-2018

Some relevant course projects and design projects that I have worked on in the past.

clean-usnob Monocular Visual Odometry
University of Toronto, AER1513 - State Estimation for Robotics

An implementation of monocular visual odometry on kitty dataset.
Project report / Video

clean-usnob Deep Q Learning - Cartpole Control
University of Toronto, AER1517 - Control for Robotics

Solving the inverted pendulum problem using Deep Q Learning.
Project report / Video

clean-usnob Autonomous Wall Painting Robot
University of Waterloo, Capstone Design Project

An autonomous wall painting robot capable of mapping, navigating, and painting walls in a room. ROS based autonomy stack running on NVIDIA Jetson TX1. Got featured on techcrunch.
Website / Video / Techcrunch