Hello, World.

I'm Vaishanth Ramaraj.

Robotics Software Engineer Computer Vision Engineer

More About Me
Let me introduce myself.
Profile Picture

An engineer focused on enabling robots to make robots see, think, and (mostly) avoid crashing into stuff. Specializing in computer vision, robotics, and machine learning, I’ve developed AI-driven solutions that tackle real-world challenges—minus the occasional robot rebellion. My mission? To keep pushing the boundaries of perception stack technologies, enabling systems to intelligently analyze and interact with their environment.

Skills

Programming Languages

Python
C++

Libraries and Tools

ROS
PyTorch
Numpy
OpenCV
Git
Docker
Isaac Sim
RTabMap

ML Architectures

Transformers
DCNN's
Diffusion Networks
VAE's
YOLO

Work Experience

Robotics Software Engineer

Dec 2023 - Present

Neupeak Robotics

ROS
Pytorch
Transformers
DCNN's
Diffusion Networks
OpenCV
Open3d
VAE's
Docker
Jetson AGX Xavier
Real-Time Streaming and Data Infrastructure
  • Designed and implemented a low-latency, Rust-based pipeline for real-time streaming, synchronization, and recording of multi-camera and multi-sensor data, leveraging NVIDIA hardware-accelerated video encoding, achieving a low memory footprint and approximately 5% CPU utilization on a Jetson Xavier.
  • Developed a data generation pipeline using SAM3 video tracking to expand labeled datasets by tracking objects across frames, enabling dataset scaling with less manual annotation and accelerating model deployment in new environments.
  • Enhanced the host-level monitoring system on Jetson Xavier to execute multi-layered action commands, resulting in a 60% reduction in CPU load.
7-Axis Manipulator
  • Developed incremental enhancements to a 7-axis manipulator calibration system by integrating external tracking measurements and optimizing URDF kinematic parameters to improve end-effector pose accuracy.
  • Implemented a time-parameterization algorithm for a 7-axis manipulator to enable smooth and reliable trajectory execution, computing parameterized trajectories in <= 10 ms under complex trajectory conditions and reducing overall trajectory execution time by 2-4 seconds.
Object Detection Model
  • Integrated architectural enhancements into an existing multi-head object detection network by introducing an additional detection head, improving feature representation and enabling more consistent and accurate object localization and classification.
  • Implemented a 3-branch semantic segmentation network for real-time object detection during navigation with clear mask boundaries.
Isaac Sim
  • Integrated a custom mobile manipulator with a 7-axis manipulator in Isaac Sim with ROS communications using OmniGraph nodes.
  • Designed and developed a custom simulation environment replicating greenhouse fruit farms, integrating deformable physics into fruit models to realistically emulate gripper-fruit interactions during robotic manipulation tasks.
  • Implemented a pipeline using Isaac Sim tools to generate synthetic semantic segmentation datasets, significantly reducing reliance on manual labeling and decreasing overall data annotation time.
  • Developed OmniGraph nodes for procedurally generating partial simulation environments, such as dynamic spawning of objects, and facilitating faster testing of robotic capabilities across diverse experimental setups.
End-to-End Navigation Model
  • Developed an end-to-end vision-based navigation model using Transformers and diffusion policies, enabling mobile robot navigation from monocular camera input while supporting platform-agnostic deployment.
  • Utilized a large open-source dataset to train the model on human navigational strategies, enhancing its ability to adapt to new environments and lowering the cost of collecting new training datasets.

Robotics Engineering Intern

Sept 2023 - Dec 2023

Void Robotics

ROS2
Docker
Jetson Orin Nano
  • Implemented a ROS2 micro-ros agent on Jetson Nano using an ARM-based Docker container. Integrated the BlynkEdgent C++ package into ESP32 for multi-WiFi connectivity and set up Docker-based VPN services to enable access to ROS2 systems across different networks.

Robotics Engineer

Jun 2022 - Apr 2023

Children’s National Research Center

ROS
Pytorch
RTabMap
OpenCV
YOLO
Docker
Jetson Nano
  • Led a team to design and develop a modular navigation system that enabled autonomous functionality for a wheelchair, reducing prototype cost by 52% compared to market alternatives.
  • Developed a ROS stack utilizing RTabMap for visual SLAM using Intel RealSense stereo camera, enabling autonomous navigation in dense and narrow environments with a 70% success rate.
  • Implemented YOLO for object detection and integrated Open3D for obstacle distance estimation, reducing collisions with dynamic obstacles and enhancing navigation safety.
  • Deployed on a Jetson Nano using docker containerization, maintaining power consumption below 10W.

Software Developer

Jul 2019 - Jun 2021

Bariflo Labs

ROS
Pytorch
Raspberry Pi
  • Developed a ROS-based automation system for a Water Aeration Device, reducing manual intervention.
  • Designed and deployed a Random Forest regression model on the cloud to analyze real-time sensor data with 160ms latency, ensuring 89% accuracy in aeration control predictions
  • Integrated an ESP32-based Wi-Fi controller with a mobile application using MQTT and RESTful APIs, enabling remote monitoring and real-time control, reducing on-site maintenance costs by 40%.
  • Optimized edge-to-cloud communication, reducing data transmission latency and ensuring 96% uptime for continuous aeration system monitoring.

Mechanical Engineer

Ayg 2018 - May 2019

National Institute of Ocean Technology

Solidworks
3D printing
Arduino
  • Designed and fabricated a soft robotic gripper using flexible 3D-printed materials, enabling secure handling of fragile objects up to 500g.
  • Developed and simulated the complete mechanism in SolidWorks, optimizing structural integrity through stress analysis.
  • Developed mechanical linkages for underwater manipulation and integrated an ESP32-controlled stepper motor, ensuring precise actuation with a ±0.5mm tolerance.
  • Optimized the gripper’s design, reducing overall weight by 30% while maintaining high grip strength, enhancing efficiency for underwater applications.

Education

Master’s

University of Maryland, College Park, MD, USA

Robotics Engineering

Bachelor’s

Kongu Engineering College, TN, India

Mechatronics Engineering

Publications
  • Ramaraj, V., Paralikar, A., Lee, E. et al. Development of a Modular Real-time Shared-control System for a Smart Wheelchair. J Sign Process Syst (2023). Link
  • Krishnamurthy, K., Meenakshipriya, B., Shree, K.I., Vaishanth, R., Sandeep, V. and Vijay, V.P., Design and Development of Spherical Robot Using Pendulum Mechanism, 2020. Link
Projects

Youtube Channel

LeRobot for Imitation learning playlist

Open Source Projects and contributions

Contact

I'd Love To Hear From You.

Email Me At

vaishanth.ramaraj.98@gmail.com