About LightSpeed
LightSpeed Build Technologies is revolutionizing the construction industry through AI-powered robotics. Our flagship systems—BRUTE for automated wall panel manufacturing and DEX for on-site collaborative construction—are addressing the global housing crisis by delivering unprecedented speed, precision, and affordability in homebuilding.
Position Overview
As Senior Robot Learning Engineer, you will own how LightSpeed's robots learn and perform physical skills. You will build the data pipeline that captures how people do the work, the policies that learn from it, and the executor that runs every action on the robot, classical or learned, behind one interface.
Our robots do contact-rich, high-variance work: taping seams, routing cable, finishing drywall, setting fixtures. Your systems decide whether a new trade takes days or weeks to teach, and whether it runs reliably once it does.
What you'll work on
Data and teleoperation
Define how we capture demonstrations: teleoperation rigs (leader arms, VR) and egocentric capture of people doing the work
Own the data pipeline: synchronized observations and actions, episode labelling, dataset versioning and quality checks
Decide what data each new task needs, and how failures are labelled and fed back
Partner with the world sensing principal on observation spaces and sensor streams
Policies and training
Set the policy architecture: a shared vision and force backbone with task-conditioned heads, so a new skill needs a few demonstrations, not a new model
Train with imitation learning, diffusion or transformer policies and vision-language-action models; use reinforcement learning where the reward can be clearly defined
Build the training and evaluation loop, in simulation and on real robots, with held-out evaluations that gate deployment
Solve manipulation of deformable materials: cable, tape, membrane
Set coverage and first-pass yield targets per skill, and measure against them
Execution and control
Own the actuate executor: classical control and learned policies behind one contract, so the planner can choose either for each step
Build the compliance layer for contact-rich work: nailing, pressing, taping, mudding, insertion, with force and impedance control
Build recovery behaviours for the common failures of each primitive
Deploy policies on the robot within real-time and safety limits
Define what each tool must sense and report, so its actions can be learned from and controlled
Foundation and skill pipeline
Co-own the foundation interfaces with the world sensing and agentic planning principals, and own the data and evaluation interface
For each new trade: collect demonstrations, train and evaluate the policy, add recovery
Drive down the time it takes to teach a new trade
Technical leadership
Set robot learning and control architecture across both robot families
Lead and mentor learning and manipulation engineers
Make the system something engineers can teach new trades with, without you in the loop
Stay hands-on: write production code and test on real robots every week
Required qualifications
Robot learning and control
5+ years in robotics or machine learning, including learned manipulation policies deployed on real hardware
Deep experience with imitation learning and reinforcement learning, and with when to use each
Force and impedance control for contact-rich manipulation
Built a data pipeline for robot learning: teleoperation capture, labelling, versioning and evaluation
Deep learning in PyTorch, from dataset to deployed policy
Engineering and leadership
Strong Python and C++
Experience with ROS2, Linux, Docker and CI/CD workflows
A record of setting technical direction across teams and mentoring engineers
Preferred qualifications
MS or PhD in Robotics, Machine Learning, Computer Science or a related field
Vision-language-action models or other robot foundation models
Diffusion policies, ACT or similar visuomotor policy architectures
Manipulation of deformable objects: cable, textile, tape
Bimanual or dexterous manipulation
Sim-to-real transfer with Isaac Sim, MuJoCo or similar
Teleoperation systems: leader-follower arms, VR, egocentric capture
Robot learning datasets in MCAP or rosbag
Contact-rich assembly, finishing or construction tasks
Background in construction, manufacturing or industrial automation
Why Join LightSpeed
Teach robots the trades that build homes and address the housing crisis
Own robot learning end to end, from demonstration capture to deployed policy
Shape the foundation every trade is built on
Work on rare real-world problems: deformable materials, contact-rich finishing, learning from human demonstration on factory and field robots
Hands-on culture with direct access to robots, sensors and manufacturing environments
Competitive compensation and comprehensive benefits
Employment Relationship
This position is at-will, meaning either you or the Company may terminate employment at any time, with or without cause or notice.
Equal Opportunity
LightSpeed Build Technologies is an equal opportunity employer committed to building a diverse and inclusive workplace. We welcome candidates from all backgrounds and experiences.