英伟达Full-Stack Solution Engineer: Humanoid Whole-Body Control and Loco-manipulation
任职要求
• A PhD in Robotics, Machine Learning, Computer Science, Electrical Engineering, Mechanical Engineering, or a related field (or equivalent experience) with at least 3 years of research and engineering experience.
• Reinforcement Learning for Control: Strong experience with reinforcement learning for robotics, including policy training, reward design, motion tracking, curriculum learning, domain randomization, and sim-to-real deployment.
• Simulation and Synthetic Training Pipelines: Hands-on experience building and scaling robot simulation environments in Isaac Lab or similar platforms. You should be comfortable debugging physics, contacts, sensors, robot models, and large-scale training workflows.
• …工作职责
• Humanoid Whole-Body Control: Build and improve software for large-scale motion tracking and loco-manipulation in simulation. • Policy Deployment on Robot Hardware: Deploy learned whole-body control policies on humanoid platforms and optimize the runtime stack for low-latency, reliable execution. • Real-Time Kinematic Motion Planning: Develop planners and interfaces that convert task-level inputs, joystick commands, teleoperation signals, human motion, or VLA outputs into motion targets that a whole-body policy can track. • Simulation-to-Real system-id: Work across simulation, hardware-in-the-loop testing, and physical robot experiments to diagnose and close the gap between policy behavior in simulation and behavior on hardware. • Performance and Reliability Engineering: Profile and optimize inference, control-loop timing, data flow, GPU utilization, and robot-side runtime performance. • Robot Testing and Debugging: Debug failures across the full stack: motion representation, state estimation, policy inference, robot model mismatch, actuator limits, contact behavior, latency, and hardware safety constraints.
• Hardware-Software Co-Design: Maintain and iterate on the DexUMI wearable exoskeleton. You will bridge the kinematics gap between human hands and diverse robot end-effectors (e.g., XHand, Inspire Hand). • Sensor Fusion & Integration: Integrate high-fidelity tactile sensors and IMUs into wearable interfaces. Ensure low-latency data streaming. • Vision & Perception Pipelines: Implement and optimize the "software adaptation" layer—using tools to segment human operators out of training data and robot embodiments. • Data Engineering for AI: Build robust pipelines to collect, clean, and replay dexterous manipulation data for Imitation Learning and Diffusion Policies. • Optimization: Solve bi-level optimization problems to parameterize exoskeleton designs that maximize human wearability while preserving robot-equivalent fingertip workspaces.
* Engage with stakeholders to identify business opportunities, clarify technical requirements, and translate them into scalable full-stack and AI-driven solutions. Leverage Domain-Driven Design (DDD) to align technical implementations with business domains. * Design and develop robust APIs, microservices, and AI agent architectures. Ensure seamless integration between language models, core backend logic, and responsive front-end interfaces. * Implement end-to-end solutions using modern full-stack technologies (e.g., Python, TypeScript, Node.js, React/Vue) and conduct comprehensive unit, integration, and performance testing. * Define technical architectures from the ground up, incorporating vector databases, prompt orchestration, caching strategies, and robust service orchestration. * Evaluate and prototype new technologies, LLM integration patterns, and infrastructure solutions to deliver production-ready systems for emerging requirements. * Optimize application performance, with a specific focus on mitigating LLM response latency, ensuring system stability, and maintaining high availability under concurrency. * Apply test-driven development (TDD) and behavior-driven development (BDD) to build reliable infrastructure, ensure code quality, and maintain system reliability. * Rapidly learn and adopt new frameworks (e.g., agentic workflows, cloud services, message queues) to develop proof-of-concept solutions and drive technical innovation.
Job Description We are seeking a highly motivated Full-Stack Engineer to deliver exceptional user experiences for our enterprise clients. The ideal candidate will have strong software engineering skills and expertise across the entire technology stack, including modern front-end frameworks and back-end languages. Excellent interpersonal communication skills and the ability to provide meaningful feedback on technical design are essential. In this role, you will be responsible for end-to-end development of user experiences — from architecture and interactive front-end interfaces to back-end systems. You will collaborate closely with our Product Managers and cross-functional development teams to deliver innovative solutions for enterprise B2B systems. We are looking for passionate individuals who are committed to building scalable, high-quality applications and can execute effectively in a fast-paced environment. Responsibilities: 1. Design, implement, and maintain full-stack applications, including web pages and back-end APIs, ensuring end-to-end functionality. 2. Optimize code across all layers of the technology stack to improve performance, stability, and maintainability. 3. Collaborate with cross-functional teams, including Product Managers, developers, QA engineers, and business stakeholders on enterprise B2B projects. 4. Stay up-to-date with the latest web and enterprise technology trends while maintaining comprehensive design and requirement documentation for B2B systems. 5. Integrate front-end frameworks (e.g., Angular and React) with back-end services (e.g., C# and Node.js) to build scalable and secure enterprise applications.