英伟达Senior Prediction and Planning Engineer, VLM - Autonomous Vehicles
任职要求
Join our team at NVIDIA to develop brand new, end-to-end autonomous driving systems for mass-production vehicles. Our strategy has evolved from AI 1.0 — building a driver from scratch — to AI 2.0 — teaching an intelligent agent to drive. This next phase leverages LLMs, VLMs, and VLAs to bring outstanding reasoning, planning capabilities, and interactivity with the driving system to autonomous vehicles and general robotics. Let’s build the future of autonomy—together. What You’ll Be Doing: • Design and train innovative large-scale models—including generative, imitation, and reinforcement learning—to improve the planning and reasoning capabilities of our driving systems. • Build, pre-train, and fine-tune LLM/VLM/VLA systems for deployment in real-world autonomous driving and robotics applications. • Explore novel data generation and collection strategies to improve diversity and quality of training datasets. • Collaborate with cross-functional teams to deploy AI models in production environments, ensuring performance, safety, and reliability standards are met. • Integrate machine learning models directly with vehicle firmware to deliver production-quality, safety-c…
工作职责
N/A
• Investigate and resolve sensor calibration and egomotion algorithm/toolchain issues across multiple OEM vehicle platforms. • Develop core autonomous driving functionality for global markets by fusing state-of-the-art perception DNNs with map signals. • Build real-time 3D world models for planning, integrating diverse inputs from sensors and external sources. • Develop and optimize LLM, VLM, and VLA systems for autonomous driving applications, including pre-training and fine-tuning. • Design innovative data generation and collection strategies to improve dataset diversity and quality. • Collaborate with cross-functional teams to deploy end-to-end AI models in production, ensuring performance, safety, and reliability standards are met.
1、负责摄像头模组的评估选型，负责Camera新器件、新工艺的收集和研究，并建立资源库，输出研究分析报告，并成功导入产品项目中； 2、熟悉Cam模组电子，结构，光机等设计要点，负责Cam模组定制开发，量产交付； 3、负责与Camera主流马达厂家及其他创新厂家保持密切沟通，掌握Camera模组变焦和OIS的技术发展趋势，确保Camera模组能够获得最大的对焦和防抖性能； 4、负责与Camera Sensor厂家保持密切沟通，掌握Camera Sensor的技术发展趋势，确保发挥Sensor的最优性能满足VR系统的需求； 5、涉及部品的重大技术问题协助推动厂家技术支持； 6、部品通用化管理和兼容性设计。
1、负责RTOS操作系统移植，支撑任务调度/内存管理/动态加载等OS能力； 2、负责I2C/I3C/SPI等各类IP外设驱动开发； 3、负责acc/mag等各类sensor器件驱动开发； 4、负责对接Android各类Sensor service服务的底层通路建设； 5、负责AI推理框架，模型量化，sensor类算法； 6、负责智能业务如行人导航，融合定位，行为识别等业务交付。