英伟达Senior Applied Research Software Engineer, Robotics Sim2Real
任职要求
• Master’s degree or PhD in Computer Science, Robotics, Electrical Engineering, or a related field (or equivalent experience). • 2 years+ experience in robotics. • Proficient programming skills in Python and C++. • Experience with machine learning frameworks, especially PyTorch. • Strong understanding of robot learning principles and algorithms. • Experience with simulation environments (e.g. Isaac Lab, Isaac Sim) • Hands-on experience of real robot testing. • Familiar with robotics …
工作职责
NVIDIA is seeking a highly skilled and motivated Robotics Applied Research Software Engineer specializing in Sim2Real and Humanoid Loco-Manipulation to join our Robotics team. This role focuses on building software for developing and deploying robotic policies from simulation to real-world environments, creating data generation pipelines, and applying robot learning for robotics. The ideal candidate will have strong software engineering skills, applied research and engineering experience in robotics and machine learning, and expertise in PyTorch, C++, and Python. Real-world experience with humanoid robots, particularly in loco-manipulation, is highly preferred. What You Will Be Doing: • Perform Vision-Language-Action (VLA) pre-training and post-training. • Implement and enhance robot learning algorithms for robotics. • Deploy algorithms on real humanoid robots to evaluate sim2real transfer. • Focus on humanoid loco-manipulation tasks to advance robotic capabilities. • Collaborate with research and engineering teams to enable foundation models Sim2Real transfer on humanoid robots. • Run experiments and analyze results to improve robotic system performance. • Continuously learn and explore new technologies. • Cross team collaborations and leadership for sim2real efforts • Publish papers / technical reports for the applied research work.
NVIDIA is now looking for LLM Train Framework Engineers for the Megatron Core team. Megatron Core is open-source, scalable, and cloud-native frameworks built for researchers and developers working on Large Language Models (LLM) and Multimodal (MM) foundation model pretraining and post-training. Our GenAI Frameworks provide end-to-end model training, including pretraining, alignment, customization, evaluation, deployment, and tooling to optimize performance and user experience. Build on Megatron Core Framework's capabilities by inventing advanced distributed training algorithms and model optimizations. Collaborate with partners to implement optimized solutions. What you’ll be doing: • Build and develop open source Megatron Core. • Address extensive AI training and inference obstacles, covering the entire model lifecycle including orchestration, data pre-processing, conducting model training and tuning, and deploying models. • Work at the intersection of AI applications, libraries, frameworks, and the entire software stack. • Spearhead advancements in model architectures, distributed training strategies, and model parallel approaches. • Enhance the pace of foundation model training and optimization through mixed precision formulas and advanced NVIDIA GPU structures. • Performance tuning and optimizations of deep learning framework and software components. • Research, prototype, and develop robust and scalable AI tools and pipelines.
Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing! An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, encouraging environment where everyone is inspired to do their best work. Come join the team and see how we can make a lasting impact on the world.NVIDIA is hiring senior software engineers in its Infrastructure, Planning and Process Team (IPP), to accelerate AI adoption across various engineering workflows within the company. IPP is a global organization within NVIDIA. The group works with various other teams within NVIDIA such as Graphics Processors, Mobile Processors, Deep Learning, Artificial Intelligence and Driverless Cars to cater to their infrastructure and software development workflow needs. As a senior engineer on AI Workflow, you will create and establish tools and software solutions that leverage Large Language Models and agentic AI to automate end to end software engineering workflows and enhance the productivity of engineers across NVIDIA. What you’ll be doing: • Develop and implement solutions throughout software development lifecycles to improve developer efficiency, accelerate feedback loops, and boost release reliability • Experience designing, developing, and deploying AI agents to automate software development workflows and processes. • Continuously measure and report on the impact of AI interventions, showing progress in metrics such as cycle time, change failure rate, and mean time to recovery (MTTR). • Build and deploy predictive models to identify high-risk commits, forecast potential build failures, and flag changes that have a high probability of failures. • Research emerging AI technologies and engineering best practices to continuously evolve our development ecosystem and maintain a competitive edge.
• Ship features with PM & Engineering. Co‑own scenario goals; translate product requirements into scientific plans and productionized solutions that meet quality/latency/cost targets. • Model development & optimization. Design, fine‑tune, and evaluate models for LLM‑based authoring, summarization, reasoning, voice/chat, and personalization (e.g., SFT, alignment, prompt/tool use, safety filtering, multilingual & multimodal). • Data & evaluation at scale. Build/extend data pipelines for curation/labeling/feature stores; author offline eval harnesses; run online A/Bs and interleavings; define guardrails and success metrics; author scorecards and decision memos. • Production ML engineering. contribute to service code and configs; add monitoring, tracing, dashboards, and auto‑scaling; participate in on‑call and postmortems to improve live‑site reliability. • Responsible AI. Produce review artifacts, document mitigations for safety/privacy/fairness, support red‑teaming and sensitive‑use checks, and align with Microsoft’s Responsible AI Standard. • Collaboration & mentoring. Partner across PM/ENG/Design/CE/ORA/CELA; share methods and code, review PRs, improve reproducibility and documentation; mentor junior scientists.
Works closely with your peers in rationalizing technology choices, design and implementations on our AIGC and related systems. Responsible for the research and application of deep learning algorithms, including model training and optimization, engineering applications. The areas include image generation, image analysis, image processing, Office (PowerPoint/Word/Excel) design generation, palette extraction, content layout generation, etc. Keeps up with the latest industry technologies and integrates them into products to drive innovation. Guarantees of the generated contents are compliant with our global standardization.