滴滴自动驾驶-数据闭环工程师(J250626019)
社招全职技术地点：北京状态：招聘
任职要求
1）计算机科学，电子工程，自动化工程，软件工程等相关专业的本科或硕士学位获得者； 2）熟悉Linux开发环境，良好的系统编程、数据结构、算法基础、系统设计能力； 3）熟练掌握Python和C++，有丰富的系统设计和开发经验者优先 4）熟悉常用数据库Mysql、MongoDB、Elasticsearch和分布式存储（HDFS/S3）； 5）掌握分布式系统设计，熟悉微服务与容器化（Docker/K8s），对常用的组件如MQ、RPC等有实践经验； 加分项 1）有自动驾驶/机器人标注平台开发经验等平台架构 2）参与过AI模型训练数据生产项目（数据集构建、数据生成）
工作职责
1）设计并实现高并发、高可用的数据标注平台后端架构，支持图像、点云、视频等多模态自动驾驶数据的标注需求； 2）搭建标注数据存储与治理系统，保障大规模标注数据（PB级）的安全存储与高效检索； 3）搭建面向自动驾驶大模型的数据生产系统，涵盖数据清洗、增强、合成与标注全流程； 4）构建数据版本管理与回溯系统，实现数据集迭代过程的可追踪性，满足模型训练合规要求；
包括英文材料
学历+
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
数据结构+
https://www.youtube.com/watch?v=8hly31xKli0
In this course you will learn about algorithms and data structures, two of the fundamental topics in computer science.
https://www.youtube.com/watch?v=B31LgI4Y4DQ
Learn about data structures in this comprehensive course. We will be implementing these data structures in C or C++.
https://www.youtube.com/watch?v=CBYHwZcbD-s
Data Structures and Algorithms full course tutorial java
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
系统设计+
https://roadmap.sh/system-design
Everything you need to know about designing large scale systems.
https://www.youtube.com/watch?v=F2FmTdLtb_4
This complete system design tutorial covers scalability, reliability, data handling, and high-level architecture with clear explanations, real-world examples, and practical strategies.
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
MySQL+
https://juejin.cn/post/7190306988939542585
这是一篇 MySQL 通关一篇过硬核经验学习路线，包括数据库相关知识，SQL语句的使用，数据库约束，设计等。
[英文] MySQL Tutorial
https://www.mysqltutorial.org/
your go-to resource for mastering MySQL in a fast, easy, and enjoyable way.
https://www.youtube.com/watch?v=5OdVJbNCSso
MySQL SQL tutorial for beginners
https://www.youtube.com/watch?v=7S_tz1z_5bA
This beginner-friendly course teaches you SQL from scratch.
MongoDB+
https://learnxinyminutes.com/mongodb/
MongoDB is a NoSQL document database for high volume data storage.
https://studio3t.com/academy/#courses
The fastest way to learn MongoDB
https://www.youtube.com/watch?v=c2M-rlkkT5o
This video will give you and introduction to MongoDB in 1 Hour. Afterwards I recommend exploring aggregation, replication, and sharding.
https://www.youtube.com/watch?v=ExcRbA7fy_A&list=PL4cUxeGkcC9h77dJ-QJlwGlZlTd4ecZOA
You'll learn how to use MongoDB (a NoSQL database) from scratch. You'll also learn how to integrate it into a simple Node.js API.
ElasticSearch+
https://www.youtube.com/watch?v=a4HBKEda_F8
Learn about Elasticsearch with this comprehensive course designed for beginners, featuring both theoretical concepts and hands-on applications using Python (though applicable to any programming language). The course is structured in two parts: first covering essential Elasticsearch fundamentals including index management, document storage, text analysis, pipeline creation, search functionality, and advanced features like semantic search and embeddings; followed by a practical section where you'll build a real-world website using Elasticsearch as a search engine, working with the Astronomy Picture of the Day (APOD) dataset to implement features such as data cleaning pipelines, tokenization, pagination, and aggregations.
HDFS+
https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html
The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware.
https://www.ibm.com/cn-zh/think/topics/hdfs
Hadoop 分布式文件系统 (HDFS) 是一种管理大型数据集的文件系统，可在商用硬件上运行。
分布式系统+
https://www.distributedsystemscourse.com/
The home page of a free online class in distributed systems.
https://www.youtube.com/watch?v=7VbL89mKK3M&list=PLOE1GTZ5ouRPbpTnrZ3Wqjamfwn_Q5Y9A
微服务+
https://learn.microsoft.com/en-us/training/modules/dotnet-microservices/
Microservice applications are composed of small, independently versioned, and scalable customer-focused services that communicate with each other by using standard protocols and well-defined interfaces.
https://microservices.io/
Microservices - also known as the microservice architecture - is an architectural style that structures an application as a collection of two or more services.
https://spring.io/microservices
Building small, self-contained, ready to run applications can bring great flexibility and added resilience to your code.
https://www.ibm.com/think/topics/microservices
Microservices, or microservices architecture, is a cloud-native architectural approach in which a single application is composed of many loosely coupled and independently deployable smaller components or services.
https://www.youtube.com/watch?v=CqCDOosvZIk
https://www.youtube.com/watch?v=hmkF77F9TLw
Learn about software system design and microservices.
Docker+
https://www.youtube.com/watch?v=GFgJkfScVNU
Master Docker in one course; learn about images and containers on Docker Hub, running multiple containers with Docker Compose, automating workflows with Docker Compose Watch, and much more. 🐳
https://www.youtube.com/watch?v=kTp5xUtcalw
Learn how to use Docker and Kubernetes in this complete hand-on course for beginners.
Kubernetes+
https://kubernetes.io/docs/tutorials/kubernetes-basics/
This tutorial provides a walkthrough of the basics of the Kubernetes cluster orchestration system.
https://kubernetes.io/zh-cn/docs/tutorials/kubernetes-basics/
本教程介绍 Kubernetes 集群编排系统的基础知识。每个模块包含关于 Kubernetes 主要特性和概念的一些背景信息，还包括一个在线教程供你学习。
https://www.youtube.com/watch?v=s_o8dwzRlu4
Hands-On Kubernetes Tutorial | Learn Kubernetes in 1 Hour - Kubernetes Course for Beginners
https://www.youtube.com/watch?v=X48VuDVv0do
Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
消息队列+
https://www.youtube.com/watch?v=xErwDaOc-Gs
RPC+
https://javaguide.cn/distributed-system/rpc/rpc-intro.html
为什么要 RPC ？ 因为，两个不同的服务器上的服务提供的方法不在一个内存空间，所以，需要通过网络编程才能传递方法调用所需要的参数。并且，方法调用的结果也需要通过网络编程来接收。
https://www.youtube.com/watch?v=S2osKiqQG9s
This video is part of an 8-lecture series on distributed systems, given as part of the undergraduate computer science course at the University of Cambridge.
自动驾驶+
https://www.youtube.com/watch?v=_q4WUxgwDeg&list=PL05umP7R6ij321zzKXK6XCQXAaaYjQbzr
Lecture: Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)
https://www.youtube.com/watch?v=NkI9ia2cLhc&list=PLB0Tybl0UNfYoJE7ZwsBQoDIG4YN9ptyY
You will learn to make a self-driving car simulation by implementing every component one by one. I will teach you how to implement the car driving mechanics, how to define the environment, how to simulate some sensors, how to detect collisions and how to make the car control itself using a neural network.
S3+
https://aws.amazon.com/s3/getting-started/
You can use Amazon S3 to store and retrieve any amount of data at any time, from anywhere.
https://www.youtube.com/watch?v=tfU0JEZjcsg
Amazon S3 is the oldest and one of the most popular services on AWS.
相关职位
社招3年以上数据挖掘
1、负责自动驾驶数据闭环核心系统的设计与开发，构建从车端数据采集到云端模型迭代的全链路自动化体系 2、优化车端影子模式（Shadow Mode）系统，设计高效的触发式数据采集策略，精准捕获有价值的 Hard Event 数据 3、开发智能数据筛选器（Filter），通过规则引擎与 AI 模型相结合的方式，从海量路测数据中高效筛选高价值训练样本 4、搭建云端自动化数据挖掘平台，实现异常场景、算法失效案例的自动发现与聚类分析 5、推动自动标注系统的迭代优化，自动化评估驾驶行为质量，自动化清洗坏行为数据，提升标注效率与质量 6、与EBM团队深度协作，将数据闭环产出转化为模型性能的持续提升 7、构建数据质量评估体系，确保训练数据的准确性、多样性与代表性
更新于 2025-09-19
社招1年以上数据开发岗
1、负责自动驾驶数据闭环相关的平台研发工作，制定数据挖掘方案，计划并实施，保证数据质量和闭环效果，为线上模型迭代提供数据支持； 2、负责数据闭环的标定平台、模型部署平台研发工作，通过数据及算法挖掘传感器标定异常，提前发现问题以及风险前置； 3、基于海量自动驾驶场景和行为，科学地管理自动驾驶用户数据和已挖掘的算法问题，研究和设计自动驾驶各算法高效发现问题和利用数据的方案。与算法研发工程师合作，通过数据驱动的方式挖掘自动驾驶算法需要关注的关键场景和高价值数据，参与算法迭代； 4、负责自动驾驶数据闭环相关的策略研发工作，制定项目挖掘方案，计划并实施，保证数据质量和闭环效果。设计和开发挖掘策略/算法/工具，为感知算法任务提供研发迭代需要的数据，支持数据转化为驾驶能力； 5、综合车端的感知、规控、地图、车辆状态等信息，利用大数据技术（如 Flink、Spark）对各种异常 case 进行识别和自动化归因算法开发； 6.负责推进自动驾驶用户数据闭环平台构建、优化，确保闭环科学地、稳定地、高效地运转。基于数据湖技术（如 Hadoop、HDFS、Delta Lake 等）构建高效的数据存储、处理和分析平台。
更新于 2025-06-09
社招5年以上A94770
1. 基于小米自动驾驶数据云平台，建设数据闭环链路，包括但不限于数据挖掘、数据标注、数据集管理、训练平台、评测平台和数据分析等功能，以支持自动驾驶模型的迭代优化； 2. 实现数据闭环的全自动化处理，优化数据和工程平台质量，提升整个数据闭环链路的运行效率； 3. 与算法团队、架构团队密切合作，沉淀通用的数据驱动能力，建设相关的平台工具，提升整体工作效率； 4. 调研行业先进的数据驱动方法，借鉴其中的先进理念和经验，并应用到数据闭环链路建设中，推动技术创新。
更新于 2024-10-31
社招A113161A
1. 负责自动驾驶大规模数据挖掘算法及平台的设计与研发，高效支撑算法数据需求 2. 负责自动驾驶数据集存储系统与管理平台的设计与研发，保障数据集高效发版
更新于 2025-05-08