百度自动驾驶AI基础平台数据仓库工程师（J84322）
社招全职3年以上IDG地点：北京状态：招聘
任职要求
-计算机相关专业，本科及以上学历，掌握常用算法和数据结构，3年以上工作经验 -熟练掌握Python、C++、Shell等至少一种编程语言和主流数据库技术，熟悉Django、Flask等主流Python框架 -熟练运用容器化技术（如Docker、Kubernetes），对云计算平台的资源管理与调配有实际操作经验 -熟练Mysql、MongoDB、Redis等数据库相关知识及使用场景，了解消息队列的原理和使用 -对大数据系统存储技术有一定了解，具备Elasticsearch、分布式文件存储（如HDFS/NFS）和对象存储（如S3/MinIO）使用开发实践经验 -熟悉自动驾驶数据标注、模型训练流程者优先
工作职责
-深度参与自动驾驶数据流水线开发，构建高可用、易扩展、低延迟的系统服务架构 -参与自动驾驶模型迭代相关的数据仓库、数据处理及车云互联服务开发工作 -设计、开发用户端SDK、API支持自动驾驶数据高效、稳定、高并发低时延地读写 -设计及实现合理的数据生命周期管理策略，保证满足业务数据需求的存储成本控制
包括英文材料
学历+
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
数据结构+
https://www.youtube.com/watch?v=8hly31xKli0
In this course you will learn about algorithms and data structures, two of the fundamental topics in computer science.
https://www.youtube.com/watch?v=B31LgI4Y4DQ
Learn about data structures in this comprehensive course. We will be implementing these data structures in C or C++.
https://www.youtube.com/watch?v=CBYHwZcbD-s
Data Structures and Algorithms full course tutorial java
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
Bash+
[英文] The Bash Guide
https://guide.bash.academy/
A quality-driven guide through the shell's many features.
https://www.youtube.com/watch?v=tK9Oc6AEnR4
Understanding how to use bash scripting will enhance your productivity by automating tasks, streamlining processes, and making your workflow more efficient.
Django+
https://www.youtube.com/watch?v=nGIg40xs9e4
Learn how to build a simple Django application in as fast as 20 minutes!
https://www.youtube.com/watch?v=rHux0gMZ3Eg
Learn Django and start building amazing back-ends!
Flask+
https://www.youtube.com/watch?v=Z1RJmh_OqeA
Flask is a micro web framework written in Python.
Docker+
https://www.youtube.com/watch?v=GFgJkfScVNU
Master Docker in one course; learn about images and containers on Docker Hub, running multiple containers with Docker Compose, automating workflows with Docker Compose Watch, and much more. 🐳
https://www.youtube.com/watch?v=kTp5xUtcalw
Learn how to use Docker and Kubernetes in this complete hand-on course for beginners.
Kubernetes+
https://kubernetes.io/docs/tutorials/kubernetes-basics/
This tutorial provides a walkthrough of the basics of the Kubernetes cluster orchestration system.
https://kubernetes.io/zh-cn/docs/tutorials/kubernetes-basics/
本教程介绍 Kubernetes 集群编排系统的基础知识。每个模块包含关于 Kubernetes 主要特性和概念的一些背景信息，还包括一个在线教程供你学习。
https://www.youtube.com/watch?v=s_o8dwzRlu4
Hands-On Kubernetes Tutorial | Learn Kubernetes in 1 Hour - Kubernetes Course for Beginners
https://www.youtube.com/watch?v=X48VuDVv0do
Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
MySQL+
https://juejin.cn/post/7190306988939542585
这是一篇 MySQL 通关一篇过硬核经验学习路线，包括数据库相关知识，SQL语句的使用，数据库约束，设计等。
[英文] MySQL Tutorial
https://www.mysqltutorial.org/
your go-to resource for mastering MySQL in a fast, easy, and enjoyable way.
https://www.youtube.com/watch?v=5OdVJbNCSso
MySQL SQL tutorial for beginners
https://www.youtube.com/watch?v=7S_tz1z_5bA
This beginner-friendly course teaches you SQL from scratch.
MongoDB+
https://learnxinyminutes.com/mongodb/
MongoDB is a NoSQL document database for high volume data storage.
https://studio3t.com/academy/#courses
The fastest way to learn MongoDB
https://www.youtube.com/watch?v=c2M-rlkkT5o
This video will give you and introduction to MongoDB in 1 Hour. Afterwards I recommend exploring aggregation, replication, and sharding.
https://www.youtube.com/watch?v=ExcRbA7fy_A&list=PL4cUxeGkcC9h77dJ-QJlwGlZlTd4ecZOA
You'll learn how to use MongoDB (a NoSQL database) from scratch. You'll also learn how to integrate it into a simple Node.js API.
Redis+
[英文] Developer Hub
https://redis.io/dev/
Get all the tutorials, learning paths, and more you need to start building—fast.
https://www.runoob.com/redis/redis-tutorial.html
REmote DIctionary Server(Redis) 是一个由 Salvatore Sanfilippo 写的 key-value 存储系统，是跨平台的非关系型数据库。
https://www.youtube.com/watch?v=jgpVdJB2sKQ
In this video I will be covering Redis in depth from how to install it, what commands you can use, all the way to how to use it in a real world project.
消息队列+
https://www.youtube.com/watch?v=xErwDaOc-Gs
ElasticSearch+
https://www.youtube.com/watch?v=a4HBKEda_F8
Learn about Elasticsearch with this comprehensive course designed for beginners, featuring both theoretical concepts and hands-on applications using Python (though applicable to any programming language). The course is structured in two parts: first covering essential Elasticsearch fundamentals including index management, document storage, text analysis, pipeline creation, search functionality, and advanced features like semantic search and embeddings; followed by a practical section where you'll build a real-world website using Elasticsearch as a search engine, working with the Astronomy Picture of the Day (APOD) dataset to implement features such as data cleaning pipelines, tokenization, pagination, and aggregations.
HDFS+
https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html
The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware.
https://www.ibm.com/cn-zh/think/topics/hdfs
Hadoop 分布式文件系统 (HDFS) 是一种管理大型数据集的文件系统，可在商用硬件上运行。
自动驾驶+
https://www.youtube.com/watch?v=_q4WUxgwDeg&list=PL05umP7R6ij321zzKXK6XCQXAaaYjQbzr
Lecture: Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)
https://www.youtube.com/watch?v=NkI9ia2cLhc&list=PLB0Tybl0UNfYoJE7ZwsBQoDIG4YN9ptyY
You will learn to make a self-driving car simulation by implementing every component one by one. I will teach you how to implement the car driving mechanics, how to define the environment, how to simulate some sensors, how to detect collisions and how to make the car control itself using a neural network.
相关职位
社招3年以上IDG
-深度参与自动驾驶数据流水线开发，构建高可用、易扩展、低延迟的系统服务架构 -参与自动驾驶模型迭代相关的数据仓库、数据处理及车云互联服务开发工作 -设计、开发用户端SDK、API支持自动驾驶数据高效、稳定、高并发低时延地读写 -设计及实现合理的数据生命周期管理策略，保证满足业务数据需求的存储成本控制
更新于 2025-04-10
社招3年以上
1. 负责小鹏汽车“扶摇”AI平台数据处理相关的软件开发工作，包括数据加载工具（XDataLoader）和数据集管理平台（XDataset），提供统一的数据加载、转换、缓存与预取能力；目标解决大规模数据加载过程中出现的性能瓶颈、数据一致性、系统稳定性等问题，服务AI大模型的训练和推理； 2. 开发并维护高性能 DataLoader SDK，支持自定义采样、并行读取、缓存预取与数据增强等功能，优化多线程/进程流水线，降低I/O与预处理延迟，简化算法团队接入并提升加载效率； 3. 搭建通用Dataset管理系统，实现多源异构数据（图片、视频、点云、传感器等）的统一接入、解析与格式化； 4. 协同算法团队及其他技术团队，深入理解业务需求，快速响应并落地实现。
更新于 2025-07-22
社招3年以上IDG
-基于AWS或微软云服务，搭建数据反馈关键平台，涵盖数据采集、存储、处理、标注、分析及反馈链路 -实现数据闭环自动化，包括触发式数据回传、关键场景挖掘、模型迭代验证等环节 -设计高可用、可扩展的云架构，优化数据存储与计算资源效率 -开发数据质量监控系统，提升数据利用率和算法泛化能力 -负责基于AWS或微软云的自动驾驶仿真平台开发 -负责设计、开发和优化基于AWS云服务的自动驾驶可视化仿真系统架构，支持高并发、低延迟的仿真场景测试 -构建云原生仿真工具链，整合数据管理、场景生成、结果分析等模块，提升仿真效率与可扩展性 -跨团队协作与技术沉淀 -与算法团队紧密合作，确保仿真环境与自动驾驶感知、规划、控制模块的精准对接 -主导技术文档编写与开源工具链研究，推动团队技术标准化
更新于 2025-04-10
社招3年以上IDG
-负责自动驾驶仿真平台前端开发 -开发高精度3D可视化仿真引擎，支持传感器数据（LiDAR、Camera、Radar）的动态渲染与实时交互，实现仿真场景的分布式可视化展示。 -Kubernetes（k8s）与云服务管理 -基于K8s搭建容器化仿真服务平台，微服务化架构，实现仿真服务的弹性伸缩、负载均衡与故障恢复 -跨团队协作与技术沉淀 -与算法团队紧密合作，确保仿真环境与自动驾驶感知、规划、控制模块的精准对接。 -主导技术文档编写与开源工具链研究，推动团队技术标准化。
更新于 2025-04-10