蔚来校招-数据开发工程师
校招全职数据分析地点：武汉状态：招聘
任职要求
掌握维度建模设计方法，具备海量数据加工处理（ETL）经验，具备良好的SQL编写能力 掌握数仓领域知识和技能，包括但不局限于：数据集市设计，元数据管理，数据质量 掌握Spark，FLink 数据开发框架，有实际的开发使用经验 了解Hadoop，Kafka，Clickhouse,Starrocks等大数据技术体系者优先 了解Iceberg，Hudi，Paimon 等数据湖技术细节者优先 具备良好的沟通和团队协作能力，做事主动积极负责，有技术热情和激情面对挑战
工作职责
1.负责公司级核心数据资产开发和建设，支撑核心业务场景设计和开发落地，实现业务价值 2.参与数据产品与应用的数据研发，发掘数据商业价值，和产品技术团队一起打造极致体验的数据产品 3.结合业务方向，深度挖掘数据需求，形成技术方案，探索行业前沿技术
包括英文材料
ETL+
https://www.ibm.com/think/topics/etl
ETL—meaning extract, transform, load—is a data integration process that combines, cleans and organizes data from multiple sources into a single, consistent data set for storage in a data warehouse, data lake or other target system.
https://www.youtube.com/watch?v=OW5OgsLpDCQ
It explains what ETL is and what it can do for you to improve your data analysis and productivity.
SQL+
https://liaoxuefeng.com/books/sql/introduction/index.html
什么是SQL？简单地说，SQL就是访问和处理关系数据库的计算机标准语言。
https://sqlbolt.com/
Learn SQL with simple, interactive exercises.
https://www.youtube.com/watch?v=p3qvj9hO_Bo
In this video we will cover everything you need to know about SQL in only 60 minutes.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
开发框架+
[英文] Understanding Modern Development Frameworks: A Guide for Developers and Technical Decision-makers
https://www.freecodecamp.org/news/understanding-modern-development-frameworks-guide-for-devs/
Hadoop+
https://www.runoob.com/w3cnote/hadoop-tutorial.html
Hadoop 为庞大的计算机集群提供可靠的、可伸缩的应用层计算和存储支持，它允许使用简单的编程模型跨计算机群集分布式处理大型数据集，并且支持在单台计算机到几千台计算机之间进行扩展。
[英文] Hadoop Tutorial
https://www.tutorialspoint.com/hadoop/index.htm
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models.
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
ClickHouse+
[英文] Advanced Tutorial
https://clickhouse.com/docs/tutorial
Learn how to ingest and query data in ClickHouse using the New York City taxi example dataset.
https://www.youtube.com/watch?v=FtoWGT7kS-c
ClickHouse is an open-source column-oriented DBMS for online analytical processing that allows users to generate analytical reports using SQL queries in real-time.
https://www.youtube.com/watch?v=Rhe-kUyrFUE&list=PL0Z2YDlm0b3gcY5R_MUo4fT5bPqUQ66ep
StarRocks+
https://docs.starrocks.io/docs/quick_start/
These Quick Start guides will help you get going with a small StarRocks environment.
https://itnext.io/introduction-to-starrocks-a-new-modern-analytical-database-1db2177d26e1
Recently, I had the opportunity to explore StarRocks which is the new kid in the block when talking about massive scale databases which are able to handle petabytes of data.
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Iceberg+
https://iceberg.apache.org/spark-quickstart/
This guide will get you up and running with Apache Iceberg™ using Apache Spark™, including sample code to highlight some powerful features.
https://www.baeldung.com/apache-iceberg-intro
This tutorial will discuss Apache Iceberg, a popular open table format in today’s big data landscape.
https://www.youtube.com/watch?v=TsmhRZElPvM
You’ve probably heard about Apache Iceberg™—after all, it’s been getting a lot of buzz.
Hudi+
[英文] Spark Quick Start
https://hudi.apache.org/docs/quick-start-guide
we will walk through code snippets that allows you to insert, update, delete and query a Hudi table.
https://www.oreilly.com/library/view/apache-hudi-the/9781098173821/
Overcome challenges in building transactional guarantees on rapidly changing data by using Apache Hudi.
https://www.youtube.com/watch?v=pyK18sDYnS0
In this video, I'll introduce you to one of the most popular Data Lake solutions out there, Apache Hudi!
相关职位
校招数据分析
1. 参与公司大数据平台的设计与开发工作，运用先进技术优化平台架构，提升平台性能与稳定性，确保能够高效处理海量数据； 2. 负责数据仓库的建设，包括数据模型的设计与构建。深入理解业务需求，运用维度建模等方法，构建科学合理的数据模型，为数据分析和决策提供坚实的数据基础； 3. 承担数据集成数据开发和数据运维工作。从多种数据源获取数据，运用数据清洗算法和工具，去除噪声数据和重复数据，将数据转换为适合分析的格式，并高效加载到数据仓库中； 4. 与数据分析师、算法工程师等团队紧密合作，为数据分析和算法模型提供高质量的数据支持。理解需求，提供定制化的数据服务，助力挖掘数据价值，推动业务发展； 5. 参与数据治理工作，制定并执行数据质量标准，保障数据的准确性、完整性和一致性。通过元数据、质量体系有效管理和组织PB级别数据
更新于 2025-08-25
校招
1. 自动驾驶数据建模 - 设计多源异构数据的数仓分层模型（ODS/DWD/DWS/ADS），支撑感知、预测等算法训练； - 设计支持相似性检索的数仓分层（ADS层集成VectorDB特性）； - 构建数据血缘与元数据管理体系，保障数据可追溯性； - 构建多模态数据的统一向量化标准（图像/点云/文本的Embedding规范）。 2. 大规模数据处理开发 - 开发高可靠ETL流程，处理车载传感器原始数据（摄像头/LiDAR/GPS等）； - 基于Spark/Flink优化数据清洗、转换、聚合任务，提升云端处理效能； - 开发多模态Embedding流水线（CV/NLP模型的分布式特征提取）； - 基于VLM（视觉语言模型）自动生成数据标签（替代人工标注）； - 构建驾驶场景语义索引系统（支持“极端天气”“危险变道”等语义检索）。 3. 分析平台建设 - 搭建数据湖仓一体架构（Paimon/Iceberg + Doris/StarRocks）； - 搭建海量特征向量数据库（Milvus/Pinecone/自研引擎）； - 开发BI可视化看板，监控数据质量及自动驾驶关键指标（生产折损率，感知准确率、干预率等）； - 开发多模态检索接口（如根据文本描述搜索关联驾驶场景视频）。 4. 效率优化 - 持续优化数据存储成本与计算性能（分区策略/压缩算法/计算资源调度）； - 探索弹性伸缩，流批一体，存算分离等架构在实时数据处理场景的应用。
更新于 2025-08-08
校招
1、参与数据需求的分析，开发及交付工作，协助客户优化业务，提升效率，驱动增长； 2、参与公司统一数仓平台的模型设计， 研发及优化工作，助力企业数据价值挖掘与数据资产变现； 3、落实公司数据治理的相关流程与规范要求，为平台数据产出及时性、准确性、一致性提供支持与保障。
更新于 2025-07-31
校招软件研发
1. 负责智能辅助驾驶场景数据平台开发，包括但不限于数据打标，数据挖掘，数据自动/辅助标注，模型训练工程化。 2. 负责数据闭环业务流串联开发，推进算法模块，各个子系统的生产流程自动化，提高迭代效率。
更新于 2025-08-25