拼多多资深/专家实时数据研发工程师
社招全职5年以上技术类地点:上海状态:招聘
任职要求
1.具备扎实的计算机理论基础, 5年以上相关工作经历; 2.精通Java语言编程,具备优秀的系统Debug/Profiling能力和经验; 3.精通并行计算或者分布式计算原理,熟悉高并发、高稳定性、可线性扩展、海量数据的系统特点和技术方案; 4.熟悉Kimball的维度建模设计方法,具备海量数据加工处理(ETL)相关经验; 5.熟悉Flink/Kaf…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1.负责拼多多实时数仓的架构设计和研发,持续集成相关工具产品,建设拼多多统一的实时数据体系; 2.负责拼多多实时数据建模、研发与质量把控,关键技术攻关,不断优化系统性能、降低资源开销; 3.推进批流一体落地,提升拼多多数据采集、生产与使用的时效性; 4.与业务深入合作,以解决实际问题导向,助力业务及产品不断优化; 5.构建丰富多样的实时应用,解决实时数据在数据分析、业务决策、服务化、产品化等场景的一系列挑战
包括英文材料
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
高并发+
https://www.baeldung.com/concurrency-principles-patterns
In this tutorial, we’ll discuss some of the design principles and patterns that have been established over time to build highly concurrent applications.
https://www.baeldung.com/java-concurrency
Handling concurrency in an application can be a tricky process with many potential pitfalls. A solid grasp of the fundamentals will go a long way to help minimize these issues.
https://www.oreilly.com/library/view/concurrency-in-go/9781491941294/
You’ll understand how Go chooses to model concurrency, what issues arise from this model, and how you can compose primitives within this model to solve problems.
https://www.oreilly.com/library/view/modern-concurrency-in/9781098165406/
With this book, you'll explore the transformative world of Java 21's key feature: virtual threads.
https://www.youtube.com/watch?v=qyM8Pi1KiiM
https://www.youtube.com/watch?v=wEsPL50Uiyo
ETL+
https://www.ibm.com/think/topics/etl
ETL—meaning extract, transform, load—is a data integration process that combines, cleans and organizes data from multiple sources into a single, consistent data set for storage in a data warehouse, data lake or other target system.
https://www.youtube.com/watch?v=OW5OgsLpDCQ
It explains what ETL is and what it can do for you to improve your data analysis and productivity.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
Hadoop+
https://www.runoob.com/w3cnote/hadoop-tutorial.html
Hadoop 为庞大的计算机集群提供可靠的、可伸缩的应用层计算和存储支持,它允许使用简单的编程模型跨计算机群集分布式处理大型数据集,并且支持在单台计算机到几千台计算机之间进行扩展。
[英文] Hadoop Tutorial
https://www.tutorialspoint.com/hadoop/index.htm
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models.
还有更多 •••
相关职位
社招5年以上技术类
1. 负责 Flink SQL、Connector 等基础引擎功能开发及优化,降低实时任务开发难度、提高计算效率; 2. 负责 Flink 任务高可用保障、调度优化,提高任务可用性; 3. 负责实时任务问题诊断功能开发; 4. 负责业务支持,提供参考解决方案,推动公司内业务场景实时化; 5. 负责运维操作工具化、自动化,SLO 保障,容量管理、资源容灾及效能优化。
更新于 2026-06-16上海
社招2年以上技术类
1. 负责大数据实时开发平台的开发,支持实时任务的开发、调试、运维、监控等功能;; 2. 负责 Flink 实时计算任务的弹性括缩能力支持,提升易用性、优化资源使用。 3. 负责支持 Flink 实时计算任务适配多云环境运行。
更新于 2026-06-30上海
社招网易游戏(互娱)
1.负责自研引擎的shader、pso、材质变体、shader cache等流程管理优化; 2.负责各平台RHI层接入适配优化; 3.负责游戏客户端引擎渲染相关功能模块设计与移动端落地; 4.与美术直接合作,满足其他职能引擎相关需求并共同推进画面表现提升; 5.负责游戏客户端性能优化以及稳定性提高;
更新于 2026-06-15杭州