
得物大数据实时计算开发-上海/杭州
社招全职3-5年技术类地点:上海 | 杭州状态:招聘
任职要求
1.至少3-5年实时数仓相关工作经验; 2.熟练掌握Spark、Flink、Kafka等大数据批流应用开发,熟悉原理与性能调优; 3.熟练掌握Java基础,熟悉IO、多线程、缓存、消息、数据库等分布式中间件,深刻理解计算机原理,有良好的数据结构和算法基础,扎实的编程…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1.负责公司电商业务的实时数据开发,为大规模搜索和推荐业务,设计并实现合理、高性能、可扩展的实时数据系统; 2.深入搜索和推荐系统链路,通过实时、丰富、可靠的数据服务,负责算法正倒排数据的研发,提升系统性能和推荐效果; 3.负责实时计算系统的开发,通过对数据流处理节点的DAG编排,提供一站式的实时业务计算平台; 4.负责搜索Dump平台的系统开发,为搜索和推荐引擎提供实时、可靠的数据Dump加工服务;
包括英文材料
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
性能调优+
https://goperf.dev/
The Go App Optimization Guide is a series of in-depth, technical articles for developers who want to get more performance out of their Go code without relying on guesswork or cargo cult patterns.
https://web.dev/learn/performance
This course is designed for those new to web performance, a vital aspect of the user experience.
https://www.ibm.com/think/insights/application-performance-optimization
Application performance is not just a simple concern for most organizations; it’s a critical factor in their business’s success.
https://www.oreilly.com/library/view/optimizing-java/9781492039259/
Performance tuning is an experimental science, but that doesn’t mean engineers should resort to guesswork and folklore to get the job done.
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
多线程+
https://liaoxuefeng.com/books/java/threading/basic/index.html
和单线程相比,多线程编程的特点在于:多线程经常需要读写共享数据,并且需要同步。
https://www.youtube.com/watch?v=_uQgGS_VIXM&list=PLsc-VaxfZl4do3Etp_xQ0aQBoC-x5BIgJ
https://www.youtube.com/watch?v=IEEhzQoKtQU
https://www.youtube.com/watch?v=mTGdtC9f4EU&list=PLL8woMHwr36EDxjUoCzboZjedsnhLP1j4
https://www.youtube.com/watch?v=TPVH_coGAQs&list=PLk6CEY9XxSIAeK-EAh3hB4fgNvYkYmghp
https://www.youtube.com/watch?v=xPqnoB2hjjA
This video is an introduction to multithreading in modern C++.
https://www.youtube.com/watch?v=YKBwKy5PrpQ
Rust threading is easy to implement and improves the efficiency of your applications on multi-core systems!
还有更多 •••
相关职位
社招3年以上技术-基础平台
本岗位聚焦于阿里集团头部电商场景大规模深度学习流程中,样本、特征、索引和模型等数据的计算存储研发,包括但不限于以下职责: 1、构建面向稀疏和多模态模型训练场景的样本存算系统,支持搜推广稀疏模型和大模型训练。 2、开发和维护基于SQL增强的实时样本特征计算服务,推动多个业务场景取得时效性收益。 3、研发批流一体的广告实时数据平台,支持百亿级索引和特征的快速构建和秒级更新,保障实时索引链路稳定性。
更新于 2026-07-22北京
实习
1、参与实现自动驾驶的数据闭环系统,利用大模型提升各个环节的效率 2、设计优化 PB 级大数据管道,并探索基于 agent/skill/MCP 的智能数据运维与调度
更新于 2026-06-16武汉