快手高级数据研发工程师（直播）-【数据平台】
社招全职1-3年J0012地点：北京状态：招聘
工作描述
任职要求 1、有Hudi、Hive、Kafka、Spark、Flink、HBase等两种以上两年以上使用经验；（熟悉Spark MLlib, Flink ML或其他大数据生态中的机器学习库者优先；了解如何利用这些框架支持AI工作流）； 2、熟悉数据仓库理论方法及ETL相关技术，对于数据的架构和设计有一定的思考，具备良好的数学思维和建模思维；具备将业务问题转化为数据问题和潜在AI应用场景的思维；理解特征工程的基本概念及其在数据管道中的重要性； 3、熟悉分布式计算框架，掌握分布式计算的设计与优化能力，了解流式计算；了解分布式机器学习/深度学习框架（如TensorFlow/PyTo…
登录查看完整工作描述
微信扫码，1秒登录
包括英文材料
Hudi+
[英文] Spark Quick Start
https://hudi.apache.org/docs/quick-start-guide
we will walk through code snippets that allows you to insert, update, delete and query a Hudi table.
https://www.oreilly.com/library/view/apache-hudi-the/9781098173821/
Overcome challenges in building transactional guarantees on rapidly changing data by using Apache Hudi.
https://www.youtube.com/watch?v=pyK18sDYnS0
In this video, I'll introduce you to one of the most popular Data Lake solutions out there, Apache Hudi!
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
机器学习+
https://www.youtube.com/watch?v=0oyDqO8PjIg
Learn about machine learning and AI with this comprehensive 11-hour course from @LunarTech_ai.
https://www.youtube.com/watch?v=i_LwzRVP7bg
Learn Machine Learning in a way that is accessible to absolute beginners.
https://www.youtube.com/watch?v=NWONeJKn6kc
Learn the theory and practical application of machine learning concepts in this comprehensive course for beginners.
https://www.youtube.com/watch?v=PcbuKRNtCUc
Learn about all the most important concepts and terms related to machine learning and AI.
还有更多 •••
相关职位
社招A07123
1、精通Unix/Linux操作系统下Java或Scala开发，有良好的编码习惯，有扎实的计算机理论基础； 2、熟练掌握大数据处理技术栈，有丰富的Hadoop/Spark的实际项目使用经验，使用过Fl
更新于 2026-02-04北京
社招3-5年J0012
1、有丰富的数据仓库及数据平台架构经验，通过对AI领域的深入理解，进行数据仓库、数据体系和数据价值的建设和优化； 2、有从事分布式数据存储与计算平台应用开发经验，熟悉Hive，Kafka，Spark，
更新于 2026-06-18北京
社招1-3年J0012
1、较为丰富的数据仓库及数据平台架构经验，期望通过对业务的深入理解，进行数据仓库、数据体系和数据价值的建设和优化； 2、有从事分布式数据存储与计算平台应用开发经验，熟悉Hive，Kafka，Spark
更新于 2026-03-17北京
社招3-5年技术
1.深入理解常用的数据建模理论; 2.熟悉Hadoop生态，熟悉hive，Spark、StarRocks等大数据引擎，有Spark任务调优经验； 3.了解数据治理，理解数据治理的重要性； 4.具备较强
更新于 2026-06-18北京