快手大数据调度&大模型训练AI-Infra工程师/专家
社招全职3-5年J0012地点:北京状态:停招♡ 收藏
工作描述
任职要求 1、有大数据引擎(Spark&Flink)、大模型训练AI-Infra优化经验优先,参与过大规模分布式系统开源贡献,或在相关领域有论文产出者加分; 2、熟悉K8S&了解Yarn调度,熟悉机器学习相关技术,有规范的文档撰写习惯,关注业界计算基础设施发展趋势; 3、本科及以上学历,计算机相关专业…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
分布式系统+
https://www.distributedsystemscourse.com/
The home page of a free online class in distributed systems.
https://www.youtube.com/watch?v=7VbL89mKK3M&list=PLOE1GTZ5ouRPbpTnrZ3Wqjamfwn_Q5Y9A
Kubernetes+
https://kubernetes.io/docs/tutorials/kubernetes-basics/
This tutorial provides a walkthrough of the basics of the Kubernetes cluster orchestration system.
https://kubernetes.io/zh-cn/docs/tutorials/kubernetes-basics/
本教程介绍 Kubernetes 集群编排系统的基础知识。每个模块包含关于 Kubernetes 主要特性和概念的一些背景信息,还包括一个在线教程供你学习。
https://www.youtube.com/watch?v=s_o8dwzRlu4
Hands-On Kubernetes Tutorial | Learn Kubernetes in 1 Hour - Kubernetes Course for Beginners
https://www.youtube.com/watch?v=X48VuDVv0do
Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
还有更多 •••
相关职位
社招3年以上大数据(数据计算
1.职位要求; 2.计算机相关专业本科及以上学历,3年以上java后端开发经验; 3.能够独立设计和实现核心模块,有高并发、高可用系统设计经验; 4.有大数据调度系统开发经验,熟悉至少一种主流调度系统
更新于 2026-08-14深圳
社招技术类
1. 扎实的计算机理论和编程基础,了解常⽤的数据结构和算法; 2. 熟练掌握 Java/C++/Go 语⾔中的⼀种,良好的代码⻛格和测试习惯,熟悉软件开发流程; 3. 较强的学习能⼒和⾃驱⼒,良好的沟
更新于 2026-06-16上海
社招技术类
1. 扎实的计算机理论和编程基础,了解常⽤的数据结构和算法。 2. 熟练掌握 Java/C++/Go 语⾔中的⼀种,良好的代码⻛格和测试习惯,熟悉软件开发流程。 3. 较强的学习能⼒和⾃驱⼒,良好的沟
更新于 2026-06-18上海