快手数据平台开发工程师—【可灵AI】
社招全职3-5年J0012地点:北京 | 深圳状态:招聘
任职要求
1、本科以上学历,计算机相关专业,3年以上后端系统开发经验; 2、熟悉linux操作系统及开发环境,至少精通Python/Java等一门编程语言,具备编写高效数据处理代码的能力; 3、熟悉Flink/Hive/HDFS等数据系统的基本原理,具备大规模数据处理经验; 4、熟…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1、参与快手项目所需的数据采集、清洗、加工与交付处理; 2、设计高效的数据处理工具链,支持亿级数据的ETL; 3、理解数据需求,与业务紧密配合,建立自动化数据处理流程及系统; 4、了解数据治理,持续提升数据质量,挖掘数据价值。
包括英文材料
学历+
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文,免费,零起点,完整示例,基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
HDFS+
https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html
The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware.
https://www.ibm.com/cn-zh/think/topics/hdfs
Hadoop 分布式文件系统 (HDFS) 是一种管理大型数据集的文件系统,可在商用硬件上运行。
MySQL+
https://juejin.cn/post/7190306988939542585
这是一篇 MySQL 通关一篇过硬核经验学习路线,包括数据库相关知识,SQL语句的使用,数据库约束,设计等。
[英文] MySQL Tutorial
https://www.mysqltutorial.org/
your go-to resource for mastering MySQL in a fast, easy, and enjoyable way.
https://www.youtube.com/watch?v=5OdVJbNCSso
MySQL SQL tutorial for beginners
https://www.youtube.com/watch?v=7S_tz1z_5bA
This beginner-friendly course teaches you SQL from scratch.
还有更多 •••
相关职位
社招3-5年J0012
1、负责可灵数据平台前后端架构设计与功能研发,探索并落地通用业务场景的技术解决方案; 2、主导管理后台前后端开发,建设数据资产管理、权限控制、系统配置等核心功能模块; 3、参与平台工程技术体系建设,负责性能优化、代码重构、稳定性保障及数据可视化等基建工具开发,极致提升系统加载速度与运行效率; 4、推动前端交互与用户体验升级,通过组件化、流程化、配置化方案及低代码/页面搭建等技术能力,赋能产品与运营,大幅提升产研团队的交付效率。
更新于 2026-06-09北京|深圳

社招3-5年
岗位职责: 1. 负责离线计算基础组件&平台的开发和维护工作,保证系统的稳定、高效 2. 参与离线数据处理架构设计,提升数据开发效率和数据质量 工作内容: 1. 负责离线计算基础组件(Hadoop、Spark、Hive等)的优化和稳定性建设 2. 负责离线数据平台建设,提升数据开发、调度和运维效率 3. 解决离线数据处理中的性能瓶颈和稳定性问题
更新于 2026-02-26杭州
社招
数据平台架构升级:负责公司级数据平台的研发与维护,利用 AI 技术对传统 ETL 链路进行智能化改造,实现自动化的数据血缘分析、元数据管理及数据质量监控。 AI Agent 平台建设:设计并实现企业级 AI Agent 框架,包括任务规划(Planning)、记忆系统(Memory)、工具调用(Tool Use)等核心模块,使 AI 能够自主完成复杂的数据提取与分析任务。
更新于 2026-04-20北京
