阿里巴巴阿里妈妈-AI数据研发工程师(数据湖仓 / Data Agent)-杭州/北京
社招全职3年以上地点:北京 | 杭州状态:招聘♡ 收藏
工作描述
任职要求 1. 本科及以上,计算机、软件工程、数学等相关专业,3 年以上大数据研发经验,独立负责过一个湖仓或实时数据平台方向的完整建设周期。 2. 精通 SQL 与 ETL 数据建模,具备主题域划分、维度建模与指标体系设计的落地经验。 3. 对 Iceberg、Hudi、Paimon 中至少一种达到原理级,有线上问题定位经历,具备数据入湖与存储治理的实践经验。 4. 深入 Flink 运行时机制,具备大规模流批一体任务的性能排查与调优经验。 5. 熟悉 StarRocks、ClickHouse、Doris 等 OLAP 引擎,具备高并…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
SQL+
https://liaoxuefeng.com/books/sql/introduction/index.html
什么是SQL?简单地说,SQL就是访问和处理关系数据库的计算机标准语言。
https://sqlbolt.com/
Learn SQL with simple, interactive exercises.
https://www.youtube.com/watch?v=p3qvj9hO_Bo
In this video we will cover everything you need to know about SQL in only 60 minutes.
ETL+
https://www.ibm.com/think/topics/etl
ETL—meaning extract, transform, load—is a data integration process that combines, cleans and organizes data from multiple sources into a single, consistent data set for storage in a data warehouse, data lake or other target system.
https://www.youtube.com/watch?v=OW5OgsLpDCQ
It explains what ETL is and what it can do for you to improve your data analysis and productivity.
Iceberg+
https://iceberg.apache.org/spark-quickstart/
This guide will get you up and running with Apache Iceberg™ using Apache Spark™, including sample code to highlight some powerful features.
https://www.baeldung.com/apache-iceberg-intro
This tutorial will discuss Apache Iceberg, a popular open table format in today’s big data landscape.
https://www.youtube.com/watch?v=TsmhRZElPvM
You’ve probably heard about Apache Iceberg™—after all, it’s been getting a lot of buzz.
Hudi+
[英文] Spark Quick Start
https://hudi.apache.org/docs/quick-start-guide
we will walk through code snippets that allows you to insert, update, delete and query a Hudi table.
https://www.oreilly.com/library/view/apache-hudi-the/9781098173821/
Overcome challenges in building transactional guarantees on rapidly changing data by using Apache Hudi.
https://www.youtube.com/watch?v=pyK18sDYnS0
In this video, I'll introduce you to one of the most popular Data Lake solutions out there, Apache Hudi!
Paimon+
https://paimon.apache.org/docs/master/concepts/
Apache Paimon is a table format for data lakes that supports batch and streaming workloads.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
StarRocks+
https://docs.starrocks.io/docs/quick_start/
These Quick Start guides will help you get going with a small StarRocks environment.
https://itnext.io/introduction-to-starrocks-a-new-modern-analytical-database-1db2177d26e1
Recently, I had the opportunity to explore StarRocks which is the new kid in the block when talking about massive scale databases which are able to handle petabytes of data.
还有更多 •••
相关职位
社招2年以上
1、丰富的大数据研发经验,主导过复杂数据体系从0到1建设或大规模演进;能结合业务场景设计高复用、可扩展的数据资产体系,有物流、供应链等复杂业务经验者优先; 2、具备面向AI消费的数据资产设计与建模能力
更新于 2026-01-05杭州
社招3年以上程序&技术类
1.本科及以上学历,计算机科学、软件工程等相关专业; 2.熟练掌握 Java 和 Python,3年及以上相关开发经验; 3.深入理解 Spark、Ray 等分布式计算框架,了解其在 ML 场景下的应
上海
社招3年以上程序&技术类
1)本科及以上学历,计算机科学、软件工程相关专业; 2)精通 Java 和 Python,具备3年以上相关开发经验; 3)深入理解 Spark、Ray 分布式计算框架,了解其在 ML 场景下的应用;
上海
