
平安集团大数据开发岗-数据智能平台团队
社招全职3年以上计算机网络技术类地点:深圳状态:招聘
工作描述
任职要求 1、熟练掌握 Hive/Spark/Flink/Kafka/Hudi/Doris等离线或实时大数据技术栈,具备3年以上大数据实际开发及调优经验; 2、熟悉数仓、集市的模型设计方法论,有大型数仓、集市或指标系统建设经验; 3、熟悉数据…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
Hudi+
[英文] Spark Quick Start
https://hudi.apache.org/docs/quick-start-guide
we will walk through code snippets that allows you to insert, update, delete and query a Hudi table.
https://www.oreilly.com/library/view/apache-hudi-the/9781098173821/
Overcome challenges in building transactional guarantees on rapidly changing data by using Apache Hudi.
https://www.youtube.com/watch?v=pyK18sDYnS0
In this video, I'll introduce you to one of the most popular Data Lake solutions out there, Apache Hudi!
Doris+
https://doris.apache.org/docs/gettingStarted/what-is-apache-doris
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
还有更多 •••
相关职位

校招信息科技类
1.计算机、大数据相关专业; 2.了解大型数据库(如GaussDB)的应用与设计; 3.了解大数据生态圈技术,包括分布式存储HDFS、Hive、HBase及计算框架Spark、Impala等的工作原理
更新于 2026-08-21深圳

社招3年以上数字科技中心
1.计算机、软件工程、数学等相关专业本科及以上学历,3年以上大数据领域开发经验; 2.具备扎实的软件工程基础和系统设计能力,熟悉分布式系统原理,精通至少一种大数据生态技术栈(如Hadoop/Spark
更新于 2026-08-10北京

校招产险信息技术部
1、本科或以上学历,计算机、数学、统计或相关专业,具有数据思维; 2、具备一定的专业技术能力,如熟悉SmartBI等工具、有Oracle、Hive/SparkSql/Kylin/doris等数据库设计
更新于 2025-09-02北京
