平安集团大数据研发工程师
社招全职3年以上计算机网络技术类地点：深圳状态：招聘
工作描述
任职要求 1.本科及以上学历，计算机、软件工程、数据科学等相关专业。 2.具备 3 年以上大数据平台、大数据开发、数据中台或数据基础架构研发经验。 3.熟悉 Hadoop 生态，理解 HDFS、YARN、Hive、Spark、MapReduce、HBase、Zookeeper 等核心组件。 4.熟悉 Flink、Kafka、Flink SQL、Spark Streaming 等实时计算技术，有实时数据链路建设经验优先。 5.熟悉数据仓库、数据湖、湖仓一体、数据建模、ETL/ELT、调度系统、元数据管理等相关技术。 6.熟悉 Java / Scala / Pyth…
登录查看完整工作描述
微信扫码，1秒登录
包括英文材料
学历+
数据科学+
https://roadmap.sh/ai-data-scientist
Step by step roadmap guide to becoming an AI and Data Scientist
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Hadoop+
https://www.runoob.com/w3cnote/hadoop-tutorial.html
Hadoop 为庞大的计算机集群提供可靠的、可伸缩的应用层计算和存储支持，它允许使用简单的编程模型跨计算机群集分布式处理大型数据集，并且支持在单台计算机到几千台计算机之间进行扩展。
[英文] Hadoop Tutorial
https://www.tutorialspoint.com/hadoop/index.htm
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models.
HDFS+
https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html
The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware.
https://www.ibm.com/cn-zh/think/topics/hdfs
Hadoop 分布式文件系统 (HDFS) 是一种管理大型数据集的文件系统，可在商用硬件上运行。
Yarn+
[英文] Introduction
https://yarnpkg.com/getting-started
Yarn is an established open-source package manager used to manage dependencies in JavaScript projects.
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
MapReduce+
https://www.youtube.com/watch?v=bcjSe0xCHbE
https://www.youtube.com/watch?v=cHGaQz0E7AU
In this video I explain the basics of Map Reduce model, an important concept for any software engineer to be aware of.
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
ZooKeeper+
https://kubernetes.io/docs/tutorials/stateful-application/zookeeper/
This tutorial demonstrates running Apache Zookeeper on Kubernetes using StatefulSets, PodDisruptionBudgets, and PodAntiAffinity.
https://www.baeldung.com/java-zookeeper
Apache ZooKeeper is a distributed coordination service which eases the development of distributed applications.
[英文] Zookeeper Tutorial
https://www.tutorialspoint.com/zookeeper/index.htm
ZooKeeper is a distributed co-ordination service to manage large set of hosts.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
还有更多 •••
相关职位
实习
1、扎实的C++或Python语言知识及熟练运用，扎实的数据结构与算法知识； 2、计算机、数学、机器学习、机器人、自动驾驶或相关专业优先； 3、有较强的独立解决问题能力，学习能力及沟通能力。具有大模型
更新于 2026-06-16武汉
社招研发类
1. 扎实的计算机理论和编程基础，了解常用的数据结构和算法。 2. 熟练掌握 Java 语言，良好的代码风格和测试习惯，熟悉软件开发流程。 加分项 1. 参与或主导线上系统研发，在大规模、高性能、
更新于 2026-09-03上海
社招技术类
1. 扎实的计算机理论和编程基础，了解常⽤的数据结构和算法。 2. 熟练掌握 Java/C++/Go 语⾔中的⼀种，良好的代码⻛格和测试习惯，熟悉软件开发流程。 3. 较强的学习能⼒和⾃驱⼒，良好的沟
更新于 2026-06-18上海
社招1-5年技术类
1、计算机相关专业，本科及以上学历，1-5年大数据开发相关工作经验，有电商搜索/推荐系统相关研发经验者优先； 2、熟悉Kafka/Spring/MyBatis/Elastic Search/Redi
更新于 2026-01-14上海