网易大数据平台开发工程师
社招全职3-5年网易游戏(雷火)地点:杭州状态:招聘
工作描述
任职要求 1. 全日制本科及以上学历,计算机科学、软件工程或相关专业; 2. 熟悉大数据生态体系,具备以下一种或多种引擎的实际项目经验:Iceberg、Flink、Spark、HBase、Hive、Trino、Doris、Kafka、Milvus 等; 3. 熟练掌握 Java 或 Python 编程语言,…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
学历+
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Iceberg+
https://iceberg.apache.org/spark-quickstart/
This guide will get you up and running with Apache Iceberg™ using Apache Spark™, including sample code to highlight some powerful features.
https://www.baeldung.com/apache-iceberg-intro
This tutorial will discuss Apache Iceberg, a popular open table format in today’s big data landscape.
https://www.youtube.com/watch?v=TsmhRZElPvM
You’ve probably heard about Apache Iceberg™—after all, it’s been getting a lot of buzz.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
Doris+
https://doris.apache.org/docs/gettingStarted/what-is-apache-doris
还有更多 •••
相关职位
校招技术
我们希望你具备以下条件: 1. 全日制本科及以上学历,计算机科学、软件工程或相关专业; 2. 了解大数据生态体系,具备以下一种或多种引擎的实际项目经验尤佳:Iceberg、Flink、Spark、Tr
杭州
社招智能与信息技术
1、全日制统招本科及以上学历,计算机相关专业 2、熟悉数据湖和元数据概念原理,Iceberg/Paimon/Lance及Gravitino/Polaris/Unity Catalog; 3、熟悉MPP
北京
社招3年以上火车票业务开发
1.计算机、软件工程、数据相关专业本科及以上学历。 2.3 年及以上数据开发或大数据平台开发相关工作经验。 3.扎实的计算机基础,熟练掌握 Java 编程,熟悉主流 Java 开发
更新于 2025-12-02上海