网易大数据组件运维工程师(ES)
社招全职3-5年网易游戏(互娱)地点:广州状态:招聘
任职要求
1.本科以上学历,2年以上大数据运维经验。 2.良好的计算机和Linux基础,熟悉Linux操作系统原理与命令。 3.熟悉主流的大数据组件,如Kafka/HDFS/Pulsar/Hbase/ES中任意一种或几种,有大数据运…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1.负责大数据相关组件Kafka/Pulsar/ElasticSearch/Hbase部署,运维,监控等工作,保证服务稳定性。 2.为相关大数据组件提供完善的指标/告警体系,持续优化相关平台与组件的性能与成本。 3.为相关大数据组件开发运维脚本,提升组件与平台的运维自动化水平。
包括英文材料
学历+
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
HDFS+
https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html
The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware.
https://www.ibm.com/cn-zh/think/topics/hdfs
Hadoop 分布式文件系统 (HDFS) 是一种管理大型数据集的文件系统,可在商用硬件上运行。
Pulsar+
https://pulsar.apache.org/docs/next/functions-develop-tutorial/
Write a function for word count.
https://www.baeldung.com/apache-pulsar
Apache Pulsar is a distributed open source Publication/Subscription based messaging system developed at Yahoo.
https://www.youtube.com/watch?v=TKs5T6N78Tc
Discover the seven key features of Apache Pulsar that make it perfect for providing a centralized messaging & data streaming service for an Enterprise.
还有更多 •••
相关职位
社招5年以上信息技术类
岗位描述 1.负责 hdfs/yarn on k8s性能优化、高可用、弹性扩缩容与多活灾备方案 2.落地并优化yarn on k8s,并为大规模spark/hive计算提供高效支持。 3.负责hdfs/yarn on k8s业务问题解决,日常稳定性保障。 4.参与运维自动化平台功能研发。
更新于 2025-12-10南京|深圳
实习
1、参与实现自动驾驶的数据闭环系统,利用大模型提升各个环节的效率 2、设计优化 PB 级大数据管道,并探索基于 agent/skill/MCP 的智能数据运维与调度
更新于 2026-06-16武汉