阿里云诚云科技-资深应用运维工程师-开源大数据平台
社招全职3年以上诚云科技地点：北京 | 杭州状态：招聘
任职要求
1、有K8S/主流开源大数据大数据引擎（Flink/EMR/Spark/StarRocks/ES/Hadoop/K8S）的运维经验，熟悉分布式系统原理及Linux原理 2、熟悉Golang/Python/Java至少一门编程语言，有运维平台开发建设经验，如有AIOps智能运维经验是加分项 3、要具备稳定性安全生产落地实战经验，包括高可用架构、可观测性&监控、异常处置、SLA&可用率、节点自愈等 4、有良好沟通及项目推动协作能力，做事严谨仔细、具备较好韧性
工作职责
1、负责阿里云开源大数据平台（Flink/EMR/Spark/StarRocks/ES/Hadoop/K8S）运维工作，包括可观测性链路、监控报警，故障应急及处置、SLA可用率度量提升等 2、研发大数据运维管控平台，通过自动化提升运维效率，包括交付&变更CICD、智能诊断定界等 3、落地AIOps智能运维，通过AI算法提升稳定性，包括异常检测、根因定位及基于大模型&智能体Agent运维落地等 4、负责稳定性架构设计及项目组织推动落地，包括基础架构云原生化、跨AZ高可用架构、产品可运维性架构演进等
包括英文材料
Kubernetes+
https://kubernetes.io/docs/tutorials/kubernetes-basics/
This tutorial provides a walkthrough of the basics of the Kubernetes cluster orchestration system.
https://kubernetes.io/zh-cn/docs/tutorials/kubernetes-basics/
本教程介绍 Kubernetes 集群编排系统的基础知识。每个模块包含关于 Kubernetes 主要特性和概念的一些背景信息，还包括一个在线教程供你学习。
https://www.youtube.com/watch?v=s_o8dwzRlu4
Hands-On Kubernetes Tutorial | Learn Kubernetes in 1 Hour - Kubernetes Course for Beginners
https://www.youtube.com/watch?v=X48VuDVv0do
Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
StarRocks+
https://docs.starrocks.io/docs/quick_start/
These Quick Start guides will help you get going with a small StarRocks environment.
https://itnext.io/introduction-to-starrocks-a-new-modern-analytical-database-1db2177d26e1
Recently, I had the opportunity to explore StarRocks which is the new kid in the block when talking about massive scale databases which are able to handle petabytes of data.
ElasticSearch+
https://www.youtube.com/watch?v=a4HBKEda_F8
Learn about Elasticsearch with this comprehensive course designed for beginners, featuring both theoretical concepts and hands-on applications using Python (though applicable to any programming language). The course is structured in two parts: first covering essential Elasticsearch fundamentals including index management, document storage, text analysis, pipeline creation, search functionality, and advanced features like semantic search and embeddings; followed by a practical section where you'll build a real-world website using Elasticsearch as a search engine, working with the Astronomy Picture of the Day (APOD) dataset to implement features such as data cleaning pipelines, tokenization, pagination, and aggregations.
Hadoop+
https://www.runoob.com/w3cnote/hadoop-tutorial.html
Hadoop 为庞大的计算机集群提供可靠的、可伸缩的应用层计算和存储支持，它允许使用简单的编程模型跨计算机群集分布式处理大型数据集，并且支持在单台计算机到几千台计算机之间进行扩展。
[英文] Hadoop Tutorial
https://www.tutorialspoint.com/hadoop/index.htm
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models.
分布式系统+
https://www.distributedsystemscourse.com/
The home page of a free online class in distributed systems.
https://www.youtube.com/watch?v=7VbL89mKK3M&list=PLOE1GTZ5ouRPbpTnrZ3Wqjamfwn_Q5Y9A
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
Go+
https://www.youtube.com/watch?v=8uiZC0l4Ajw
学习Golang的完整教程！从开始到结束不到一个小时，包括如何在Go中构建API的完整演示。没有多余的内容，只有你需要知道的知识。
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
高可用+
https://redis.io/blog/high-availability-architecture/
A high available architecture is when there are a number of different components, modules, or services that work together to maintain optimal performance, irrespective of peak-time loads.
https://www.ibm.com/think/topics/high-availability
High availability (HA) is a term that refers to a system’s ability to be accessible and reliable close to 100% of the time.
相关职位
社招3年以上诚云科技
ꔷ 主导疑难问题工单的分析与解决，保障客户核心业务稳定运行； ꔷ 参与客户业务重保（Critical Support）方案设计与执行，提升客户满意度。 用户体验优化与产品改进 ꔷ 从工单中定位产品缺陷，提炼用户需求，提出优化建议； ꔷ 推动产品质量与功能迭代，通过技术改进提升用户体验。 运维平台智能化建设 ꔷ 参与大数据运维平台的产品化及智能化升级，主导售后工具、运维平台的开发与优化； ꔷ 基于历史工单数据、开源社区知识库，结合 MCP、RAG 等大模型技术，构建智能运维体系，提升售后响应效率与问题解决能力。 运维服务体系建设 ꔷ 负责运维服务体系的规划与落地，包括团队生态人员招聘、技能培养及知识沉淀； ꔷ 制定运维能力提升计划，确保团队高效支持复杂场景
更新于 2025-08-04
社招3-5年技术
1. 系统开发与实现：依据风控平台的业务需求，负责核心模块的代码编写，涵盖风险评估、预警规则设定、用户行为分析等功能的具体实现，确保代码的质量和可维护性；运用 Java 相关技术，如 Spring Boot、Spring Cloud 等框架，搭建稳定、高效的系统架构，保障平台在高并发、大数据量环境下的稳定运行 。 2. 数据处理与算法应用：参与处理和分析海量的风险数据，包括用户交易数据、信用数据等，借助数据挖掘算法和机器学习技术，构建风险预测模型，为风险评估和控制提供数据支持；优化现有算法，提升风险识别的准确性和及时性，降低误判率 。 3. 技术协作与沟通：与产品团队紧密合作，理解业务需求，将其转化为可行的技术方案；协同测试团队，进行联调测试，及时解决测试过程中发现的问题，保障系统的稳定性和可靠性；与运维团队协作，协助完成系统的部署、监控和维护工作，确保系统的持续稳定运行 。 4. 问题解决与优化：实时监控风控平台的运行状态，快速定位并解决系统出现的故障和性能瓶颈，如响应延迟、数据异常等问题；根据业务发展和用户反馈，持续对系统进行优化和升级，提升系统的性能和用户体验 。
更新于 2025-05-16
社招3年以上金融服务平台
1. 负责为美团金服销售业务建设稳定高可用的系统，能支撑业务快速变化，业务量高速增长；（业务支撑） 2. 面对信贷账户的业务规模，从整体上规划系统的容量、稳定性，制定有效的技术解决方案和迭代计划，持续提升系统的高并发、高可用、扩展性、资金安全处理能力； 3. 主动发现和分析产品存在的用户痛点和技术问题，提出全链路可行的改进方案，并能推动业务、产品、研发多方合作落地实施； 4. 指导初级工程师，提高团队技术能力及战斗力；
更新于 2025-06-22
社招3年以上金融服务平台
1. 负责美团金服信贷业务建设稳定高可用的系统，能支撑业务快速变化，业务量高速增长；（业务支撑） 2. 面对信贷账户的业务规模，从整体上规划系统的容量、稳定性，制定有效的技术解决方案和迭代计划，持续提升系统的高并发、高可用、扩展性、资金安全处理能力； 3. 主动发现和分析产品存在的用户痛点和技术问题，提出全链路可行的改进方案，并能推动业务、产品、研发多方合作落地实施； 4. 指导初级工程师，提高团队技术能力及战斗力；
更新于 2025-07-23