米哈游LLM网关SRE工程师
社招全职5年以上程序&技术类地点:上海状态:招聘♡ 收藏
工作描述
任职要求 1. 5 年以上运维/SRE 经验,其中 2 年以上 LLM/AI 推理服务/大模型平台生产运维经验; 2. 深度熟悉 LLM 服务线上运维(流式、限流、Token 计量、模型路由、多模型调度等); 3. 熟悉 Kubernetes、Prometheus/Grafana,有 LLM 监控指标设计与告警治理经验; 4. 熟悉 vLLM、Triton、SGLang 等推理引擎部署运维及常见故障处理; 5. 熟悉 CI/CD 与灰度发布,了解 GPU/NPU 推理资源特性,具备 SLO/On-call 经验; 6. 熟练使用 Go/…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
Kubernetes+
https://kubernetes.io/docs/tutorials/kubernetes-basics/
This tutorial provides a walkthrough of the basics of the Kubernetes cluster orchestration system.
https://kubernetes.io/zh-cn/docs/tutorials/kubernetes-basics/
本教程介绍 Kubernetes 集群编排系统的基础知识。每个模块包含关于 Kubernetes 主要特性和概念的一些背景信息,还包括一个在线教程供你学习。
https://www.youtube.com/watch?v=s_o8dwzRlu4
Hands-On Kubernetes Tutorial | Learn Kubernetes in 1 Hour - Kubernetes Course for Beginners
https://www.youtube.com/watch?v=X48VuDVv0do
Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
Prometheus+
https://grafana.com/docs/grafana/latest/getting-started/get-started-grafana-prometheus/
Prometheus is an open source monitoring system for which Grafana provides out-of-the-box support.
https://prometheus.io/docs/tutorials/getting_started/
Prometheus is a system monitoring and alerting system.
Grafana+
vLLM+
https://www.newline.co/@zaoyang/ultimate-guide-to-vllm--aad8b65d
vLLM is a framework designed to make large language models faster, more efficient, and better suited for production environments.
https://www.youtube.com/watch?v=Ju2FrqIrdx0
vLLM is a cutting-edge serving engine designed for large language models (LLMs), offering unparalleled performance and efficiency for AI-driven applications.
Triton Inference Server+
https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html
Triton Inference Server is an open source inference serving software that streamlines AI inferencing.
SGLang+
[英文] Install SGLang
https://docs.sglang.ai/get_started/install.html
SGLang is a fast serving framework for large language models and vision language models.
https://github.com/sgl-project/sgl-learning-materials
还有更多 •••
相关职位
实习阿里巴巴研究型实
1. Agent方向:深入理解Transformer架构、掌握预训练(Pretrain)、监督微调(SFT)等基础算法,并深入应用 RLHF、RLAIF、DPO/GRPO 等对齐技术; 2. LLM方
更新于 2026-03-20杭州
实习阿里巴巴2027
1、计算机科学、人工智能、机器学习或相关领域硕士或博士学位; 2、具备 LLM 训练或后训练(fine-tuning / post-training)经验; 3、在 NeurIPS、ICML、ICLR
更新于 2026-04-08杭州|森尼韦尔
实习阿里巴巴2027
1、计算机科学、人工智能、机器学习或相关领域硕士或博士学位; 2、具备 LLM 训练或后训练(fine-tuning / post-training)经验; 3、在 NeurIPS、ICML、ICLR
更新于 2026-04-08杭州