
转转服务器运维工程师(大模型部署与运维方向)(J15153)
社招全职3年以上地点:北京状态:招聘♡ 收藏
工作描述
任职要求 同上 工作职责 一.岗位概述 公司即将采购服务器并建设本地大模型运行环境,重点部署国产开源/可私有化大模型(如 DeepSeek、Qwen、Kimi 系列等)。现招聘若干名服务器运维工程师,作为大模型基础设施运维核心成员,负责服务器到货后的环境搭建、模型部署、外部技术对接、日常运维与内部使用支持,保障 2~3 个大模型稳定上线并服务公司内部业务。 二、岗位职责 1. 参与服务器采购后的技术评估、到货验收、上架规划、系统安装、网络配置、存储挂载及基础环境初始化。 2. 负责 GPU/CPU 服务器基础环境建设,包括 GPU 驱动、CUDA、cuDNN、NCCL、容器运行时、Docker、Kubernetes 等安装与维护。 3. 牵头对接外部技术团队、供应商、开源社区或合作方,完成 2~3 个国产开源大模型(如 DeepSeek、Qwen、Kimi 等)的本地化部署、推理服务上线、API 封装与内部接入。 4. 负责大模型推理服务的日常运维,包括服务启停、版本更新、模型切换、日志管理、监控告警、故障排查与恢复。 5. 监控 GPU 利用率、显存、温度、推理延迟、吞吐量、并发能力等关键指标,持续优化推理性能与资源利用率。 6. 负责模型量化、推理加速、批处理、并行策略等优化工作,熟悉 vLLM、SGLan…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
CUDA+
https://developer.nvidia.com/blog/even-easier-introduction-cuda/
This post is a super simple introduction to CUDA, the popular parallel computing platform and programming model from NVIDIA.
https://www.youtube.com/watch?v=86FAWCzIe_4
Lean how to program with Nvidia CUDA and leverage GPUs for high-performance computing and deep learning.
NCCL+
https://developer.nvidia.com/nccl
The NVIDIA Collective Communication Library (NCCL) implements multi-GPU and multi-node communication primitives optimized for NVIDIA GPUs and networking.
Docker+
https://www.youtube.com/watch?v=GFgJkfScVNU
Master Docker in one course; learn about images and containers on Docker Hub, running multiple containers with Docker Compose, automating workflows with Docker Compose Watch, and much more. 🐳
https://www.youtube.com/watch?v=kTp5xUtcalw
Learn how to use Docker and Kubernetes in this complete hand-on course for beginners.
Kubernetes+
https://kubernetes.io/docs/tutorials/kubernetes-basics/
This tutorial provides a walkthrough of the basics of the Kubernetes cluster orchestration system.
https://kubernetes.io/zh-cn/docs/tutorials/kubernetes-basics/
本教程介绍 Kubernetes 集群编排系统的基础知识。每个模块包含关于 Kubernetes 主要特性和概念的一些背景信息,还包括一个在线教程供你学习。
https://www.youtube.com/watch?v=s_o8dwzRlu4
Hands-On Kubernetes Tutorial | Learn Kubernetes in 1 Hour - Kubernetes Course for Beginners
https://www.youtube.com/watch?v=X48VuDVv0do
Full Kubernetes Tutorial | Kubernetes Course | Hands-on course with a lot of demos
vLLM+
https://www.newline.co/@zaoyang/ultimate-guide-to-vllm--aad8b65d
vLLM is a framework designed to make large language models faster, more efficient, and better suited for production environments.
https://www.youtube.com/watch?v=Ju2FrqIrdx0
vLLM is a cutting-edge serving engine designed for large language models (LLMs), offering unparalleled performance and efficiency for AI-driven applications.
SGLang+
[英文] Install SGLang
https://docs.sglang.ai/get_started/install.html
SGLang is a fast serving framework for large language models and vision language models.
https://github.com/sgl-project/sgl-learning-materials
Ollama+
https://www.youtube.com/watch?v=GWB9ApTPTv4
Learn how to set up and use Ollama to build powerful AI applications locally.
https://www.youtube.com/watch?v=UtSSMs6ObqY
In this short video, I'll teach you everything you need to know to get up and running with Ollama.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
llama.cpp+
https://blog.steelph0enix.dev/posts/llama-cpp-guide/
No LLMs were harmed during creation of this post.
https://github.com/ggml-org/llama.cpp/discussions/15396
This is a detailed guide for running the new gpt-oss models locally with the best performance using llama.cpp.
https://www.youtube.com/watch?v=EPYsP-l6z2s
In this guide, you'll learn how to run local llm models using llama.cpp.
TGI+
https://huggingface.co/docs/text-generation-inference/en/index
Text Generation Inference (TGI) is a toolkit for deploying and serving Large Language Models (LLMs).
https://learn.ritual.net/examples/tgi_inference_with_mistral_7b
In this tutorial, we will use Huggingface's TGI (Text Generation Interface) API to query a Large Language Model (LLM) and enable users to requests jobs from it, both on-chain and off-chain.
https://www.sandgarden.com/learn/text-generation-inference-tgi
Text Generation Inference (TGI) is the process by which a trained AI model generates new text based on an input prompt, focusing on producing this text efficiently in terms of speed and computational resources.
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
学历+
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
Ubuntu+
[英文] Tutorials
https://ubuntu.com/tutorials
These tutorials provide a step-by-step process to doing development and dev-ops activities on Ubuntu machines, servers or devices.
https://www.youtube.com/watch?v=D4WyNjt_hbQ
This tutorial is intended for those of you that are looking for a resource for helping you get started using Ubuntu on your laptop or desktop.
还有更多 •••
相关职位
社招3年以上运维开发
1、本科及以上学历,计算机、通信、电子等相关专业,具备 3 年及以上服务器硬件运维经验。 2、熟悉服务器基本架构及常见硬件组件,包括 CPU、内存、硬盘、RAID 卡、网卡、电源等,了解常见故障表现
更新于 2026-11-04杭州
社招3年以上程序&技术类
- 计算机科学与技术、电子工程、通信工程等计算机相关专业,本科及以上学历 - 3 年以上 GPU 服务器运维经验 - 熟悉主流 GPU 体系(NVLink / NVSwitch / Fabric Ma
上海
社招5年以上信息技术类
1. 教育背景与专业知识:全日制本科及以上学历,计算机相关专业,五年以上相关工作经验,优秀者可适当放宽; 2. 行业与专业经验:有半导体从业经验者优先; 3. 专业技能与资格:精通NVIDIA G
更新于 2026-06-12合肥