腾讯AI Infra研发工程师-上海/北京/深圳
社招全职3年以上腾讯云技术地点:上海状态:招聘
工作描述
任职要求 1.熟悉主流的大模型推理框架及其加速技术,如vLLM、SGlang、TensorRT-LLM等,熟练分析单机及分布式情况下的性能热点和优化手段; 2.熟悉业界主流开源模型结构,例如DeepSeek、Qwen、Wan、Flux等; 3.熟悉主流的训练框架和分布式框架,包括Megatron-LM、DeepSpeed、verL、LLama-factory等,熟悉常见的分布式并行策略,了解显存、通信与计算相关性能瓶颈和优化手段; 4.熟悉自动驾驶相关算法者优先,例如BEVfor…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
vLLM+
https://www.newline.co/@zaoyang/ultimate-guide-to-vllm--aad8b65d
vLLM is a framework designed to make large language models faster, more efficient, and better suited for production environments.
https://www.youtube.com/watch?v=Ju2FrqIrdx0
vLLM is a cutting-edge serving engine designed for large language models (LLMs), offering unparalleled performance and efficiency for AI-driven applications.
SGLang+
[英文] Install SGLang
https://docs.sglang.ai/get_started/install.html
SGLang is a fast serving framework for large language models and vision language models.
https://github.com/sgl-project/sgl-learning-materials
TensorRT+
https://docs.nvidia.com/deeplearning/tensorrt/latest/getting-started/quick-start-guide.html
This TensorRT Quick Start Guide is a starting point for developers who want to try out the TensorRT SDK; specifically, it demonstrates how to quickly construct an application to run inference on a TensorRT engine.
Megatron+
https://www.youtube.com/watch?v=hc0u4avAkuM
LLaMA-Factory+
https://llamafactory.readthedocs.io/en/latest/
LLaMA Factory is an easy-to-use and efficient platform for training and fine-tuning large language models.
还有更多 •••
相关职位
社招3年以上云智能集团
1. 熟悉AI领域,对于AI应用数据特征、数据存储和查询需求有深入理解,对Agent有实践经验; 2. 深入理解 LLM 原理,特别是上下文工程、KV Cache 机制及 Prompt 优化策略。 熟
更新于 2026-06-25杭州|上海
社招3年以上云智能集团
1. 扎实的算法基础和良好的编码习惯,精通 C++、Java、Go、Python 中任何一门语言; 2. 在高性能数据结构、编码压缩、向量处理、异步IO、内存管理、多线程并发等领域有深入实践;有 Li
更新于 2026-01-13上海
社招软件开发岗
1. 具备AI基础设施整体架构设计能力,能够设计支撑多场景、可扩展的智能化系统并推动技术方案执行; 2. 拥有Agent框架与工具链开发经验,熟悉智能化任务编排与自主决策系统构建,能持续优化系统运行效
更新于 2026-07-29北京