哈啰大模型训推优化工程师
社招全职软研类地点：上海状态：招聘
任职要求
1、精通C/C++、Python等至少一门编程语言，以及Linux下的系统开发经验 2、熟悉常用机器学习算法，对文本/多模态大模型相关领域模型，对llama、deepseek、qwen等模型有深刻的理解，熟悉TF/Pytorch等深度学习框架，有相关模型训练和模型效果优化者优先 3、熟悉大模型MegatronLM/Deepspeed分布式训练框架，深入了解模型量化、蒸馏、剪枝等模型优化原理和策略，有文本、语音、以及多模态模型相关训练、效果调优经验优先 4、熟练使用包括vllm/sglang/lmdeploy等一种以上模型推理服务框架，有代码分析及性能优化经验优先。 5、有技术敏锐度，善于攻坚，抗压能力比较强，良好的团队合作精神和意识。
工作职责
1、主导大模型在线推理系统的性能攻坚，构建多节点多GPU的分布式推理架构，实现智能请求调度算法与异构硬件的极致性能调优； 2、研究低bit量化、稀疏化attention等解码加速技术，在保障精度前提下显著降低计算资源消耗； 3、设计高并发场景下的负载均衡方案，构建支持动态扩展的弹性计算架构，优化推理引擎运行时环境，实现毫秒级延迟与高QPS吞吐能力。
包括英文材料
C+
https://www.freecodecamp.org/chinese/news/the-c-beginners-handbook/
本手册遵循二八定律。你将在 20% 的时间内学习 80% 的 C 编程语言。
https://www.youtube.com/watch?v=87SH2Cn0s9A
https://www.youtube.com/watch?v=KJgsSFOSQv0
This course will give you a full introduction into all of the core concepts in the C programming language.
https://www.youtube.com/watch?v=PaPN51Mm5qQ
In this complete C programming course, Dr. Charles Severance (aka Dr. Chuck) will help you understand computer architecture and low-level programming with the help of the classic C Programming language book written by Brian Kernighan and Dennis Ritchie.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
机器学习+
https://www.youtube.com/watch?v=0oyDqO8PjIg
Learn about machine learning and AI with this comprehensive 11-hour course from @LunarTech_ai.
https://www.youtube.com/watch?v=i_LwzRVP7bg
Learn Machine Learning in a way that is accessible to absolute beginners.
https://www.youtube.com/watch?v=NWONeJKn6kc
Learn the theory and practical application of machine learning concepts in this comprehensive course for beginners.
https://www.youtube.com/watch?v=PcbuKRNtCUc
Learn about all the most important concepts and terms related to machine learning and AI.
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
Llama+
https://github.com/LlamaFamily/Llama-Chinese
Llama中文社区，实时汇总最新Llama学习资料，构建最好的中文Llama大模型开源生态，完全开源可商用。
https://www.llama.com/docs/overview/
This guide provides information and resources to help you set up Llama including how to access the model, hosting, how-to and integration guides.
PyTorch+
https://datawhalechina.github.io/thorough-pytorch/
PyTorch是利用深度学习进行数据科学研究的重要工具，在灵活性、可读性和性能上都具备相当的优势，近年来已成为学术界实现深度学习算法最常用的框架。
https://www.youtube.com/watch?v=V_xro1bcAuA
Learn PyTorch for deep learning in this comprehensive course for beginners. PyTorch is a machine learning framework written in Python.
深度学习+
https://d2l.ai/
Interactive deep learning book with code, math, and discussions.
DeepSpeed+
https://www.youtube.com/watch?v=pDGI668pNg0
vLLM+
https://www.newline.co/@zaoyang/ultimate-guide-to-vllm--aad8b65d
vLLM is a framework designed to make large language models faster, more efficient, and better suited for production environments.
https://www.youtube.com/watch?v=Ju2FrqIrdx0
vLLM is a cutting-edge serving engine designed for large language models (LLMs), offering unparalleled performance and efficiency for AI-driven applications.
SGLang+
[英文] Install SGLang
https://docs.sglang.ai/get_started/install.html
SGLang is a fast serving framework for large language models and vision language models.
https://github.com/sgl-project/sgl-learning-materials
LMDeploy+
https://lmdeploy.readthedocs.io/en/latest/get_started/get_started.html
This tutorial shows the usage of LMDeploy on CUDA platform.
相关职位
社招3年以上计算机网络技术类
1.算法平台大模型（含LLM）训练和推理优化工作：涵盖PD分离部署、检索增强生成（RAG）、智能代理（Agent）等前沿应用领域，推动技术与业务的深度融合。 2.性能优化：对AI模型训练和推理过程进行性能分析和调优，提升算法执行效率，包括但不限于算法加速、资源调度优化等。 3.工具开发：开发算法研发和部署过程中所需的工具和脚本，提高研发效率，实现算法工程化。 4.技术支持：为AI工程师和研究人员提供技术咨询和支持，帮助他们解决在算法研发过程中遇到的工程问题。 5.跨部门协作：与产品、研发、运维等其他团队协作，确保算法平台的稳定性和可用性。 6.技术研究：跟踪最新的AI工程化技术和趋势，将新技术应用到平台建设中，推动技术创新。
更新于 2025-07-09
社招ACG
-结合LLM技术发展，优化分布式训练和推理框架的性能，各常见模型训推MFU优化到极致状态 -在自研芯片上适配常见的大模型与自驾模型，结合芯片特点做优化，充分发挥自研芯片算力 -探索前沿的训推优化技术，算法、框架、集群协同创新，构建有竞争力的大模型训推系统 -与业务团队协同，理解客户需求，驱动技术创新，业务持续突破
更新于 2025-04-07
社招ACG
- 结合LLM技术发展，优化分布式训练和推理框架的性能，各常见模型训推MFU优化到极致状态 - 在自研芯片上适配常见的大模型与自驾模型，结合芯片特点做优化，充分发挥自研芯片算力 - 探索前沿的训推优化技术，算法、框架、集群协同创新，构建有竞争力的大模型训推系统 - 与业务团队协同，理解客户需求，驱动技术创新，业务持续突破
更新于 2025-07-10
社招ACG
-结合LLM技术发展，优化分布式训练和推理框架的性能，各常见模型训推MFU优化到极致状态 -在自研芯片上适配常见的大模型与自驾模型，结合芯片特点做优化，充分发挥自研芯片算力 -探索前沿的训推优化技术，算法、框架、集群协同创新，构建有竞争力的大模型训推系统 -与业务团队协同，理解客户需求，驱动技术创新，业务持续突破
更新于 2025-07-10