米哈游LLM Posttrain算法研究员
校招全职程序&技术类地点:上海 | 北京状态:招聘♡ 收藏
工作描述
任职要求 1. 计算机科学、人工智能或相关领域的硕士/博士 2. 熟悉 Transformer 架构,熟练使用 PyTorch 及主流大模型训练框架(如 DeepSpeed, Megatron-LM, vLLM 等) 3. 有 SFT、RLHF 的实际操作经验,理解训练过程中的稳定性与效率问题 4. 具备优秀的工程实现能力和快速复现Paper的能力 加分项 1. 在NeurIPS/ICML/ACL/EMNLP等顶级会议…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
Transformer+
https://huggingface.co/learn/llm-course/en/chapter1/4
Breaking down how Large Language Models work, visualizing how data flows through.
https://poloclub.github.io/transformer-explainer/
An interactive visualization tool showing you how transformer models work in large language models (LLM) like GPT.
https://www.youtube.com/watch?v=wjZofJX0v4M
Breaking down how Large Language Models work, visualizing how data flows through.
PyTorch+
https://datawhalechina.github.io/thorough-pytorch/
PyTorch是利用深度学习进行数据科学研究的重要工具,在灵活性、可读性和性能上都具备相当的优势,近年来已成为学术界实现深度学习算法最常用的框架。
https://www.youtube.com/watch?v=V_xro1bcAuA
Learn PyTorch for deep learning in this comprehensive course for beginners. PyTorch is a machine learning framework written in Python.
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
DeepSpeed+
[英文] Getting Started
https://www.deepspeed.ai/getting-started/
DeepSpeed model training is accomplished using the DeepSpeed engine.
https://www.youtube.com/watch?v=pDGI668pNg0
Megatron+
https://www.youtube.com/watch?v=hc0u4avAkuM
vLLM+
https://www.newline.co/@zaoyang/ultimate-guide-to-vllm--aad8b65d
vLLM is a framework designed to make large language models faster, more efficient, and better suited for production environments.
https://www.youtube.com/watch?v=Ju2FrqIrdx0
vLLM is a cutting-edge serving engine designed for large language models (LLMs), offering unparalleled performance and efficiency for AI-driven applications.
SFT+
https://cameronrwolfe.substack.com/p/understanding-and-using-supervised
Understanding how SFT works from the idea to a working implementation...
还有更多 •••
相关职位
社招程序&技术类
1、计算机科学、人工智能、机器学习或相关领域硕士或博士学位; 2、具备 LLM 后训练经验或RL训练经验,熟悉分布式训练、rollout系统和性能调优; 3、在 NeurIPS、ICML、ICLR、C
北京
实习程序&技术类
1)2027/2028 届在校硕士及以上学历,计算机科学、人工智能、机器学习、NLP 或相关专业 2)熟悉 Transformer / MoE 架构原理,熟练使用 PyTorch 及主流大模型训练/推
上海
社招3年以上程序&技术类
1)硕士及以上学历,计算机科学、人工智能、机器学习、NLP 或相关专业 2)3年以上大模型训练或 NLP 算法相关经验,有 SFT、RLHF/DPO、Reward Model 训练的实际项目经验 3)
上海|北京