米哈游【提前批-大模型】LLM预训练数据算法研究员
校招全职程序&技术类地点:上海 | 北京状态:招聘
工作描述
任职要求 1.熟练掌握 Apache Spark、Ray 等大规模分布式数据处理框架; 2.熟悉大模型完整训练链路,包含预训练、中段训练、后训练阶段; 3.对数据质量具备严苛把控意识,能够针对各类代码、文本语料梳理并处理各类边界异常样本。 加分项 1.拥…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
Apache+
https://www.apache.org/
The Apache® Software Foundation (ASF) provides software for the public good, guided by community over code.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Ray+
https://github.com/ray-project/ray
Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://www.youtube.com/watch?v=FhXfEXUUQp0
In this video, I'll teach you everything you need to know about Apache Ray!
https://www.youtube.com/watch?v=fMiAyj2kgac
Using powerful machine learning algorithms is easy using Ray.io and Python.
https://www.youtube.com/watch?v=q_aTbb7XeL4
Parallel and Distributed computing sounds scary until you try this fantastic Python library.
还有更多 •••
相关职位
校招程序&技术类
1.具备大语言模型数据研发相关工作经验; 2.熟悉大模型完整训练链路,包含预训练、中段训练、后训练阶段; 3.具备agent模型训练与评测实操经验; 4.有 agentic, reasoning, c
上海|北京
校招程序&技术类
1、计算机科学、人工智能、机器学习、软件工程或相关领域在读硕士 / 博士。 2、熟悉 LLM 评测方法,对代码生成、代码修复、Agent 评测或自动化测试有实践经验。 3、熟悉 Python,具备较强
北京
校招程序&技术类
1. 在自然语言处理、大语言模型研究、机器学习或相关方向具有扎实积累和实践经验 2. 具备扎实的代码与算法基础,熟练掌握PyTorch等深度学习框架 3. 具备有效的沟通和协作技能,对探索新技术和推动
上海|北京