米哈游LLM Pretrain Data实习生
实习兼职程序&技术类地点：上海 | 北京状态：招聘
任职要求
1、计算机科学或相关技术领域的硕士或博士在读。
2、具备LLM训练及训练数据整理的实际经验。
加分项
1、熟悉大规模数据处理框架…登录查看完整任职要求
微信扫码，1秒登录
工作职责
1、支持开发基于LLM的预训练语料数据过滤方法，涵盖code数据与通用文本数据。 2、参与大规模数据pipeline的开发工作。 3、与技术团队合作，探究新的数据处理或数据生成方法。
包括英文材料
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
Apache+
https://www.apache.org/
The Apache® Software Foundation (ASF) provides software for the public good, guided by community over code.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
还有更多 •••