理想汽车大模型评测实习生
实习兼职车辆控制地点:北京状态:招聘
任职要求
1. 熟悉PyTorch、TensorFlow等深度学习框架,具备扎实的算法与数据结构基础; 2. 拥有一定的数据处理与分析能力,能熟练使用常见的数据分析工具(如 Pandas、NumPy、Matplotlib等); 3. 学习能力强,对前沿AI技术和模型评测方法保持好奇心和探索热情。 加分项: 1. 参与过大模型训练/微调/评测相关项目,或在顶级会议(ACL、NeurIPS、ICLR等)发表论文。
工作职责
1. 参与多模态(文本、语音、图像)模型评测; 2. 针对大模型在实际业务中的落地场景(如代码生成、知识问答、长文本摘要),设计测试用例,定位模型幻觉、偏见、安全性等问题; 3. 研究并扩展评测数据集,构建多样化业务场景; 4. 前沿技术研究与创新,跟踪大模型评测领域最新进展。
包括英文材料
PyTorch+
https://datawhalechina.github.io/thorough-pytorch/
PyTorch是利用深度学习进行数据科学研究的重要工具,在灵活性、可读性和性能上都具备相当的优势,近年来已成为学术界实现深度学习算法最常用的框架。
https://www.youtube.com/watch?v=V_xro1bcAuA
Learn PyTorch for deep learning in this comprehensive course for beginners. PyTorch is a machine learning framework written in Python.
TensorFlow+
https://www.youtube.com/watch?v=tpCFfeUEGs8
Ready to learn the fundamentals of TensorFlow and deep learning with Python? Well, you’ve come to the right place.
https://www.youtube.com/watch?v=ZUKz4125WNI
This part continues right where part one left off so get that Google Colab window open and get ready to write plenty more TensorFlow code.
深度学习+
https://d2l.ai/
Interactive deep learning book with code, math, and discussions.
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
数据结构+
https://www.youtube.com/watch?v=8hly31xKli0
In this course you will learn about algorithms and data structures, two of the fundamental topics in computer science.
https://www.youtube.com/watch?v=B31LgI4Y4DQ
Learn about data structures in this comprehensive course. We will be implementing these data structures in C or C++.
https://www.youtube.com/watch?v=CBYHwZcbD-s
Data Structures and Algorithms full course tutorial java
数据分析+
[英文] Data Analyst Roadmap
https://roadmap.sh/data-analyst
Step by step guide to becoming an Data Analyst in 2025
Pandas+
[英文] 10 minutes to pandas
https://pandas.pydata.org/docs/user_guide/10min.html
This is a short introduction to pandas, geared mainly for new users.
[英文] Cookbook - pandas
https://pandas.pydata.org/docs/user_guide/cookbook.html#cookbook
This is a repository for short and sweet examples and links for useful pandas recipes.
https://www.kaggle.com/learn/pandas
Solve short hands-on challenges to perfect your data manipulation skills.
https://www.youtube.com/watch?v=2uvysYbKdjM
I'm super excited for this one. We're doing another complete Python Pandas tutorial walkthrough.
https://www.youtube.com/watch?v=Mdq1WWSdUtw
Filtering, Joins, Indexing, Data Cleaning, Visualizations
NumPy+
https://numpy.org/doc/stable/user/absolute_beginners.html
NumPy (Numerical Python) is an open source Python library that’s widely used in science and engineering.
[英文] NumPy - Learn
https://numpy.org/learn/
Below is a curated collection of educational resources, both for self-learning and teaching others, developed by NumPy contributors and vetted by the community.
https://www.kaggle.com/code/themlphdstudent/learn-numpy-numpy-50-exercises-and-solution
This kernel uses exercises of NumPy from the Machine Learning Plus webpage
https://www.youtube.com/watch?v=KHoEbRH46Zk
If you've heard of Pandas and NumPy, you may think one is simply a superset of the other.
https://www.youtube.com/watch?v=QUT1VHiLmmI
Learn the basics of the NumPy library in this tutorial for beginners.
https://www.youtube.com/watch?v=VXU4LSAQDSc
This video serves as an introduction to the NumPy Python library.
Matplotlib+
https://matplotlib.org/stable/tutorials/index.html
This page contains a few tutorials for using Matplotlib.
https://www.youtube.com/watch?v=c9vhHUGdav0
This video serves as an introduction to the Matplotlib Python library.
https://www.youtube.com/watch?v=OZOOLe2imFo
In this video we do a complete Matplotlib crash course in Python.
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
NeurIPS+
https://neurips.cc/
ICLR+
https://iclr.cc/
相关职位
实习模型标注
岗位职责: 1、梳理和解读大模型相关的评测业务,辅助进行定制化的评测框架体系构建,完善内部评测机制; 2、针对交付评测数据进行数据验收,反馈指标以及数据问题,引导评测同学进行质量提升; 3、针对市场上大模型相关应用进行摸底调研,结合内部模型方向给到模型优化改进意见;
更新于 2025-02-27
实习D13923
1、协助参与快手大模型(包括但不限于 LLM、T2I、I2I、MLLM 等)的评测工作,支持评测体系的建设与优化; 2、协助开发和维护评测相关的自动化工具,提升评测效率和稳定性; 3、在导师指导下完成数据收集、分析与可视化,输出阶段性评测结论; 4、参与图像等生成结果质量评估,结合主观感受与客观指标,提出改进建议。
更新于 2025-09-19

社招技术族-实习
1、产品评测与数据管理:负责大模型产品的全面评测工作,包括数据集的设计、构建和管理,以及 prompt 的深入挖掘和分析。 2、测试结果分析与报告撰写:负责测试结果的详细记录、数据的整理和分析,并根据分析结果撰写清晰、准确和具有洞察力的测试报告。 3、跨部门协作:与算法和研发团队保持紧密联系,共同解决模型运行过程中遇到的挑战。提供模型badcase的跟踪、修复与验证。
更新于 2025-05-09