阿里巴巴数据技术及产品部-大模型RL Data工程师-Computer Use
社招全职3年以上地点:杭州状态:招聘
工作描述
任职要求 1. 对大模型计算机操作、GUI 界面理解方向有深入判断,能将真实计算机使用任务(含桌面专业软件)转化为可标注、可评测的数据。 2. 具备人机交互、软件评测、UI/UX、计算机视觉或多模态大模型相关背景,或有 Agent 产品实测经验;熟悉至少一类专业桌面软件(CAD、Blender/Maya、Adobe 系列、Office、IDE 等)的实际操作者优先。 3. 熟练掌握 Python,具备数据处理、统计分析与可视化能力;了解主流大模型推理服务,以及浏览器自动化(Playwright、Puppeteer)与桌面/坐标级自动化(如 pyautogui、操作系统级自动化、Computer Use API)、界面视觉 grounding(截图理解、OCR、UI 元素检测)的调用方式与工程约束。 4. 了解 Agent 核心机制(ReAct、Tool Use、Planning、多步推理与反思),对计算机操作类 Agent 的能力边界(感知与视觉定位误差累积、长程任务失败模式、跨应用状态管理、安全风险)有认知或实践。 5. 有 GUI Agent 开发经验者优先(界面元素解析、操作策略训练、自动化环境搭建、Agent 评…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
OpenCV+
https://learnopencv.com/getting-started-with-opencv/
At LearnOpenCV we are on a mission to educate the global workforce in computer vision and AI.
https://opencv.org/university/free-opencv-course/
This free OpenCV course will teach you how to manipulate images and videos, and detect objects and faces, among other exciting topics in just about 3 hours.
AI agent+
https://www.ibm.com/think/ai-agents
Your one-stop resource for gaining in-depth knowledge and hands-on applications of AI agents.
Blender+
https://www.youtube.com/watch?v=z-Xl9tGqH14
The complete Beginner Donut Tutorial, uploaded in one video :)
Maya+
https://www.youtube.com/channel/UCHmAXsicpLK2EHMZo5_BtDA
Autodesk Maya is an industry leading 3D digital content creation software used extensively by movie, game, and FX studios both big and small.
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文,免费,零起点,完整示例,基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Playwright+
https://learn.microsoft.com/en-us/training/modules/build-with-playwright/
In this module, you'll learn how to use Playwright to test a sample web application.
https://playwright.dev/docs/intro
Playwright Test is an end-to-end test framework for modern web apps.
https://www.youtube.com/watch?v=hN1Zn6kLntk
还有更多 •••
相关职位
社招3年以上
1. 对长程多步 agentic 任务及其失败模式有深入判断,能将真实复杂任务转化为可复现、可自动判分、难度可控且抗作弊的训练与评测环境;有 Agent 产品实测、长程任务或轨迹设计、过程级评测、RL
更新于 2026-09-23杭州
社招3年以上
1. 金融、会计、财务、审计、税务、经济、金融工程或相关专业本科及以上学历,对金融财会领域大模型的能力边界有判断,能将真实财务任务转化为可标注、可评测的数据;持有 CPA / CFA / ACCA /
更新于 2026-09-24杭州
社招3年以上
1. 具备机器人、机电一体化、自动化/控制、实验室自动化、科学仪器,或多模态大模型 / 具身智能 / Agent 相关背景(博士或同等深度研究/工程经历),对「AI 操作物理设备」的能力边界有深入判断
更新于 2026-09-23杭州