千问千问事业部-数据架构专家 - 预训练/RAG方向-杭州
社招全职1年以上技术类-开发地点：杭州状态：招聘
工作描述
任职要求 1. 具备大规模内容数据处理经验，熟悉网页、文档、视频等各模态数据的实时&批次处理技术，对数据清洗、去重、结构化、特征建设、质量&权威性&时效性评估等关键流程有深入理解； 2. 熟悉分布式数据计算与存储技术，如 Ray、Spark、Flink、Paimon 等，具备大规模数据处理系统设计与性能优化经验，能够与AI Infra及基础数据平台团队协同推进能力落地； 3. 熟悉数据检索相关技术，能基于线上用户case拆解来分析数据收录问题，指导数据发现、采集、处理和索引挑选各环节的数据策略优化； 4. 熟悉主流Agent开发框架，如LangChain、OpenClaw等，能基于业务场景拆解和落地skill能力建设，具有Agent实际落地经验。 5. 具备搜索引擎索引构建、大模型训练数…
登录查看完整工作描述
微信扫码，1秒登录
包括英文材料
Ray+
https://github.com/ray-project/ray
Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://www.youtube.com/watch?v=FhXfEXUUQp0
In this video, I'll teach you everything you need to know about Apache Ray!
https://www.youtube.com/watch?v=fMiAyj2kgac
Using powerful machine learning algorithms is easy using Ray.io and Python.
https://www.youtube.com/watch?v=q_aTbb7XeL4
Parallel and Distributed computing sounds scary until you try this fantastic Python library.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
AI agent+
https://www.ibm.com/think/ai-agents
Your one-stop resource for gaining in-depth knowledge and hands-on applications of AI agents.
开发框架+
[英文] Understanding Modern Development Frameworks: A Guide for Developers and Technical Decision-makers
https://www.freecodecamp.org/news/understanding-modern-development-frameworks-guide-for-devs/
LangChain+
https://python.langchain.com/docs/tutorials/
New to LangChain or LLM app development in general? Read this material to quickly get up and running building your first applications.
https://www.freecodecamp.org/news/beginners-guide-to-langchain/
LangChain is a popular framework for creating LLM-powered apps.
还有更多 •••
相关职位
社招5年以上云智能集团
1.在数据领域工作5年以上，具备丰富的大数据/数据库产品架构和研发经历； 2.熟悉开源大数据组件/关系型数据库(比如Mysql, Postgre, Oracle等）、NoSQL数据库(MongoDB
更新于 2026-03-28北京|杭州
社招5年以上
1.在数据领域工作5年以上，具备丰富的大数据/数据库产品架构和研发经历； 2.熟悉开源大数据组件/关系型数据库(比如Mysql, Postgre, Oracle等）、NoSQL数据库(MongoDB
更新于 2026-04-01北京|杭州
社招3年以上软硬件服务-无人
1、精通至少一种主流技术栈（Java、Python、C++），具备复杂系统开发经验，熟悉分布式系统原理，掌握微服务、容器化、消息队列等技术的实际应用。 2、拥有数据密集型系统开发经验，熟悉数据协议设计
更新于 2026-06-23北京|深圳
社招5年以上技术类-开发
● 计算机相关专业本科及以上学历，5年以上后端或全栈开发经验。 ● 精通 Python/Go/Java 中至少一门语言，熟悉 K8s、Docker 等容器化技术，有大规模分布式系统设计经验。 ● 在
更新于 2026-06-05杭州