千问千问事业部-领域数据建设专家-杭州
社招全职2年以上地点:杭州状态:招聘♡ 收藏
工作描述
任职要求 1. 具备大规模内容数据处理经验,熟悉Ray、Spark、Flink、Paimon等分布式数据存储及实时&批次计算技术,对网页、文档、图片、音视频等各模态数据的采集、清洗、去重、结构化、特征建设、质量&权威性&时效性评估等关键流程有深入理解。 2. 深刻理解并熟练掌握 AI Agent 的核心技术范式,熟悉主流Agent开发框架和Harness工程,具有Agent落地经验,能基于业务场景拆解和落地skill能力建设。 3. 熟悉数据检索及…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
Ray+
https://github.com/ray-project/ray
Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://www.youtube.com/watch?v=FhXfEXUUQp0
In this video, I'll teach you everything you need to know about Apache Ray!
https://www.youtube.com/watch?v=fMiAyj2kgac
Using powerful machine learning algorithms is easy using Ray.io and Python.
https://www.youtube.com/watch?v=q_aTbb7XeL4
Parallel and Distributed computing sounds scary until you try this fantastic Python library.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Paimon+
https://paimon.apache.org/docs/master/concepts/
Apache Paimon is a table format for data lakes that supports batch and streaming workloads.
还有更多 •••
相关职位
社招模型数据策略
【团队使命】 知识塑造了文明的骨骼,专业则赋予它精度与锋芒。领域专家的判断力是校准模型的标尺,持续定义知识选取、推理质量与表达水准的上限。我们相信,专业不止于知识本身,它是精准的判断、高效的生产力、也
北京|杭州
社招5年以上技术类-数据
1. 计算机科学、人工智能、数据科学等相关专业,硕士及以上学历优先。 2. 5年以上AI数据相关经验,至少2年大模型(LLM/VLM)数据工作经验;有从0到1搭建数据团队或平台的经历;懂模型、懂数
更新于 2026-07-21北京|杭州
社招1年以上技术类-数据
1、计算机科学、数据科学认知科学管理学、语言学或相关领域的本科及以上学历、有2年以上多模态数据处理与构建的经验: 2、熟悉大模型模型评估和标注,有数据标注与管理的经验,具备从训练数据到模型效果评估到优
更新于 2026-06-24杭州