千问千问事业部-数据研发专家-RAG内容方向
社招全职3年以上技术类-开发地点:杭州状态:招聘
工作描述
任职要求 1. 具备大规模内容数据处理经验,熟悉网页、文档、视频等各模态数据的实时&批次处理技术,对数据清洗、去重、结构化、特征建设、质量&权威性&时效性评估等关键流程有深入理解; 2. 熟悉分布式数据计算与存储技术,如 Ray、Spark、Flink、Paimon 等,具备大规模数据处理系统设计与性能优化经验,能够与AI Infra及基础数据平台团队协同推进能力落地; 3. 熟悉数据检索相关技术,能基于线上用户case拆解来分析数据收录问题,指导数据发现、采集、处理和索引挑选各环…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
Ray+
https://github.com/ray-project/ray
Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://www.youtube.com/watch?v=FhXfEXUUQp0
In this video, I'll teach you everything you need to know about Apache Ray!
https://www.youtube.com/watch?v=fMiAyj2kgac
Using powerful machine learning algorithms is easy using Ray.io and Python.
https://www.youtube.com/watch?v=q_aTbb7XeL4
Parallel and Distributed computing sounds scary until you try this fantastic Python library.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
AI agent+
https://www.ibm.com/think/ai-agents
Your one-stop resource for gaining in-depth knowledge and hands-on applications of AI agents.
还有更多 •••
相关职位
社招5年以上技术
1、本科及以上学历,计算机、软件工程、统计学等相关专业,5 年及以上大型互联网数据仓库实战经验。 2、精通数据仓库理论与维度建模,具备从 0 到 1 搭建业务数仓、优化复杂数仓架构的能力。 3、精通大
更新于 2026-06-22北京
社招10年以上J0012
1、有较为丰富的数据仓库及数据平台架构经验,通过对业务的深入理解,进行数据仓库、数据体系和数据价值的建设和优化,有短视频、直播、电商或广告类业务经验优先; 2、有从事分布式数据存储与计算平台应用开发经
更新于 2026-01-22北京
社招5年以上技术类-数据
1.计算机、数学、统计、人工智能、大数据、机器人等相关专业硕士及以上学历,有数据算法相关实践经验,具备多模态/跨模态数据处理实践经验优先; 2. 有相关大规模分布式系统开发经验,熟悉主流大数据存储处理
更新于 2026-05-22杭州