
MiniMaxAI 数据基础设施工程师
社招全职地点:北京 | 上海状态:招聘♡ 收藏
工作描述
1. 基于 Spark、Ray 搭建大模型数据处理基建,负责集群管理、任务调度、资源隔离和性能分析,并迭代面向非结构化与多模态数据的处理能力。 2. 基于 Paimon、Iceberg、Lance 建设数据湖与 Catalog Service,负责结构化、非结构化与多模态数据的存储与管理。 3. 面向数据生产与算法团队,建设计算与数据湖链路的监控、日志、追踪与告警,联合 K8s、SRE 定位性能、稳定性与容量问题,并优化资源利用率与成本。 任职要求 1. 编程基础扎实,熟练使用 Python、Java 或 Scala 中至少一种,能够开发平台组件、数据引擎和运维工具。 2. 熟悉 Linux、容器和分布式系统,理解计算、…
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Ray+
https://github.com/ray-project/ray
Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
https://www.youtube.com/watch?v=FhXfEXUUQp0
In this video, I'll teach you everything you need to know about Apache Ray!
https://www.youtube.com/watch?v=fMiAyj2kgac
Using powerful machine learning algorithms is easy using Ray.io and Python.
https://www.youtube.com/watch?v=q_aTbb7XeL4
Parallel and Distributed computing sounds scary until you try this fantastic Python library.
大模型+
https://www.youtube.com/watch?v=xZDB1naRUlk
You will build projects with LLMs that will enable you to create dynamic interfaces, interact with vast amounts of text data, and even empower LLMs with the capability to browse the internet for research papers.
https://www.youtube.com/watch?v=zjkBMFhNj_g
Paimon+
https://paimon.apache.org/docs/master/concepts/
Apache Paimon is a table format for data lakes that supports batch and streaming workloads.
Iceberg+
https://iceberg.apache.org/spark-quickstart/
This guide will get you up and running with Apache Iceberg™ using Apache Spark™, including sample code to highlight some powerful features.
https://www.baeldung.com/apache-iceberg-intro
This tutorial will discuss Apache Iceberg, a popular open table format in today’s big data landscape.
https://www.youtube.com/watch?v=TsmhRZElPvM
You’ve probably heard about Apache Iceberg™—after all, it’s been getting a lot of buzz.
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
还有更多 •••
相关职位

社招3年以上技术类-数据
1、本科及以上学历,计算机科学、统计学、数学、电子工程或相关专业;硕士及以上优先。 2、3 年以上数据开发、数据分析或AI Infra相关工作经验; 3、有 AI Infra或云计算平台相关数据开发或
更新于 2026-04-02杭州
校招A83197A
1、2027届获得本科及以上学历,计算机、数据科学、人工智能相关专业; 2、熟悉Go/Java/Python/C++语言中的一种,对代码质量有追求; 3、掌握扎实的计算机基础知识,深入理解数据结构、算
更新于 2026-07-25深圳
社招3年以上技术类-数据
1、本科及以上学历,计算机科学、统计学、数学、电子工程或相关专业; 2、3 年以上数据开发、数据分析或AI Infra相关工作经验; 3、有 AI Infra或云计算平台相关数据开发或者研发经验者优先
更新于 2026-06-26杭州