字节跳动媒体数据存储系统工程师/专家-视频与边缘
社招全职2年以上A162987地点：北京状态：招聘
任职要求
1、本科及以上学历，2年及以上服务端开发经验，强悍的系统设计及编码能力； 2、算法、数据结构、操作系统等基础知识扎实，优秀的逻辑思维能力； 3、精通主流语言的至少一门Go/C/C++/Java/Python/Erlang/Rust等； 4、良好的沟通能力和团队合作精神，有一定的组织协调能力； 5、热爱技术，具备快速学习能力，做事情严谨踏实，团队协作能力强。 加分项： 1、熟悉Fuse用户态文件系统、分布式缓存系统（例如Alluxio/JuiceFS/GooseFS/JindoFS）等； 2、熟悉高性能网络通信（NVLink/RDMA/NCCL/GPU Direc）等； 3、深入理解向量索引算法，有向量检索研发和性能优化经验（Milvus/Weaviate/等），有数据库引擎核心研发经验（RocksDB/LevelDB/MySQL/MongoDB/Cassandra/HBase/InfluxDB等）。
工作职责
1、负责存储相关组件的设计和开发，服务于大模型推理和训练场景，包括模型分发加载、KV Cache存储和优化，数据IO性能优化，提高核心性能指标； 2、负责设计和实现面向面向海量数据模型训练和视频转码的分布式缓存文件系统，使用内存、SSD、HDD以及云端对象存储等介质进行数据的持久化存储和管理，均衡的优化存储性能与成本； 3、负责设计和实现面向多模态内容理解和检索元数据管理服务。
包括英文材料
学历+
系统设计+
https://roadmap.sh/system-design
Everything you need to know about designing large scale systems.
https://www.youtube.com/watch?v=F2FmTdLtb_4
This complete system design tutorial covers scalability, reliability, data handling, and high-level architecture with clear explanations, real-world examples, and practical strategies.
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
数据结构+
https://www.youtube.com/watch?v=8hly31xKli0
In this course you will learn about algorithms and data structures, two of the fundamental topics in computer science.
https://www.youtube.com/watch?v=B31LgI4Y4DQ
Learn about data structures in this comprehensive course. We will be implementing these data structures in C or C++.
https://www.youtube.com/watch?v=CBYHwZcbD-s
Data Structures and Algorithms full course tutorial java
Go+
https://www.youtube.com/watch?v=8uiZC0l4Ajw
学习Golang的完整教程！从开始到结束不到一个小时，包括如何在Go中构建API的完整演示。没有多余的内容，只有你需要知道的知识。
C+
https://www.freecodecamp.org/chinese/news/the-c-beginners-handbook/
本手册遵循二八定律。你将在 20% 的时间内学习 80% 的 C 编程语言。
https://www.youtube.com/watch?v=87SH2Cn0s9A
https://www.youtube.com/watch?v=KJgsSFOSQv0
This course will give you a full introduction into all of the core concepts in the C programming language.
https://www.youtube.com/watch?v=PaPN51Mm5qQ
In this complete C programming course, Dr. Charles Severance (aka Dr. Chuck) will help you understand computer architecture and low-level programming with the help of the classic C Programming language book written by Brian Kernighan and Dennis Ritchie.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Erlang+
https://www.erlang.org/faq/getting_started
Learn You Some Erlang is an easy-going tutorial which takes a day or two to get through. Alternatively, there's a spartan online tutorial.
Rust+
https://www.youtube.com/watch?v=BpPEoZW5IiY
In this comprehensive Rust course for beginners, you will learn about the core concepts of the language and underlying mechanisms in theory.
https://www.youtube.com/watch?v=lzKeecy4OmQ
Full Rust 101 Crash Course for beginners.
https://www.youtube.com/watch?v=rQ_J9WH6CGk
缓存+
https://hackernoon.com/the-system-design-cheat-sheet-cache
The cache is a layer that stores a subset of data, typically the most frequently accessed or essential information, in a location quicker to access than its primary storage location.
https://www.youtube.com/watch?v=bP4BeUjNkXc
Caching strategies, Distributed Caching, Eviction Policies, Write-Through Cache and Least Recently Used (LRU) cache are all important terms when it comes to designing an efficient system with a caching layer.
https://www.youtube.com/watch?v=dGAgxozNWFE
RocksDB+
https://rocksdb.org/docs/getting-started.html
The RocksDB library provides a persistent key value store.
MySQL+
https://juejin.cn/post/7190306988939542585
这是一篇 MySQL 通关一篇过硬核经验学习路线，包括数据库相关知识，SQL语句的使用，数据库约束，设计等。
[英文] MySQL Tutorial
https://www.mysqltutorial.org/
your go-to resource for mastering MySQL in a fast, easy, and enjoyable way.
https://www.youtube.com/watch?v=5OdVJbNCSso
MySQL SQL tutorial for beginners
https://www.youtube.com/watch?v=7S_tz1z_5bA
This beginner-friendly course teaches you SQL from scratch.
MongoDB+
https://learnxinyminutes.com/mongodb/
MongoDB is a NoSQL document database for high volume data storage.
https://studio3t.com/academy/#courses
The fastest way to learn MongoDB
https://www.youtube.com/watch?v=c2M-rlkkT5o
This video will give you and introduction to MongoDB in 1 Hour. Afterwards I recommend exploring aggregation, replication, and sharding.
https://www.youtube.com/watch?v=ExcRbA7fy_A&list=PL4cUxeGkcC9h77dJ-QJlwGlZlTd4ecZOA
You'll learn how to use MongoDB (a NoSQL database) from scratch. You'll also learn how to integrate it into a simple Node.js API.
Cassandra+
[英文] Learn Cassandra
https://teddyma.gitbooks.io/learncassandra/content/index.html
This book step-by-step guides developers to understand what Cassandra is, how Cassandra works and how to use the features and capabilities of Apache Cassandra 2.0.
https://www.youtube.com/watch?v=J-cSy5MeMOA
Apache Cassandra is an open source NoSQL distributed database.
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
InfluxDB+
https://docs.influxdata.com/influxdb/v2/get-started/
collect, store, process and visualize time series data.
https://www.youtube.com/watch?v=XloH_0G2IzA
This is short video going over getting started with InfluxDB.
相关职位
社招2年以上A196935
1、负责存储相关组件的设计和开发，服务于大模型推理和训练场景，包括模型分发加载、KV Cache存储和优化，数据IO性能优化，提高核心性能指标； 2、负责设计和实现面向面向海量数据模型训练和视频转码的分布式缓存文件系统，使用内存、SSD、HDD以及云端对象存储等介质进行数据的持久化存储和管理，均衡的优化存储性能与成本； 3、负责设计和实现面向多模态内容理解和检索元数据管理服务。
更新于 2025-05-12
社招2年以上JHKY1
1、负责存储相关组件的设计和开发，服务于大模型推理和训练场景，包括模型分发加载、KV Cache存储和优化，数据IO性能优化，提高核心性能指标； 2、负责设计和实现面向海量数据模型训练和视频转码的分布式缓存文件系统，使用内存、SSD、HDD以及云端对象存储等介质进行数据的持久化存储和管理，均衡的优化存储性能与成本； 3、负责设计和实现面向多模态内容理解和检索元数据管理服务。
更新于 2020-11-05
社招3年以上D8028
团队介绍： 7 亿快手用户每天都在生产百 PB 级的数据，需要被长期地记录下来，这些数据包括媒体数据、用户及业务的画像与行为数据、大模型的样本与训练数据等，这些都属于快手的高价值数字资产。存储团队的职责，就是以极高的性价比为快手和用户保障数据的稳固。 随着 AGI 时代的临近，存储的边界也在被重新定义，目前我们正处于存储发展的关键时期，这是一个充满技术挑战与行业影响力的机会，如果你对分布式存储系统、分布式缓存系统或性能优化充满热情，欢迎加入我们，一起应对高复杂业务场景，驱动技术发展，创造行业价值。 1、负责存储相关组件的设计与开发，服务于大模型训练及推理场景，包括模型分发、KV Cache、并行 IO 优化等，提高核心性能指标； 2、负责设计和实现面向海量数据的分布式缓存，综合利用本地内存、本地 SSD 以及远端存储系统（对象存储/HDFS）等进行数据的存储和迁移管理，实现「近计算端缓存+远端大容量存储」的一体化分级系统； 3、负责设计和实现高效、易用的数据访问接口，实现和推理框架、引擎的无缝对接； 4、负责存储与缓存的接入、管理、运维、监控，确保稳定性。
更新于 2025-07-13
校招技术类
作为团队的工程核心，你将以后端系统研发为基础，同时负责构建和扩展支撑AI应用的研发工具链和基础设施，为业务创新提供稳定、高效的工程能力。 ●负责AI应用的后端系统设计、开发与维护，保障服务的高可用性、可扩展性和安全性。 ●负责AI研发全流程中的关键平台工具的设计与开发，包括但不限于：媒体内容数据平台、存储系统等 ●构建和维护核心的AI基础服务，如统一模型服务网关、向量数据库与检索引擎，为上层AI应用提供基础能力。 ●与算法、全栈及产品团队紧密协作，深入理解研发流程中的痛点，持续优化基础设施与工具链，赋能团队进行更前沿的AI探索。