美团分布式存储研发工程师
社招全职5年以上核心本地商业-基础研发平台地点：北京状态：招聘
任职要求
1.熟悉 Spark、Presto、Hive、HBase 等主流大数据系统中一种或者几种的原理； 2.精通C/C++或Java，精通网络编程，多线程、高并发编程； 3.理解大型分布式存储系统工作原理，掌握生产环境中各种架构的元数据、数据的可用性、性能的分析方法 具备以下条件优先 熟悉常见分布式存储产品及其在大数据场景应用，包括但不限于HDFS、HBase、Ceph…
登录查看完整任职要求
微信扫码，1秒登录
工作职责
美团分布式存储方向，承载了全公司数据仓库和机器学习的全部离线数据，为业务提供了高可用、高可靠、超大规模的大数据存储底座、元数据存储、表格存储和消息存储服务，工作职责包括但不限于： 1. 持续提升大数据存储底座的性能、稳定性、可靠性，解决AI时代爆发的数据访问的性能和成本压力，为AI训练海量数据提供更好的元数据扩展性和数据性能 2. 持续优化成本，提升数据全生命周期管理能力，解决AI时代数据规模爆炸性增长的资源需求 3. 持续提升数据底座和元数据底座的可观测性、审计能力、安全能力以及周边工具链，增强在大数据和AI场景下的数据易用性和安全性
包括英文材料
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Presto+
[英文] What is Presto?
https://prestodb.io/what-is-presto/
https://www.tutorialspoint.com/apache_presto/index.htm
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
C+
https://www.freecodecamp.org/chinese/news/the-c-beginners-handbook/
本手册遵循二八定律。你将在 20% 的时间内学习 80% 的 C 编程语言。
https://www.youtube.com/watch?v=87SH2Cn0s9A
https://www.youtube.com/watch?v=KJgsSFOSQv0
This course will give you a full introduction into all of the core concepts in the C programming language.
https://www.youtube.com/watch?v=PaPN51Mm5qQ
In this complete C programming course, Dr. Charles Severance (aka Dr. Chuck) will help you understand computer architecture and low-level programming with the help of the classic C Programming language book written by Brian Kernighan and Dennis Ritchie.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
网络编程+
https://www.youtube.com/watch?v=2HrYIl6GpYg
I will make a simple HTTP web server with the C Programming Language.
https://www.youtube.com/watch?v=8z6okCgdREo
This tutorial is for Gophers who have written a command line or an API application, but have little to no experience in lower-level concepts like reading and writing to sockets, working with channels, and managing multiple goroutines.
https://www.youtube.com/watch?v=bdIiTxtMaKA&list=PL9IEJIKnBJjH_zM5LnovnoaKlXML5qh17
https://www.youtube.com/watch?v=bzja9fQWzdA
Implement the ubiquitous TCP protocol that underlies much of the traffic on the internet!
[英文] 📺Network Programming with Python Course (build a port scanner, mailing client, chat room, DDOS)
https://www.youtube.com/watch?v=FGdiSJakIS4
Learn network programming in Python by building four projects. You will learn to build a mailing client, a DDOS script, a port scanner, and a TCP Chat Room.
https://www.youtube.com/watch?v=gntyAFoZp-E
https://www.youtube.com/watch?v=JiuouCJQzSQ
Explore the fundamentals of networking in Rust by building a simple TCP server.
https://www.youtube.com/watch?v=JRTLSxGf_6w
https://www.youtube.com/watch?v=sFizpxHkIlI
In this video we'll cover SOCKET PROGRAMMING in JAVA.
https://www.youtube.com/watch?v=sXW_sNGvqcU
多线程+
https://liaoxuefeng.com/books/java/threading/basic/index.html
和单线程相比，多线程编程的特点在于：多线程经常需要读写共享数据，并且需要同步。
https://www.youtube.com/watch?v=_uQgGS_VIXM&list=PLsc-VaxfZl4do3Etp_xQ0aQBoC-x5BIgJ
https://www.youtube.com/watch?v=IEEhzQoKtQU
https://www.youtube.com/watch?v=mTGdtC9f4EU&list=PLL8woMHwr36EDxjUoCzboZjedsnhLP1j4
https://www.youtube.com/watch?v=TPVH_coGAQs&list=PLk6CEY9XxSIAeK-EAh3hB4fgNvYkYmghp
https://www.youtube.com/watch?v=xPqnoB2hjjA
This video is an introduction to multithreading in modern C++.
https://www.youtube.com/watch?v=YKBwKy5PrpQ
Rust threading is easy to implement and improves the efficiency of your applications on multi-core systems!
高并发+
https://www.baeldung.com/concurrency-principles-patterns
In this tutorial, we’ll discuss some of the design principles and patterns that have been established over time to build highly concurrent applications.
https://www.baeldung.com/java-concurrency
Handling concurrency in an application can be a tricky process with many potential pitfalls. A solid grasp of the fundamentals will go a long way to help minimize these issues.
https://www.oreilly.com/library/view/concurrency-in-go/9781491941294/
You’ll understand how Go chooses to model concurrency, what issues arise from this model, and how you can compose primitives within this model to solve problems.
https://www.oreilly.com/library/view/modern-concurrency-in/9781098165406/
With this book, you'll explore the transformative world of Java 21's key feature: virtual threads.
https://www.youtube.com/watch?v=qyM8Pi1KiiM
https://www.youtube.com/watch?v=wEsPL50Uiyo
还有更多 •••
相关职位
社招软件序列
负责地平线数据存储服务的设计、开发、性能调优；设计和改进地平线数据传输组件；根据上层业务需求设计和改进数据存储服务模块；制定开发目标、撰写设计文档并负责模块实现、性能调优、功能测试；对接业务线提供技术支持并优化系统；持续优化存储底座功能;
更新于 2026-07-15北京
社招ACG
-负责设计、开发和优化公有云存储系统类产品，包括对象存储、分布式块存储服务、文件存储、云消息队列服务、云Cache服务、kv系统、关系型数据库、冷数据存储服务、数据传输服务等等 -负责开发和优化大规模高性能服务软件 -为百度开放云行业客户提供分布式存储技术和产品解决方案 -联动大数据、云计算、边缘云、视频云等多团队打造整体高性能解决方案 -持续关注业界最新进展，进行技术调研和选型 -参与制定技术路线，进行技术架构设计和优化
更新于 2026-06-26北京
社招1年以上基础后端
-负责公司新一代统一分布式存储（对象+文件）的核心架构设计与研发。面向 EB 级海量数据，打造百Tbps 级超高带宽与微秒级极低延迟的高可用存储服务，全面支撑AGI、社交、推荐、搜索、电商、广告等核心业务场景 -深入剖析大模型训练与推理的 I/O 特征，攻克集群计算中的 I/O带宽和延迟瓶颈与百亿文件等难题，保障采集、清洗、训练、发布等全流程在统一存储上无缝运行，彻底打破“存储墙”，极致提升 GPU 算力利用率。 -紧跟下一代硬件架构趋势，结合 PCIe 5.0 高带宽特性与QLC、FDP等新型固态存储技术进行底层 I/O 栈重构；探索 CXL 内存/存储池化、DPU/SmartNIC 硬件卸载及 GPUDirect Storage 技术，实现极致的内核旁路（Bypass Kernel）与端到端零拷贝优化，不断突破单机与集群的性能极限。
更新于 2026-07-18北京|上海|杭州
社招ACG
-设计、开发和优化公有云存储系统类产品，包括但不限于对象/文件/块存储服务 -开发和优化大规模高性能服务软件 -为百度开放云行业客户提供分布式存储技术和产品解决方案 -联动大数据、云计算、边缘云、视频云等多团队打造整体高性能解决方案
更新于 2025-09-25北京