夸克智能信息-大数据平台开发工程师-杭州
社招全职3年以上技术类-开发地点：杭州状态：招聘
任职要求
1、熟练掌握C/C++/Go/Java 等开发语言，具备高并发、低延迟系统的设计与调优经验。深入理解分布式系统核心理论，包括 CAP 理论、Raft/Paxos 共识算法及分布式事务模型。 2、精通 LSM-Tree 引擎优化，熟悉 RocksDB 核心机制（Leveled Compaction、MemTable 管理、WAL 持久化等）。 3、熟悉至少一种主流 NoSQL 存储系统（如 HBase、Cassandra、MongoDB），并有相关深度优化经验。 4、精通Spark/Flink内核机制（Task调度、Shuffle管理、State Backend），具备算子优化或自定义 Source/Sink 开发经验。 5、有主导或参与存储引擎开源项目（如 TiKV、CockroachDB 等）核心模块开发经验者优先考虑。
工作职责
1、分布式 NoSQL 存储架构设计与优化：负责大规模分布式 NoSQL存储系统的架构设计、核心模块开发及性能调优，支持 PB 级数据存储需求。 2、实现多租户资源隔离、优先级调度与 SLA 保障，支撑智能信息搜索/推荐/LLM 等高性能业务场景。 3、大数据计算引擎研发与优化：设计并开发流、批计算框架，构建基于 DAG 的动态任务调度系统，实现万级并发任务的资源利用率与 SLA 平衡。 4、攻克每日 PB 级流、批数据处理的稳定性挑战，优化大规模 Join/Aggregation 场景下的 IO 与网络带宽瓶颈。
包括英文材料
C+
https://www.freecodecamp.org/chinese/news/the-c-beginners-handbook/
本手册遵循二八定律。你将在 20% 的时间内学习 80% 的 C 编程语言。
https://www.youtube.com/watch?v=87SH2Cn0s9A
https://www.youtube.com/watch?v=KJgsSFOSQv0
This course will give you a full introduction into all of the core concepts in the C programming language.
https://www.youtube.com/watch?v=PaPN51Mm5qQ
In this complete C programming course, Dr. Charles Severance (aka Dr. Chuck) will help you understand computer architecture and low-level programming with the help of the classic C Programming language book written by Brian Kernighan and Dennis Ritchie.
C+++
https://www.learncpp.com/
LearnCpp.com is a free website devoted to teaching you how to program in modern C++.
https://www.youtube.com/watch?v=ZzaPdXTrSb8
Go+
https://www.youtube.com/watch?v=8uiZC0l4Ajw
学习Golang的完整教程！从开始到结束不到一个小时，包括如何在Go中构建API的完整演示。没有多余的内容，只有你需要知道的知识。
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
高并发+
https://www.baeldung.com/concurrency-principles-patterns
In this tutorial, we’ll discuss some of the design principles and patterns that have been established over time to build highly concurrent applications.
https://www.baeldung.com/java-concurrency
Handling concurrency in an application can be a tricky process with many potential pitfalls. A solid grasp of the fundamentals will go a long way to help minimize these issues.
https://www.oreilly.com/library/view/concurrency-in-go/9781491941294/
You’ll understand how Go chooses to model concurrency, what issues arise from this model, and how you can compose primitives within this model to solve problems.
https://www.oreilly.com/library/view/modern-concurrency-in/9781098165406/
With this book, you'll explore the transformative world of Java 21's key feature: virtual threads.
https://www.youtube.com/watch?v=qyM8Pi1KiiM
https://www.youtube.com/watch?v=wEsPL50Uiyo
分布式系统+
https://www.distributedsystemscourse.com/
The home page of a free online class in distributed systems.
https://www.youtube.com/watch?v=7VbL89mKK3M&list=PLOE1GTZ5ouRPbpTnrZ3Wqjamfwn_Q5Y9A
CAP+
https://www.hellointerview.com/learn/system-design/core-concepts/cap-theorem
Master the fundamental tradeoffs between consistency and availability in distributed systems.
https://www.ibm.com/think/topics/cap-theorem
The CAP theorem says that a distributed system can deliver only two of three desired characteristics:
consistency, availability and partition tolerance (the ‘C,’ ‘A’ and ‘P’ in CAP).
https://www.youtube.com/watch?v=BHqjEjzAicA
Raft+
https://raft.github.io/
Raft is a consensus algorithm that is designed to be easy to understand.
https://thesecretlivesofdata.com/raft/
Understandable Distributed Consensus
https://www.youtube.com/watch?v=ZyqAbQkpeUo
Sail into the world of distributed systems with our in-depth, Raft consensus algorithm tutorial.
Paxos+
https://lamport.azurewebsites.net/pubs/paxos-simple.pdf
The Paxos algorithm for implementing a fault-tolerant distributed system has been regarded as difficult to understand, perhaps because the original presentation was Greek to many readers.
https://paxos.systems/
Paxos algorithms are a family of consensus algorithms (or protocols) that are used in distributed systems to achieve consensus in the presence of crash failures.
https://www.scylladb.com/glossary/paxos-consensus-algorithm/
Paxos is a family of protocols for solving the problem of consensus in distributed networks.
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
RocksDB+
https://rocksdb.org/docs/getting-started.html
The RocksDB library provides a persistent key value store.
WAL+
https://adambcomer.com/blog/simple-database/wal/
To recover our data after the database restarts, we need our first layer of on-disk persistence, the WAL.
[英文] Write-Ahead Logging
https://sqlite.org/wal.html
The default method by which SQLite implements atomic commit and rollback is a rollback journal.
[英文] The Write-Ahead Log: The underrated Reliability Foundation for Databases and Distributed systems
https://www.architecture-weekly.com/p/the-write-ahead-log-a-foundation
I want to talk with you today about the Write-Ahead Log concept.
https://www.postgresql.org/docs/current/wal-intro.html
Write-Ahead Logging (WAL) is a standard method for ensuring data integrity.
NoSQL+
https://nosql-database.org/
Everything about NoSQL Systems – Types, Benefits, and Real-World Uses
https://piaosanlang.gitbooks.io/mongodb/content/section1.1.html
NoSQL(NoSQL = Not Only SQL )，即"不仅仅是SQL"，指的是非关系型的数据库。是对不同于传统的关系型数据库管理系统的统称。
https://www.youtube.com/watch?v=0buKQHokLK8
NoSQL databases can operate in multiple modes: as key-value store, document store or wide column store.
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
Cassandra+
[英文] Learn Cassandra
https://teddyma.gitbooks.io/learncassandra/content/index.html
This book step-by-step guides developers to understand what Cassandra is, how Cassandra works and how to use the features and capabilities of Apache Cassandra 2.0.
https://www.freecodecamp.org/news/the-apache-cassandra-beginner-tutorial/
In this tutorial I will introduce you to Apache Cassandra, a distributed, horizontally scalable, open-source database.
https://www.youtube.com/watch?v=J-cSy5MeMOA
Apache Cassandra is an open source NoSQL distributed database.
MongoDB+
https://learnxinyminutes.com/mongodb/
MongoDB is a NoSQL document database for high volume data storage.
https://studio3t.com/academy/#courses
The fastest way to learn MongoDB
https://www.youtube.com/watch?v=c2M-rlkkT5o
This video will give you and introduction to MongoDB in 1 Hour. Afterwards I recommend exploring aggregation, replication, and sharding.
https://www.youtube.com/watch?v=ExcRbA7fy_A&list=PL4cUxeGkcC9h77dJ-QJlwGlZlTd4ecZOA
You'll learn how to use MongoDB (a NoSQL database) from scratch. You'll also learn how to integrate it into a simple Node.js API.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
内核+
https://www.youtube.com/watch?v=C43VxGZ_ugU
I rummage around the Linux kernel source and try to understand what makes computers do what they do.
https://www.youtube.com/watch?v=HNIg3TXfdX8&list=PLrGN1Qi7t67V-9uXzj4VSQCffntfvn42v
Learn how to develop your very own kernel from scratch in this programming series!
https://www.youtube.com/watch?v=JDfo2Lc7iLU
Denshi goes over a simple explanation of what computer kernels are and how they work, alonside what makes the Linux kernel any special.
TiKV+
https://tikv.org/docs/7.1/concepts/overview/
TiKV is a highly scalable, low latency, and easy to use key-value database that delivers performance less than 10 ms at any scale.
CockroachDB+
https://www.baeldung.com/cockroachdb-java
This tutorial is an introductory guide to using CockroachDB with Java.
https://www.cockroachlabs.com/resources/tutorial/
Tutorials in all programming languages.
相关职位
实习A127650
ByteIntern：面向2026届毕业生（2025年9月-2026年8月期间毕业），为符合岗位要求的同学提供转正机会。 团队介绍：商业平台与基础架构团队负责抖音集团广告投放系统、广告AI系统、广告业务平台、广告创意平台和广告研发效能平台的建设。负责抖音、今日头条等各端上的广告业务系统研发，并且构建高并发、高性能、高可用的服务框架，设计和研发多数据中心的广告系统架构。同时推动用户行为长序列、深度学习推荐模型、多模态LLM和AIGC等先进技术在商业化场景中的应用和落地，精准匹配广告与用户需求，让营销更高效、更智能、更可持续。 1、参与抖音集团广告系统平台开发，基于现代Web开发框架、低代码技术等方案，支持抖音、今日头条等各端上的信息流广告、开屏广告、搜索广告、激励广告等广告形态的一站式流量接入和样式开发； 2、参与抖音集团广告算法大数据平台开发，支持广告算法工程师的数据管理、数据挖掘、样本建模、特征工程等方向的平台全栈开发； 3、基于商业产品的发展趋势和广告系统的技术挑战，设计相应的前端架构，支持抖音集团广告业务的长期增长； 4、跨团队协作完成整体项目规划、设计与开发工作，重点参与项目的组件开发、平台优化、业务基建等任务。
更新于 2025-01-14
社招3年以上技术类-开发
1、负责大模型应用开发范式及一站式研发平台的设计、开发及应用，支持公司内部大模型的应用的快速落地 2、负责大模型产品的整体技术解决方案，并支持技术研发和效果优化等工作，推动产品持续增长 3、保障大模型应用系统架构的稳定、高效运行，帮助业务优化性能和改善系统稳定性
更新于 2025-10-14
社招3年以上技术类-开发
1. 参与互联网网页、文档、图片、音视频等境内外内容数据的发现、采集及处理 2. 优化爬虫架构及平台能力，优化js渲染性能和效果，提升反爬对抗能力 3. 优化数据处理系统，完善数据标注等平台能力 4. 负责大模型训练语料、RAG索引等重要数据的交付
更新于 2025-07-30
校招智能信息秋季20
阿里巴巴智能信息事业群，聚焦AI在信息服务赛道的创新应用，从工具到服务，持续为用户提供高效、智能的AI应用。智能信息事业群核心产品为夸克、通义、UC浏览器、书旗小说、超级汇川等，以多产品矩阵，覆盖横跨各年龄段的7亿+用户人群，服务超10万+客户。 如果你想接触和使用先进的机器学习的框架和统计方法设计方案，解决业务中的从未被解决过的问题； 如果你想通过Python/R等流行的语言编写高效的机器学习算法，参与阿里巴巴集团智能信息事业群大数据体系的模型设计、开发、维护，通过元数据、质量体系有效的管理和组织EB级的数据； 如果你想参与阿里巴巴集团智能信息事业群大数据产品的研发，发挥你的商业Sense，通过数据分析和算法来洞察数据背后的机会，来探索大数据商业化，释放大数据的价值； 如果你想接触世界领先的大数据处理与应用的技术和平台，获得大数据浪潮之巅的各类大牛的指导； 那就加入我们吧！
更新于 2025-08-13