腾讯大数据调度工具开发工程师(DataOps 方向)(深圳/北京)
社招全职3年以上大数据(数据计算平台部)技术地点:深圳状态:招聘
任职要求
1.职位要求; 2.计算机相关专业本科及以上学历,3年以上java后端开发经验; 3.能够独立设计和实现核心模块,有高并发、高可用系统设计经验; 4.有大数据调度系统开发经验,熟悉至少一种主流调度系统内部原理; 5.了解大数据生态任务执行,有 Spark、Flink、Hive 等任务提交与监控的实际经验; 6.优先条件; 7.有商业级调度产品(如 DataWorks…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1.设计并实现高性能、高可用的分布式任务调度引擎,支持分钟级百万任务调度; 2.构建分布式调度系统的高可用架构,实现故障自动转移与恢复; 3.设计并实现监控告警体系,推动调度系统的可观测性建设; 4.推动代码质量、单元测试和工程规范落地。
包括英文材料
学历+
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
后端开发+
https://www.youtube.com/watch?v=tN6oJu2DqCM&list=PLWKjhJtqVAbn21gs5UnLhCQ82f923WCgM
Learn what technologies you should learn first to become a back end web developer.
高并发+
https://www.baeldung.com/concurrency-principles-patterns
In this tutorial, we’ll discuss some of the design principles and patterns that have been established over time to build highly concurrent applications.
https://www.baeldung.com/java-concurrency
Handling concurrency in an application can be a tricky process with many potential pitfalls. A solid grasp of the fundamentals will go a long way to help minimize these issues.
https://www.oreilly.com/library/view/concurrency-in-go/9781491941294/
You’ll understand how Go chooses to model concurrency, what issues arise from this model, and how you can compose primitives within this model to solve problems.
https://www.oreilly.com/library/view/modern-concurrency-in/9781098165406/
With this book, you'll explore the transformative world of Java 21's key feature: virtual threads.
https://www.youtube.com/watch?v=qyM8Pi1KiiM
https://www.youtube.com/watch?v=wEsPL50Uiyo
高可用+
https://redis.io/blog/high-availability-architecture/
A high available architecture is when there are a number of different components, modules, or services that work together to maintain optimal performance, irrespective of peak-time loads.
https://www.ibm.com/think/topics/high-availability
High availability (HA) is a term that refers to a system’s ability to be accessible and reliable close to 100% of the time.
系统设计+
https://roadmap.sh/system-design
Everything you need to know about designing large scale systems.
https://www.youtube.com/watch?v=F2FmTdLtb_4
This complete system design tutorial covers scalability, reliability, data handling, and high-level architecture with clear explanations, real-world examples, and practical strategies.
还有更多 •••
相关职位
社招3-5年J0012
1、负责大数据方向Flink&Spark on K8S的关键能力建设,包括:Spark 高吞吐调度、Flink 极致负载均衡、Spark 计算 Offload 至 GPU 的调度支持、大数据作业资源弹性调度等; 2、负责大模型训练的ETTR(端到端训练启动时间)优化与 MFU(模型计算利用率)提升的关键技术能力建设,包括:GPU容器冷/热快速启停技术、模型服务初始化阶段的数据预加载与加速技术等。
更新于 2025-11-14北京
社招技术类
1. 负责⼤数据资源调度系统YARN 的设计和研发⼯作,解决集群规模增⻓带来的技术挑战,提⾼集群稳定性、可扩展性,深度优化资源调度策略和性能,提升资源利⽤效率; 2. 负责 公司在离线混部系统 的设计和研发⼯作,解决混部场景下,在离线资源复⽤、协调、隔离等问题,保证业务稳定性,提升在离线集群的资源利⽤效率; 3. 深⼊理解系统软硬件特性,关注线上运⾏状态,分析和解决线上问题,推动业务需求的解决⽅案落地。
更新于 2026-06-16上海
社招技术类
1. 负责⼤数据资源调度系统YARN 的设计和研发⼯作,解决集群规模增⻓带来的技术挑战,提⾼集群稳定性、 可扩展性,深度优化资源调度策略和性能,提升资源利⽤效率。 2. 负责 公司在离线混部系统 的设计和研发⼯作,解决混部场景下,在离线资源复⽤、协调、隔离等问题,保证 业务稳定性,提升在离线集群的资源利⽤效率。 3. 深⼊理解系统软硬件特性,关注线上运⾏状态,分析和解决线上问题,推动业务需求的解决⽅案落地
更新于 2026-06-18上海