字节跳动资深数据开发工程师-游戏技术
社招全职4年以上A114064地点：广州状态：招聘
任职要求
1、计算机相关专业本科以上学历，4年以上大数据相关工作经验； 2、掌握Hive、Yarn、Spark、Flink、Kafka、HBase等大部分大数据相关技术，了解其原理并可完成性能调优； 3、熟练使用HQL，至少掌握Python、Java、Scala、GO其中一种，熟悉Linux操作系统，熟练Shell编程； 4、工作积极主动，能独立分析和解决问题，有责任心，良好的沟通能力和团队合作能力； 5、有游戏行业经验候选人优先。
工作职责
1、参与游戏业务的离线和实时数据仓库建设和运维； 2、参与数据ETL流程的优化并解决ETL相关技术问题； 3、参与复杂数据链路依赖和多元数据内容生态下的数据治理工作； 4、依托公司成熟的大数据方案，在业务快速落地数据解决方案。
包括英文材料
学历+
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
Yarn+
[英文] Introduction
https://yarnpkg.com/getting-started
Yarn is an established open-source package manager used to manage dependencies in JavaScript projects.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
性能调优+
https://goperf.dev/
The Go App Optimization Guide is a series of in-depth, technical articles for developers who want to get more performance out of their Go code without relying on guesswork or cargo cult patterns.
https://web.dev/learn/performance
This course is designed for those new to web performance, a vital aspect of the user experience.
https://www.ibm.com/think/insights/application-performance-optimization
Application performance is not just a simple concern for most organizations; it’s a critical factor in their business’s success.
https://www.oreilly.com/library/view/optimizing-java/9781492039259/
Performance tuning is an experimental science, but that doesn’t mean engineers should resort to guesswork and folklore to get the job done.
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
Scala+
Go+
https://www.youtube.com/watch?v=8uiZC0l4Ajw
学习Golang的完整教程！从开始到结束不到一个小时，包括如何在Go中构建API的完整演示。没有多余的内容，只有你需要知道的知识。
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
Bash+
[英文] The Bash Guide
https://guide.bash.academy/
A quality-driven guide through the shell's many features.
https://www.youtube.com/watch?v=tK9Oc6AEnR4
Understanding how to use bash scripting will enhance your productivity by automating tasks, streamlining processes, and making your workflow more efficient.
相关职位
社招4年以上A126562
1、参与游戏业务的离线和实时数据仓库建设和运维； 2、参与数据ETL流程的优化并解决ETL相关技术问题； 3、参与复杂数据链路依赖和多元数据内容生态下的数据治理工作； 4、依托公司成熟的大数据方案，在业务快速落地数据解决方案。
更新于 2024-07-01
社招4年以上A60405
1、参与游戏业务的离线和实时数据仓库建设和运维； 2、参与数据ETL流程的优化并解决ETL相关技术问题； 3、参与复杂数据链路依赖和多元数据内容生态下的数据治理工作； 4、依托公司成熟的大数据方案，在业务快速落地数据解决方案。
更新于 2024-06-14
社招4年以上A185218
1、参与游戏业务的离线和实时数据仓库建设和运维； 2、参与数据ETL流程的优化并解决ETL相关技术问题； 3、参与复杂数据链路依赖和多元数据内容生态下的数据治理工作； 4、依托公司成熟的大数据方案，在业务快速落地数据解决方案。
更新于 2025-06-18
社招5年以上A250683A
1、参与数据集成系统的日常研发和运维，独立承担团队部分工作； 2、持续对数据质量、系统稳定性进行优化； 3、持续对系统的技术选型、系统设计、部署架构、监控告警进行优化迭代； 4、参与文档知识库的撰写和整理。
更新于 2024-12-09