字节跳动大数据研发工程师
社招全职A140437地点:北京状态:招聘
任职要求
1、计算机相关专业本科以上学历,熟悉大数据计算架构和工作原理,熟悉Spark/Flink编程;精通Hive,有HQL优化经验; 2、熟悉JAVA,python等多种编程技术,编程能力强,有web服务开发经验,具备独立完成模块开发能力; 3、理解基本的设计模式,能将业务需求快速理解成技术需求; 4、熟练使用Mys…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1、广告各类在线业务的离线数据加工与在线数据服务开发与维护; 2、数据服务接口及产品需求研发迭代,代码review、bug修复及日常服务运维; 3、针对海量数据处理和查询需求,设计适应业务变化的合理的多维数据分析系统架构,满足多样性的需求; 4、海量日志清洗加工,并抽象出可以多业务复用的数据模型。
包括英文材料
学历+
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
Java+
https://www.youtube.com/watch?v=eIrMbAQSU34
Master Java – a must-have language for software development, Android apps, and more! ☕️ This beginner-friendly course takes you from basics to real coding skills.
还有更多 •••
相关职位
社招2年以上技术
1.参与滴滴国际化外卖商家、骑手、订单等数据域的离线、实时数据集市和实时数据的开发工作; 2.参与滴滴国际化外卖离线、实时相关数据规划、设计以及落地; 3.参与风控实时数据计算和服务的性能优化与运维,为业务提供稳定的服务;
更新于 2025-04-16北京
社招
1. 参与围绕泛搜推领域数据的数据工程研发体系建设,通过数据+算法分析+工程化能力,高效赋能业务; 2. 通过抽象业务域,简历规范化的数据解决方案,通过构建实时、离线数仓为业务提供稳定、安全的数据源; 3. 参与湖仓一体的下一代大数据解决方案建设,提升效率,更好的支持业务; 4. 参与到实验效果的分析中,提供更科学的实验指导及实验分析。
更新于 2025-04-17杭州