
叠纸游戏实时数据开发
社招全职4年以上平台类地点:上海状态:招聘
任职要求
1、计算机相关专业本科及以上学历,4年以上实时数仓相关工作经验; 2、熟悉Kafka/Flink/Clickhouse/HBase/Doris 等开源实时大数据技术; 3、流式处理性能经验丰富,对流批一体化有深入见解,有过pb级在线业务的优先; 4、具备3年以上的Java开发经验,熟练掌握SpringBoot、SSM、Mybatis等框架,有一定的DEBUG及性能优化能力; 5、具有良好的学习能力、团队协助以及沟通能力,执行…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1、参与和主导大数据实时数仓的架构设计、方案选型、验证、落地等; 2、负责自动化实时数据接入系统的设计、开发工作,实现游戏日志数据自动化接入; 3、参与构建流批一体的数据自助分析平台,支持业务方自助进行数据的快速定位和分析; 4、负责流计算引擎flink的调度优化、执行优化,支撑高吞吐、大状态作业的稳定运行; 5、建设复杂业务场景的实时数据体系,驱动业务。
包括英文材料
学历+
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
ClickHouse+
[英文] Advanced Tutorial
https://clickhouse.com/docs/tutorial
Learn how to ingest and query data in ClickHouse using the New York City taxi example dataset.
https://www.youtube.com/watch?v=FtoWGT7kS-c
ClickHouse is an open-source column-oriented DBMS for online analytical processing that allows users to generate analytical reports using SQL queries in real-time.
https://www.youtube.com/watch?v=Rhe-kUyrFUE&list=PL0Z2YDlm0b3gcY5R_MUo4fT5bPqUQ66ep
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
Doris+
https://doris.apache.org/docs/gettingStarted/what-is-apache-doris
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
还有更多 •••
相关职位
社招3-5年后端开发
1、负责实时计算平台的整体架构设计、开发和运维,打造业界一流的实时数据平台 2、 负责Flink on k8s 架构下容灾,具备集群、机房级别故障的双链路容灾和逃逸能力 3、规范和管理flink计算资源,降低运维成本,提高计算资源的利用率 4、支持流批一体的数据开发新范式
北京|上海|杭州
社招3年以上A210687
1、负责实时数据建设工作,对长中短期工作目标、工作方法和结果负责; 2、深入理解业务场景,标准化实时解决方案,降低实时开发、运维成本; 3、负责对实时计算作业性能、资源的优化,保障实时任务的稳定性; 4、负责实时新技术调研工作。
更新于 2024-03-18北京
社招J6HX2
1、负责部门用户增长业务的实时数据系统建设的规划、设计及落地,为业务团队提供高效的实时、离线数据支持; 2、负责部门业务中增长方向实时数据集市研发及实时数据指标开发; 3、负责实时数据计算和数据服务的性能优化建设,提供稳定的业务实时数据服务。
更新于 2021-09-16北京