
美图数据开发工程师—— 大数据平台
社招全职研发类地点:厦门状态:招聘
工作描述
任职要求 * Bachelor's degree or above in Computer Science, Software Engineering, Mathematics, or a related field. * 3+ years of experience in big data development, platform engineering, or data infrastructure-related roles. * Hands-on experience planning, building, and optimizing medium-to-large-scale big data clusters (50–100+ nodes or PB-scale data environments). * Strong expertise in mainstream big data ecosystem technologies, including Hadoop, Spark, Hive, HBase, Presto, Flink, and ClickHouse. * Proficient in Java, Python, and Shell scripting for platform development and automation. * Advanced experience with Hive SQL optimization and large-scale query performance tuning. * Ability to independently perform requirement analysis, technology selection, and architecture design for highly available and scalable big data solutions. * Experience with source code modification, customization, or secondary development of open-source frameworks such as Hadoop, Spark, Hive, or Presto is highly preferred. * Strong problem-solving skills, self-motivation, communication abilities, and the capability to handle …
登录查看完整工作描述
微信扫码,1秒登录
包括英文材料
Hadoop+
https://www.runoob.com/w3cnote/hadoop-tutorial.html
Hadoop 为庞大的计算机集群提供可靠的、可伸缩的应用层计算和存储支持,它允许使用简单的编程模型跨计算机群集分布式处理大型数据集,并且支持在单台计算机到几千台计算机之间进行扩展。
[英文] Hadoop Tutorial
https://www.tutorialspoint.com/hadoop/index.htm
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
Presto+
[英文] What is Presto?
https://prestodb.io/what-is-presto/
https://www.tutorialspoint.com/apache_presto/index.htm
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
ClickHouse+
[英文] Advanced Tutorial
https://clickhouse.com/docs/tutorial
Learn how to ingest and query data in ClickHouse using the New York City taxi example dataset.
https://www.youtube.com/watch?v=FtoWGT7kS-c
ClickHouse is an open-source column-oriented DBMS for online analytical processing that allows users to generate analytical reports using SQL queries in real-time.
https://www.youtube.com/watch?v=Rhe-kUyrFUE&list=PL0Z2YDlm0b3gcY5R_MUo4fT5bPqUQ66ep
还有更多 •••
相关职位
社招3年以上火车票业务开发
1.计算机、软件工程、数据相关专业本科及以上学历。 2.3 年及以上数据开发或大数据平台开发相关工作经验。 3.扎实的计算机基础,熟练掌握 Java 编程,熟悉主流 Java 开发
更新于 2025-12-02上海
社招3-5年J0012
1、计算机及相关专业,本科及以上学历; 2、优秀的代码基础,至少熟悉Java/Python/Ruby/JavaScript 等主流语言中的一种; 3、有服务端接口测试、性能测试、流量回放等相关经验,并
更新于 2026-04-17北京
社招3年以上信息技术类
岗位职责: 1、大数据基础平台、应用平台功能设计和开发; 2、负责大数据平台及组件的调研选型,部署,日常监控及问题解决; 3、参与海量数据处理方案设计,提供业务系统技术支撑。 任职要求: 1、3年及
更新于 2026-08-25南京|深圳