京东数据开发工程师
社招全职数据开发岗地点:北京状态:招聘
任职要求
对外发布职位名 数据开发工程师 岗位职责及目标 1.负责按照业务需求建立并完善风控所需要的风控集市 ,参与模型结构设计、模型mapping开发、特征开发等工作; 2.负责自有数据、三方数据进行分层管理和加工,通过合理的数据抽象和建模,沉淀可复用的数据资产; 3.参与数据治理、数据质量、数据服务及数据产品等基础数据平台和设施建设。 任职要求 1.本科及以上学历,计算机相关专业; 2.熟悉Hadoop生态相关技术并有相关实践经验,包括但不限于hadoop/hive/hbase/spark/kafka/flink/presto/kylin等; 3.有丰富的数据开发经验,有HiveSQL/SparkSQL/MapReduce调优经验,对数据处理、数据建模、数据治理等 有深刻认识和实战经验; 4.对数据敏感,能够快速理解业务并独立完成业务数据模型设计及开发,对金融风控、机器学习等领域有了解的 优先; 5.具有较好的沟通能力、学习能力和团队合作精神,乐于挑战自我,有进取心和求知欲。 符合京东价值观:客户为先、创新、拼搏、担当、感恩、诚信。
工作职责
1.负责按照业务需求建立并完善风控所需要的风控集市 ,参与模型结构设计、模型mapping开发、特征开发等工作; 2.负责自有数据、三方数据进行分层管理和加工,通过合理的数据抽象和建模,沉淀可复用的数据资产; 3.参与数据治理、数据质量、数据服务及数据产品等基础数据平台和设施建设。
包括英文材料
数据治理+
https://www.ibm.com/think/topics/data-governance
Data governance is the data management discipline that focuses on the quality, security and availability of an organization’s data.
https://www.youtube.com/watch?v=uPsUjKLHLAg
Building data fabric eliminates the technological complexities of data governance so users can connect to the right data at the right time, regardless of where it resides.
学历+
Hadoop+
https://www.runoob.com/w3cnote/hadoop-tutorial.html
Hadoop 为庞大的计算机集群提供可靠的、可伸缩的应用层计算和存储支持,它允许使用简单的编程模型跨计算机群集分布式处理大型数据集,并且支持在单台计算机到几千台计算机之间进行扩展。
[英文] Hadoop Tutorial
https://www.tutorialspoint.com/hadoop/index.htm
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models.
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
HBase+
[英文] HBase Tutorial
https://www.tutorialspoint.com/hbase/index.htm
HBase is a data model that is similar to Google's big table designed to provide quick random access to huge amounts of structured data. This tutorial provides an introduction to HBase, the procedures to set up HBase on Hadoop File Systems, and ways to interact with HBase shell.
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
Kafka+
https://developer.confluent.io/what-is-apache-kafka/
https://www.youtube.com/watch?v=CU44hKLMg7k
https://www.youtube.com/watch?v=j4bqyAMMb7o&list=PLa7VYi0yPIH0KbnJQcMv5N9iW8HkZHztH
In this Apache Kafka fundamentals course, we introduce you to the basic Apache Kafka elements and APIs, as well as the broader Kafka ecosystem.
Flink+
https://nightlies.apache.org/flink/flink-docs-release-2.0/docs/learn-flink/overview/
This training presents an introduction to Apache Flink that includes just enough to get you started writing scalable streaming ETL, analytics, and event-driven applications, while leaving out a lot of (ultimately important) details.
https://www.youtube.com/watch?v=WajYe9iA2Uk&list=PLa7VYi0yPIH2GTo3vRtX8w9tgNTTyYSux
Today’s businesses are increasingly software-defined, and their business processes are being automated. Whether it’s orders and shipments, or downloads and clicks, business events can always be streamed. Flink can be used to manipulate, process, and react to these streaming events as they occur.
Presto+
[英文] What is Presto?
https://prestodb.io/what-is-presto/
https://www.tutorialspoint.com/apache_presto/index.htm
MapReduce+
https://www.youtube.com/watch?v=bcjSe0xCHbE
https://www.youtube.com/watch?v=cHGaQz0E7AU
In this video I explain the basics of Map Reduce model, an important concept for any software engineer to be aware of.
机器学习+
https://www.youtube.com/watch?v=0oyDqO8PjIg
Learn about machine learning and AI with this comprehensive 11-hour course from @LunarTech_ai.
https://www.youtube.com/watch?v=i_LwzRVP7bg
Learn Machine Learning in a way that is accessible to absolute beginners.
https://www.youtube.com/watch?v=NWONeJKn6kc
Learn the theory and practical application of machine learning concepts in this comprehensive course for beginners.
https://www.youtube.com/watch?v=PcbuKRNtCUc
Learn about all the most important concepts and terms related to machine learning and AI.
相关职位
社招3年以上数据开发岗
1.参与京东外卖&秒送PB级数据仓库的建设,为各业务方提供完整、高效的数据支撑; 2.基于简单、易用、高效、可靠等原则建设离线数据仓库,支撑上层数据产品和分析师; 3.构建实时数据仓库,满足实时业务场景; 4.深入参与数据产品建设,为公司内外提供完善的数据解决方案; 5.满足公司各部门日常的数据需求。
更新于 2025-06-15
社招数据开发岗
1.深入理解电商平台业务,围绕场景构建分析模型,挖掘潜在问题和增长机会,助力业务发展; 2.完成平台业务的数据架构设计及实时和离线的数据开发工作; 3.对未来数据流架构和研发流程进行设计和落地,持续提升稳定性和研发效能。
更新于 2025-06-15
社招数据开发岗
1.深入理解电商平台业务,围绕场景构建分析模型,挖掘潜在问题和增长机会,助力业务发展; 2.完成平台业务的数据架构设计及实时和离线的数据开发工作; 3.对未来数据流架构和研发流程进行设计和落地,持续提升稳定性和研发效能。
更新于 2025-06-15