百度大数据开发工程师（J86332）
社招全职2年以上MEG地点：北京状态：招聘
任职要求
- 本科及以上学历，计算机、统计等相关专业 - 精通hive、spark编程，两年以上大数据开发经验，有电商搜索、推荐、广告策略从业背景优先 - 熟悉Linux平台，熟练掌握python、shell 等脚本语言，对数据结构和算法设计有一定理解 - 熟悉主流机器学习算法，有相关数据挖掘项目经验、征工程方向工作优先 - 良好的逻辑思维能力，对数据敏感，能够发现关键数据、抓住核心问题 - 较强的沟通能力和逻辑表达能力，具备良好的团队合作精神和主动沟通意识
工作职责
- 负责数据仓库和大数据处理模块的架构设计和开发 - 负责业务数据梳理和通用数据特征建设 - 负责BI数据指标体系的构建和开发，数据质量监控和异常分析，确保数据准时、准确产出 - 支持日常业务分析需求，以支持各项决策 - 通过数据分析和数据挖掘，深入挖掘产品潜在价值和需求，进而提供更有价值的产品和服务，通过技术创新推动产品成长 - 负责电商搜索、推荐的数据策略工作
包括英文材料
学历+
Hive+
[英文] Hive Tutorial
https://www.tutorialspoint.com/hive/index.htm
Hive is a data warehouse infrastructure tool to process structured data in Hadoop. It resides on top of Hadoop to summarize Big Data, and makes querying and analyzing easy.
https://www.youtube.com/watch?v=D4HqQ8-Ja9Y
Spark+
[英文] Learning Spark Book
https://pages.databricks.com/rs/094-YMS-629/images/LearningSpark2.0.pdf
This new edition has been updated to reflect Apache Spark’s evolution through Spark 2.x and Spark 3.0, including its expanded ecosystem of built-in and external data sources, machine learning, and streaming technologies with which Spark is tightly integrated.
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
Linux+
https://ryanstutorials.net/linuxtutorial/
Ok, so you want to learn how to use the Bash command line interface (terminal) on Unix/Linux.
https://ubuntu.com/tutorials/command-line-for-beginners
The Linux command line is a text interface to your computer.
https://www.youtube.com/watch?v=6WatcfENsOU
In this Linux crash course, you will learn the fundamental skills and tools you need to become a proficient Linux system administrator.
https://www.youtube.com/watch?v=v392lEyM29A
Never fear the command line again, make it fear you.
https://www.youtube.com/watch?v=ZtqBQ68cfJc
Python+
https://liaoxuefeng.com/books/python/introduction/index.html
中文，免费，零起点，完整示例，基于最新的Python 3版本。
https://www.learnpython.org/
a free interactive Python tutorial for people who want to learn Python, fast.
https://www.youtube.com/watch?v=K5KVEU3aaeQ
Master Python from scratch 🚀 No fluff—just clear, practical coding skills to kickstart your journey!
https://www.youtube.com/watch?v=rfscVS0vtbw
This course will give you a full introduction into all of the core concepts in python.
Bash+
[英文] The Bash Guide
https://guide.bash.academy/
A quality-driven guide through the shell's many features.
https://www.youtube.com/watch?v=tK9Oc6AEnR4
Understanding how to use bash scripting will enhance your productivity by automating tasks, streamlining processes, and making your workflow more efficient.
脚本+
[英文] Scripting language
https://en.wikipedia.org/wiki/Scripting_language
https://zhuanlan.zhihu.com/p/571097954
一个脚本通常是解释执行而非编译。脚本语言通常都有简单、易学、易用的特性，目的就是希望能让程序员快速完成程序的编写工作。
数据结构+
https://www.youtube.com/watch?v=8hly31xKli0
In this course you will learn about algorithms and data structures, two of the fundamental topics in computer science.
https://www.youtube.com/watch?v=B31LgI4Y4DQ
Learn about data structures in this comprehensive course. We will be implementing these data structures in C or C++.
https://www.youtube.com/watch?v=CBYHwZcbD-s
Data Structures and Algorithms full course tutorial java
算法+
https://roadmap.sh/datastructures-and-algorithms
Step by step guide to learn Data Structures and Algorithms in 2025
https://www.hellointerview.com/learn/code
A visual guide to the most important patterns and approaches for the coding interview.
https://www.w3schools.com/dsa/
机器学习+
https://www.youtube.com/watch?v=0oyDqO8PjIg
Learn about machine learning and AI with this comprehensive 11-hour course from @LunarTech_ai.
https://www.youtube.com/watch?v=i_LwzRVP7bg
Learn Machine Learning in a way that is accessible to absolute beginners.
https://www.youtube.com/watch?v=NWONeJKn6kc
Learn the theory and practical application of machine learning concepts in this comprehensive course for beginners.
https://www.youtube.com/watch?v=PcbuKRNtCUc
Learn about all the most important concepts and terms related to machine learning and AI.
数据挖掘+
https://www.youtube.com/watch?v=-bSkREem8dM
Database vs Data Warehouse vs Data Lake
https://www.youtube.com/watch?v=7rs0i-9nOjo
相关职位
社招1年以上MEG
-负责百度APP Feed流业务(包括鸿蒙系统)的服务端系统及平台的工程架构设计、研发 -负责信息流列表、资讯详情页、直播等前台业务服务端研发工作 -参与前台、中台业务需求对接，技术方案设计和实现 -负责服务性能优化、稳定性建设 -参与大模型应用探索
更新于 2025-06-13
社招网易数智
1、负责网易大数据平台的Iceberg等大数据组件迭代研发。 2、负责Iceberg等技术在业务上的实践落地以及问题分析诊断。 3、 参与Hive等组件在大数据元数据服务方面的稳定性建设以及问题诊断。
更新于 2025-04-17
社招A166444A
1、为大规模推荐系统设计和实现合理的离线/实时数据架构； 2、设计和实现灵活可扩展、稳定、高性能的存储系统和计算模型； 3、生产系统的Trouble-shoting，设计和实现必要的机制和工具保障生产系统整体运行的稳定性； 4、打造业界领先的离在线存储、批式流式计算框架等分布式系统，为海量数据和大规模业务系统提供可靠的基础设施。
更新于 2025-02-20
社招5年以上技术
1、负责哈啰街猫业务基础数据的建设，包括基础数据模型建立和维护，报表的开发，业务系统的数据开发等； 2、理解哈啰街猫投喂、电商等业务，根据业务需求建立用户画像体系和标签体系，支持推荐和用户运营； 3、参与数据产品及应用的研发工作，挖掘数据业务价值，助力数据化运营；
更新于 2025-02-12