
唯品会高级/资深大数据SRE
社招全职5-10年地点:上海状态:招聘
任职要求
1、熟悉HDFS、YARN、RSS、ZK、常见OLAP引擎等大数据组件,具有大规模集群的运维经验; 2、熟悉操作系统优化、Ansible&Puppet等自动化工具,熟悉Shell编程; 3、熟悉Golang/P…
登录查看完整任职要求
微信扫码,1秒登录
工作职责
1、负责大规模大数据底层存储、计算组件的运维部署、管理扩容和优化等,保障服务的稳定性和可用性等: 2、负责推动混部的落地,提升计算资源利用率; 3、负责自动化运维平台的优化,提升运维工作效率; 4、协同数据平台研发提升作业稳定性,为业务保驾护航;
包括英文材料
HDFS+
https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html
The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware.
https://www.ibm.com/cn-zh/think/topics/hdfs
Hadoop 分布式文件系统 (HDFS) 是一种管理大型数据集的文件系统,可在商用硬件上运行。
Yarn+
[英文] Introduction
https://yarnpkg.com/getting-started
Yarn is an established open-source package manager used to manage dependencies in JavaScript projects.
ZooKeeper+
https://kubernetes.io/docs/tutorials/stateful-application/zookeeper/
This tutorial demonstrates running Apache Zookeeper on Kubernetes using StatefulSets, PodDisruptionBudgets, and PodAntiAffinity.
https://www.baeldung.com/java-zookeeper
Apache ZooKeeper is a distributed coordination service which eases the development of distributed applications.
[英文] Zookeeper Tutorial
https://www.tutorialspoint.com/zookeeper/index.htm
ZooKeeper is a distributed co-ordination service to manage large set of hosts.
OLAP+
https://www.youtube.com/watch?v=iw-5kFzIdgY
OLAP (for online analytical processing) is software for performing multidimensional analysis at high speeds on large volumes of data from a data warehouse, data mart, or some other unified, centralized data store.
大数据+
https://www.youtube.com/watch?v=bAyrObl7TYE
https://www.youtube.com/watch?v=H4bf_uuMC-g
With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.
还有更多 •••