Data Platform Engineer (Cloudera)
TOG Indonesia
Lokasi
Jakarta
Tipe kerja
On-site
Gaji
Negotiable
Deskripsi pekerjaan
- Manage and deploy best practice for Hadoop cluster using Cloudera Data Platform infrastructure (Cloudera Manager, Cloudera Management Service, HDFS, Hive, Impala, Hue, Oozie, Ranger Zookeeper, Knox, Kafka, Hbase, Spark, YARN, etc.)
- Manage and deploy best practice for Cloudera Data Services, including Cloudera Machine Learning (previously Cloudera Data Science Workbench).
- Perform daily monitoring for Cloudera Data Platform cluster node, OS parameters, and device alert.
- Perform OS tuning for Cloudera Data Platform on Linux platform including configuration and best practice setting.
- Review and perform security hardening for OS setting and Cloudera Data Platform.
- Backup, restore, and Data Replication of Cloudera Data Platform system with Hive BDR.
- Support testing activities (including DR drill) with various stakeholders i.e. application teams, external parties.
- Able to give advice and recommendation for query and job tuning, including Spark (Java, Scala, and Python PySpark), Impala, and Hive.
- Establish and maintain documentation and standardsWorks as part a team and provide the support when requirement
Tanggung jawab
- Manage and deploy best practice for Hadoop cluster using Cloudera Data Platform infrastructure (Cloudera Manager, Cloudera Management Service, HDFS, Hive, Impala, Hue, Oozie, Ranger Zookeeper, Knox, Kafka, Hbase, Spark, YARN, etc.)
- Manage and deploy best practice for Cloudera Data Services, including Cloudera Machine Learning (previously Cloudera Data Science Workbench).
- Perform daily monitoring for Cloudera Data Platform cluster node, OS parameters, and device alert.
- Perform OS tuning for Cloudera Data Platform on Linux platform including configuration and best practice setting.
- Review and perform security hardening for OS setting and Cloudera Data Platform.
- Backup, restore, and Data Replication of Cloudera Data Platform system with Hive BDR.
- Support testing activities (including DR drill) with various stakeholders i.e. application teams, external parties.
- Able to give advice and recommendation for query and job tuning, including Spark (Java, Scala, and Python PySpark), Impala, and Hive.
- Establish and maintain documentation and standardsWorks as part a team and provide the support when requirement
Kualifikasi
- 3+ years of experience with Cloudera Data Platform and Cloudera Data Services.
- 2+ years of experience with OS Linux, ie. Red Hat Enterprise Linux and SystemD.
- 2+ years of experience with Kubernetes and containerization are a major plus.
- Having a problem-solving attitude, work independently and as part of a team.
- Willing to work in banking industry.
Benefit & Fasilitas
competitiveSalarymedicalLeavebonusSystempaidSickDays
Keahlian
ClouderaHadoopCloudera ManagerRedHatLinux