Hadoop Administrator / Big Data Engineer
Job Description
<p><strong>Job Description</strong></p><p>We are seeking a skilled and experienced Hadoop Administrator/Big Data Engineer to join our team. As a Hadoop Administrator, you will be responsible for deploying, configuring, and maintaining Hadoop services, including Hadoop, HDFS, Spark, and related technologies. You will also oversee the infrastructure and topology of our host machines, ensuring their smooth operation, connectivity, and scalability. The ideal candidate has a deep understanding of Hadoop architecture, networking, and distributed computing principles.</p><p><br></p><p><strong>Responsibilities</strong></p><ul><li>Install, configure, and manage Hadoop services, including Hadoop, HDFS, Spark, and related components. (We do not use distributions such as Cloudera’s. We are building the data platform from grounds up using open-source tools)</li><li>Monitor and maintain the health, performance, and security of Hadoop clusters and related infrastructure.</li><li>Design and implement scalable and fault-tolerant Hadoop architectures and topologies.</li><li>Collaborate with the data engineering team to understand and address data and processing requirements.</li><li>Optimize Hadoop clusters for maximum performance and efficiency.</li><li>Troubleshoot and resolve issues related to Hadoop services, infrastructure, and connectivity.</li><li>Implement and enforce security measures, including access control and data protection.</li><li>Stay up-to-date with industry trends, best practices, and emerging technologies related to Hadoop and big data processing.</li><li>Document system configurations, procedures, and troubleshooting steps.</li></ul><p><br></p><p><strong>Requirements</strong></p><ul><li>Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.</li><li>3-5 years of experience <span>as a Hadoop Administrator or Big Data Engineer, managing Hadoop clusters in production environments.</span></li><li>Strong knowledge of Hadoop ecosystem components.</li><li>Proficiency in Linux/Unix system administration and shell scripting.</li><li>Experience with cluster management and orchestration tools such as Apache Ambari, Cloudera Manager, or Hortonworks Data Platform.</li><li>Excellent problem-solving and troubleshooting skills.</li><li>Strong communication and collaboration abilities.</li><li>Relevant certifications, such as Cloudera Certified Administrator for Apache Hadoop (CCAH), are desirable.</li></ul><p><br></p><p><strong>Benefits</strong></p><ul><li>Social Insurance</li><li>Premium Medical Insurance</li><li>Opportunity to travel and work onsite with our Saudi client</li><li>Hybrid work model, with the possibility of accommodating personal needs</li></ul>
