Engineer – Digital Data

Job Description

To develop and maintain our data infrastructure and systems. Design, build, and optimize data pipelines, databases, and data warehouses to facilitate efficient data processing, storage, and retrieval. Collaboration with cross-functional teams, including data scientists, analysts, and software engineers, will be essential to ensure the availability, reliability, and scalability of client’s data infrastructure, supporting data-driven decision-making processes.<p><br></p><strong>Related Responsibilities</strong><p><br></p><ul><li>Data Pipelines Design, implement, and maintain scalable and robust data pipelines that efficiently extract, transform, and load (ETL) data from diverse sources into our target systems. This involves tasks such as data ingestion, data cleansing, data transformation, and data integration.</li><li>Management of Data Warehouses and Databases Develop and oversee data warehousing solutions and databases to ensure optimal performance, data integrity, and data security. Implement appropriate strategies for data partitioning, indexing, and caching to enhance query efficiency and analytics capabilities.</li><li>Data Modelling Devise and execute data models that align with our business requirements, guaranteeing the accuracy, consistency, and usability of our data. Collaborate closely with stakeholders to grasp their data needs and translate them into effective data structures.</li><li>Performance Optimization Identify and address performance bottlenecks within data pipelines, databases, and queries. Apply caching mechanisms, indexing strategies, and query optimization techniques to enhance data processing and retrieval speeds.</li><li>Data Quality and Governance Establish data quality standards, data governance policies, and data lineage tracking mechanisms to ensure data accuracy, consistency, and compliance. Implement processes for data quality checks, monitoring, and validation.</li><li>Data Integration and APIs Integrate data from various sources, including internal systems and external APIs, ensuring data compatibility and consistency. Develop and maintain API endpoints to enable seamless data access and consumption.</li><li>Collaboration and Communication Foster collaboration with cross-functional teams, including data scientists, analysts, and software engineers, to comprehend data requirements and provide effective data engineering solutions. Articulate complex technical concepts to non-technical stakeholders.</li><li>Continuous Improvement Stay abreast of emerging technologies, tools, and best practices in data engineering. Proactively identify opportunities to enhance our data infrastructure, automate processes, and optimize data workflows.</li></ul><p><br></p><strong>Technical Requirements</strong><p><br></p><ul><li>Proficiency in programming languages such as Python, SQL, and/or Java.</li><li>Strong familiarity with big data technologies like Hadoop, Spark, or Kafka.</li><li>Experience in data modeling and database design principles, encompassing both relational databases (e.g., MS-Sql, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).</li><li>Knowledge of data warehousing concepts and experience with relevant solutions (e.g., Redshift, Snowflake).</li><li>Competence in cloud platforms like AWS, Azure, or GCP, including their data services (e.g., S3, BigQuery).</li><li>Exposure to data integration techniques (e.g., RESTful APIs, message queues).</li><li>Proficient problem-solving skills and ability to optimize data processing and query performance.</li><li>Excellent communication and collaboration aptitude, with the ability to work effectively in cross-functional teams.</li><li>Keen attention to detail and a commitment to data quality and governance</li></ul><p><br></p><strong>Build Knowledge Repositories</strong><p><br></p><ul><li>Ensure new knowledge is captured and shared</li><li>Serve as a subject matter expert (SME)</li><li>Share knowledge and enter data into knowledge repositories and build/harvest/leverage/re-use knowledge. </li></ul><p><br></p><strong>Project Management </strong><p><br></p><ul><li>Participate in supporting the project scope, gather client requirements, manage/align resources, manage communications</li><li>Identify project tasks/activities and develop project schedules.</li><li>Collaborate with team members and project stakeholders</li><li>Effectively communicate project objectives and goals </li><li>Complete project activities on time, within budget and within scope</li></ul><p><br></p><strong>Implementation of Products/Solutions With Clients</strong><p><br></p><ul><li>Develop implementation plans</li><li>Create accurate operating procedures , support instructions, and operational/system documentation</li><li>Solicit feedback from client on quality of product/solution</li></ul><p><br></p><strong>Increase Client Satisfaction</strong><p><br></p><ul><li>Solve problems quickly, effectively communicate solutions and associated risks</li><li>Manage expectations and meet deadlines</li></ul><p><br></p><strong>Maintain recoverability as per target </strong><p><br></p><ul><li>Maintain utilization rates as per target</li><li>Ensure that Injazat Operation Readiness Process for Infrastructure projects is planned and executed to transition projects into support. OR activities are within the baseline project schedule and OR is accepted into operations constrained within the scope of the project. </li><li>Obtain positive project references from clients. (e.g) Emails from Client, Reference letters signed from clients and Case studies completed with clients </li><li>Support establishment of new solutions and services. </li><li>Gain skills and experience to implement emerging technologies, gain new certifications and support partnership requirements.</li></ul><p><br></p><strong>Continuous Improvement</strong><p><br></p><ul><li>Motivate one’s own team and identify opportunities to take part in change initiatives, programs and projects that reflect international best practice and changes in the competitive environment.</li></ul><p><br></p><strong>Policies, Processes &amp; Procedures</strong><p><br></p><ul><li>Recommend improvements to departmental policy and directs the implementation of procedures and controls so that all relevant procedural/legislative requirements are fulfilled while delivering a quality, cost-effective service to customers.</li></ul><p><br></p><strong>MIS &amp; Reports</strong><p><br></p><ul><li>Helps direct the design, development, testing and implementation of financial and reporting system updates and enhancements, including updated internal controls</li><li>Prepare the organization’s financial reports and present findings and recommendations to the top executive management</li><li>Analyze capability and service offering financials to determine performance. </li><li>Perform sensitivity analysis to assess the impact of factors such as volume and growth fluctuations in cost. </li><li>Investigate financial performance variances to identify business trends and forecast future financial activity.</li><li>Provide support for preparation of annual budgets, by educating managers, developing financial tools/models, and preparing trend analysis and variance reports.</li></ul><p><br></p><strong>Minimum Qualifications</strong><p><br></p><ul><li>Bachelor’s or master’s degree in computer science / Information Systems or a related field.</li></ul><p><br></p><strong>Minimum Experience </strong><p><br></p><ul><li>Overall 10+ years of experiences in IT Industry and Services </li><li>A minimum of 6+ years’ experience in Data Engineer role</li><li>Experience in working with Middle East client will be preferred.</li><li>Arabic Speaking/writing skills will have an added advantage.</li></ul><p><br></p><strong>Job-Specific Skills</strong><p><br></p><ul><li>Experience with big data tools Hadoop, Spark, Kafka, etc.</li><li>Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.</li><li>Experience with data pipeline and workflow management tools Azkaban, Luigi, Airflow, etc.</li><li>Experience with AWS / Azure / G42 cloud platforms services</li><li>Experience with stream-processing systems Storm, Spark-Streaming, etc.</li><li>Experience with object-oriented/object function scripting languages Python, Java, C++, Scala, etc</li></ul>