Senior Data Engineer
Job Description
We are seeking a talented and experienced Senior Data Engineer to join our client’s team a Prominent Govt Entity in Abu Dhabi UAE. As a Senior Data Engineer, you will play a pivotal role in strengthening our Data Management practice and driving our data-driven decision-making processes. Your primary responsibility will be to deliver large and small data warehouse, Big Data, and Data Lake projects, contributing to the overall data management maturity of our organization.
Your focus will be on automation and enhancing the enterprise data practice at our organization. You will collaborate with IT and BI teams to understand the organization’s data transformation needs and design appropriate data solutions to meet our business requirements effectively.
Key Accountabilities:
• Design and build secure data warehousing systems based on the organization’s specifications.
• Analyze and identify data storage requirements and implement the most suitable approach to data storage.
• Manage the end-to-end process of extracting, transforming, and loading datasets into the data warehouse, ensuring unified data formats and standards.
• Oversee data projects, including prioritization, resource allocation, and risk mitigation.
• Consult with IT and BI teams to gain a holistic understanding of data transformation needs and design appropriate solutions.
• Improve engineering efficiency through innovative approaches, enabling extensibility, reusability, scalability, upgradability, maintainability, and traceability of data and code.
• Engineer the data as a unified asset to unlock the value of our unique collection of data and real-time predictions.
• Design, build, and maintain batch or real-time data pipelines in production.
• Automate data workflows, including data ingestion, aggregation, and ETL/ELT processing.
• Develop ETL/ELT processes to extract and manipulate data from multiple sources.
• Build, maintain, and deploy data products for analytics and data science teams, utilizing cloud platforms such as AWS and Azure.
