Lead Data Engineer – Quality & Automation

Job Description

The Data Quality & Automation Engineering Lead is a fully-participating member of a cross-functional team working autonomously on technology development and problem resolution in the Enterprise Data & Analytics space. The role involves leading and championing quality practices along with designing and implementing data quality and automation platforms. They will also provide support and maintenance to technical analytics solutions and products that support Emirates Airlines and the Emirates Group businesses. Job Outline: – Work with product owners, analysts, software engineers and architects to drive understanding of technical landscape and context of deliveries & refine complex functional and non-functional requirements and translate to acceptance tests. – Support in building the technical design by contributing in the analysis of data application and ensuring quality related features are baked into the solution. – Work on and guide engineers on problems of diverse scope where analysis of data requires evaluation of identifiable factors and select methods to validate and automate the solution. – Drive & mentor creation of test strategies and test plans validating the core business problem and translating them into tests around code functionality, data quality, performance, and security. – Build components & liase with teams across the organization to manage cross dependencies for generating / mocking test data for exploratory analysis and running tests. – Build platforms for automated tests / jobs of moderate to high scope and complexity across all stages of the data pipeline. Conduct code reviews to check for good coding & design practices and adherence to published coding standards and guidelines. – Build and enhance data quality rules and platforms for observability across the data pipeline – Perform and support team debugging complex issues, resolve blockers. – Advocate and perform data analysis activities such as source system analysis, data modelling, data dictionary collection, data profiling and source-to-target mapping ensuring delivery on business needs. – Advocate and participate in updating data inventories and registries as required to keep metadata and data lineage up-to-date, following agreed Data Governance standards, guidelines and principles.