Data Engineer

Job Description

Role purpose:

The Data engineer is a core member of the agile teams delivering data pipelines and data governance capabilities within the organization through building and automating data flows across all Analytics and Autonomics domain.

Key accountabilities and decision ownership:

• Build, test, monitor and maintain a highly scalable data management ecosystem.

• Execute architected techniques and solutions for data collection, management and usage.

• Extreme focus on detail and data quality validation and data governance.

• Design, Build and Develop Automated Data pipelines across the different platforms.

Must have technical / professional qualifications:

• Good knowledge in UNIX/Linux administration
• Experience with SQL / Python / Data Structures and Algorithms.
• Very Good Knowledge in Cloud infrastructure Preferable GCP and AWS.
• Good knowledge in Big Data and Data Science technologies
• Good knowledge in data catalogue tools (e.g., Collibra).
• Familiar with data movement techniques and best practices to handle large volumes of data.
• Experience with data warehousing architecture and data modelling best practices.
• Hands-on experience in data modelling, data visualization, and pipeline design & development
• Experience with File Systems, server architectures, and distributed systems.
• familiar with DevOps toll stack (e.g., Ansible, github, Chef)

Key performance indicators:

• good analytical & troubleshooting skills
• Conscientiousness and high accuracy in work
• Flexible attitude and can do attitude

#_VOIS #movewithus