Senior Data Ops Engineer

Job Description

<ul><li>Optimizing and fine-tuning data pipelines to enhance performance, scalability, and reliability;</li><li>Developing and maintaining data models and schemas.</li><li>Supporting data processing and analytics, ensuring data consistency and adherence to best practices;</li><li>Monitoring and troubleshooting data pipeline issues, performance bottlenecks, and data quality problems;</li><li>Implementing data governance and data lineage processes, ensuring the traceability and documentation of data movement and transformations;</li><li>Implementing and maintaining data security and access controls within Databricks;</li><li>Ensuring compliance with data privacy regulations and company policies.</li><li>Evaluating and recommending tools and techniques to improve data processing efficiency and scalability.</li></ul><p><br></p><strong>Requirements</strong><p><br></p><ul><li>6+ years experience</li><li>excellent SQL and Python </li><li>problem-solving skills</li><li>background in Big Data Administration</li><li>Data Engineering and willing to work shifts and on-call</li></ul>