SENIOR DATA ENGINEER – HQ
Job Description
<p>The Senior Data Engineer takes on the responsibility of designing and developing data pipelines using SQL Server Integration Services (SSIS) to extract data from various data sources and write it to regular or distributed databases. The Senior Data Engineer will work closely with other data engineers in the team who are responsible for the data modeling and administration of the source and target databases. The Senior Data Engineer will also collaborate with a team of full-stack web developers to enable them to build high-performance data-driven applications.</p><p>The ideal candidate will have hands-on experience in data extraction, transformation, and loading (ETL) using SSIS with strong expertise in data warehousing and business intelligence solutions. The candidate should have strong experience in SQL and be proficient in writing efficient SQL queries.</p><p><br></p><p><br></p><p><strong>Responsibilities</strong></p><ul><li>Collaborate with stakeholders to identify data requirements and design data pipelines accordingly.</li><li>Extract data from various data sources, including SQL Server databases, CSV files, XML files, and Excel spreadsheets.</li><li>Transform data to conform to data models and align it with business requirements.</li><li>Load data into regular or distributed databases.</li><li>Collaborate with the Data Platform Engineer to optimize the data model for performance and data retrieval efficiency.</li><li>Write efficient SQL queries to extract data and calculate metrics to support business analytics.</li><li>Troubleshoot technical issues related to the data pipeline and collaborate with data source providers to resolve any identified issues.</li><li>Develop and maintain technical documentation, including data maps, data transformation rules and data lineage, and other documentations relevant to the solution.</li><li>Collaborate with other members of the team to ensure efficient delivery of the solution.</li><li>Mentor junior members in the team.</li></ul><p><br></p><p><br></p><p><strong>Qualifications</strong></p><ul><li>Bachelor’s degree in Computer Engineering, Computer Science, Information Systems, or a related field from a reputable university.</li><li>Minimum 3 years of relevant experience.</li><li>Strong experience with SQL, database technologies, and database design and management.</li><li>Hands-on experience in data modeling and in developing complex, but efficient, queries using SQL Server database.</li><li>Strong experience in ETL using SSIS and other ETL tools and in the development of complex queries and data transformation rules.</li><li>Strong experience in data warehousing and business intelligence solutions including working with large datasets from various sources.</li><li>Programming skills in .NET is highly preferred.</li><li>Hands-on experience with distributed databases such as Apache Ignite, Cassandra, etc. is preferred.</li><li>Programming skills in other languages such as Python, Java or Scala is preferred.</li><li>Good experience with microservices, DevOps tools and containerization technologies is preferred.</li><li>Strong analytical and problem-solving skills, with the ability to analyze complex data-related issues and propose effective solutions.</li><li>Excellent troubleshooting and debugging skills.</li><li>Excellent communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.</li><li>Attention to detail and a strong commitment to delivering high-quality work within established timelines.</li><li>Ability to work independently and manage workload effectively.</li><li>Strong oral and written communication and leadership skills to collaborate with stakeholders across different departments.</li><li>Ability to multitask and prioritize workflow.</li><li>Passion for learning new technologies and methodologies.</li><li>A team player with a positive attitude and ability to work well in a fast-paced and dynamic environment.</li></ul><p><br></p>
