Job Description
Job Description
About the job
As a Sr. Data Engineer is responsible for architecting, engineering, configuring, and deploying advanced big data platforms, including technologies such as Hadoop, Spark, Kafka, HUE, R, Solr, and many others.
What you’ll do
- Architect, engineer, configure, and deploy big data platforms, including technologies such as Hadoop, Hive, Airflow, EMR, Spark, Kafka, HUE, R, Solr, and others.
- Collaborate with cross-functional teams, to understand data requirements and design optimal data solutions.
- Develop and maintain scalable and high-performance data processing pipelines using big data technologies.
- Perform data ingestion, data integration, and data transformation tasks to process large volumes of data from various sources.
- Design and implement data models, database schemas, and data storage solutions to support data processing requirements.
- Monitor and optimize the performance and scalability of big data platforms and data processing pipelines.
- Troubleshoot and resolve data-related issues and incidents in a timely manner.
- Develop and maintain documentation related to data engineering processes, data pipelines, and data architecture.
- Stay up-to-date with the latest trends and advancements in big data technologies and data engineering practices, and provide recommendations for technology adoption and process improvements.
What you’ll need
- Bachelor’s degree in Computer Science, Information Technology or related field.
- Minimum of 5 years of experience in data engineering, data architecture, or a related role.
- Strong expertise in data platforms such as Hadoop, Hive, Airflow, EMR, Spark, Kafka, HUE, R, Solr, and others.
- Proficient in data modeling, database design, and data integration techniques.
- Hands-on experience with data processing frameworks such as Apache Spark, Apache Kafka, and Apache Solr.
- Strong programming skills in languages such as Java, Scala, Python, or similar.
- Experience with data visualization tools and technologies such as Tableau, Power BI, or similar.
- Knowledge of cloud-based data platforms such as AWS, Azure, or Google Cloud Platform.
- Excellent problem-solving skills and ability to troubleshoot and resolve data-related issues.
- Strong communication skills and ability to work in a collaborative team environment.
Why Aspire
In addition to a competitive long-term total compensation with salary and performance-based bonus, we have a reward philosophy that expands beyond this.
- Be part of a (Remote is here-to stay) organization.
- Work and learn from great minds.
- Explore new opportunities to learn and grow everyday by attending technical and nontechnical training.
- Get market exposure by working with international tech leaders.
- Nursery reimbursement benefit.
- Aspire Wellness Program.
- Attend virtual and onsite international tech conference.