Principal Data Engineer / AWS
Job Description
<p><strong>WE ARE HIRING!</strong></p><p><strong>Integrant Inc, is hiring a passionate and organized “Principal Data Engineer / AWS” to join us to support with below roles and responsibilities:</strong></p><ul><li>Design, develop, and maintain end to end data analytical solutions using AWS technologies.</li><li>Engage in activities of requirement elicitation with our clientele.</li><li>Mentor junior members on the team in data engineering.</li><li>Deliver analytical solutions to clients and contribute in knowledge transfer.</li></ul><p><br></p><p><strong>Requirements</strong></p><ul><li>6+ years of experience as a data engineer.</li><li>Familiarity with analytical architectures including Data Warehouses, Data Lakes and Data Lakehouses.</li><li>Knowledge of relational engines available on AWS including Amazon RDS and Amazon Aurora.</li><li>Knowledge of NoSQL offerings on AWS (e.g. DynamoDB).</li><li>Knowledge of setting up Data Lakes on S3 using Lake Formation for governance.</li><li>Knowledge of using AWS Glue to set up catalogs, crawlers and ETL jobs.</li><li>Familiarity with the Hadoop ecosystems, including tools like Hive, Spark and Kafka.</li><li>Familiarity with using Hadoop derivative tools to perform batch analytics in Amazon EMR.</li><li>Familiarity with AWS Lambda to perform lightweight transformations.</li><li>Familiarity with governance over AWS based analytical solutions including using tools such as IAM, Macie, Cloud Watch, Cloud Trail and Step Functions.</li><li>Familiarity with using Amazon Kinesis (Firehose, Streams and Analytics) to capture and analyze data in real time.</li><li>Knowledge of setting up data warehouse solutions using Amazon Redshift.</li><li>Familiarity with Dimensional Modeling (Dimensions, Facts, Slowly Changing Dimensions, Outriggers, Role Playing Dimensions, Junk Dimensions, Degenerate Dimensions, Multi-valued Dimensions, Transactional Facts, Periodic Snapshot Facts and Accumulating Snapshot Facts).</li><li>Knowledge of implementing common ETL patterns to support data warehouse workloads.</li><li>Knowledge of using Redshift Spectrum to perform federated querying.</li><li>Knowledge of using Amazon Athena.</li><li>Strong knowledge of Python</li></ul><p>Nice to Have:</p><ul><li>An MSc in Computer Science or other relevant field.</li><li>Familiarity with DataOps.</li><li>Familiarity with Machine Learning concepts and frameworks (Scikit-Learn, Keras, Tensorflow, HuggingFace, etc.).</li><li>Familiarity with Amazon SageMaker. • Familiarity with Amazon Comprehend.</li><li>Familiarity with MLOps.</li><li>Familiarity with Snowflake.</li><li>Familiarity of containerization tools and frameworks (Docker, Kubernetes, etc.)</li><li>Familiarity with Amazon Quicksight.</li><li><br></li></ul><p><strong>Benefits</strong></p><ul><li>Why Integrant?</li><li>Competitive compensation package</li><li>PTO, full medical and dental coverage, etc.</li><li>Opportunity to travel and work onsite with U.S. customers</li><li>In-house Technical and English training programs</li><li>Dedicated learning time (check out our 4Plus1 Program)</li><li>Interest free loans</li><li>Flexible work schedules</li><li>Perks: events, sponsored lunch, game area, rooftop hangout + more!</li></ul>
