Senior Software Engineer – Web scraping
Job Description
<p><strong>Job Overview</strong></p><p>ProperBird, a Munich-based startup in the Prop-tech industry is seeking a Senior Software Engineer to join our data team. The successful candidate will manage the data crawling process for our real-time data collection and maintain and improve our data pipeline infrastructure. You will work closely with our development team to ensure the efficient operation of our data systems and databases.</p><p><br></p><p><strong>Responsibilities</strong></p><ul><li>Crawl new websites and streamline the data pipeline</li><li>Develop, maintain, and improve data pipelines for real-time data collection</li><li>Optimize code for efficiency and run time, particularly for large-scale operations</li><li>Manage database operations including backups, restores, and migrations</li><li>Monitor and maintain data quality and integrity</li><li>Collaborate with the development team to identify and resolve data issues</li><li>Clean and preprocess data for use in analytics and reporting</li><li>Work with product management and other stakeholders to define data needs and requirements</li></ul><p><br></p><p><strong>Job Requirements</strong></p><ul><li>Bachelor’s degree or higher in Computer Science, Engineering, or a related field</li><li>Strong proficiency in Python</li><li>Experience with Airflow, MongoDB, Postgres, Selenium CHR capture, Amazon s3, and Gitlab (CI/CD)</li><li>Knowledge of data warehousing and ETL processes</li><li>Experience with large-scale data processing, data modeling, and data architecture</li><li>Excellent analytical and problem-solving skills</li><li>Strong communication and collaboration skills</li><li>Ability to work independently with minimal supervision</li></ul><p><br></p><p><strong>Benefits</strong></p><ul><li>fully remote position</li><li>competitve salary</li><li>salary is paid in EUR</li><li>25 days off per year</li></ul><p><br></p><p><strong>Other Key Facts</strong></p><ul><li>start of employment: September.</li><li>6 months probation period</li><li>12 month contract (that is extended every year)</li><li>working days: Monday – Friday</li></ul>
