What will be your main challenges? (Responsibilities)
Research and identify public and government data sources.
Extract, transform, and normalize data from websites, APIs, feeds, FTP sources, and online repositories.
Design and build reusable, scalable, and maintainable ETL processes and workflows (no one-off scripts!).
Apply advanced web scraping techniques using Python, HTTP requests, and HTML parsing.
Ensure quality: Identify inconsistencies, validate data samples, and document methodologies and processes.
Collaborate and version control: Maintain repositories using Git under development best practices and maintain clear communication with stakeholders.
What are we looking for? (Requirements)
Solid experience in web scraping, data scraping, and structured/unstructured data extraction.
Technical proficiency: Hands-on experience programming in Python (or similar languages), knowledge of APIs, HTTP, FTP, HTML parsing, and relational databases like PostgreSQL.
Language: Advanced English level (fluent written and technical communication).
Analytical mindset: Ability to solve complex data acquisition problems, optimize solutions, and work independently while taking on technical challenges.
Quality focus: Strong emphasis on data validation, normalization, and documentation.
Qualifications
BA/BSc/HND
