Python Developer, Elixir
London/Remote
Outside IR35 contract
Circa £500 - £600 a day
Initial 6-month contract, however extendable
Talented Data Scraping Engineer with Python and Elixir is sought by highly prestigious global brand. Key accountabilities include analysing, maintaining and enhancing a highly customized application.
The role will be responsible for aiding in the design, planning and delivery of functionality outlined by the stakeholders and steered by the Team Lead. Working closely with the engineering and data science teams to gather requirements, identify data sources, and implement robust scraping solutions to extract, parse, and store data from various websites and APIs.
All deliveries will be hosted in an AWS environment with a strong emphasis on performance, automation, monitoring and logging, and security, therefore a solid understanding of working in a modern Cloud environment including DevOps and CI/CD processes is needed.
Key Responsibilities:
- Design, develop, and maintain the Website UI using Ember JS
- Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
- Optimize scraping algorithms for efficiency, scalability, and reliability.
- Implement data quality checks and validation processes to ensure accuracy and completeness of scraped data.
- Excellent understanding of all the principles of the data engineering development lifecycle
- Strong development background in Python and Elixir and Ecto wrapper, Ember JS, ideally within an AWS environment
- A strong desire to improve existing implementations, and to innovate and introduce new and exciting ways to achieve the project goals
- Design, develop, and maintain data scraping scripts and pipelines using Python and Elixir
- AWS Certifications an advantage