Data Engineering Lead (SC) - Contract - Hybrid working/London - £competitive
Synergize Consulting are now hiring for a Data Engineering Lead to work at a leading consultancy client of ours on a contract basis.
This will be a key position within a large public sector programme, and the successful candidate will be required to lead a team of data engineers, as well as designing, building and implementing cutting-edge cloud data solutions.
Responsibilities include:
- Design, develop, and maintain scalable data pipelines using AWS and Java-based microservices to process large volumes of structured and unstructured data.
- Lead and mentor a team of data engineers, providing technical guidance, setting development standards, and ensuring high performance across the team.
- Build and optimise Java-based microservices to support data integration, transformation, and orchestration for Real Time and batch data processing.
- Work with data architects to define data models, design data storage solutions, and optimise data integration processes to ensure data quality, performance, and scalability.
- Implement data quality controls, monitoring, and governance practices to ensure the integrity and security of data across the platform.
Experience required:
- A strong background in hands-on data engineering, having experience of building cloud-based data solutions.
- Excellent skills with AWS, including experience with Glue, and an understanding of services such as S3, Lambda and Athena.
- Strong expertise in developing and deploying Java-based microservices in a cloud environment.
- Previous experience with PySpark, and the ability to build and run ETL processes
- Proficiency with SQL for querying and optimising data
- Strong team leadership abilities, demonstrating experience of having led engineers to achieve success
- Automation and DevOps knowledge, including CI/CD pipelines, Docker and Kubernetes
- Excellent communication skills, both written and verbal
- Due to the nature of the client, it would be an advantage for candidates to hold, or be eligible and willing to undergo, a certain level of security clearance (SC).
If you are looking to take the next exciting step in your IT career, please send in your CV for immediate consideration.