Resource On Demand Limited
Description
We're seeking a hands-on Lead Data Engineer to drive complex, enterprise-level data migration projects across multi-cloud platforms, within a consulting company.
If you thrive working with cutting-edge technologies, value flexible work, and enjoy leading migration-first initiatives – we’d like to hear from you.
Why Apply?
- Competitive base salary up to £80,000+ (based on experience)
-
Flexible hybrid working (2–3 days per week in their London office)
Responsibilities
Key Responsibilities for the Lead Data Engineer:
- Lead and execute end-to-end data migration projects across Azure, AWS, and Google Cloud Platform (GCP)
- Architect, build, and maintain robust data pipelines using Apache Airflow and PySpark
- Collaborate with cross-functional teams to design scalable ETL solutions with Databricks, Python, and SQL
- Develop, integrate, and support APIs, RESTful services, and microservice architectures
- Advise stakeholders on cloud data best practices, security, compliance, and performance optimisations
- Lead and execute end-to-end data migration projects across Azure, AWS, and Google Cloud Platform (GCP)
- Architect, build, and maintain robust data pipelines using Apache Airflow and PySpark
- Collaborate with cross-functional teams to design scalable ETL solutions with Databricks, Python, and SQL
- Develop, integrate, and support APIs, RESTful services, and microservice architectures
- Advise stakeholders on cloud data best practices, security, compliance, and performance optimisations
Skills
As the Lead Data Engineer, you should have the following:
- Proven experience as a Data Engineer, with significant exposure to large-scale, multi-cloud data migration
- Expert in Apache Airflow and PySpark (essential)
- Proven success in migrating and integrating data across Azure, AWS, and GCP
- Advanced knowledge of Python, SQL, ETL pipelines, and Databricks
- Experience developing with APIs, REST, and microservices architectures
- Strong communicator who thrives in a collaborative, hybrid work environment
- Solution-focussed, innovative, and delivery-driven mindset
- British Citizenship or ILR status is required (no sponsorship available)
- Proven experience as a Data Engineer, with significant exposure to large-scale, multi-cloud data migration
- Expert in Apache Airflow and PySpark (essential)
- Proven success in migrating and integrating data across Azure, AWS, and GCP
- Advanced knowledge of Python, SQL, ETL pipelines, and Databricks
- Experience developing with APIs, REST, and microservices architectures
- Strong communicator who thrives in a collaborative, hybrid work environment
- Solution-focussed, innovative, and delivery-driven mindset
- British Citizenship or ILR status is required (no sponsorship available)
Experience Requirements
Experience mentoring and coaching junior engineers.
Qualifications
Relevant certification(s) in Microsoft, AWS, or GCP
Educational Requirements
N/A