Senior / Lead Data Engineer – Consultancy – Eligible for SC – £100k – AWS or Azure – London

Job title:

Senior / Lead Data Engineer – Consultancy – Eligible for SC – £100k – AWS or Azure – London

Company:

Avanti Recruitment

Job description

Senior / Lead Data Engineer – Consultancy – Eligible for SC Clearance – AWS or Azure – LondonI’m looking for an experienced Senior / Lead Data Engineer to join a successful, multinational Consultancy in their London office working on high profile client projects.As a Senior Data Engineer, you’ll design and implement cutting-edge data solutions that transform their clients’ businesses. You’ll work with cross-functional teams to create scalable, efficient architectures that turn complex data challenges into opportunities for innovation.Your role
– Design end-to-end data architectures that align with business objectives
– Create cloud-native solutions leveraging PaaS, serverless, and container technologies
– Build robust data pipelines for both batch and streaming processes
– Collaborate with clients to understand their data landscape and requirements
– Mentor team members and champion best practices in data architectureTo be considered you will be able to demonstrate skills and experience in many of the following:
– Expertise in designing production-grade data pipelines using Python, Scala, Spark, and SQL
– Deep knowledge of either:
AWS (EMR, Glue, Redshift, Kinesis, Lambda, DynamoDB)
Or
Azure (Data Factory, Synapse, Databricks, Event Hubs, Logic Apps, Cosmos DB)
– Experience with data processing across structured and unstructured sources
– Strong scripting abilities and API integration skills
– Knowledge of data visualization and reporting best practicesDesirable but not essential:
– Experience with data mining and machine learning
– Natural language processing expertise
– Multi-cloud platform experienceThey will with an Agile environment with Scrum practices, Cross-functional collaborative teams and need someone who can work from the London office or client sites 2 days a week.Salary: £80,000 – £100,000 + 25 days holiday (option to buy 5 more) + pension + Performance Bonus + share optionsLocation: Hybrid working – 2 days a week in the London office or on Client siteSC Clearance Eligibility – you must be eligible for SC Security Clearance (or higher) – this means at least 5 years residence in the UK and in that time you’ve not been out the country for more than 29 days consecutively and no more than 6 months out the country per year.

Expected salary

£80000 – 100000 per year

Location

London

Job date

Sun, 30 Mar 2025 01:35:09 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesin.eu) you saw this job posting.