Senior Data Engineer and Platform Lead

Job title:

Senior Data Engineer and Platform Lead

Company:

Morgan Advanced Materials

Job description

Overview:Role: Senior Data Engineer and Platform LeadLocation: Hybrid / RemotePosition: StaffMorgan Advanced Materials is a world leader in the development and production of advanced materials. We produce a wide range of specialist, high specification materials that have extraordinary attributes and properties. Despite the complexity of our technologies, our focus is simple – we supply innovative, differentiated products made from advanced materials that enable our customers’ products to perform more efficiently, more reliably and for longer.Morgan is making a significant investment in establishing a world-class global data team, and we are excited to welcome new employees who will play a crucial role in this initiative. As part of this team, you will be instrumental in building the future data platform that will drive the success of our enterprise. Your contributions will not only shape the foundation of our data capabilities but also help position Morgan as a leader in leveraging data to achieve strategic business goals. This is a unique opportunity to be a part of a transformative journey, where your efforts will directly impact the future growth and innovation of the company.Role: Senior Data Engineer and Platform LeadLocation: Hybrid / RemotePosition: StaffWe are looking for a highly skilled and experienced Azure Data Engineer to join our dynamic Global Data & Analytics Platform team. The successful candidate will be responsible for delivering scalable data solutions on the Global Data Platform, managing the platform, and driving its further development. This role requires proficiency in data engineering, data modelling, and data pipeline orchestration, with a proven track record of working with Azure-specific data platform tools and technologies. Strategic and forward-thinking capabilities, as well as experience in applying AI within a business data environment, are essential. Additionally, strong soft skills are necessary to collaborate effectively with cross-functional international teams and communicate complex technical concepts to non-technical stakeholders.Responsibilities:Role Description:

• Take ownership of the Azure-hosted analytical platform, ensuring it meets current and future business requirements.
• Optimize the platform for performance, security, and scalability, ensuring alignment with best practices.
• Design and develop scalable ETL pipelines and data solutions using Azure Data Factory, Synapse Analytics, and related tools.
• Work closely with stakeholders to understand business needs and translate them into actionable data solutions.

• Lead and mentor the Data & Analytics team, ensuring the smooth operation of data pipelines and alignment with organizational objectives.

Responsibilities:Team Leadership and Coordination:

• Provide technical guidance and mentorship to the Data & Analytics team.
• Oversee the team’s Agile processes including sprints, ask prioritisation and issue resolution
• Define best practices for data pipeline design, development, and maintenance.
• Coordinate with the solution architect to ensure platform architecture meets current and future requirements.
• Act as a point of escalation for complex data engineering challenges.

Data Engineering:

• Design, build, and maintain data pipelines for seamless integration of ERP and other critical data sources into Azure Synapse.
• Ensure data workflows are optimized for performance, scalability, and reliability.
• Lead efforts to standardize ETL/ELT processes and enforce data quality standards across the platform.
• Implement data transformation logic to create clean, usable datasets for reporting and analytics.

Platform Administration and Optimization:

• Monitor and optimize Azure Synapse Analytics performance, ensuring cost efficiency and resource utilization.
• Implement monitoring and alerting for pipeline performance, failures, and resource consumption.
• Suggest and implement automation for repetitive tasks using tools like Azure Logic Apps, Power Automate, or custom scripting.
• Collaborate with the Data Governance Lead to ensure compliance with governance and security standards.

Business and Stakeholder Collaboration:

• Work closely with business units to understand data requirements and ensure outputs align with business needs.
• Validate that datasets and reports delivered by Power BI developers meet performance and usability standards.
• Support data-driven decision-making by ensuring high-quality and accessible data across the organization.

Innovation and Strategy:

• Stay updated on advancements in Azure, Synapse, data engineering tools and other relevant technologies to recommend and implement improvements.
• Identify opportunities to leverage advanced data processing techniques (e.g., big data, real-time processing) and AI.
• Contribute to the long-term strategy for the GDP, including scaling the platform for future needs.

Key Skills:

• Leadership: Experience managing and mentoring data engineers or technical teams.
• Technical Expertise:

• Advanced knowledge of Azure Synapse Analytics, Azure Data Factory, and SQL.
• Proficiency in ETL/ELT pipeline design and optimization.
• Familiarity with automation tools (Azure Logic Apps, Power Automate, Python, or PowerShell scripting).
• Knowledge of cloud performance optimization and cost management.
• Collaboration: Strong ability to work cross-functionally with technical teams, governance leads, and business stakeholders.
• Analytical Thinking: Ability to design efficient, scalable, and high-performing data workflows.
• Strategy and planning: Experience with definition of data strategy, global data platform strategy and development roadmaps aligned with company’s digital transformation plans.
• Governance Awareness: Understanding of data governance principles and ability to work within established frameworks.

Qualifications:EXPERIENCE & BACKGROUNDQualifications/Experience

• Bachelor or Master degree in a related field of study
• 5+ years of experience in data engineering, with a strong focus on Azure cloud services across a mixture of Enterprise and SME environments

• Proficiency in Python, SQL, Azure Data Factory, Azure Synapse Analytics, Azure Data Lakes, and big data technologies like Apache Spark
• Experience with DevOps practices and CI/CD pipelines in an Azure environment is a plus.
• Certification in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate) is highly desirable.
• Excellent problem-solving abilities, strong communication skills, ability to work collaboratively in a team environment, and a keen attention to detail.
• Fully up to speed with Agile development methodologies e.g., DevOps, Scrum (EPICs, Stories, Task, Issues, Bugs)
• Excellent analytical and problem-solving skills and the ability to troubleshoot complex issues
• Excellent stakeholder management, communication and interpersonal skills
• Ability to thrive in a fast-paced and collaborative environment
• Detail-oriented and well-organized

Morgan Advanced Materials is an EEO/AA/M/W/D/V Employer Ind-1

Expected salary

Location

United Kingdom

Job date

Thu, 27 Feb 2025 06:26:00 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesin.eu) you saw this job posting.