Data Engineer

Job title:

Data Engineer

Company:

OpenSky Data Systems

Job description

DATA ENGINEER(Permanent – Hybrid)Location: Naas, Co. KildareThe Role:This is a full-time hybrid role for a Data Engineer in our Data & AI Practice at OpenSky Data Systems in Naas.You will be working on the latest Microsoft Data & AI technologies at the forefront of technological development (Fabric, Azure OpenAI, AI Studio & Cognitive Services, etc). We are working closely with our colleagues in Microsoft to ensure our staff and our clients have the best and most modern technology stacks working for them and that means if you are not Microsoft certified already, you will be very soon working for us!We offer clear career progression paths, ensuring our team members have opportunities to advance their careers, develop new skills, and grow into leadership roles. Whether it’s honing expertise in Data & AI technologies, or taking on strategic responsibilities, we help you shape your career in the way that aligns with your aspirations.The Role:Open Sky Data Systems has a 20 year history in delivering Technology Innovation to our customers across Ireland, UK, Europe and the United States. We have multi-disciplinary teams working across our 3 Centres of Excellence, Modern Applications (.NET), Microsoft Cloud (Power Platform) and Data & AI. We deliver projects that matter, whether it is working to reduce HPV cancer in Europe or reducing homelessness in Ireland, our projects create a positive impact on others.Our Data & AI Practice works at the very forefront of Microsoft solutions and is partnered with leading AI institutes globally including CeADAR (Ireland’s Centre for AI) and the Alan Turing Institute (UK). We invest extensively every year in research & training, ensuring your skills are at the highest level so we can deliver excellence every time to our customers.Key Responsibilities:

• Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Microsoft Azure Synapse Analytics and Microsoft Fabric.
• Database Systems & ETL: Build, maintain, and optimize database systems and ETL pipelines using tools like Azure Data Factory (ADF) and SQL Server Integration Services (SSIS).
• SQL Development: Write and optimize SQL queries, stored procedures, views, and other SQL objects.
• Data Warehousing: Design and maintain star schema data models, reusable pipelines, and warehouse objects.
• Data Quality & MDM: Implement master data management solutions and apply best practices for data profiling, cleansing, and standardization.
• DevOps & CI/CD: Use Azure DevOps, GitHub, and CI/CD workflows to manage deployments.
• Data Governance: Implement data governance and cataloguing solutions using Microsoft Purview to ensure compliance with GDPR, NIS2, and ISO27001 standards.
• BI Reporting & Data Visualization: Create, update, and maintain interactive dashboards and reports using Power BI, SSRS, and Excel to provide actionable insights for business stakeholders.
• Best Practices and Compliance: Adhere to Microsoft best practices and methodologies, specifically the Microsoft Cloud Adoption Framework. Ensure all solutions are compliant with relevant data protection regulations.
• Client Consultation: Provide expert consultation services to clients regarding data engineering strategies. Offer innovative solutions by thinking creatively and outside the box.
• Project Collaboration: Work on multiple ongoing projects simultaneously. Collaborate effectively with cross-functional teams to achieve project goals.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 3-5 years of experience in data engineering or a similar role working with Microsoft Fabric or Azure Synapse Analytics for data ingestion, ETL/ELT workloads, and data integration in real world projects.
• Proven ability to manage multiple projects and meet deadlines, with a solid understanding of GDPR and NIS2 to ensure full compliance in all projects.
• Strong problem-solving skills and attention to detail with excellent communication skills with both technical and non-technical teams.

Must-Have Skills

• Expertise in Microsoft Azure Synapse Analytics, and Power BI.
• Proficiency in Microsoft SQL Server and T-SQL scripting.
• Advanced knowledge of Azure Data Factory, SSIS, and Azure Data Storage (Blobs, Files, Queues, Tables, Disks, Data Lake Storage).
• Strong in SQL and T-SQL; familiarity with Python or C#.
• Hands-on experience with ETL tools, data warehousing, and star schema design.
• Proficient in Azure DevOps, GitHub, and CI/CD processes.
• Skilled in building and optimising big data pipelines and architectures.
• Strong analytical skills for managing unstructured data sets.
• Solid understanding of data warehousing concepts and ETL processes.
• Experience with data governance and compliance standards (GDPR, NIS2, ISO27001).

Desirable Skills

• Microsoft Certifications: Data Engineer Associate, Fabric Data Engineer Associate, Fabric Analytics Engineer Associate, Azure AI Engineer Associate, Power BI Data Analyst Associate
• Expertise in Microsoft Purview and Microsoft Fabric
• Experience with Microsoft Cloud Adoption Framework.
• Knowledge of Azure AI services.
• Creative thinker with the ability to innovate and provide strategic solutions.

What we OfferYou will form part of a high-performance team, working together to deliver projects of national and international importance, changing the way large Business and Governments work.

• Incremental Increases in Annual Leave
• Continuous Professional Development
• Education Assistance Programme
• Digital Doctor Service
• Hybrid working
• Company Pension
• Employee Assistance Programme (EAP)

Why Join Our TeamOpenSky Data Systems is a European challenger brand to the large global software consultancies, delivering innovation across Government, Transport, Environment, and Health sectors in Ireland and the UK. We specialise in transformative digital solutions that drive efficiency and enhance user experiences for our clients.Our plan is simple: hire people who possess the expertise, experience, and motivation that we require, and then help them grow, develop, and achieve their goals.If this sounds like the change you have been looking for, then apply today.

Expected salary

Location

Naas, Co Kildare

Job date

Wed, 18 Dec 2024 23:30:26 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesin.eu) you saw this job posting.