Senior Data Engineer

Job title:

Senior Data Engineer

Company:

KLANIK

Job description

About company :KLANIK is an IT consulting company that supports clients in their digital and technological projects.The KLANIK group now has more than 750 talents, operating across 16 offices in Europe, North America, Africa, and the Middle East. These experts are engaged, unique, and passionate, involved in strategic projects thanks to their high-level skills in Software, DevOps, Cloud, Agile methodologies, Cybersecurity, Big Data, and AI.In addition to their professional roles, KLANIK employees receive daily support in both personal and professional development through various engaging and innovative initiatives:– KONSCIOUS: an internal community focused on ecological, social, and environmental issues
– KAMPUS: a certified technical training institute
– KORNER: a technology start-up incubator
– KLANIK ESPORT: a professional e-sport club open to employees Job Description :Context:
As Data engineer, you will be part of the B2B Supply Belgium business platform. The main focus is serving B2B customers in Belgium with power / gas, products and services, green energy …Role:
We’re looking for an experienced Data Engineer to join our newly established data team. Your role will involve designing and building scalable, efficient data pipelines that drive our data-focused initiatives. You’ll work closely with cross-functional teams, including analysts and project managers, to ensure data is consistently accessible, actionable, and aligned with organizational goals.Responsabilities
– Design, implement, and maintain scalable data architectures, including databases, AWS data lakes, and data warehouses aligned with the client’s current tools and frameworks.
– Develop and optimize ETL (Extract, Transform, Load) pipelines to transfer data from diverse sources to centralized repositories.
– Integrate multiple data sources into unified datasets (gold data sources) for streamlined analysis and reporting.
– Ensure data consistency, accuracy, and quality at all stages of the data lifecycle.
– Oversee and fine-tune the data infrastructure, focusing on storage efficiency, processing speed, and cost management.
– Work with cross-functional teams to uphold data system scalability, security, and performance.
– Create and maintain data processing scripts using Python, Spark, and SQL, ensuring automation and regular execution.
– Partner with analysts, software developers, and other stakeholders to meet specific data requirements.
– Gather and interpret data requirements with business stakeholders to tailor solutions effectively.
– Document data processes, pipelines, and system architectures comprehensively.
– Promote and adhere to best practices in data engineering.
– Share data management best practices across both IT and business stakeholders.Must have:
– Demonstrated experience as a Senior Data Engineer or in a similar capacity
– Extensive experience working on Data Platforms
– In-depth expertise with AWS services, including S3, Athena, Glue, and Redshift
– Proficient in Databricks (ideally on AWS)
– Strong coding skills in Python, Spark, SQL, or other data engineering languages
– Hands-on experience with data processing technologies
– Familiarity with Agile methodologies such as Scrum or Kanban
– Knowledgeable in DataIku
– Works well within a team setting
– Strong communication skills, with the ability to convey technical information to non-technical business leaders
– Capable of thriving in a multicultural, multinational environment
– Flexible and able to adapt to new technologies and changing project needs
– Demonstrates excellent organization and keen attention to detail#LI-KT1 Required qualifications :– Prior experience in the utilities sector is a plus
– Familiarity with technical systems like Salesforce and SAP ISU
– Proficiency in Agile tools such as Azure DevOps or Jira
– Experience with financial closing reports
– Fluent in either Dutch or French (MANDATORY)
– Fluent in English
– Bachelor or Master Degree
– 5 – 7 years of experience as a data engineer or similar positionIf you recognize yourself in this description and your native language is either French or Dutch (+ fluent in English) and the project interests you, don’t hesitate to apply!

Expected salary

Location

Bruxelles

Job date

Wed, 22 Jan 2025 23:58:10 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesin.eu) you saw this job posting.