Data Platform Engineer

Job title:

Data Platform Engineer

Company:

Randstad

Job description

IT, telekommunikációszoftverfejlesztő

• Design, implement, and manage end-to-end data solutions using Microsoft Azure services (Microsoft SQL Server, Azure SQL Database, Azure Data Lake, Azure Synapse Analytics, Microsoft Fabric).
• Develop and optimize data pipelines, ETL processes, and database performance using tools like SSIS, Azure Data Factory, and Databricks.
• Establish data quality checks and validation mechanisms during the ingestion process.
• Determine appropriate data storage technologies and structures (e.g., databases, data lakes, object storage) based on the organization’s needs, and support teams in implementation of the proper solution.
• Develop data management strategies, including data partitioning, indexing, and archiving, to optimize performance and storage efficiency.
• Design and implement data pipelines to transform and analyze data at scale, primarily utilizing the Microsoft technology stack.
• Select and configure appropriate processing technologies, such as distributed computing platforms, data processing frameworks, and streaming systems.
• Collaborate with data analysts and data scientists to ensure the platform supports advanced analytics and machine learning workloads, ensuring data accessibility and accuracy.
• Contribute to data governance policies on relevant topics, such as security and storage of data.
• Monitor and optimize data platform performance and availability to ensure high availability and performance.
• Ensure data security, backup, and disaster recovery strategies are in place and effective.
• Collaborate with cross-functional teams, including data engineers, data scientists, and business stakeholders, to understand their requirements and align the data platform accordingly.
• Explore and implement emerging features in Microsoft technologies (e.g. Fabrc) and integrate them into our data architecture to support business goals.
• Provide technical guidance and training to team members on data management best practices and Microsoft data technologies

Education:

• Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.

Experience
Required

• A minimum of 5 years of progressively responsible postgraduate experience in data platforms engineering.
• Core Expertise in the Microsoft Data Stack, in particular proficiency with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, and Azure SQL Database.
• Strong knowledge of Azure Cloud architecture and networking principles.
• Familiarity with CI/CD pipelines for data workflows (e.g., using Azure DevOps).
• Proficiency in Python, PowerShell, or similar scripting languages.
• Strong knowledge of data platform technologies, including data ingestion, storage, processing, and analytics.
• Strong experience with ETL tools like SQL Server Integration Services (SSIS) and Azure Data Factory.
• Familiarity with Microsoft Azure services such as Azure Data Lake, Azure Synapse Analytics, and Azure Databricks.
• Proficiency in database design, data warehousing, and data integration concepts.
• Proficiency in cloud platforms and technologies, such as AWS, Azure, or Google Cloud.
• Experience with big data technologies, such as Hadoop, Spark, and distributed storage systems.
• Familiarity with data governance, data security, and data privacy regulations (e.g., GDPR, CCPA).

Preferred

• Experience within the RC/RC Movement and/ or international humanitarian or development

organisations.Knowledge and Skills
Required

• Strong strategic and conceptual thinking; setting meaningful, long-term vision and strategy, consider long-term potential, propose challenging strategic goals.
• Propensity for embracing change and ambiguity: anticipate emerging conditions and demands, embrace widespread organisational change, navigate complex dynamics, view uncertainty and disruption as an

opportunity.

• Ability to drive results, and create culture that fosters proactive action, actively prioritize, set high standards.
• Developing others: Push autonomy and empowerment, view people development as imperative, create culture of accountability.
• Data products development, business value development, data product deployment, and resource mobilisation.
• Strong presentation, written and oral communication skills.
• Able to network effectively and influence and inspire others including peers, the membership and other stakeholders.
• Focused on quality and standards, results, and accountability.
• Excellent interpersonal skills; proven people’s management skills (staff and consultants), including conflict resolution.
• Proven training, knowledge transfer and supervisory skills as part of the people’s management.
• Proven teamwork and trust-building skills, including development of effective and efficient networks and partnerships within and outside of the organisation.
• Proactive approach to finding creative and constructive solutions to difficult issues.

Preferred

• Data modelling, statistics.
• Knowledge on applying artificial intelligence techniques, such as NLP and machine learning.
• Certifications:

Microsoft Certified: Azure Data Engineer Associate.
Microsoft Certified: Azure Solutions Architect Expert.

• Fluent in spoken and written English is a must

• cafeteria benefits
• medical insurance
• personalized home office options
• frequent opportunities to travel globally

Expected salary

Location

Budapest

Job date

Mon, 27 Jan 2025 08:52:20 GMT

To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesin.eu) you saw this job posting.