Codete
vacanciesin.eu
Codete is not just a software company, it’s a place where tech-enthusiasts can grow by doing what they love and feel valued for what they are. We’re experienced, agile and versatile: we work with a wide range of technologies in projects from many different industries, and the majority of our team are senior-level specialists.
We are looking for an exceptional Senior Data Engineer to help us define and build our next generation data platform on top of Google Cloud, guiding its direction and integration within the company.
This platform will support our internal analytics and personalization needs, while enabling future business opportunities.
Requirements
– 7+ years of experience designing and implementing large scale software
– 4+ years of experience working with Big Data technologies like Apache Beam,DataFlow, BigQuery, Kafka, Airflow and Spark
– Experience designing a real-time Big Data platform
– Experience deploying and managing Big Data infrastructure
– Strong coding ability in an object oriented language (preferably Scala, Python, Java)
– Excellent team player with strong communication skills (verbal and written)
– Enthusiastic about collaborative problem solving
– Bachelor’s degree or better in Computer Science
Nice to have:
Experience with Streamsets, Google BigQuery, Apache NiFi, Looker, Pipeline monitoring tools, Strong SQL and data modelling skills.
Challenges:
- Understand the data sources and map them into respective domains
- Build projects using complex business algorithms and load them in the data warehouse.
- Present a schema management system design at an Engineering-wide architecture
review
- Build new data pipelines using DataFlow and DataForm
- Code data fills in python against Google Cloud Storage and BigQuery
- Investigate, deploy and implement a caching solution for enabling real-time joins of big
data sets
- Develop a data quality validation framework used for both testing and real time
production data
- Design tools enabling easy-to-use workflows for internal teams using the data platform
Apply now
To help us track our recruitment effort, please indicate in your email/cover letter where (vacanciesin.eu) you saw this job posting.