Informații principale

Descrierea și cerințele proiectului

For our client we are currently looking for a data engineer.


100% Utilization, max. 48 € / hour


You will be responsible for the following tasks:

+ Identify meaningful, reliable and accurate data across a diverse data landscape

+ Design and develop new data engineering pipelines with cloud tools and frameworks

+ Prepare and accompany the roll-out of our data pipelines and applications by ensuring data availability and consistency in our Data Lake

+ Requirement engineering of reporting needs and communication with different stakeholders

+ Contribute as a valued team member to testing, debugging, QA, and documentation of data pipelines and systems

Requirements:

Must:

+ University degree in Computer Science or equivalent experience

+ Strong analytical and problem-solving skills

+ Data Engineering working experience, ideally with Python

+ Willingness to learn new technologies

+ Experience with big data technology stack, for example, (Py-)Spark, Delta Tables, etc.

+ 5+ years of experience with general-purpose languages such as C#, Python, Java, Scala etc

+ Fluency in SQL and relational DB systems (PostgreSQL, SQL Server)


Nice:

+ Experience with data warehousing, infrastructure, ETL/ ELT and analytic tools such as Azure Synapse or Databricks

+ Experience with multiple Big Data file formats (Parquet, Avro, Delta Lake)

+ Experience with time-series databases and streaming data processing

+ Proficiency with PySpark

+ Proficiency with .Net

+ Experience setting up MLOps processes and a machine learning model registry

+ Experience with CI/CD pipelines on Gitlab

+ Some experience with Terraform and k8s


Start: 01.05.2025
Duration: 12 Months ++
Location: Remote

Categorie