Data Engineer - Databricks (f/m/d)
In this project you will work in the data platform environment of an international insurance group
Must haves
- Databricks
- Python/PySpark
- SQL
Nice to have
- Delta Lake
- Microsoft Azure
Your Tasks
- Design, build and operate data pipelines on Databricks
- Data modelling and building lakehouse structures (Delta Lake)
- Connecting and integrating source systems
- Ensuring data quality and governance in a regulated environment
- Performance and cost optimisation of Spark workloads
- Providing data for analytics and AI use cases
- Collaboration with data scientists, analysts and the platform team
Requirements
- At least 5 years of professional experience in data engineering
- Solid hands-on experience with Databricks (Apache Spark, Delta Lake)
- Strong skills in Python/PySpark and SQL
- Experience building and operating data pipelines (batch and/or streaming)
- Experience with data modelling and lakehouse architectures is a plus
- Cloud experience (preferably Microsoft Azure) is a plus
- Excellent English skills (project language)
Our Xtra Advantages
- 20 years of IT-recruitment experience
- access to a huge talentpool
- individual consulting.