Data Engineer with Databricks and Azure (f/m/d)
Our client is one of Austria's largest IT service providers and the software house of a leading banking group.
Must haves
- Databricks
- Python
Nice to have
- Microsoft Azure
- Java
Wanted Expertise
- DWH / BI - Data Warehouse / Business Intelligence (other)
Your Tasks
-
Develop and migrate data pipelines on Databricks (Python/PySpark)
-
Integrate and process streaming data via Azure Event Hub and Kafka
-
Implement and take over real-time processing pipelines (Apache Druid, Apache Storm)
-
Build and operate data models and workloads on the Azure data platform
-
Analyze existing solutions and legacy code (Java) as a basis for the migration
-
Contribute within the agile Scrum process (refinement, planning, review)
-
Automation and quality assurance via CI/CD, DevOps and DataOps
Requirements
-
Proven experience as a Data Engineer with a focus on Databricks and Python
-
Hands-on experience with streaming technologies (Azure Event Hub, Kafka) and real-time technologies (Apache Druid, Apache Storm)
-
Experience in the development and migration of data pipelines
-
Strong knowledge of cloud-based data platforms, ideally Microsoft Azure
-
Advantageous: Java skills for analyzing existing solutions and legacy code
-
Advantageous: experience in web analytics, CI/CD, DevOps and DataOps
-
Advantageous: experience in migration projects and agile working methods (Scrum)
-
English required, German advantageous
Our Xtra Advantages
- 20 years of IT-recruitment experience
- access to a huge talentpool
- individual consulting.