As a Senior Data & AI Platform Engineer – Azure Data Engineering , you will lead the architecture and development of modern lakehouse platforms on Azure. Use the latest Azure services such as Microsoft Fabric, Unity Catalog, and Databricks to implement end-to-end data solutions, ensuring governance, scalability, and performance.
Tasks & Responsibilities
Architecture of data lakehouse solutions using OneLake, Delta Lake, and Fabric, as well as zero-ETL data integration (mirroring)
Introduction of Databricks Photon and serverless clusters for high-performance processing and implementation of Unity Catalog for fine-grained access control
Definition and enforcement of standards (IaC, CI/CD, DataOps) and coordination of multiple projects; mentoring of junior engineers
Development of robust monitoring and data quality frameworks; use of Purview and observability tools
Advising internal stakeholders on data strategy, governance, and cost efficiency; close coordination with business departments
A hybrid/remote setup is possible in Austria
5+ years of experience in data engineering / data platform development, including extensive practice on Microsoft Azure
Knowledge of data architectures, distributed data processing systems and cloud services like Azure Data Factory, MS Fabric, Databricks, Event Hubs are required
Experience in data security and governance - knows data protection requirements and implements access authorizations, encryption and compliance conformity
Proven ability to achieve performance and cost optimization with large data volumes
Proficient in DevOps methods: continuous delivery of data pipelines, infrastructure-as-code (e.g. Terraform/Bicep) and containerized deployments.
Strategic thinking & consulting: Ability to translate business requirements into data architectures and advise clients.
Leadership skills to technically lead a team, as well as clear communication skills with customers (including non-technical contacts).
Language skills: Very good knowledge of German and English.