Senior Azure Databricks ETL Job at Hays, Toronto, ON

ejhlTUZERHlCeTlWVzRPN3UrYUtkNGkrWUE9PQ==
  • Hays
  • Toronto, ON

Job Description

Job Title: DevOps Developer – Insurance Domain

Location: Toronto - Hybrid

Type: Long Term Contract

Senior Azure Databricks ETL & DevOps Developer – Insurance Domain Role Summary This role focuses on designing, developing, and optimizing scalable data pipelines and DevOps workflows using Azure Databricks, Azure Data Factory, and CI/CD tools. The developer will work closely with data architects, business analysts, and DevOps engineers to support insurance data modernization initiatives, including claims, policy, and customer analytics.

Key Responsibilities ETL Development - Build metadata-driven ETL pipelines using Azure Databricks, PySpark, and ADF. - Transform data from Azure Data Lake and SQL Server using Spark SQL and Delta Lake. - Optimize query performance and ensure SLA compliance for high-volume insurance datasets.

DevOps & CI/CD - Develop and manage Azure DevOps pipelines for build, release, and deployment. - Implement automated testing, version control (GitHub), and environment provisioning. - Monitor pipeline health and troubleshoot deployment issues across environments. Collaboration & Governance - Work with BAs and architects to translate business requirements into technical solutions. - Maintain data lineage, impact analysis, and traceability using Unity Catalog and metadata repositories. - Ensure compliance with insurance data governance and security standards. Mentorship & Documentation - Guide junior developers in best practices for data engineering and DevOps. - Document technical specifications, transformation logic, and deployment workflows.

Technical Environment - Cloud & Tools: Azure Databricks, Azure Data Factory, Azure SQL, Azure DevOps, GitHub, Jenkins, Jira - Languages: Python, PySpark, SQL, Spark SQL - Frameworks: Delta Lake, Unity Catalog, Medallion Architecture

- Certifications Preferred: 
- Microsoft Certified Azure Data Engineer Associate 
- Databricks Certified Data Engineer

Insurance-Specific Use Cases - Claims ingestion and transformation pipelines - Policy data modeling and analytics - Customer 360 views and fraud detection - Integration with Guidewire and other core insurance platforms

Job Tags

Contract work, Long term contract,

Similar Jobs

McGill University

Student Affairs Officer Job at McGill University

Student Affairs Officer Location Montral, QC : Please refer to the How to Apply for a Job (for External Candidates) job aid for instructions on how to apply. If you are an active McGill employee (ie: currently in an active contract or position at McGill University), do not... 

有限会社大浩商事 Kitty Farm Ishioka

ブリーディング施設の施設長・施設長候補 Job at 有限会社大浩商事 Kitty Farm Ishioka

08/0108/31Kitty Farm Ishioka 230,000250,0003151-11OK... 

Appcast

Mécanicien licencié Chef d'équipe - POSTE DE SOIR Job at Appcast

Aperu: Services nationaux des citernes, membre du groupe Trimac, est fire dtre la pointe de lindustrie nord-amricaine de la maintenance des camions et du nettoyage des citernes. Nous fournissons des services dinspection, de rparation, de certification et de nettoyage...

Prime Staffing

Travel General Ultrasound & Vascular Technologist - $2,268 per week Job at Prime Staffing

 ...Prime Staffing is seeking a travel Ultrasound Technologist for a travel job in Hilo, Hawaii. Job Description & Requirements ~ Specialty: Ultrasound Technologist ~ Discipline: Allied Health Professional ~ Start Date: 09/29/2025~ Duration: 13 weeks ~36 hours...