Job Description

Description

Are you ready to elevate data engineering to the next level?

One of our Customers is seeking a Senior Cloud Data Engineer specializing in Azure and Databricks, you will play an essential role in shaping the future of our data and analytics platform. In this pivotal position within the Information Technology department, you will leverage your expertise to lead the development and delivery of high-quality data solutions, ensuring adherence to the highest standards of data governance.

Key Responsibilities:

• Lead the design, build, and implementation of both batch and real-time data pipelines, ensuring automated and repeatable data delivery that aligns with enterprise governance standards.
• Develop and propose data models tailored to meet business requirements, ensuring optimal design for access, query patterns, and data consumption.
• Collaborate effectively with stakeholders, including data scientists and IT teams, to refine data requirements for analytics initiatives.
• Drive enhancements in the speed and quality of data onboarding to the Data and Analytics platform.
• Build robust data pipelines that support larger data consumption on the platform.
• Implement DevSecOps practices to enhance the quality of data pipeline development.
• Increase the overall speed of data onboarding.
• Build robust data pipelines for enhanced data consumption.
• Improve data pipeline development quality through DevSecOps methodologies.

Skills Required:

• Proficient in programming with Spark using Scala and Python.
• Experience with modern data architectures, including Azure Data Lake Storage, Azure Synapse, Databricks, Delta Lake, and DLT pipelines.
• Proven experience leading Data Engineering practices within an organization.
• Expertise in database modeling techniques such as Data Vaults, Star, Snowflake, and 3NF.
• Experience building REST API integrations using Denodo and SQL Warehouse API.
• Familiarity with streaming data architecture including Spark Streaming, Event Hub, and Kafka.
• Development experience in Function Apps using C#.
• Knowledge of relational and non-relational databases, including SQL Server, Oracle, Cassandra, and MongoDB.
• Experience with source code and configuration management tools like Azure DevOps, Git, Maven, and Nexus.

If you are a qualified candidate looking to make a significant impact in data engineering, we want to hear from you! Please click the apply button to submit your application. For further inquiries, feel free to reach out through our contact page.

Job Tags

Similar Jobs