Job Description

Job Summary:

We are seeking a highly skilled Data Engineer with expertise in Python and DataBricks to design, build, and maintain robust ETL pipelines and data solutions. In this role, you will work closely with cross-functional teams to transform business requirements into efficient, scalable, and reliable data workflows. This position offers a dynamic environment where you will contribute to innovative solutions, work with modern cloud technologies, and engage in agile delivery practices within an international, collaborative setting.

Key Responsibilities:

• Collaborate with cross-functional teams to gather and understand data requirements.
• Design, develop, and deploy scalable ETL processes using Python and DataBricks.
• Own the end-to-end engineering lifecycle, including extraction, transformation, and loading of data.
• Create and manage data pipelines with robust error handling, monitoring, and performance optimization.
• Implement automation scripts and tooling to streamline workflows.
• Participate actively in agile ceremonies such as sprint planning, daily stand-ups, and retrospectives.
• Conduct code reviews and maintain high-quality coding standards.
• Apply testing methodologies (unit, integration, etc.) to ensure reliability and performance.
• Integrate various data sources using REST APIs and related techniques.
• Maintain documentation including technical specifications and data flow diagrams.

Required Skills:

• Strong proficiency in Python programming and software engineering best practices.
• Hands-on experience with DataBricks for developing scalable data solutions.
• 7-15 years overall experience
• Proficiency with Snowflake or similar cloud-based data warehouses.
• Solid understanding of ETL design, data modeling, and warehousing principles.
• Familiarity with agile methodologies and collaborative development environments.
• Experience with Git or other version control systems.
• Excellent problem-solving abilities and strong attention to detail.
• Working knowledge of Linux environments and REST API integrations.

Preferred Skills:

• Experience with data visualization tools (e.g., Power BI).
• Background in database administration or performance tuning.
• Familiarity with orchestration tools like Apache Airflow.
• Exposure to big data frameworks such as Hadoop or Spark.

Education:

Bachelor’s degree in Computer Science, Information Systems, or a related field preferred.

Job Tags

Similar Jobs