Role name: Data Engineer Role Description: Job Overview: We are seeking a talented and motivated Data Engineer with expertise in Spark SQL, Databricks, Azure Data Factory (ADF), SQL, IICS, Unix, PySpark, Python, and Azure Data Lake Storage (ADLS) to join our dynamic team. In this role, you will be responsible for designing, developing, and maintaining scalable data pipelines, optimizing data workflows, and ensuring efficient data processing. You will collaborate closely with data scientists, analysts, and other stakeholders to ensure the timely delivery of data solutions. Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, PySpark, and Python. Build and optimize Spark SQL queries and workflows to process large volumes of data. Implement and manage data pipelines and data integration solutions in cloud environments, specifically on Azure. Leverage PySpark and Python to develop scalable, distributed data processing solutions and build custom data transformations. Work with IICS (Informatica Intelligent Cloud Services) for data integration, transformation, and management. Develop and optimize data workflows to support analytics and reporting needs. Write complex SQL queries to extract, manipulate, and load data from various sources into data warehouses. Utilize Unix/Linux shell scripting for automating tasks, managing file systems, and processing data. Work with Azure Data Lake Storage (ADLS) to store, manage, and access large-scale data sets in a cloud environment. Collaborate with data scientists, analysts, and other stakeholders to ensure the data infrastructure meets business requirements. Ensure data quality, consistency, and security through best practices and governance frameworks. Troubleshoot and resolve data processing issues, ensuring the scalability and reliability of data pipelines. Monitor and optimize the performance of data solutions for efficiency and cost-effectiveness. Location:
...option to work remotely. Responsibilities Tasks Operate dryers and blow-drying machines Hand fold and bag shirts, sheets and other articles Hand iron laundered fine linens or dry-cleaned silk garments Operate finishing equipment such as steam pressers, and use...
...Kumon? At Kumon, we dont just help students achieve academic success; we empower them to reach their full potential. As a Franchise Consultant, youll be a key player in supporting franchisees to excel, ensuring centres maintain high standards of instruction, and expanding...
...Through the multi-disciplinary team, patients who have high risk gaps in care related to medication therapy are transitioned to a Pharmacist for Case & Disease Management (CMDM). The incumbent then conducts thorough research to evaluate the patient and extensive...
...You are skilled at asking the right questions to understand new technology, and proficient at communicating the implications of high-level constraints and stakeholder decisions both verbally and in writing. You are comfortable making decisions in the face of ambiguity....