Summary
techcarrot is hiring a Data Engineer in Dubai, United Arab Emirates. The role involves assessing SAP and non-SAP data sources, analyzing data quality and business value, and developing scalable pipelines on the Azure Data platform and Azure Databricks. The engineer will build and test prototypes, support their integration into intelligence products, and collaborate with multiple engineering teams. Applicants need 7+ years of Azure experience, at least 5 years of relevant experience, three Azure analytics implementations, automotive domain experience, and a bachelor's degree in computers or a related field.
The posting
As published on techcarrot.ae. Pulled from the employer's site and shown as they wrote it.
Assessing complex new data sources with a variety of SAP and non-SAP source system and quickly turning these into business insights ready data sets. Develop and support the implementation and integration of these new data sources into our Azure Data platform. Perform detailed analysis of structured, semi-structured and unstructured data sources for quality, completeness and business value. Required to design, document, develop, implement and test rapid prototypes that demonstrate the value of the data and present them to diverse audiences. Required to participate in early state design and feature definition activities. Responsible for designing, developing, and implementing robust and scalable data pipelines using the Microsoft Azure data platform and the Azure Databricks ecosystem. Responsible for creating reusable and scalable data pipelines Act as a team-player while collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products. Requirements Advanced working knowledge and experience with relational and non-relational databases Experience building and optimizing Big Data pipelines, architectures, and data sets Strong analytic skills related to working with unstructured datasets Expertise in Azure Data factory, Databricks, EventHub, Python, PySpark ,Azure Synapse and SQL. Azure DevOps experience mandatory to deploy the data objects. 7+ years of experience in the Azure Domain with minimum 5+ years of relevant experience. Minimum 3 implementation experience from conceptualization to delivery of analytics capabilities on Azure platform. Automotive domain experience is a must. Knowledge/Experience with Azure cloud stack. Knowledge of SAP IS-Auto, SAP BW/BO, Tableau, PowerBI will be considered as added advantage. Certification on Azure platform toolset will be considered as added advantage Bachelor’s degree in Computers or allied field of study.