Job Description

Roles & Responsibilities


Azure Data Engineer
PCS Gulf excels in IT and financial consulting, driven by the belief that optimal solutions arise from a diverse network of experts collaborating across IT, Finance, and business strategy. Our seasoned team remains industry leaders, staying updated on the latest trends. We provide innovative, cutting-edge solutions tailored to clients' needs, drawing from vast industry exposure. Collaborating closely, we craft comprehensive solutions addressing all aspects of business. With a stellar track record and proficiency, we empower clients, from startups to large corporations, to realize their full potential. At PCS Gulf, our unwavering dedication is to deliver tangible results.
Responsibilities:
• You are detailed reviewing and analysing
structured, semi-structured and unstructured data sources for quality,
completeness, and business value.
• You design, architect, implement and test
rapid prototypes that demonstrate value of the data and present them to
diverse audiences.
• You participate in early state design and
feature definition activities.
• Responsible for implementing robust data
pipeline using Microsoft,Databricks Stack.
• Responsible for creating reusable and scalable
data pipelines.
• You are a Team-Player, collaborating with team
members across multiple engineering teams to support the integration of
proven prototypes into core intelligence products.
Requirements:
• Advanced working knowledge and experience with
relational and non-relational databases
• Experience building and optimizing Big Data
data pipelines, architectures, and data sets.
• Strong experience in Azure
Datafactory,Databricks, Eventhub, Python,PySpark ,Azure Synapse and SQL
• Azure Devops experience to deploy the ADF
pipelines.
• Minimum
3-5 years of experience.
• Knowledge/Experience with Azure cloud
stack.

Seniority Level: Other

Job Functions: Software Development

Industries : Information Technology