Data Engineer jobs in United States

The Data Engineer will build and maintain data pipelines, storage layers, data products based on the architecture design and meet organizational requirements. This role involves working closely with end client and team consisting of backend engineers, cloud engineers, and data analysts to enable seamless data integration and building robust data platforms on Azure cloud.

• Must Have Skills : Azure DE, Microsoft Fabric, PySpark, SQL
• Experience : 8+ years
• Notice Period : 15 days to immediate joiner
• Location : Dubai (UAE)

• Design, develop and manage data pipelines on Microsoft Azure for internal and external data sources.
• Develop ingestion frameworks for batch and real-time data.
• Ensure data pipelines are optimized for reliability and scalability.
• Ensure the scalability, security, and performance of our cloud architecture while aligning with business goals.
• Work closely with solution architect, backend developers, data governance specialists

• Collaborate with business stakeholders to translate functional requirements into scalable technical solutions.
• Hands-on experience with Microsoft Fabric platform in building end-to-end data solutions.
• Hands-on experience with building pipelines using MS Fabric.
• Build and optimize data lake zones (raw, curated, consumption).
• Proficiency in developing business and dataflow logic for data processing using tools like PySpark, T SQL, Stored Procedures.
• Integrate cloud-based solutions with on-premises systems.
• Implement infrastructure as code (IaC) solutions using Terraform for consistent, automated provisioning.
• In-depth knowledge of Azure architecture components, including compute, storage, networking, and security.
• Optimize cloud storage solutions for performance and cost.
• Establish monitoring and logging solutions using Azure Monitor, Log Analytics, Application Insights, and third-party tools.
• Configure automated scaling solutions to handle workload fluctuations.
• Create and maintain comprehensive architecture documentation, including diagrams, processes, and technical specifications.

• Seniority level : Mid-Senior level
• Employment type : Full-time
• Job function : Information Technology
• Industries : Human Resources Services