Establish and maintain scalable data architectures for real-time and batch processing.
Collaborate with stakeholders to ensure efficient end-to-end data solutions.
Optimize existing processes and expand data pipelines to ensure scalability and future growth.
Lead the adoption of emerging technologies, especially Microsoft Fabric, to enhance data management and analytics.
Prepare and maintain comprehensive documentation for data architectures and processes.
Independently manage and deliver projects with minimal oversight.
Requirements:
- A minimum of seven years of experience as a Data Engineer or in a similar role, with a strong focus on cloud-based solutions.
- Extensive expertise in Azure Data Factory (ADF) for orchestrating data workflows and integrating data from platforms like MySQL, Oracle, and SQL Server.
- Hands-on experience with Microsoft Fabric for modern data warehousing and processing environments.
- Proficiency in data modeling, ETL / ELT development, and performance optimization in cloud-based architectures.
- Strong background in Lambda and Medallion data architectures, designing scalable data pipelines for both real-time and batch processing.
- Advanced SQL skills, including performance tuning, index optimization, and schema design.
- Solid experience in Python for data engineering, automation, and integration tasks.
- Knowledge of API-driven data integration and experience managing semi-structured and unstructured data using Azure Data Lake, Azure Blob Storage, and Azure Cosmos DB.
- Familiarity with NoSQL databases and hands-on experience with streaming data solutions like Azure Event Hubs or Azure Stream Analytics.
- Proven ability to work independently, manage multiple priorities, and deliver high-quality, scalable solutions.
- Strong problem-solving skills to identify and resolve challenges in complex data environments.
- Excellent communication skills, with the ability to effectively convey technical concepts to both technical and non-technical stakeholders.
What We Offer:
- Be part of a world-class organization that drives performance benefits.
- Attractive pay structure.
- Health Insurance coverage for you and your dependents.
- Life Insurance.
- Growth opportunities, including career progression, tuition assistance, language courses, training, and certifications.
J-18808-Ljbffr