Azure Data Engineer (W2 Contract)

ISoftech Inc; District of Columbia; Remote; USD 80,000 - 110,000; Full time

Job summary

An established industry player is on the lookout for an Azure Data Engineer to spearhead the development of advanced data solutions. This role involves designing and maintaining scalable data pipelines, managing data ingestion, and implementing real-time data streaming solutions. The ideal candidate will have a strong background in Azure cloud services, data integration, and data transformation, ensuring data integrity and availability. You will collaborate with cross-functional teams, utilizing your expertise in Azure Data Factory, Databricks, and T-SQL to deliver impactful solutions. Join a dynamic environment where your contributions will drive innovation and efficiency in data processing.

Qualifications

• 3+ years as a Data Engineer focused on Azure Cloud Services.
• Proficient in data integration and real-time data processing techniques.

Responsibilities

• Design and maintain scalable data pipelines using Azure services.
• Lead data migration projects to Azure Cloud Services.

Skills

Azure Data Factory

Azure Databricks

T-SQL

Python

Data Integration

ETL Development

Data Warehousing

CI/CD Practices

Education

Bachelor’s degree in electrical and computer engineering

Tools

Azure SQL Database

Azure Event Hub

Kafka

Azure Synapse Analytics

Azure DevOps

Git

Job description

Talent Acquisition Specialist at Tanvi IT Solutions Inc

Remote

USC/GC (W2 Contract)

Role Overview:

We are seeking an Azure Data Engineer with extensive experience in Azure cloud services, data integration, and data transformation to lead the development and maintenance of our advanced data solutions. The ideal candidate will have a proven track record of implementing Azure-based data processing, storage, and analytics solutions that meet complex business requirements.

Key Responsibilities:

1. Design, develop, and maintain scalable and efficient data pipelines using Azure Data Factory (ADF), Azure Databricks (ADB), and Azure Stream Analytics.
2. Manage data ingestion from multiple sources into Azure Blob Storage, Azure Data Lake, and Azure SQL Database, ensuring data integrity and availability.
3. Develop and maintain bilateral FHIR data feeds with Azure Data Factory.
4. Implement real-time data streaming solutions using Azure Event Hub and Kafka, integrated with Azure Databricks for real-time analytics.
5. Develop and optimize ETL processes for data warehousing, utilizing Azure Synapse Analytics, to support OLTP, OLAP, and BI reporting needs.
6. Conduct data modelling, normalization, and denormalization to design efficient data structures for Operational Data Store (ODS) and Data Warehouse solutions.
7. Lead data migration projects from on-premises infrastructure to Azure Cloud Services, ensuring seamless transitions and minimal downtime.
8. Craft complex T-SQL scripts, including triggers, stored procedures, and functions, to support data processing and reporting requirements.
9. Monitor and tune database and query performances, utilizing Azure Monitor and other tools to ensure optimal data processing speeds and system reliability.
10. Collaborate closely with the DevOps team to implement CI/CD pipelines for data infrastructure projects using Azure DevOps and Git.
11. Produce and maintain detailed documentation for data models, ETL processes, and data pipeline architectures to ensure clarity and sustainability.

Professional Qualifications:

1. Minimum of 3 years of experience as a Data Engineer or Developer, with a strong focus on Azure Cloud Services.
2. Minimum of 2 years of experience with Azure Data Factory, Azure Databricks, Azure SQL Database, and other Azure data services.
3. Proficient in data integration, data ingestion, and real-time data processing techniques.
4. Advanced skills in Python, PySpark, Spark SQL, and T-SQL scripting.
5. Experience with data modeling, ETL development, and data warehousing principles.
6. Familiarity with CI/CD practices, Azure DevOps, and Git.
7. Proven ability to work with cross-functional teams to translate business requirements into technical solutions.

Education and Certifications:

• Bachelor’s degree in electrical and computer engineering or related field.

Relevant Azure certifications highly preferred.

Additional Details:

• Seniority level: Mid-Senior level
• Employment type: Contract
• Job function: Information Technology
• Industry: Information Services