Azure Data Integration Engineer

i4DM

United States

Remote

USD 140,000 - 190,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
HSA Plan
Life insurance
Disability insurance
Retirement savings plan

Job summary

i4DM is seeking an experienced Azure Data Integration Engineer to support the ATLAS platform. You will design, develop, and maintain scalable Azure-based pipelines and ETL/ELT solutions that ingest and transform multi-source data into standardized enterprise data products.

You will work with Azure Data Factory, Synapse, Databricks, and Data Lake to enable trusted data access, governance, and analytics for Veterans and their families.

Qualifications

  • Bachelor's degree in computer science or a related technical field.
  • Minimum of five (5) years of practical experience in cloud application development with Microsoft Azure.
  • Expertise in Azure Data Factory, Synapse Analytics, Data Lake, Databricks, DAX, Power Query, and data modeling.
  • Strong SQL skills with experience in T-SQL, query optimization, and database performance tuning.
  • Experience in big data processing using Apache Spark, Python, or Scala.
  • Experience integrating Power BI with Azure SQL, Data Lake, and Synapse Analytics.
  • Understanding of ETL processes, data warehousing, and BI best practices.

Responsibilities

  • Design and implement scalable, secure, and efficient data pipelines using Azure Data Factory (ADF).
  • Develop and optimize ETL processes to ingest, transform, and store data in Azure Data Lake, SQL, and Synapse Analytics.
  • Automate data ingestion from structured and unstructured sources like APIs, databases, and IoT streams.
  • Build and maintain data lakes, warehouses, and lakehouses using Azure Data Lake, Synapse, and Databricks.
  • Monitor and troubleshoot data pipeline performance using Azure Monitor, Log Analytics, and Application Insights.
  • Implement data security best practices, RBAC, Azure AD, Managed Identities, and Key Vault.

Skills

Azure Data Factory
Synapse Analytics
Databricks
Data Lake
Power BI
ETL/ELT
SQL

Education

Bachelor's degree in CS or related field

Tools

Azure DevOps
Terraform
Bicep

Job description

Description About the Role:

We are seeking an experienced Azure Data Integration Engineer to support ATLAS, the VA’s open-architected, multi-cloud enterprise data management and analytics platform. In this role, you will design, develop, and maintain scalable Azure-based pipelines and ETL/ELT solutions that ingest, condition, curate, and transform multi-source data into standardized, consumable enterprise data products. You will use Azure Data Factory, Synapse, Databricks, Azure Data Lake, and related services to improve interoperability among key data platforms and provide consistent, secure access to trusted data regardless of its source or stage of curation. Working with analysts, data scientists, product teams, and enterprise users, you will help deliver actionable insights that enable evidence-based decisions and improve outcomes for Veterans and their families. This hands-on role combines data integration engineering, cloud data architecture, governance, performance optimization, and analytics enablement across the ATLAS ecosystem.

Key Responsibilities:
  • Design and implement scalable, secure, and efficient data pipelines using Azure Data Factory (ADF).
  • Develop and optimize ETL processes to ingest, transform, and store data in Azure Data Lake, SQL, and Synapse Analytics.
  • Automate data ingestion from structured and unstructured sources like APIs, databases, and IoT streams.
  • Build and maintain data lakes, warehouses, and lakehouses using Azure Data Lake, Synapse, and Databricks.
  • Optimize storage and retrieval of data using Parquet, Delta Lake, and columnar storage formats.
  • Ensure high availability, scalability, and performance tuning for large-scale datasets.
  • Implement batch and real-time data streaming solutions using Azure Stream Analytics, Event Hub, and Kafka.
  • Work with big data processing frameworks such as Apache Spark (Databricks) and HDInsight.
  • Integrate data from various sources like SQL Server, CosmosDB, SAP, and third-party APIs.
  • Implement data security best practices, including RBAC, Azure AD, Managed Identities, and Key Vault.
  • Work with Purview, Data Catalog, and metadata management tools to enforce data governance.
  • Monitor and troubleshoot data pipeline performance using Azure Monitor, Log Analytics, and Application Insights.
  • Optimize query performance in Synapse Analytics, SQL, and CosmosDB.
  • Automate data quality checks, anomaly detection, and alerting mechanisms.
  • Work closely with BI Developers and Cloud Engineers to support analytics and AI/ML use cases.
  • Participate in Agile/Scrum ceremonies, design reviews, and technical discussions.
  • Document data flows, best practices, and architecture decisions.
  • Design, develop, and optimize Power BI dashboards and reports for business intelligence and analytics.
  • Create interactive visualizations using advanced DAX, Power Query (M), and custom visuals.
  • Develop paginated reports using Power BI Report Builder.
  • Ensure compliance with cloud security best practices and industry standards (ISO 27001, GDPR, HIPAA).
  • Automate deployments with Azure DevOps, GitHub Actions, and CI/CD pipelines.
  • Work closely with Cloud Engineers and DevOps teams to optimize deployment strategies.
  • Collaborate with software engineers, architects, and DevOps teams to build robust applications.
  • Participate in code reviews, sprint planning, and Agile/Scrum ceremonies.
  • Document technical solutions and best practices.
Requirements
Minimum Qualifications:
  • Bachelor’s degree in computer science or a related technical field.
  • Minimum of five (5) years of practical experience in cloud application development with Microsoft Azure.
  • Expertise in Azure Data Factory (ADF), Synapse Analytics, Data Lake, Databricks, DAX, Power Query (M), and data modeling.
  • Strong SQL skills with experience in T-SQL, query optimization, and database performance tuning.
  • Experience in big data processing using Apache Spark, Python, or Scala.
  • Experience integrating Power BI with Azure SQL, Data Lake, and Synapse Analytics.
  • Understanding of ETL processes, data warehousing, and BI best practices.
  • Strong knowledge of Row-Level Security (RLS) and Power BI service administration.
  • Hands-on experience with real-time data streaming (Kafka, Event Hub, Stream Analytics).
  • Familiarity with DevOps for data pipelines, CI/CD, and Infrastructure as Code (Terraform, Bicep).
  • Knowledge of Azure AD authentication, security best practices, and cloud monitoring.
  • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements.
  • Knowledge of Agile, Scrum, and SAFe methodologies.
  • Careful, reliable, and detail-oriented when performing high impact administration tasks.
  • Experience with Synapse Pipelines, Starburst, Azure Data Lake Service, Collibra for data cataloging, Azure ML/AI services, and Pyramid Analytics for visualization.
Preferred Qualifications:
  • Microsoft Certified: Azure Data Engineer Associate (DP-203)
  • Microsoft Certified: Power BI Data Analyst Associate (PL-300)
  • Experience with CosmosDB, Delta Lake, and NoSQL solutions.
  • Knowledge of Machine Learning and AI integration with data pipelines.
  • Familiarity with Power BI, Looker, or Tableau for data visualization.
  • Knowledge of Azure architecture such as Azure services and portal, Azure Government Cloud, SQL Administrator, SQL reporting, APIs, authorization methods for applications and APIs, migrating SQL schemas and data between environments.
  • Experience in embedded analytics and Power BI API integration.
Benefits

Comprehensive healthcare coverage, HSA Plan, Life and Disability Insurance, and Retirement Savings Plan.

TAG: #LI-I4DM TAG: INDMJC

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Integration Engineer
Azure Data Integration Engineer

i4DM • Millersville (MD)

On-site
USD 120,000 - 160,000
Healthcare coverage
HSA Plan
Life and Disability Insurance
+1
SQL Developer / Database Engineer
SQL Developer / Database Engineer

i4DM • United States

Remote
USD 120,000 - 180,000
SQL Developer / Database Engineer
SQL Developer / Database Engineer

i4DM • Millersville (MD)

On-site
USD 120,000 - 160,000
Data Quality Engineer
Data Quality Engineer

i4DM • United States

Remote
USD 100,000 - 150,000
Healthcare coverage
HSA Plan
Life and Disability Insurance
+1
Senior Data Engineer
Senior Data Engineer

Node.Digital LLC • Washington

Remote
USD 140,000 - 190,000
Medical
Dental
Vision
+6
Data Engineer
Data Engineer

TG Administration LLC • Scottsdale (AZ)

On-site
USD 95,000 - 130,000
Healthcare Benefits
Retirement Benefits
Time Off
Azure Data Engineer/Integration Developer
Azure Data Engineer/Integration Developer

DXC Luxoft • United States

Remote
USD 140,000 - 190,000
Azure Data Engineer
Azure Data Engineer

Recru • Fort Worth (TX), Arlington (TX), Dallas (TX)

On-site
USD 120,000 - 150,000
Azure Data Engineer
Azure Data Engineer

Veriipro • Bellevue (WA)

On-site
USD 110,000 - 160,000
Senior Data Architect & Engineer - Enterprise Pipelines
Senior Data Architect & Engineer - Enterprise Pipelines

Ares Enterprise • Washington

Hybrid
USD 120,000 - 180,000