Azure Data Engineer - Secret Clearance (Onsite)

The Baer Group; St. Louis (MO); On-site; USD 83,000 - 152,000; Full time

Job summary

Baer is seeking an Azure Cloud Developer for a 12-month Federal project based in St. Louis, MO. The role requires active Secret clearance and US citizenship.

You will design, build, and maintain scalable data pipelines on Microsoft Azure, using Data Factory, Databricks, Spark, SQL, and related services. Strong Python or Java and CI/CD practices are essential.

Onsite work Mon-Thur, with alignment to Agile teams and SDLC processes.

Qualifications

• 3+ years of experience with Microsoft Azure cloud-native technologies.
• 2+ years of experience building ETL/data pipelines using Azure Data Factory, Event Hubs, Event Grid, Azure Functions, Databricks, or Apache Spark.
• Experience with Azure Cosmos DB, Azure SQL, Azure Synapse, and Azure Cache for Redis.
• Experience with Airflow or Oozie for workflow orchestration.
• Strong Python or Java programming and SQL skills.
• Experience with batch and streaming data pipelines, CSV/JSON/XML data formats, and Agile development.
• Knowledge of CI/CD, SDLC, security, and coding best practices.
• Experience with Azure cloud migration projects.
• Microsoft Azure certification is a plus.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure cloud-native services.
• Integrate data from internal and external systems into Azure data platforms.
• Develop ETL/ELT solutions using Azure Data Factory and related Azure services.
• Build and optimize batch and streaming data processing pipelines using Databricks or Apache Spark.
• Write complex SQL queries for data transformation, validation, and analysis.
• Perform root cause analysis and troubleshoot data pipeline and integration issues.
• Monitor, maintain, and enhance existing data pipelines for performance and reliability.
• Work closely with cross-functional teams in an Agile environment.
• Follow CI/CD, security best practices, coding standards, and SDLC processes.

Skills

Azure Data Factory

Azure Databricks

Azure SQL

Azure Cosmos DB

Python

Java

SQL

ETL/ELT pipelines

CI/CD

Apache Spark

Tools

Databricks

Apache Spark

Azure Functions

Airflow

Oozie

Job description

Baer is seeking an Azure Cloud Developer for a 12-month Federal project based in St. Louis, MO. The role requires active Secret clearance and US citizenship.

You will design, build, and maintain scalable data pipelines on Microsoft Azure, using Data Factory, Databricks, Spark, SQL, and related services. Strong Python or Java and CI/CD practices are essential.

Onsite work Mon-Thur, with alignment to Agile teams and SDLC processes.