Azure Data Engineer: Cloud ETL & Pipelines (Secret)

The Baer Group; St. Louis (MO); On-site; USD 83,000 - 124,000; Full time

Job summary

The Baer Group in St. Louis, MO is seeking an Azure Cloud Developer for a Federal project. The role is onsite (Mon-Thur) for 12+ months, with an hourly rate and expenses reimbursed.

You will design, build, and maintain scalable data pipelines on Microsoft Azure, integrating data from multiple sources, and optimizing data processing for analytics in an Agile environment. Strong Azure data engineering, programming, and SQL skills are required; Azure Data Factory, Databricks, Spark experience is

Qualifications

• 3+ years of Microsoft Azure cloud-native experience.
• 2+ years building ETL/data pipelines with Azure Data Factory, Event Hubs, Event Grid, Azure Functions, Databricks, or Apache Spark.
• Experience with Azure Cosmos DB, Azure SQL, Azure Synapse, and Azure Cache for Redis.
• Experience with Airflow or Oozie for workflow orchestration.
• Strong Python or Java programming and SQL skills.
• Experience with batch and streaming data pipelines, CSV/JSON/XML data formats, and Agile development.
• Knowledge of CI/CD, SDLC, security, and coding best practices.
• Experience with Azure cloud migration projects.
• Microsoft Azure certification is a plus.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Azure.
• Integrate data from internal and external systems into Azure data platforms.
• Develop ETL/ELT solutions using Azure Data Factory.
• Build batch and streaming data pipelines with Databricks or Apache Spark.
• Write complex SQL queries for data transformation and analysis.
• Follow CI/CD, security, and SDLC practices in an Agile environment.

Skills

Azure cloud

Python/Java

SQL

Agile development

Tools

Azure Data Factory

Databricks

Apache Spark

Airflow/Oozie

Azure Cosmos DB

Azure SQL

Azure Synapse

Azure Cache for Redis

Job description

The Baer Group in St. Louis, MO is seeking an Azure Cloud Developer for a Federal project. The role is onsite (Mon-Thur) for 12+ months, with an hourly rate and expenses reimbursed.

You will design, build, and maintain scalable data pipelines on Microsoft Azure, integrating data from multiple sources, and optimizing data processing for analytics in an Agile environment. Strong Azure data engineering, programming, and SQL skills are required; Azure Data Factory, Databricks, Spark experience is