Azure Data Engineer

Infinite Computer Solutions; Alpharetta (GA); Presencial; USD 150 000 - 190 000; Tempo integral

Resumo da oferta

Infinite Computer Solutions in Alpharetta, GA is hiring a Senior Data Engineer (Azure) to design and build cloud-native data platforms on Microsoft Azure.

You will need 8+ years in data engineering with Banking/Financial Services experience, strong experience with Azure Databricks, ADF, Data Lake, Delta Lake, and CI/CD in an Agile environment.

Collaborate with stakeholders across risk, finance, and operations to deliver scalable data solutions and reliable analytics.

Qualificações

• 8+ years of experience in Data Engineering.
• Mandatory Banking/Financial Services experience (ALM, Risk, Treasury, Regulatory, Finance, or Capital Markets preferred).
• Strong hands-on experience with Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), Azure SQL, and ADLS Gen2.
• Experience designing and developing ETL/ELT pipelines and Lakehouse (Bronze/Silver/Gold) architecture.
• Strong SQL/T-SQL development and data modeling (Star/Snowflake Schema).
• Experience with Delta Lake, incremental loads, CDC, and data quality frameworks.
• Knowledge of Power BI and semantic models is a plus.
• Experience with Azure DevOps, Git, and CI/CD.
• Excellent problem-solving, communication, and Agile/Scrum experience.

Responsabilidades

• Design, develop, and maintain scalable Azure data pipelines using ADF and Databricks.
• Build and optimize PySpark/Spark SQL transformations for enterprise data processing.
• Develop Delta Lake/Lakehouse solutions and curate analytical datasets.
• Implement data quality, reconciliation, and performance optimization.
• Collaborate with business, risk, finance, and data stakeholders to deliver scalable data solutions.
• Support production deployments, troubleshooting, and CI/CD automation.

Conhecimentos

Data Engineering

BFSI domain knowledge

Agile/Scrum

Ferramentas

Azure Databricks

PySpark

Spark SQL

Azure Data Factory

Azure Data Lake

Delta Lake

ADLS Gen2

SQL/T-SQL

Azure DevOps

Git CI/CD

Descrição da oferta de emprego

Senior Data Engineer (Azure)

Location: Alpharetta, GA / Berkeley Heights, NJ

(In Office Position) Employment Type: Full-Time / W2 - Infinite Computer Solutions

We are hiring a Senior Data Engineer with 8+ years of experience in Data Engineering and mandatory Banking/Financial Services (BFSI) domain experience. The ideal candidate will have strong expertise in building cloud‑native data platforms on Microsoft Azure using Azure Databricks, Azure Data Factory, and Azure Data Lake.

Required Skills

• 8+ years of experience in Data Engineering.
• Mandatory Banking/Financial Services experience (ALM, Risk, Treasury, Regulatory, Finance, or Capital Markets preferred).
• Strong hands‑on experience with Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), Azure SQL, and ADLS Gen2.
• Experience designing and developing ETL/ELT pipelines and Lakehouse (Bronze/Silver/Gold) architecture.
• Strong SQL/T‑SQL development and data modeling (Star/Snowflake Schema).
• Experience with Delta Lake, incremental loads, CDC, and data quality frameworks.
• Knowledge of Power BI and semantic models is a plus.
• Experience with Azure DevOps, Git, and CI/CD.
• Excellent problem‑solving, communication, and Agile/Scrum experience.

Responsibilities

• Design, develop, and maintain scalable Azure data pipelines using ADF and Databricks.
• Build and optimize PySpark/Spark SQL transformations for enterprise data processing.
• Develop Delta Lake/Lakehouse solutions and curate analytical datasets.
• Implement data quality, reconciliation, and performance optimization.
• Collaborate with business, risk, finance, and data stakeholders to deliver scalable data solutions.
• Support production deployments, troubleshooting, and CI/CD automation.

Preferred Certifications:

Microsoft Azure, Azure Developer, Power BI, or Azure DevOps certifications.Domain: Banking/Financial