Lead Azure Data Engineer

Info Resume Edge; Atlanta (GA); On-site; USD 90,000 - 120,000; Full time

Job summary

Info Resume Edge in Atlanta, Georgia is seeking a Data Engineer to participate in the modernization and migration of Azure data systems to the Databricks Lakehouse Platform. The ideal candidate will have strong hands-on experience with SQL/T-SQL and a bachelor's degree in Computer Science or a related field. Responsibilities include designing and maintaining ETL/ELT pipelines and optimizing data integration solutions. The candidate should possess analytical skills and the ability to collaborate across technical and business teams.

Qualifications

• Proven experience working with cloud-based data engineering solutions, preferably in Azure ecosystems.
• Experience supporting cloud migration or modernization initiatives is a plus.
• Strong understanding of ETL/ELT concepts, data modeling, and distributed data processing.

Responsibilities

• Participate in the modernization and migration of Azure data and analytics systems to the Databricks Lakehouse Platform.
• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Azure Functions, and Databricks.
• Build scalable data integration solutions across Azure Data Lake, Azure SQL Database, Azure Storage (Blob/File), and Databricks.
• Migrate legacy data pipelines into Databricks notebooks or Delta pipelines.

Skills

SQL / T-SQL

Education

Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field

Job description

Participate in the modernization and migration of current Azure data and analytics systems to the Databricks Lakehouse Platform.

Support Databricks platform enablement, configuration, and deployment activities.

Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Azure Functions, and Databricks.

Build scalable data integration solutions across Azure Data Lake, Azure SQL Database, Azure Storage (Blob/File), and Databricks.

Assist in optimizing ingestion and transformation processes for performance, reliability, and cost efficiency.

Migrate legacy data pipelines, workflows, and processing logic into Databricks notebooks or Delta pipelines.

Work with cross-functional teams to understand business requirements and translate them into technical solutions.

Ensure all solutions comply with Marsh MMA standards for security, governance, and data quality.

Perform data validation, unit testing, troubleshooting, and system performance tuning.

Document architecture, workflows, design decisions, and operational procedures.

Required Technical Skills

Strong hands-on experience with:

• SQL / T-SQL

Qualifications

Bachelors degree in Computer Science, Data Engineering, Information Technology, or related field.

Proven experience working with cloud-based data engineering solutions, preferably in Azure ecosystems.

Experience supporting cloud migration or modernization initiatives is a plus.

Strong understanding of ETL/ELT concepts, data modeling, and distributed data processing.

Soft Skills

Strong analytical and problem-solving mindset.

Excellent communication and documentation abilities.

Ability to collaborate with cross-functional teams across technical and business domains.

Detail-oriented with a focus on quality and compliance.