Principal Data Engineer (Azure to AWS Migration) Houston, TX

BURGEON IT SERVICES; Houston (TX); Hybrid; USD 170,000 - 230,000; Full time

Job summary

BURGEON IT SERVICES in Houston, TX is seeking a Principal Data Engineer to drive an Azure-to-AWS migration of data platforms, pipelines, lakes and Databricks workloads. You will architect scalable solutions and guide a team through complex migrations.

You will ensure data governance, security and performance while collaborating with stakeholders in Oil & Gas to deliver reliable, scalable data solutions.

Qualifications

• Hands-on Azure-to-AWS migration experience.
• Proficient in designing enterprise data platforms with strong governance.
• Experience leading migration programs for large data workloads.

Responsibilities

• Lead Azure-to-AWS migration of data platforms, data lakes and pipelines.
• Oversee Databricks workloads, SQL Server and PostgreSQL migrations.
• Ensure data governance, security and performance across platforms.

Skills

Azure Data Factory

Azure Databricks

ADLS Gen2

AWS S3

AWS Glue

Step Functions

Lambda

EventBridge

Databricks

SQL Server to PostgreSQL

Aurora PostgreSQL

Job description

Job Title: Principal Data Engineer (Azure to AWS Migration)

Location: Houston, TX 77072

Work Mode: Onsite / Hybrid

Domain: Oil & Gas

Job Description

We are looking for an experienced Principal Data Engineer with strong hands-on experience in Azure-to-AWS data platform migration. The candidate will lead the migration of existing Azure data services to AWS, including data pipelines, data lakes, Databricks workloads, and databases.

Mandatory Skills

• Azure Data Factory (ADF), ADLS Gen2 and Azure Databricks.
• AWS S3, AWS Glue, Step Functions, Lambda, EventBridge and IAM.
• Databricks, Apache Spark, PySpark, Spark SQL and Delta Lake.
• Databricks Workflows/Jobs and Unity Catalog.
• Hands-on experience migrating Databricks workloads from Azure to AWS.
• SQL Server to PostgreSQL / Amazon Aurora PostgreSQL migration.
• Amazon Aurora PostgreSQL and AWS Database Migration Service (DMS).
• SQL Server and PostgreSQL database architecture, stored procedures, indexing and performance tuning.
• Data modeling: Conceptual, Logical and Physical Data Models; ER/Studio.
• Database migration: Schema conversion, CDC, bulk loading, data reconciliation, cutover, rollback and stabilization.
• Enterprise Data Architecture, Data Governance, Security and Performance Optimization.
• Strong technical leadership and experience managing enterprise migration projects.