Data Engineer — AWS/Databricks Lakehouse Solutions

International Business Machines Corporation; San Diego (CA); Remote; USD 120,000 - 155,000; Full time

Job summary

International Business Machines Corporation (IBM) Consulting seeks a skilled Data Engineer embedded with client teams to design and deliver hands-on data solutions on AWS and Databricks platforms. You will re-engineer legacy workloads and support migrations, collaborating across SAP, MySQL, and cloud services to accelerate analytics.

This role emphasizes architecture and engineering leadership, CI/CD, security, and scalable data platforms, with travel 4 days per week and close collaboration with

Qualifications

• Advanced hands-on expertise in data engineering and solution architecture.
• Strong experience with Databricks, AWS, SQL and Python.
• Experience with MySQL, data migration and ETL technologies.
• Willingness to travel 4 days per week.

Responsibilities

• Work onsite or embedded with client teams to translate business problems into solutions.
• Design and build data pipelines using Databricks, AWS, and related services.
• Lead migration of Tier-1 applications from MySQL to Databricks Lakebase and perform schema redesign.
• Integrate SAP data via SAP BTP and BDC Connect and other non-SAP data.
• Establish CI/CD, testing, observability, security, and cost controls.
• Coach client and delivery teams on design decisions.
• Create end-to-end data solutions across multiple platforms including AWS and GCP.

Tools

Databricks

AWS

Terraform

Fivetran

SAP BTP

BDC Connect

Kafka

Job description

International Business Machines Corporation (IBM) Consulting seeks a skilled Data Engineer embedded with client teams to design and deliver hands-on data solutions on AWS and Databricks platforms. You will re-engineer legacy workloads and support migrations, collaborating across SAP, MySQL, and cloud services to accelerate analytics.

This role emphasizes architecture and engineering leadership, CI/CD, security, and scalable data platforms, with travel 4 days per week and close collaboration with