Cloud Data Engineer - AWS/Databricks & Migration Lead

International Business Machines Corporation; Atlanta (GA); Remote; USD 120,000 - 180,000; Full time

Job summary

IBM Consulting in the United States seeks a data engineer to design and deliver hands-on solutions on the AWS/Databricks platform. The role blends architecture and engineering, building solutions with clients and re-engineering legacy workloads, including migration from MySQL to Databricks Lakebase.

You will design end-to-end data platforms, integrate SAP data via SAP BTP, and set engineering standards (CI/CD, testing, observability, security, cost control).

Qualifications

• Extensive data engineering and solution design experience.
• Proven ability to deliver complex data solutions for clients.
• Hands-on with Databricks, AWS, SQL and Python at scale.

Responsibilities

• Design and deliver hands-on data solutions on AWS/Databricks.
• Migrate legacy workloads and support MySQL to Databricks Lakebase.
• Build data pipelines using Fivetran, Databricks and AWS services.
• Lead architecture and delivery for platform migrations and data products.
• Establish CI/CD, testing, observability, security and cost controls.
• Coach teams and communicate status, risks, and decisions.

Skills

Data engineering

Solution architecture

Cloud data platforms

Client collaboration

Education

Databricks Certified Data Engineer

Machine Learning Professional

Tools

Databricks

AWS

SQL

Python

Fivetran

Terraform

CI/CD

GCP

Job description

IBM Consulting in the United States seeks a data engineer to design and deliver hands-on solutions on the AWS/Databricks platform. The role blends architecture and engineering, building solutions with clients and re-engineering legacy workloads, including migration from MySQL to Databricks Lakebase.

You will design end-to-end data platforms, integrate SAP data via SAP BTP, and set engineering standards (CI/CD, testing, observability, security, cost control).