Senior Data Platform Engineer - AWS/Databricks

International Business Machines Corporation

Denver (CO)

Remote

USD 140,000 - 200,000

Full time

2 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

IBM Consulting is seeking a Data Engineer embedded with client teams to design and deliver hands-on solutions on the AWS/Databricks platform. You will combine architecture and engineering while building and proving solutions with the client, including re-engineering legacy workloads and migrating data from MySQL to Databricks Lakebase.

You will design end-to-end data solutions across multiple platforms (AWS, with GCP for ML/GenAI), establish engineering standards, and coach stakeholders on

Qualifications

Advanced hands-on expertise in data engineering and solution architecture.
Experience with Databricks Spark, Delta Lake, MLflow, Unity Catalog.
Relational databases (MySQL) and data migration/re-engineering.
Proven ability to design scalable data platforms and pipelines.

Responsibilities

Design and build data pipelines and integrations using Fivetran, Databricks, and AWS services.
Lead technical design and delivery for migrating a Tier-1 MySQL application to Databricks Lakebase.
Collaborate with SAP data integration and non-SAP data to create data products.
Establish engineering standards: CI/CD, testing, observability, security, and cost control.
Coach client and delivery teams and communicate status and decisions to stakeholders.

Skills

Databricks

AWS

SQL

Python

Data architecture

CI/CD

Terraform

Tools

Databricks Lakebase

Fivetran

SAP BTP

GCP ML/GenAI

Git

Terraform

Job description

You will design end-to-end data solutions across multiple platforms (AWS, with GCP for ML/GenAI), establish engineering standards, and coach stakeholders on

Get your free, confidential resume review.

or drag and drop your file here.