Senior Data Engineer - AWS DMS & Databricks

Robotic Technologies Automation

Wilmington (DE)

On-site

USD 140,000 - 200,000

Full time

12 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotic Technologies Automation is seeking a hands-on Senior Data Engineer to build and run end-to-end data pipelines on AWS DMS and Databricks using PySpark, Python, and SQL. The role owns pipelines from source ingestion through transformation to curated analytics-ready data, working directly with the customer and delivering on AWS with no ramp-up time from Azure.

You will design, implement, and optimize data flows, discuss design choices with stakeholders, and write clear runbooks and

Qualifications

  • Hands-on experience with AWS DMS in production settings.
  • Databricks on AWS including Delta Lake and medallion design.
  • Proficient in PySpark and Python for pipelines.
  • Strong SQL for transformations, validation, reconciliation, and troubleshooting.

Responsibilities

  • Design, build, and maintain end-to-end data pipelines from ingestion to curated output tables.
  • Configure and run AWS DMS replication (full load + CDC) from relational sources.
  • Land DMS output in S3 and process in Databricks with Delta Lake and medallion design.
  • Write complex SQL for transformations, validation, reconciliation, and troubleshooting.
  • Handle CDC logic: upserts/merges, deletes, late-arriving data, duplication.
  • Tune Spark jobs and DMS tasks for performance and reliability.
  • Implement data quality checks, logging, alerting, and restart/recovery.
  • Coordinate with Databricks Workflows and source control with peer review.
  • Meet with customer stakeholders; gather requirements and explain design choices.
  • Write technical documentation for pipelines and runbooks.

Skills

Communication
Customer-facing
Problem-solving
Team collaboration

Tools

AWS DMS
Databricks
PySpark
Python
SQL
Delta Lake
S3

Job description

Robotic Technologies Automation is seeking a hands-on Senior Data Engineer to build and run end-to-end data pipelines on AWS DMS and Databricks using PySpark, Python, and SQL. The role owns pipelines from source ingestion through transformation to curated analytics-ready data, working directly with the customer and delivering on AWS with no ramp-up time from Azure.

You will design, implement, and optimize data flows, discuss design choices with stakeholders, and write clear runbooks and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: AWS DMS + Databricks
Senior Data Engineer: AWS DMS + Databricks

Robotics Technologies LLC • Wilmington (DE)

On-site
USD 120,000 - 180,000
Senior Databricks Data Engineer - Spark, AWS & Delta Lake
Senior Databricks Data Engineer - Spark, AWS & Delta Lake

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 180,000
Senior Data Engineer: Databricks + AWS
Senior Data Engineer: Databricks + AWS

Robotic Process Automation LLC • Sunnyvale (CA)

On-site
USD 83,000 - 102,000
Data Engineer: Databricks & Azure Data Factory
Data Engineer: Databricks & Azure Data Factory

Robotic Process Automation LLC • Fort Wayne (IN)

On-site
USD 98,000 - 139,000
Senior Databricks Engineer for Enterprise Data Pipelines
Senior Databricks Engineer for Enterprise Data Pipelines

Robotic Process Automation LLC • Pennsylvania

On-site
USD 95,000 - 128,000
Senior AWS Data Engineer — Data Lake & Warehouse Expert
Senior AWS Data Engineer — Data Lake & Warehouse Expert

Robotic Technologies Automation • New Jersey

On-site
USD 140,000 - 170,000
Senior Data Engineer – Databricks & AWS Platform
Senior Data Engineer – Databricks & AWS Platform

Robotics Technologies LLC • Sunnyvale (CA)

On-site
USD 76,000 - 108,000
Senior Data Engineer - AWS DMS & Databricks Lead
Senior Data Engineer - AWS DMS & Databricks Lead

Quantum Technologies. LLC • Wilmington (DE)

On-site
USD 140,000 - 210,000
Senior AWS Data Engineer – DMS & Databricks Expert
Senior AWS Data Engineer – DMS & Databricks Expert

Ethereum Technologies • Wilmington (DE)

On-site
USD 140,000 - 180,000
Data Engineer: Databricks & ADF ETL Specialist
Data Engineer: Databricks & ADF ETL Specialist

Robotic Process Automation LLC • Irving (TX)

On-site
USD 98,000 - 139,000