Remote Senior Databricks Data Engineer & SRE

NTT DATA, Inc.; Addison (TX); In loco; USD 92.000 - 138.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical insurance

Dental insurance

Vision insurance with employer contrib

Flexible spending or HSA

Life and AD&D insurance

Short and long term disability

Paid time off

Employee assistance program

401k with company match

Descrizione del lavoro

NTT DATA Services seeks a Senior Data Engineering Support Engineer in Addison, TX to own enterprise Databricks and PySpark operations, driving high availability, performance, and cost efficiency. You will lead RCAs, design automation, and mentor junior staff to maintain a robust Delta Lakehouse environment.

You will partner with core development teams to bridge engineering and operations, implementing self-healing pipelines and reliable governance across data assets.

Competenze

• 7+ years of total experience in Data Engineering.
• 3+ years dedicated to supporting or optimizing large-scale Databricks and PySpark systems in production.

Mansioni

• Act as the highest tier of internal escalation for complex production failures in PySpark jobs.
• Drive performance tuning to resolve bottlenecks and memory issues.
• Analyze cluster utilization and optimize cost with auto-scaling and spot instances.
• Oversee data access control, schema evolution, and data lineage in Unity Catalog.
• Build automated scripts to reconcile data and monitor system health.
• Create runbooks and post-mortem RCA documents for incident resolution.

Conoscenze

Databricks

PySpark

Python

SQL

Delta Lake

Unity Catalog

Delta Live Tables

CI/CD

Strumenti

Databricks

Delta Live Tables

Unity Catalog

Descrizione del lavoro

NTT DATA Services seeks a Senior Data Engineering Support Engineer in Addison, TX to own enterprise Databricks and PySpark operations, driving high availability, performance, and cost efficiency. You will lead RCAs, design automation, and mentor junior staff to maintain a robust Delta Lakehouse environment.

You will partner with core development teams to bridge engineering and operations, implementing self-healing pipelines and reliable governance across data assets.