Data Engineer - Databricks, PySpark & ETL Pipelines

RADcube; Indianapolis (IN); In loco; USD 110.000 - 160.000; Tempo pieno

Descrizione del lavoro

RADcube in Indianapolis seeks a skilled Data Engineer to design and maintain scalable data pipelines on Databricks for consumer data products. You will develop ETL/ELT pipelines with PySpark, Spark SQL and Delta Lake, implement medallion architecture, Unity Catalog, and Workflows, and optimize cluster performance and costs in production.

4+ years of data engineering experience required. Join a technology-focused team delivering AI, cloud and analytics solutions across healthcare, finance, and

Competenze

• 4+ years in data engineering or equivalent
• Experience with Databricks platforms and PySpark
• Strong SQL and version-control/CI-CD practices

Mansioni

• Build and maintain scalable data pipelines on Databricks for consumer data products.
• Develop ETL/ELT pipelines using PySpark, Spark SQL and Delta Lake.
• Implement medallion architecture (bronze/silver/gold), Unity Catalog and Workflows
• Optimize cluster performance and cost; monitor and troubleshoot production jobs

Conoscenze

Databricks

PySpark

SQL

Git CI/CD

ETL/ELT

Strumenti

Delta Lake

Descrizione del lavoro

RADcube in Indianapolis seeks a skilled Data Engineer to design and maintain scalable data pipelines on Databricks for consumer data products. You will develop ETL/ELT pipelines with PySpark, Spark SQL and Delta Lake, implement medallion architecture, Unity Catalog, and Workflows, and optimize cluster performance and costs in production.

4+ years of data engineering experience required. Join a technology-focused team delivering AI, cloud and analytics solutions across healthcare, finance, and