Databricks Data Engineer: Scalable Pipelines & Medallion

RADcube - A NLogix Company; Indianapolis (IN); On-site; USD 110,000 - 160,000; Full time

Job summary

RADcube - A NLogix Company is seeking a Data Engineer to join its Indianapolis team. You will build and maintain scalable data pipelines on Databricks to support consumer-facing data products.

Responsibilities include developing ETL/ELT pipelines with PySpark, Spark SQL, and Delta Lake; implementing medallion architecture, Unity Catalog and Workflows; and optimizing cluster performance while monitoring production jobs. A strong background in data engineering and SQL is required.

Qualifications

• 4+ years of data engineering experience with Databricks, PySpark, and SQL.
• Experience with Git/CI-CD workflows.
• Nice to have: pharma/consumer data exposure; Databricks certification.

Responsibilities

• Build ETL/ELT data pipelines on Databricks for consumer-facing data products.
• Develop pipelines using PySpark, Spark SQL, and Delta Lake.
• Implement medallion architecture (bronze/silver/gold), Unity Catalog and Workflows.
• Optimize cluster performance and reduce costs; monitor jobs in production.

Skills

Data engineering

Databricks

PySpark

SQL

Git/CI-CD

Tools

Databricks

Job description

RADcube - A NLogix Company is seeking a Data Engineer to join its Indianapolis team. You will build and maintain scalable data pipelines on Databricks to support consumer-facing data products.

Responsibilities include developing ETL/ELT pipelines with PySpark, Spark SQL, and Delta Lake; implementing medallion architecture, Unity Catalog and Workflows; and optimizing cluster performance while monitoring production jobs. A strong background in data engineering and SQL is required.