Databricks Data Engineer — Pipelines & Big Data

Cyber Space Technologies LLC; Columbus (OH); On-site; USD 90,000 - 115,000; Full time

Job summary

A technology solutions provider is seeking a skilled Data Engineer to design and maintain scalable data pipelines using Databricks and Python. The role involves optimizing ETL/ELT processes for complex datasets and collaborating with various stakeholders to ensure data quality and reliability. Candidates should possess strong experience in Data Engineering, hands-on expertise in Databricks, and a solid understanding of data modeling. This position is fully onsite in Columbus, Ohio.

Qualifications

• Strong experience as a Data Engineer.
• Hands-on expertise with Databricks.
• Experience with Spark and distributed data processing.
• Solid understanding of data modeling and data warehousing concepts.
• Experience working in enterprise environments.

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks and Python.
• Develop and optimize ETL/ELT processes for large, complex datasets.
• Work with structured and semi-structured data from multiple sources.
• Collaborate with data architects, analysts, and stakeholders to deliver data solutions.
• Ensure data quality, performance, and reliability across pipelines.
• Support production deployments, monitoring, and issue resolution.
• Follow best practices for data engineering, security, and compliance standards.

Skills

Data Engineering

Databricks

Python

ETL/ELT processes

Data modeling

Spark

Tools

Databricks

Spark

Job description

A technology solutions provider is seeking a skilled Data Engineer to design and maintain scalable data pipelines using Databricks and Python. The role involves optimizing ETL/ELT processes for complex datasets and collaborating with various stakeholders to ensure data quality and reliability. Candidates should possess strong experience in Data Engineering, hands-on expertise in Databricks, and a solid understanding of data modeling. This position is fully onsite in Columbus, Ohio.