Databricks Engineer

Cyber Space Technologies LLC; Columbus (OH); On-site; USD 90,000 - 115,000; Full time

Job summary

A technology solutions provider is seeking a skilled Data Engineer to design and maintain scalable data pipelines using Databricks and Python. The role involves optimizing ETL/ELT processes for complex datasets and collaborating with various stakeholders to ensure data quality and reliability. Candidates should possess strong experience in Data Engineering, hands-on expertise in Databricks, and a solid understanding of data modeling. This position is fully onsite in Columbus, Ohio.

Qualifications

• Strong experience as a Data Engineer.
• Hands-on expertise with Databricks.
• Experience with Spark and distributed data processing.
• Solid understanding of data modeling and data warehousing concepts.
• Experience working in enterprise environments.

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks and Python.
• Develop and optimize ETL/ELT processes for large, complex datasets.
• Work with structured and semi-structured data from multiple sources.
• Collaborate with data architects, analysts, and stakeholders to deliver data solutions.
• Ensure data quality, performance, and reliability across pipelines.
• Support production deployments, monitoring, and issue resolution.
• Follow best practices for data engineering, security, and compliance standards.

Skills

Data Engineering

Databricks

Python

ETL/ELT processes

Data modeling

Spark

Tools

Databricks

Spark

Job description

We're looking for a Data Engineer with strong experience in Databricks and Python to work on large-scale data platforms and analytics solutions. This role requires hands-on development and close collaboration with business and technology teams in a fully onsite environment.

Key Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks and Python
• Develop and optimize ETL/ELT processes for large, complex datasets
• Work with structured and semi-structured data from multiple sources
• Collaborate with data architects, analysts, and stakeholders to deliver data solutions
• Ensure data quality, performance, and reliability across pipelines
• Support production deployments, monitoring, and issue resolution
• Follow best practices for data engineering, security, and compliance standards

Required Skills & Qualifications

• Strong experience as a Data Engineer
• Hands-on expertise with Databricks
• Experience with Spark and distributed data processing
• Solid understanding of data modeling and data warehousing concepts
• Experience working in enterprise environments