Data Engineer - Databricks & Cloud Pipelines (Remote)

Zohorecruit; Chesterfield (MO); Remote; USD 110,000 - 160,000; Full time

Job summary

Koantek LLC is seeking a Data Engineer to design and build robust data pipelines across cloud platforms. You will integrate structured and unstructured data and create tooling for data processing while guiding data-driven strategies with stakeholders.

You will lead complex data projects, applying Databricks best practices and enabling knowledge transfer to teams and clients. Remote work is available in the United States.

Qualifications

• Bachelor's degree in Computer Science, IT, or related field or equivalent experience.
• 3+ years as a Data Engineer with two major cloud platforms (AWS, Azure, GCP).
• Experience designing and implementing Databricks-based data pipelines for large-scale processing.
• Develop scalable streaming and batch data solutions using cloud-native components.
• Experience implementing DataOps, CI/CD and DevOps in data environments.

Responsibilities

• Design, build, and document data pipelines leveraging Databricks.
• Lead data integration projects across structured and unstructured sources.
• Apply Databricks best practices to deliver reliable solutions.
• Collaborate with data scientists and stakeholders for data-driven decisions.
• Create reusable project documentation and enable knowledge transfer.
• Assist project managers with estimates and risk assessment in client proposals.

Skills

Spark

Python

PySpark

Spark Scala

Data Modeling

Kafka

Cloud Platforms

Databricks

CI/CD

DevOps in Data

Education

Bachelor's degree in Computer Science or related

Tools

Databricks administration

Databricks notebooks

Databricks clusters

Databricks jobs

Databricks data pipelines

Kafka

StreamSets

MapReduce

Job description

Koantek LLC is seeking a Data Engineer to design and build robust data pipelines across cloud platforms. You will integrate structured and unstructured data and create tooling for data processing while guiding data-driven strategies with stakeholders.

You will lead complex data projects, applying Databricks best practices and enabling knowledge transfer to teams and clients. Remote work is available in the United States.