Remote Data Engineer — Big Data & Databricks AI Pipelines

Koantek; Town of Chesterfield (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

Koantek seeks a Data Engineer to design and build robust data pipelines, integrating data from multiple sources and enabling data-driven decisions. You will collaborate with data scientists and stakeholders to optimize data workflows and data infrastructure.

The role focuses on Databricks, Spark, Python and cloud-native architectures across AWS/Azure/GCP, with opportunities to lead technical engagements and knowledge transfer within the team.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience).
• 3+ years as a Data Engineer with cloud experience (AWS/Azure/GCP).
• Experience designing and building data pipelines and data processing solutions.

Responsibilities

• Design and build robust data pipelines and data processing tools.
• Integrate structured and unstructured data from diverse sources.
• Collaborate with data scientists and stakeholders to enable data-driven decisions.
• Architect complex data solutions and document implementations.

Skills

Spark

Python

PySpark

Education

Bachelor's degree in Computer Science, IT, or related field

Tools

Kafka

StreamSets

MapReduce

Databricks

Job description

Koantek seeks a Data Engineer to design and build robust data pipelines, integrating data from multiple sources and enabling data-driven decisions. You will collaborate with data scientists and stakeholders to optimize data workflows and data infrastructure.

The role focuses on Databricks, Spark, Python and cloud-native architectures across AWS/Azure/GCP, with opportunities to lead technical engagements and knowledge transfer within the team.