Data Engineer: Scalable Ingestion & Data Platform

DMTI Spatial Inc.; Idaho; Remote; USD 90,000 - 130,000; Full time

Job summary

DMTI Spatial Inc. is seeking a Software Engineer to join the data ingestion team on a greenfield project within a world-class data platform.

You will build automation and tooling for ingestion of tens of thousands of datasets and work with a team of experienced data and software engineers to scale data pipelines. Responsibilities include developing, testing, and maintaining ingestion applications, participating in design reviews, and contributing to CI/CD.

Qualifications

• Bachelor's degree in Computer Science or higher.
• Strong academic record with software engineering fundamentals.
• Experience with data ingestion and scalable data platforms.

Responsibilities

• Develop, test, and maintain data ingestion applications and workflows.
• Contribute to CI/CD pipelines and code reviews.
• Analyze problems and implement robust solutions.
• Collaborate with cross-functional teams to meet objectives.
• Support retrieval and transformation of large datasets.

Skills

Python

OOP design patterns

Data engineering

Linux

Education

Bachelor's degree in Computer Science

Tools

Prefect

Luigi

Airflow

Hadoop

Spark

Pandas

Dask

MySQL

MS-SQL

Flask

React

Job description

DMTI Spatial Inc. is seeking a Software Engineer to join the data ingestion team on a greenfield project within a world-class data platform.

You will build automation and tooling for ingestion of tens of thousands of datasets and work with a team of experienced data and software engineers to scale data pipelines. Responsibilities include developing, testing, and maintaining ingestion applications, participating in design reviews, and contributing to CI/CD.