Geospatial Data Engineer — Remote, Databricks Pipelines

Remote Jobs; United States; Remote; USD 110,000 - 150,000; Full time

Benefits offered by this job

Annual Bonus

Healthcare, Vision, Dental

401(k)

21 Days Vacation

Office Lunch provided Daily

Job summary

Urban SDK is seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms for geospatial traffic analytics. You will leverage Python, Databricks, and AWS S3 to enable robust data delivery and scalable processing.

You will implement automated testing, CI/CD, and data quality monitoring while collaborating with data scientists to productionize models and ensure reliable data availability in a cloud environment.

Qualifications

• 3+ years of experience as a data engineer or in a similar role.
• Strong proficiency in Python and data engineering libraries.
• Hands-on with Databricks and Spark for large-scale processing.
• Experience with AWS S3 and cloud-based data architectures.
• Solid understanding of CI/CD, testing, and data quality monitoring.
• Experience with SQL and NoSQL databases.
• Attention to detail and problem-solving skills.

Responsibilities

• Design, implement, and maintain scalable data pipelines and ETL/ELT workflows on Databricks and cloud platforms.
• Manage large-scale geospatial and temporal datasets stored in AWS S3.
• Collaborate with data scientists to productionize machine learning models and ensure data availability.
• Implement data validation, testing, and monitoring frameworks to ensure data accuracy and reliability.
• Optimize data storage and processing strategies for high traffic and mobility data.
• Develop and maintain documentation for data workflows, architecture, and processes.
• Work with cross-functional teams to understand data requirements and ensure timely delivery.

Skills

Python

Pandas

PySpark

Databricks

Strong data processing

SQL

NoSQL databases

Data quality monitoring

CI/CD practices

Testing frameworks

Education

Bachelor's or Master's in Computer Science or related field

Tools

Databricks

Spark

AWS S3

Prefect

Docker

Kubernetes

Job description

Urban SDK is seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms for geospatial traffic analytics. You will leverage Python, Databricks, and AWS S3 to enable robust data delivery and scalable processing.

You will implement automated testing, CI/CD, and data quality monitoring while collaborating with data scientists to productionize models and ensure reliable data availability in a cloud environment.