Data Engineer

urbansdk.com; Stati Uniti; Remoto; USD 120.000 - 150.000; Tempo pieno

Vantaggi offerti da questo lavoro

Experience-based salary

Annual bonus

Medical, dental and vision coverage

401(k)

21 vacation days

Lunch at the office

Descrizione del lavoro

UrbanSDK is seeking a data engineer to design and operate scalable data pipelines for geospatial and mobility analytics. You will process large spatial and time-based datasets in cloud environments, ensure data quality, and make data readily available for analytics and machine learning.

You will work with Python, PySpark, and Databricks, manage data in AWS S3, and collaborate with data scientists to productionize models, implement testing and monitoring, and document architectures for cross-team

Competenze

• Bachelor’s or master's degree in computer science, data engineering, or a related discipline.
• At least three years of data engineering or comparable experience.
• Strong Python skills and experience with libraries such as pandas or PySpark.
• Practical experience with Databricks and Spark for large-scale processing.
• AWS experience, especially S3, and understanding of cloud data architectures.
• Familiarity with SQL and NoSQL databases, version control, pipeline testing, and CI/CD.
• Strong problem-solving skills and attention to detail.

Mansioni

• Build and maintain ETL/ELT pipelines and workflows using Databricks, Spark, and cloud services.
• Manage large geospatial and temporal datasets stored in AWS S3.
• Work with data scientists to productionize machine learning models and provide reliable data inputs.
• Develop validation, automated testing, and monitoring practices to track data quality and pipeline reliability.
• Tune storage and processing approaches for high volumes of mobility data.
• Document data workflows, architecture, and operating processes, and coordinate delivery across teams.

Conoscenze

Python

Pandas

PySpark

Databricks

Spark

AWS S3

SQL

NoSQL

CI/CD

Version control

Testing

Formazione

Bachelor’s or Master’s in CS or Data Eng

Strumenti

Databricks

Spark

AWS S3

Prefect

Descrizione del lavoro

Role overview

Design and operate scalable data pipelines and platforms that support geospatial and traffic analytics. The role focuses on processing large spatial and time-based datasets in cloud environments, maintaining dependable data quality, and making data available for analytical and machine learning work.

Responsibilities

• Build and maintain ETL/ELT pipelines and workflows using Databricks, Spark, and cloud services.
• Manage large geospatial and temporal datasets stored in AWS S3.
• Work with data scientists to productionize machine learning models and provide reliable data inputs.
• Develop validation, automated testing, and monitoring practices to track data quality and pipeline reliability.
• Tune storage and processing approaches for high volumes of mobility data.
• Document data workflows, architecture, and operating processes, and coordinate delivery across teams.

Requirements

• A bachelor’s or master’s degree in computer science, data engineering, or a related discipline.
• At least three years of data engineering or comparable experience.
• Strong Python skills and experience with libraries such as pandas or PySpark.
• Practical experience with Databricks and Spark for large-scale processing.
• AWS experience, especially S3, and understanding of cloud data architectures.
• Familiarity with SQL and NoSQL databases, version control, pipeline testing, and CI/CD.
• Strong problem-solving skills and attention to detail.

Nice to have

• Experience with geospatial formats or tools such as GeoJSON, Shapefiles, or PostGIS.
• Familiarity with orchestration tools such as Prefect, containerization, or cloud-native data services.
• Experience supporting machine learning pipelines in production.

Benefits and work setup

Full-time position, based in Jacksonville, Florida, or remote.

• experience-based salary, annual bonus, medical, dental and vision coverage, a 401(k), 21 vacation days, and lunch at the office.