A geospatial technology firm is seeking a skilled Data Engineer to design and maintain scalable data pipelines that support its traffic analytics applications. The role requires strong proficiency in Python and hands-on experience with Databricks and AWS S3, alongside a solid background in data engineering practices. You will collaborate with cross-functional teams to ensure efficient data workflows and optimize processing strategies for high-volume datasets. This full-time position is available remotely or from Jacksonville, FL.
Qualifications
3+ years of experience as a data engineer or in a similar role.
Strong proficiency in Python and associated libraries for data engineering.
Hands-on experience with Databricks and Spark for large-scale data processing.
Experience with AWS services, especially S3.
Responsibilities
Design, implement, and maintain scalable data pipelines and ETL/ELT workflows on Databricks.
Manage large-scale geospatial and temporal datasets stored in AWS S3.
Collaborate with data scientists to productionize machine learning models.
Skills
Python
Databricks
AWS S3
SQL
NoSQL
Data Engineering Practices
ETL/ELT Workflows
Education
Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
Tools
PySpark
Docker
Kubernetes
PostGIS
Prefect
Job description
A geospatial technology firm is seeking a skilled Data Engineer to design and maintain scalable data pipelines that support its traffic analytics applications. The role requires strong proficiency in Python and hands-on experience with Databricks and AWS S3, alongside a solid background in data engineering practices. You will collaborate with cross-functional teams to ensure efficient data workflows and optimize processing strategies for high-volume datasets. This full-time position is available remotely or from Jacksonville, FL.