Engineering - Data - Data Engineer

LightBox Employer; Shelton (CT); On-site; USD 90,000 - 130,000; Full time

Job summary

LightBox is seeking a Data Engineer to join the Data Integration team. You will design, build, and maintain reliable data pipelines and data-intensive applications that support LightBox products.

This hands-on, mid-career role involves solving practical data problems with ownership and collaboration from the team. You will work with large datasets, transform data for product features, and partner with engineering, product, and data stakeholders to deliver trusted, scalable data solutions.

Qualifications

• BS degree in CS/Engineering or equivalent experience.
• 2+ years building and maintaining production ETLs.
• Strong SQL, Python, and at least one scalable data framework (Spark, DuckDB, Polars).
• Experience with batch and/or event-driven pipelines and orchestration tools.
• Familiarity with AWS or GCP and modern data formats (Parquet/Delta Lake).
• GitHub workflows, PRs, CI/CD, and code reviews.

Responsibilities

• Build, test, and maintain batch and event-driven data pipelines and ETL/ELT workflows.
• Transform and organize data for product features and downstream users.
• Investigate data-quality issues and implement fixes.
• Improve workflows for reliability, efficiency, and maintainability.
• Collaborate with engineering, product, and data stakeholders to deliver solutions.
• Adhere to version control, testing, monitoring, and documentation practices.

Skills

SQL skills

Python

Data pipelines

ETL/ELT design

Team collaboration

Communication

Problem solving

Education

Bachelor's degree in Computer Science, Engineering, or a related field

Tools

Spark

DuckDB

Polars

Prefect

Airflow

Dagster

GitHub Actions

AWS

GCP

Parquet

Delta Lake

Job description

Data Engineer

Data Integration Team | LightBox

Department: Data Integration

Reports to: Manager, Data Engineering

Position Overview

LightBox is seeking a Data Engineer to join the Data Integration team. This role designs, builds, and maintains reliable data pipelines, data-intensive applications, and AI-enabled automation that support LightBox products. The successful candidate will work with large, diverse datasets and partner with engineering, product, and data stakeholders to deliver trusted, scalable data solutions.

This is a hands-on role for a mid-career engineer who enjoys solving practical data problems and taking ownership of well-defined work with support from the team.

What You Will Do

• Build, test, and maintain batch and event-driven data pipelines and ETL/ELT workflows.
• Transform, validate, and organize data for product features and downstream consumers.
• Investigate pipeline and data-quality issues, troubleshoot root causes, and implement fixes.
• Improve existing workflows for reliability, efficiency, and maintainability; support platform modernization.
• Work with engineering, product, and data stakeholders to understand requirements and deliver solutions.
• Follow team practices for version control, code review, testing, monitoring, and documentation.

What You Bring

Required qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• 2+ years of relevant industry experience including building and maintaining production ETLs.
• High proficiency in at least one SQL dialect, Python, and at least one scalable data processing framework (Spark, DuckDB, Polars, etc.)
• Experience designing, building, and operating batch and/or event-driven data pipelines.
• Experience with a workflow orchestration platform (Prefect, Airflow, Dagster, etc.), and familiarity with distributed data processing.
• Experience with cloud data and infrastructure services in AWS and/or GCP.
• Familiarity with modern data storage formats and technologies, including Apache Parquet and Delta Lake.
• Working knowledge of GitHub workflows, including pull requests, code review, branching, and CI/CD automation with GitHub Actions.
• Clear communication, curiosity, and a collaborative approach to problem-solving.

Bonus qualifications:

• Experience using Codex or other LLM-assisted development tools to generate and refine code from specifications, with strong code-review and testing practices.
• Experience processing large scale geospatial or location-based data.
• Experience with data modeling and designing data solutions for multiple product or business use cases.
• Experience supporting production data workflows with monitoring, alerting, and incident-response practices.

Working at LightBox

This job description summarizes the primary responsibilities and qualifications for the role. Responsibilities may change as business needs evolve. The role may occasionally require work outside standard business hours to meet deadlines or support customers and production operations.

LightBox is an equal opportunity employer. We are committed to providing equal employment opportunities to all employees and applicants without regard to protected characteristics under applicable law.