Remote Data Engineer: Build Data Pipelines & Analytics

Illumination-Works-LL; United States; Remote; USD 110,000 - 160,000; Full time

Benefits offered by this job

Competitive salary

PTO

Medical, dental, vision insurance

401K

Training opportunities

Job summary

Illumination Works is seeking a Data Engineer to design, build, and optimize data pipelines and data models supporting analytics and data science initiatives. You will work with data scientists and engineers to ensure reliable, high-quality data delivery across multiple data sources.

The role emphasizes hands-on development with Python, SQL, and Databricks, plus Delta Lake and data ingestion strategies. A Secret clearance is required for our government-related projects, with strong communication

Qualifications

• 4+ years of experience as a Data Engineer or in a similar data-focused role.
• Advanced SQL skills with complex joins, aggregations and window functions.
• Python proficiency for data engineering and transformation.
• Experience with Databricks notebooks and data pipelines.
• Experience with Delta Lake and data modeling.

Responsibilities

• Develop, maintain, and enhance data pipelines using Python, SQL, and Databricks.
• Develop and maintain Databricks notebooks supporting data ingestion, transformation, and delivery.
• Design and maintain data tables, schemas, and Delta Lake structures for analytics use.
• Collaborate with data scientists to evolve pipelines and data structures.
• Create complex SQL queries with joins, aggregations, and window functions.
• Integrate and transform data from multiple sources including structured and semi-structured data.
• Support data quality through validation, troubleshooting, and issue resolution.
• Optimize pipelines and queries for performance and scalability.
• Document data sources, transformations, and pipeline configurations.
• Collaborate with stakeholders to deliver data solutions meeting mission requirements.

Skills

SQL

Python

Databricks

ETL/ELT

Delta Lake

Data modeling

Data integration

Data quality

Communication

Education

Bachelor's degree in CS/Math/DS/Engineering

Tools

Databricks

Job description

Illumination Works is seeking a Data Engineer to design, build, and optimize data pipelines and data models supporting analytics and data science initiatives. You will work with data scientists and engineers to ensure reliable, high-quality data delivery across multiple data sources.

The role emphasizes hands-on development with Python, SQL, and Databricks, plus Delta Lake and data ingestion strategies. A Secret clearance is required for our government-related projects, with strong communication