Security-Cleared Data Engineer - ETL & Big Data

Silverthorne Advisory Group; Illinois; On-site; USD 110,000 - 140,000; Full time

Benefits offered by this job

Health insurance

401(k)

401(k) matching

Paid time off

Bonus based on performance

Professional development

Company parties

Job summary

Silverthorne Advisory Group is seeking a Data Engineer to design, build, and maintain advanced data infrastructures in the Defense sector. The role emphasizes ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks for efficient data processing and analysis.

You will collaborate with data scientists and analysts to deliver timely data insights, while ensuring data quality, governance, and regulatory compliance across large federal datasets.

Qualifications

• Experience designing end-to-end data pipelines with ETL tooling.
• Proven ability to work with large datasets and big data tech.
• Knowledge of data governance and regulatory best practices.

Responsibilities

• Design, develop, and implement end-to-end data pipelines using ETL and Databricks.
• Create and optimize pipelines for scalability and high-performance processing.
• Perform data cleansing, integration, and quality assurance on large datasets.
• Leverage big data tech to process federal agency data efficiently.
• Troubleshoot data issues and implement innovative solutions.
• Enforce data governance and regulatory compliance.
• Collaborate with cross-functional teams to design data models and architectures.
• Provide data insights to stakeholders and support decision-making.
• Maintain documentation for applications and workflows.
• Stay updated with evolving data engineering trends and tools.

Skills

ETL processes

Big data processing

Data governance

Regulatory compliance

Tools

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

AWS S3

Job description

Silverthorne Advisory Group is seeking a Data Engineer to design, build, and maintain advanced data infrastructures in the Defense sector. The role emphasizes ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks for efficient data processing and analysis.

You will collaborate with data scientists and analysts to deliver timely data insights, while ensuring data quality, governance, and regulatory compliance across large federal datasets.