Remote Data Engineer — ETL, Databricks & Big Data for Defense

Silverthorne Advisory Group; Arlington (VA); Remote; USD 120,000 - 150,000; Full time

Benefits offered by this job

Retirement Plan

401(k)

401(k) matching

Bonus based on performance

Company parties

Competitive salary

Dental insurance

Health insurance

Opportunity for advancement

Paid time off

Training & development

Vision insurance

Job summary

Silverthorne Advisory Group is seeking a skilled Data Engineer to join our defense sector team. You will design, build, and maintain our Advana data infrastructure and ensure robust, scalable pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.

You will collaborate with data scientists and analysts, implement data governance, and stay current with evolving trends in data engineering.

Qualifications

• Secret clearance or higher required (can be sponsored).
• Hands-on experience with Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Experience with large datasets and big data technologies.
• Knowledge of data modeling, governance, and visualization concepts.

Responsibilities

• Design end-to-end data pipelines using ETL and Databricks.
• Create scalable, reliable data pipelines with high performance.
• Perform data cleansing, integration, and quality assurance on large datasets.
• Collaborate with data scientists and analysts to provide insights.
• Maintain documentation for data workflows and processes.
• Stay updated on data engineering trends and tools.
• Implement data governance policies and regulatory compliance.

Skills

ETL processes

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Data governance

Data modeling

Tools

Databricks

Spark

Jupyter Notebooks

Job description

Silverthorne Advisory Group is seeking a skilled Data Engineer to join our defense sector team. You will design, build, and maintain our Advana data infrastructure and ensure robust, scalable pipelines using Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.

You will collaborate with data scientists and analysts, implement data governance, and stay current with evolving trends in data engineering.