Data Engineer - ETL & Databricks for Big Data (Remote)

Silverthorne Advisory Group LLC; Virginia (MN); On-site; USD 80,000 - 120,000; Full time

Benefits offered by this job

Health, Vision, and Dental Plans

401(k) Plan with matching

Generous Paid Time Off

Bonus System

Professional Development Support

Flexible work from home options

Company Retreats & Team Events

Job summary

Silverthorne Advisory Group LLC is looking for a skilled Data Engineer to join their Defense sector team in Virginia, Minnesota. The role requires expertise in ETL, Databricks, Python, and big data technologies to design and maintain data infrastructure. Responsibilities include developing data pipelines, ensuring data quality, and collaborating with cross-functional teams for data insights. The position offers a competitive compensation package, healthcare benefits, and opportunities for professional development.

Qualifications

• Secret clearance or higher required.
• High level of proficiency in ETL processes.
• Strong problem-solving skills for complex data issues.
• Experience with large datasets and big data technologies.
• Understanding of data modeling, database design, and governance practices.

Responsibilities

• Design and implement end-to-end data pipelines using ETL processes.
• Create and optimize data pipelines ensuring scalability and reliability.
• Perform data cleansing and maintain accuracy of large datasets.
• Leverage big data technologies for efficient data processing.
• Troubleshoot data-related problems with innovative solutions.
• Implement data governance policies ensuring compliance.
• Collaborate with teams to understand data requirements.
• Maintain documentation for applications and workflows.

Skills

ETL processes

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Job description

Silverthorne Advisory Group LLC is looking for a skilled Data Engineer to join their Defense sector team in Virginia, Minnesota. The role requires expertise in ETL, Databricks, Python, and big data technologies to design and maintain data infrastructure. Responsibilities include developing data pipelines, ensuring data quality, and collaborating with cross-functional teams for data insights. The position offers a competitive compensation package, healthcare benefits, and opportunities for professional development.