Data Engineer

Silverthorne Advisory Group LLC; Tampa (FL); On-site; USD 80,000 - 120,000; Full time

Benefits offered by this job

Retirement Plan

401(k)

401(k) matching

Bonus based on performance

Company parties

Competitive salary

Dental insurance

Health insurance

Opportunity for advancement

Paid time off

Training & development

Vision insurance

Flexible work from home options

Job summary

A consulting firm in the Defense sector is seeking a skilled Data Engineer to design and maintain data systems using ETL processes and technologies like Python and Databricks. The role offers a competitive salary, benefits, and opportunities for advancement, while requiring a Secret clearance. Join us in our mission to enhance data-driven decision-making in federal agencies.

Qualifications

• Secret clearance or higher required (can be sponsored).
• High level of proficiency in ETL processes and using Databricks, Python, and SQL.
• Strong problem-solving skills for complex data-related issues.
• Experience with large datasets and big data technologies.
• Understanding of data modeling, database design, and data governance.

Responsibilities

• Design and implement end-to-end data pipelines.
• Optimize data pipelines for scalability and performance.
• Perform data cleansing and integration.
• Leverage big data tech for large datasets.
• Implement data governance policies.
• Collaborate with teams for data insights.

Skills

ETL processes

Databricks

Python

Spark

Scala

JavaScript/JSON

SQL

Jupyter Notebooks

Job description

Overview

Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense sector. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our Advana data infrastructure and systems. Your expertise in ETL, Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks will be essential in ensuring efficient data processing and analysis.

Responsibilities

• Design, develop, and implement end-to-end data pipelines, utilizing ETL processes and technologies such as Databricks, Python, Spark, PySpark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Create and optimize data pipelines from scratch, ensuring scalability, reliability, and high-performance processing.
• Perform data cleansing, data integration, and data quality assurance activities to maintain the accuracy and integrity of large datasets.
• Leverage big data technologies to efficiently process and analyze large datasets, particularly those encountered in a federal agency.
• Troubleshoot data-related problems and provide innovative solutions to address complex data challenges.
• Implement and enforce data governance policies and procedures, ensuring compliance with regulatory requirements and industry best practices.
• Work closely with cross-functional teams to understand data requirements and design optimal data models and architectures.
• Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making processes.
• Maintain documentation for software applications, workflows, and processes.
• Stay updated with emerging trends and advancements in data engineering and recommend suitable tools and technologies for continuous improvement.

Requirements

• Secret clearance or higher required (can be sponsored).
• High level of proficiency in ETL processes and demonstrated, hands-on experience with technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
• Strong problem-solving skills and ability to solve complex data-related issues.
• Demonstrated experience working with large datasets and leveraging big data technologies to process and analyze data efficiently.
• Understanding of data modeling/visualization, database design principles, and data governance practices.
• Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams.
• Detail-oriented mindset with a commitment to delivering high-quality results.

Benefits

• Retirement Plan
• 401(k)
• 401(k) matching
• Bonus based on performance
• Company parties
• Competitive salary
• Dental insurance
• Health insurance
• Opportunity for advancement
• Paid time off
• Training & development
• Vision insurance
• Flexible work from home options available