Data Engineer - DoD Analytics & Big Data Pipelines

Systems Planning & Analysis; Huntsville (AL); On-site; USD 76,000 - 152,000; Full time

Benefits offered by this job

Competitive base pay

Industry-leading 401k contribution

Health insurance

Job summary

Intrepid, an SPA Company, seeks a Data Engineer to support Army Material Command with data management and analytics. You will build and maintain data pipelines, develop dashboards, and enable continuous audit readiness for federal clients.

Work with Databricks, Power BI, and the Microsoft Power Platform to modernize legacy environments and automate processes. A Secret DoD clearance is required, and the role offers a competitive compensation package.

Qualifications

• Bachelor’s Degree or 5+ years experience in Accounting, Finance, IT, Logistics or Business Management.
• Strong core technological skills in Python, SQL, Dataverse, Power Apps, Power Automate, Databricks and PowerBI.
• Experience with data analytics, automation and AI tools.
• Experience with ETL pipelines and big data processing.
• Experience refactoring legacy code and optimizing it.

Responsibilities

• Create ad hoc Python/SQL scripts for data ingestion or transformation.
• Manage pipelines in a large Databricks AWS Data Lake (S3, Glue, S3).
• Restructure data and connect it for PowerBI dashboards.
• Provide documentation for products created.
• Analyze processes to identify gaps and modernization needs.
• Support integration of analytics and automation tools (Power BI, Qlik, Power Apps, Databricks).
• Design and develop solutions in Power Platform and Dynamics 365.
• Troubleshoot issues in development and production environments.

Skills

Data analytics

Communication

Synthesis of complex information

Education

Bachelor’s Degree or 5+ years experience in related fields

Tools

Python

SQL

Dataverse (CDS)

Power Apps

Power Automate

Databricks

Power BI

Job description

Overview

Intrepid, an SPA Company, brings more than 20 years of experience supporting the Department of Defense and U.S. Government, consistently setting the standard for excellence in the federal marketplace. Committed to advancing the mission of the U.S. Warfighter, Intrepid leverages technological superiority to deliver innovative solutions across air, space, land, and sea domains. We are proud to foster a collaborative, dynamic work environment, offering competitive compensation and an industry-leading 401k contribution. Our team is built through merit and achievement, and we’re always looking for the best and brightest to join us in our growth. We treat our people like family, we are mission-focused, and we give back! Join us today.

Overview

Intrepid, an SPA Company, brings more than 20 years of experience supporting the Department of Defense and U.S. Government, consistently setting the standard for excellence in the federal marketplace. Committed to advancing the mission of the U.S. Warfighter, Intrepid leverages technological superiority to deliver innovative solutions across air, space, land, and sea domains. We are proud to foster a collaborative, dynamic work environment, offering competitive compensation and an industry-leading 401k contribution. Our team is built through merit and achievement, and we’re always looking for the best and brightest to join us in our growth. We treat our people like family, we are mission-focused, and we give back! Join us today.

We are looking for a Data Engineer to join our team to support the Army Material Command. This position will be r esponsible for working with clients to strengthen their financial management processes, operations and systems, with a focus on maximizing the impact of the organization’s resources. Additionally, this position will provide data management, analysis, and visualization capabilities with the accounting and financial processes, creating continuous audit readiness as well as provide advisory and support on asset visibility and accountability, asset resolution, and disposition.

Responsibilities

Seeking an experienced Data Engineer to join our practice with a dedicated focus on military clients in the Defense & Security segment. This individual will have a big data architecture background, responsible for writing new python scripts, running existing code/jobs, editing complex inter-related python scripts, running Glue jobs (and other pipelines), implementing star-schema data models for PowerBI, designing Power Automate workflows, and other responsibilities with managing a Data Lake. The Data Engineer will collaborate with cross-functional teams to modernize legacy environments, and support advanced automations and analytics initiatives for our federal client.

Responsibilities Include

• Create ad hoc python script/SQL code or edit existing scripts for data ingestion or transformation.
• Manage pipelines in a large Databricks AWS Data Lake (via Databricks: S3 > Glue > S3 via SQL and Python).
• Restructure source data (implement a data model) and connection for PowerBI dashboards.
• Provide documentation or work with another team member to create documentation for products created.
• Analyze existing technical processes and systems to identify gaps, recommend improvements, and support modernization initiatives. Gaps include AWS environment size and scoping, opportunities for ML models, NLP models, connections to source data rather than uploaded data, PowerAutomate workflows, in-built QA flags, etc.
• Support integration of advanced analytics and automation tools, leveraging platforms such as Power BI, Qlik, Power Apps, and Databricks to improve reporting and decision-making.
• Design, configure, and develop custom solutions in Microsoft Power Platform using Power Apps, Power Automations, and Microsoft Dynamics 365.
• Troubleshoot and resolve issues in development and production environments to maintain stable and reliable data pipelines.
  
  

Qualifications

Required Qualifications:

• Bachelor’s Degree or minimum 5 years or more of experience in Accounting, Finance, Information Technology, Logistics or Business Management.
• Strong Core Technological Skills in: Python, SQL, Microsoft Dataverse (CDS), Power Apps, Power Automate, Databricks, and PowerBI.
• Experience with data analytics, automation, and AI tools.
• Experience with ETL pipelines, integration of data sources, and big data processing.
• Experience refactoring and optimizing legacy code.
• Strong communication and ability to synthesize complex information and deliver high-impact solutions in fast-paced environments.
• An active Secret DoD security clearance and the ability to maintain it throughout employment.
  
  

Desired Qualifications

• Experience with Army financial systems, such as ADVANA, GFEBS, and LMP.
• Prior experience supporting federal audit readiness or CFO functions within DoW or similar agencies.
• Experience in data visualization tools (e.g., Power BI, Qlik), familiarity with data platforms (e.g., Databricks), and cloud platforms (e.g., AWS, Azure).
  
  

Pay Range Information

At SPA, we strive to deliver a robust total compensation package that will attract and retain top talent. Elements of the compensation package include competitive base pay and variable compensation opportunities. SPA provides eligible employees with an opportunity to enroll in a variety of benefit programs, generally including health insurance, flexible spending accounts, health savings accounts, retirement savings plans, life and disability insurance programs, and a number of programs that provide for both paid and unpaid time away from work. The specific programs and options available to any given employee may vary depending on eligibility factors such as geographic location, date of hire, etc. Please note that the salary information shown below is a general guideline only. Salaries are commensurate with experience and qualifications, as well as market and business considerations. , Pay Transparency Salary range: USD $76,225.43/Yr. - USD $151,649.84/Yr.