About The Role
We are looking for a skilled Data Engineer (Level 2-3) to design, build, and evolve scalable data pipelines that power advanced analytics, reporting, and machine learning initiatives. In this role, you will develop and manage robust ETL/ELT workflows to efficiently ingest, transform, and deliver high-quality data across platforms. You will architect and maintain modern data models, warehouses, and lakehouse environments while championing data governance, security, and compliance. Operating in a dynamic environment, you will partner closely with data scientists, analysts, and engineers to translate complex business needs into reliable, high-performance data solutions.
Note: This position requires working onsite full-time with occasional travel (up to 15% of the time), primarily to Scott AFB in O'Fallon, IL, and/or MacDill AFB in Tampa, FL.
Key Responsibilities
- Pipeline Engineering: Design, build, and automate scalable data pipelines and ETL/ELT workflows to ingest, transform, and deliver data across platforms.
- Architecture & Modeling: Architect and maintain robust data models, data warehouses, and lakehouse environments to support growing analytics and machine learning needs.
- Performance Optimization: Continuously optimize database and query performance, implementing partitioning, indexing, and other scaling strategies for fast, reliable data access.
- Governance & Quality: Ensure data accuracy, consistency, integrity, and compliance through strong governance practices, validation frameworks, and security standards.
- Monitoring & Automation: Proactively monitor, troubleshoot, and strengthen production pipeline reliability while driving automation to reduce manual effort.
- Cross-Functional Collaboration: Partner with data scientists, analysts, and engineers to deliver actionable data solutions aligned with mission objectives.
Required Skills & Qualifications
- Security Clearance: Active DoD Secret clearance (or higher) required.
- Experience: 3+ years of professional experience, including designing, developing, and automating ETL/ELT pipelines.
- Technical Proficiency: Strong programming and querying skills in SQL, Python, and/or Scala.
- Core Knowledge: Familiarity with BI tools, cloud platforms, big data technologies, data modeling, warehousing, and lakehouse architectures (along with data optimization and governance best practices).
- Soft Skills: Excellent problem-solving, communication, and collaboration skills for working effectively across cross-functional teams.
- Work Arrangement: Comfortable working onsite full-time with up to 15% travel, primarily to Scott AFB (O'Fallon, IL) and/or MacDill AFB (Tampa, FL).
Preferred Skills & Experience
- Bachelor’s degree in a related STEM or technical field from an accredited college or university.
- Prior hands-on experience with USTRANSCOM systems, Qlik, the Advana tool suite, Maven Smart System, and/or Databricks.