Senior Data Engineer

Jobtailor; Charlottesville (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

Jobtailor seeks a data engineer to build and operate scalable data platforms on mission-driven projects. You will develop data pipelines, organize structured and unstructured data, and guide cross-functional teams to deliver robust analytics capabilities.

The role requires hands-on experience with Python, SQL, ETL workflows, and cloud data services, plus a DoD clearance or ability to obtain one. You will work in a collaborative environment across analysts, engineers, and data users.

Qualifications

• 3+ years of experience supporting operations and maintenance for secure DoD information management systems
• 3+ years of experience creating software for retrieving, parsing, and processing structured and unstructured data
• 3+ years of experience with Python, SQL, Scala, or Java
• 3+ years of experience building scalable ETL/ELT workflows for reporting and analytics
• Experience using version control tools such as GitLab, GitHub, or Bitbucket
• Ability to obtain DoD 8570 or 8140 IAT Level II Certification within 30 days of hire date
• Experience with Terraform, Kubernetes, or Docker
• Experience with UNIX/Linux systems and scripting (Bash, Ansible, YAML)
• Experience with a public cloud (AWS/Azure/GCP)
• Experience with distributed data tools (Spark, Databricks, Hadoop, Hive, Redshift)
• Experience with NoSQL (MongoDB, Cassandra)
• Experience with data warehousing (Redshift/MySQL/Snowflake)
• Experience with Agile development
• Experience with Atlassian tools
• Bachelor's degree in Data or IT related field

Responsibilities

• Build advanced technology solutions and implement data engineering activities on mission-driven projects
• Deploy and develop pipelines and platforms that organize disparate data
• Guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers
• Perform analytical exploration and data examination
• Manage assessment, design, building, and maintenance of scalable platforms for clients
• Develop scripts to convert various data types into usable formats
• Support project teams in scaling, monitoring, and operating data platforms

Skills

Python

SQL

Scala

Java

ETL / ELT

GitLab/GitHub/Bitbucket

Data exploration

Collaboration

Education

Bachelor's degree in Data or IT

Tools

Terraform

Kubernetes

Docker

UNIX/Linux scripting

AWS Redshift

Databricks/Hadoop/Hive (Big Data tools)

Jira & Confluence (Atlassian)

Job description

• Build advanced technology solutions and implement data engineering activities on mission-driven projects
• Deploy and develop pipelines and platforms that organize disparate data and make it meaningful
• Work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers
• Perform analytical exploration and data examination
• Manage the assessment, design, building, and maintenance of scalable platforms for clients
• Develop scripts and programs to convert various types of data into usable formats
• Support project teams in scaling, monitoring, and operating data platforms

Requirements

• 3+ years of experience supporting operations and maintenance for secure DoW information management systems
• 3+ years of experience creating software for retrieving, parsing, and processing structured and unstructured data
• 3+ years of experience with Python, SQL, Scala, or Java
• 3+ years of experience building scalable ETL / ELT workflows for reporting and analytics
• Experience using version control tools such as GitLab, GitHub, or Bitbucket
• Experience creating solutions within a collaborative and cross-functional team environment
• Ability to develop scripts and programs for converting various types of data into usable formats, and support project team to scale, monitor, and operate data platforms
• TS/SCI clearance required
• HS diploma or GED
• Ability to obtain a DoD 8570 or 8140 IAT Level II Certification within 30 days of hire date
• Experience with Terraform, Kubernetes, or Docker
• Experience with systems administration using UNIX or Linux, including basic commands and scripting such as Bash, Ansible, or YAML
• Experience with a public cloud, including AWS, Microsoft Azure, or Google Cloud
• Experience with distributed data or computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka
• Experience with NoSQL implementation, including MongoDB or Cassandra
• Experience with data warehousing using AWS Redshift, MySQL, or Snowflake
• Experience with Agile development techniques and ceremonies
• Experience with the Atlassian tool suite, including Jira and Confluence
• Bachelor's degree in a Data or IT related field

Core Competencies

Demonstrates expertise in building and maintaining scalable data platforms, utilizing programming languages such as Python and SQL, and implementing ETL workflows for data processing. Proficient in collaborating within cross-functional teams and managing secure information systems with a focus on mission-driven projects.

Highest-signal resume keywords

• Python Programming
• ETL / ELT Workflow Development
• Data Platform Management
• TS/SCI Clearance
• AWS Cloud Experience

Hard Skills

• SQL
• Scala
• Java
• Data Engineering
• Data Analysis
• Scripting
• NoSQL Implementation
• Data Warehousing
• Agile Development
• Version Control

Soft Skills

• Collaboration
• Team Guidance
• Analytical Exploration

Certifications & Qualifications

• DoD 8570 IAT Level II Certification

Industry Keywords

• Data Engineering
• Information Management Systems
• Mission-Driven Projects
• Distributed Data Tools
• Cloud Computing

Tools & Technologies

• GitLab
• GitHub
• Bitbucket
• Terraform
• Kubernetes
• Docker
• UNIX
• Linux
• AWS Redshift
• Atlassian Suite