Sr. Data Engineer

Centurion Consulting Group; Huntsville (AL); On-site; USD 120,000 - 170,000; Full time

Job summary

Centurion Consulting Group seeks a Senior Data Engineer to join on-site in Huntsville, AL, supporting mission-driven projects requiring a Top Secret clearance. You will design and operate data warehouses or lakes, build scalable ETL/ELT pipelines, and work across data from diverse sources.

You’ll collaborate with analysts, developers, and data consumers to implement data platforms that enable insights for fraud detection, research, and national intelligence efforts.

Qualifications

• 5+ years designing data warehouse or data lake, RESTful API models, event processing, or BI for software systems
• 5+ years building scalable ETL/ELT pipelines and processing large-scale data
• 5+ years coding in SQL, Python, Scala, Spark, or Java
• Experience tuning data lake architecture to optimize cloud storage and pipelines
• Experience with data catalog, governance policies, and lifecycle management
• Top Secret clearance
• Bachelor's degree and 8+ years of experience or 12+ years without a degree

Responsibilities

• Build and deploy data pipelines and platforms that organize disparate data sources
• Guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers
• Assess, design, build, and maintain scalable data systems for mission-driven projects
• Work in a fast-paced, agile environment to drive data solutions

Skills

Data warehousing

ETL/ELT pipelines

SQL

Python

Scala

Spark

Java

Top Secret clearance

RESTful APIs

Education

Bachelor's degree

12+ years experience without degree

Tools

AWS

Azure

Apache Spark

Apache NiFi

AirFlow

Databricks

Snowflake

Redshift

BigQuery

AWS EMR

AWS Glue

Azure Data Factory

Job description

Job Description

Centurion is looking for an on site Sr Data Engineer with a Top Secret in Huntsville, AL.

Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it's gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their data to impact important missions from fraud detection to cancer research, to national intelligence.

As a Data Engineer, you'll help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. You'll deploy and develop pipelines and platforms that organize and make disparate data meaningful.

Here, you'll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You'll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients.

Qualifications

• 5+ years of experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems
• 5+ years of experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data
• 5+ years of experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java
• Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance
• Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management
• Top Secret clearance
• Bachelor's degree and 8+ years of experience designing, developing, operationalizing, and maintaining data systems, or 12+ years of experience designing, developing, operationalizing, and maintaining data systems in lieu of a degree

Nice to Have Skills

• 3+ years of experience architecting and designing large-scale enterprise data and analytics systems
• 3+ years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps
• Experience with distributed data or computing tools, including Apache Spark, Apache NiFi, AirFlow, Databricks, Snowflake, Redshift, or BigQuery
• Experience with federal information system policies, including NIST 800.53 and FISMA, data security, access controls, and data protection techniques
• Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub
• Experience with NoSQL database such as Elasticsearch, Solr, MongoDB, or Cosmo DB
• Experience with AI or ML pipelines and processes
• TS/SCI clearance with a polygraph
• Master's degree