Data Engineer, Senior

Precision Solutions; Huntsville (AL); Sur place; USD 120 000 - 180 000; Plein temps

Résumé du poste

Precision Solutions is seeking a Senior Data Engineer to join our on-site team in Huntsville, AL. A Top Secret clearance is required to work on mission-critical data platforms and analytics projects.

You will design and implement scalable data pipelines and data platforms, guiding a multidisciplinary team and collaborating with analysts, developers, and data consumers in an agile setting to extract actionable insights from diverse data sources.

Qualifications

• 5+ years designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems
• 5+ years building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows
• 5+ years of coding in SQL, Python, Scala, Spark, or Java
• Experience tuning data lake architecture to optimize cloud storage and pipeline performance
• Experience with data management solutions that address data catalog, governance, and lifecycle
• Top Secret clearance
• Bachelor’s degree and 8+ years of experience designing, developing, operationalizing, and maintaining data systems, or 12+ years in lieu of a degree

Responsabilités

• Design and implement scalable data pipelines and platforms across multiple clients
• Collaborate with analysts, developers, and data consumers in a fast-paced, agile environment
• Guide data engineering activities and ensure data quality, governance, and lifecycle management

Connaissances

Data modeling

ETL pipeline design

SQL

Python

Spark

Java

RESTful API design

Cloud data platforms

Formation

Bachelor’s degree

Outils

AWS EMR

Azure Data Factory

Snowflake

BigQuery

Apache NiFi

Databricks

Description du poste

Overview

Data Engineer, Senior

Onsite | Huntsville, AL

Top Secret clearance required

Summary

Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield pivotal insights when it’s gathered from disparate sources. We need an experienced data engineer like you to help our clients find answers in their data to impact important missions from fraud detection to cancer research, to national intelligence.

As a Data Engineer, you’ll help build advanced technology solutions and implement data engineering activities on some of the most mission-driven projects in the industry. You’ll deploy and develop pipelines and platforms that organize and make disparate data meaningful. Here, you’ll work with and guide a multi-disciplinary team of analysts, data engineers, developers, and data consumers in a fast-paced, agile environment. You’ll use your experience in analytical exploration and data examination while you manage the assessment, design, building, and maintenance of scalable platforms for your clients.

Requirements

• 5+ years of experience designing data warehouse or data lake, RESTful API models, event processing, or business intelligence for software systems

• 5+ years of experience building scalable ETL or ELT data pipelines, automating large-scale batch and streaming data workflows, and parsing structured, unstructured, or event-streaming data

• 5+ years of experience with coding in software programming languages, including SQL, Python, Scala, Spark, or Java

• Experience performing tuning on data lake architecture to optimize cloud storage and pipeline performance

• Experience with data management solutions that address aspects of data catalog, data usage, governance policies, and lifecycle management

• Top Secret clearance

• Bachelor’s degree and 8+ years of experience designing, developing, operationalizing, and maintaining data systems, or 12+ years of experience designing, developing, operationalizing, and maintaining data systems in lieu of a degree

Preferred Requirements

• 3+ years of experience architecting and designing large-scale enterprise data and analytics systems

• 3+ years of experience using and developing data systems with AWS and Microsoft Azure cloud data products such as AWS EMR, AWS Glue, Azure Dataverse, Azure Data Factory, and Power Apps

• Experience with distributed data or computing tools, including Apache Spark, Apache NiFi, AirFlow, Databricks, Snowflake, Redshift, or BigQuery

• Experience with federal information system policies, including NIST 800.53 and FISMA, data security, access controls, and data protection techniques

• Experience creating and improving continuous automation across multiple technical stacks, and automating CD/CD pipelines with tools such as Jenkins or GitHub

• Experience with NoSQL database such as Elasticsearch, Solr, MongoDB, or Cosmo DB

• Experience with AI or ML pipelines and processes

• TS/SCI clearance with a polygraph

• Master’s degree

Education/Certification Requirements

• Bachelor’s degree

Clearance Requirements

• Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; an active Top Secret clearance required

About Us

Northern Virginia-based Precision Solutions is an expert in staffing solutions for companies of any size that open the door to new opportunities and seek outstanding talent. We pride ourselves on being versatile enough to tailor our relationships to the needs of each individual client, being agile in the fast-paced marketplace, and being precise in meeting the needs of any company.