Senior Data Engineer

Maverick Associates; Columbia (MD); Hybrid; USD 133,000 - 238,000; Full time

Job summary

Maverick Associates in Columbia, MD is seeking a Senior Data Engineer to lead ingestion into a big data environment. The role emphasizes cyberanalytic missions, data integrity, and leadership across the department in a hybrid work setting.

The candidate should have DoD/IC experience, strong data pipeline and testing capabilities, and the ability to mentor a team in a fast-paced environment.

Qualifications

• Active TS/SCI clearance required or eligible.
• Minimum 14 years in software/data engineering or related fields.
• Experience with unit and integration testing.
• Proficiency with data extraction, transformation, and loading for analytics.

Responsibilities

• Work with big data systems and complex structured and unstructured data sets.
• Support government data acquisition, analysis, and sharing efforts.
• Develop software infrastructure for big data scaled ingestion and data source integration.
• Lead the department to achieve strategic goals and maintain data integrity.

Skills

Cyber security ops

Agile environments

Communication skills

Leadership

Education

BS degree substitution with 14+ years experience

Tools

Kafka

NiFi

AWS S3

SQS

Maven

GitLab

JSON

XML

YAML

VSCode/IntelliJ

Bash/Linux

Job description

Senior SC Data Engineer --Columbia, MD (Hybrid)

Columbia, MD, US Senior Full-time ID: 90002

Estimated Salary: The estimated salary range for this position is between $133,000 and $238,000 DOE

About our client:

Our client delivers high-quality solutions and services to IC, DoD, Federal, and commercial customers. Their security, software, and systems engineers and architects work at the forefront of national challenges, solving some of the most complex problems in cyber analytics and data science.

Our Client's Values

Professionalism and a mission-centric mindset are core to how they operate, shaping both their work and the way they conduct themselves.

They take pride in fostering a culture of learning, growth, and excellence --- for their employees, their partners, and the customers they serve.

Description

We are seeking a talented Data Engineer to support our client's ingestion of mission-critical and mission-support data sets into a big data environment. The ideal candidate will have a background in supporting cyber and/or network-related missions within military spaces, as either a developer, analyst, or engineer. Additionally, this role includes responsibilities for leading the department, requiring advanced expertise and leadership capabilities.

Requirements

?++Essential Job Responsibilities++

• Work with big data systems and complex structured and unstructured data sets.
• Support government data acquisition, analysis, and sharing efforts.
• Focus on software infrastructure for big data scaled ingestion, including understanding and ingesting new data sources, modifying existing data sources, implementing testing, establishing monitoring, and troubleshooting.
• Lead the department in achieving strategic goals, ensuring data integrity, and fostering a collaborative and innovative work environment.

++Minimum Qualifications++

• Security Clearance-Current active TS/SCI eligible
• At least 14 years of experience in one of the following: Software development/engineering, data engineering, database engineering, etc. ( 4 additional years relevant experience can substitute for a BS degree)
• Experience with Unit and Integration testing.
• Fluency with data extraction, custom translation development, and loading including data prep and labelling to enable data analytics.
• Familiarity with various log formats such as JSON, XML, and others.
• Experience with data flow, management, and storage solutions (i.e. Kafka, NiFi, and AWS S3 and SQS solutions)
• Ability to decompose technical problems and troubleshoot both system and dataflow issues.
• Must be certified DoD IAT II or higher
• Willingness to do a programming challenge during the interview process.
• Experience with Zoom/Teams/Meet style team meetings

++Languages:++

• Java: Experience with Java, including unit and integration testing.
• Python: Experience with Python is desired.
• SQL: Familiarity with SQL schemas and statements.

++Tools and Technologies:++

• Data Flow Solutions: Experience with Kafka, NiFi, AWS S3, and SQS.
• Version Control and Build Tools: Proficiency with Maven and GitLab.
• Data Formats: Familiarity with JSON, XML, SQL, and compressed file formats.
• Configuration Files: Experience using YAML files for data model and schema configuration.
• Apache NiFi: Significant experience with NiFi administration and building/troubleshooting data flows.
• AWS S3: bucket administration.
• IDE: VSCode, IntelliJ / PyCharm, or other suitable

++Technical Expertise++:

• ETL creation and processing expertise.
• Experience with code debugging concepts
• Expertise in data modelling design, troubleshooting, and analysis from ingest to visualization.
• Conducted data model reviews covering data meaning, needs, storage, creation, ingest, and processing.
• Developed custom logic for data modification from various sources.
• Database and Software Admin & Troubleshooting: Experience with databases, ODBC drivers
• Linux OS (BASH), and basic server administration.
• Expert in data model analysis and troubleshooting issues.
• Analyzed and solved complex technical problems.

++Desired Skills:++

• Prior experience in cyber/network security operations
• Familiarity with Agile environments.
• Good communication skills.
• Developed documentation and training in areas of expertise.
• Amazon S3, SQS/SNS Admin experience
• Apache Airflow Workloads via UI or CLI a plus
• Experience with Mage AI a plus
• Kubernetes, Docker