Senior Data Engineer

Ardalyst Defense, LLC; Maryland; Hybrid; USD 130,000 - 180,000; Full time

Benefits offered by this job

Competitive salary commensurate with/

PTO

Holidays

401(k) Retirement Plan

Health, Dental, Vision and Life

Disability insurance

Training and certifications

Job summary

Ardalyst Defense, LLC is seeking a Senior Data Engineer (Databricks) to lead Databricks implementations and help deliver enterprise-scale data and analytics capabilities in hybrid cloud environments. You will support the end-to-end lifecycle of cloud-based data platforms, including design, development, integration, maintenance, and data quality observability.

You will collaborate with leadership to shape solution direction, review roadmaps, and provide technical leadership to the engineering

Qualifications

• Senior Databricks engineer with 5+ years in data technologies and warehousing.
• Active DoD Secret security clearance required.
• Associate degree or equivalent in IT/Networking/Cybersecurity.
• Hybrid cloud data designs with data quality functions implemented.
• 7+ years Python and SQL for data analysis and processing; experience with in-memory tools like Spark/PySpark/Kafka/Scala.

Responsibilities

• Develop and deliver client installation plans with project teams.
• Serve as escalation point for technical issues from clients and engineers.
• Manage client expectations on functionality, deployment, and timelines.
• Provide solution-architecture expertise for hybrid cloud environments.
• Collaborate with Leadership to review Product Roadmaps.
• Identify organizational impact of technical solutions.
• Lead engineering team as needed with technical guidance.
• Travel to customer sites, naval installations, shipyards, and vessels for installation and maintenance.

Skills

Python programming

SQL querying

Data analysis

Communication skills

Interpersonal skills

Problem solving

Education

Associate's degree in IT / Networking / Cybersecurity

Tools

Databricks

R

Spark

PySpark

Kafka

Scala

SQL

Job description

Ardalyst Defense, LLC is seeking a Senior Data Engineer (Databricks) to lead Databricks implementations and help deliver enterprise-scale data and analytics capabilities in hybrid cloud environments. In this role, you will support the end-to-end lifecycle of cloud-based data platforms, including design, development, integration, maintenance, technical guidance, and continuous focus on data quality and observability.

Role context

You will act as a senior technical driver for hybrid cloud data architecture and scalable data processing. The position also includes collaboration with stakeholders and leadership to shape solution direction and ensure deployments align with mission and business objectives.

Location

• Northern Virginia, Maryland, DC (hybrid)

What you will do

• Develop and deliver the client installation plan through coordination with clients and the project team
• Serve as the escalation point for technical issues from clients and other system engineers
• Manage client expectations around solution functionality, deployment processes, and realistic timelines
• Provide subject matter expertise in solution architecture for hybrid cloud environments
• Collaborate with the Leadership Team to review and contribute to Product Roadmaps
• Identify organizational impact of the technical solution architecture
• Provide technical leadership to the engineering team, as necessary
• Travel as required to customer sites, naval installations, shipyards, and vessels in support of installation, maintenance, modernization, and troubleshooting
• Perform other related duties as assigned by supervisors, team leads, or program management

Key requirements

• Senior Databricks engineer with 5 years of experience, including knowledge of databases, data warehousing, data analytics, or related data technologies
• Active DoD Secret Security Clearance required
• Associate’s degree in information technology, Networking, Cybersecurity, or a related field, or an equivalent combination of education, military training, and relevant experience
• Hybrid cloud data and infrastructure design experience, including implementation of typical data quality functions such as standardization, transformation, rationalization, linking, and matching
• Seven (7) years experience in Python and SQL for data analysis, data processing, or problem-solving, including experience with in-memory computing using R, Python, Spark, PySpark, Kafka, and Scala
• Seven (7) years experience identifying data source telemetry and routing it for operational observability
• Excellent written and oral communication skills and strong interpersonal skills

Technologies

• Databricks
• Python
• SQL
• R
• Spark
• PySpark
• Kafka
• Scala

About Ardalyst Defense, LLC

Ardalyst Defense, LLC is a Maryland Service-Disabled Veteran-Owned Small Business (SDVOSB) providing engineering services and technical, analytical, and cyberspace operations services to integrated U.S. government agency operations. Ardalyst personnel have decades of direct operations experience in full-scope Cyberspace Operations at the Service, Joint, and National Agency levels.

Benefits

• Competitive salary commensurate with experience
• Paid Time Off (PTO)
• Paid Holidays
• 401(k) Retirement Plan
• Health, Dental, Vision and Life insurance
• Short Term and Long-Term Disability insurance
• Monetary assistance with training and certifications

Training and professional growth

• Opportunities for training, certification development, and continued learning