Senior Data Engineer

Soliel, LLC; Virginia, Northern (MN, KY); Hybrid; USD 110,000 - 120,000; Full time

Job summary

Soliel, LLC is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and data systems supporting analytics, reporting, and operational applications. You will lead data engineering efforts, troubleshoot data and performance issues, and collaborate with architects, developers, DBAs, analysts, and visualization developers.

The role emphasizes reliable, analytics-ready datasets and data products, with strong hands-on skills in SQL, Python/Scala, and cloud-based data

Qualifications

• Bachelor's degree or higher in Engineering, Science, or IT.
• 5+ years of data engineering, database development, or ETL/ELT experience.
• Proficiency in SQL, Python, or Scala for data transformation.
• Experience with relational DB design, indexing, and query optimization.
• Knowledge of data quality, validation, and governance principles.
• Understanding of DoD security and compliance for data handling.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or other data integration tools.
• Develop and optimize relational and cloud databases to support analytics and operations.
• Implement data validation and transformation logic to ensure accuracy and completeness.
• Monitor and tune database performance, including indexing and queries.
• Ensure data lineage, metadata tracking, and documentation for audit purposes.
• Collaborate with architects and developers to align DB and pipeline design with business needs.
• Work with Senior DBAs on security, availability, and backup/recovery strategies.
• Automate pipeline and DB deployment using CI/CD and IaC.

Skills

SQL

Python

Scala

ETL/ELT

Data pipelines

Data governance

DoD security

Databricks

Spark

Education

Bachelor's degree in Engineering/Science/IT

Tools

Azure Data Factory

Synapse

Azure SQL

Databricks

Spark

Job description

Senior Data Engineer

Fort Eustis / Hybrid (3 days per week onsite)

CLEARANCE: Secret or TS

ABOUT US:

Soliel is an innovative, premium engineering company specializing in providing Enterprise Architecture, Network Design, Engineering, and Operations Support, Software Design and Development, Data Center Design, Deployment and Migration, and Systems Engineering services for both public and private sectors.

Our Federal systems integration team manages the complexity inherent with technology change, from requirements planning to architecture, testing to deployment, and beyond. We also offer a complete range of industry-leading services, including architecture, systems development, information assurance, solution and platform integration, and program management, functional, and testing services.

Over the years, Soliel's team of technical experts has consistently delivered outstanding innovative solutions and services that meet or exceed customer expectations and satisfaction.

JOB DESCRIPTION:

We are seeking a Senior Data Engineer to design, develop, and maintain scalable data pipelines, data integration solutions, and data systems supporting analytics, reporting, and operational applications. The role requires strong hands-on technical skills and the ability to lead complex data engineering efforts, troubleshoot data and performance issues, and collaborate with architects, developers, DBAs, analysts, and visualization developers. The Senior Data Engineer will help develop reliable, analytics-ready datasets and data products that support reporting, visualization, and data-driven decision-making.

KEY RESPONSIBILITIES:

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or other data integration tools.
• Develop, optimize, and maintain relational and cloud-based databases (Azure SQL, Synapse, or similar) to support analytics and operational applications.
• Implement data validation, cleansing, and transformation logic to ensure data accuracy, consistency, and completeness.
• Monitor and tune database performance, including query optimization, indexing, and resource allocation.
• Ensure data lineage, metadata tracking, and database documentation for audit and compliance purposes.
• Collaborate with Data Architects and application developers to align database and pipeline design with business requirements.
• Work closely with Senior DBAs to ensure database security, availability, and backup/recovery strategies.
• Automate pipeline and database deployment using CI/CD practices and infrastructure-as-code.
• Troubleshoot and resolve pipeline failures, data inconsistencies, and database performance or integration issues..

REQUIRED SKILLS:

• CompTIA Security+ certification
• Bachelor’s or higher in Engineering, Science, or IT.
• 5+ years of experience in data engineering, database development, or ETL/ELT development required.
• Proficiency in SQL, Python, or Scala for data transformation.
• Experience with relational database design, indexing, partitioning, and query optimization.
• Knowledge of data quality, validation frameworks, and data governance principles.
• Understanding of DoD security and compliance requirements for data handling.
• PREFERRED SKILLS:
• Experience with Databricks, Spark, or big data processing.
• Familiarity with metadata management, data cataloging, or data lineage tools.
• Experience with performance tuning, backup/recovery, and high-availability database architectures.

COMPENSATION:

• Salary: $110,000-120,000 (flexible based on experience)