Data Engineer - Arlington, VA

The SOFEI Group; Arlington (VA); On-site; USD 110,000 - 160,000; Full time

Job summary

The SOFEI Group is seeking a Data Engineer to join a team building dependable, scalable data solutions in Arlington, Virginia. The role focuses on designing modern data pipelines and improving data platform reliability to support analytics and operations.

We value strong engineering depth, cloud experience, and the ability to work with cross-functional partners to deliver high-quality data products.

Qualifications

• 7+ years of experience in data engineering or a closely related technical discipline.
• Proven track record building large-scale, production-grade data pipelines.
• Strong programming skills in Python and SQL.
• Experience with cloud-based data ecosystems and distributed processing.
• Hands-on with Databricks in cloud environments and pipeline development.
• Knowledge of big data technologies (Spark, Kafka, Hadoop) and modern formats (Parquet, Delta Lake, Iceberg).
• Experience with cloud services (Azure, Google Cloud) and analytic databases.
• Solid understanding of data modeling and secure data architecture.
• Ability to collaborate in Agile teams and communicate with both technical and business partners.

Responsibilities

• Design, build, and maintain scalable data pipelines and processing workflows.
• Develop reusable data platforms and automation to improve efficiency and reliability.
• Produce maintainable code for data integration, transformation, and services.
• Establish automated validation and testing to monitor data quality.
• Collaborate with architects, product leaders, data scientists, and DevOps teams.
• Assess new data sources, determine value and fit, and implement ingestion approaches.
• Deploy data management capabilities within enterprise environments while meeting requirements.
• Strengthen data protection and recovery planning, including backups.
• Build and support data storage solutions for reporting and analytics.

Skills

Python

SQL

Airflow

dbt

Databricks

Apache Spark

Kafka

Hadoop

Delta Lake

Iceberg

Azure

Google Cloud

Data Modeling

Secure Data Architecture

Agile

Tools

Databricks

Airflow

dbt

Job description

We are looking for a Data Engineer to join a team building dependable, scalable data solutions in Arlington, Virginia. This role focuses on designing modern data pipelines, improving the reliability of data platforms, and supporting analytics and operational needs across the business. The ideal candidate brings strong engineering depth, experience with cloud-based data ecosystems, and the ability to work closely with cross-functional partners to deliver high-quality data products.

Responsibilities:

• Design, build, and maintain scalable data pipelines and processing workflows that support reliable access to business-critical data.
• Develop reusable data platforms and automation solutions that improve the efficiency, consistency, and performance of data operations.
• Produce clear, maintainable, and well-documented code for data integration, transformation, and platform services.
• Establish automated validation and testing practices to monitor accuracy, completeness, and overall data quality.
• Partner with architects, product leaders, data scientists, and DevOps teams to deliver resilient data systems aligned with technical and business goals.
• Assess new data sources, determine their value and fit, and implement effective ingestion approaches.
• Deploy and integrate data management capabilities within enterprise or client environments while meeting operational requirements.
• Strengthen data protection and continuity by identifying risks, supporting backup strategies, and contributing to recovery planning.
• Build and support data storage solutions such as warehouses, lakes, and operational repositories for reporting and advanced analytics.
• At least 7 years of experience in data engineering or a closely related technical discipline.
• Demonstrated success building large-scale, production-ready data pipelines and data processing solutions.
• Strong programming skills in Python and solid experience with SQL and workflow orchestration tools such as Airflow and dbt.
• Hands-on experience with Databricks in a cloud environment, including pipeline development, distributed processing, and performance tuning.
• Practical knowledge of big data technologies such as Apache Spark, Kafka, and Hadoop, along with modern data formats including Parquet, Delta Lake, or Iceberg.
• Experience working with cloud data services and platforms such as object storage, managed ETL tools, analytical databases, or comparable Azure and Google Cloud offerings.
• Solid understanding of data modeling, secure data architecture, and optimization techniques for high-performing data stores.
• Ability to collaborate effectively in Agile teams and communicate clearly with both technical stakeholders and business partners.