Data Engineer

ECF Data; Washington (District of Columbia); Remote; USD 100,000 - 130,000; Full time

Job summary

A leading company in data and AI solutions is seeking a Data Engineer to build scalable data pipelines and support data science teams. This role involves designing data warehouses and ensuring data governance while working collaboratively and independently. The position is remote but based out of Washington, DC, with flexible work options available.

Qualifications

• 5+ years of data and analytics engineering experience in cloud environments.
• Experience with data transformation, ETL, and orchestration tools.

Responsibilities

• Build full data pipelines from ingestion to processing, transformation, loading, and analysis.
• Design and manage large-scale data warehouses and lakehouses.
• Create efficient SQL queries and Python data processing jobs.

Skills

SQL

Python

Communication

Data Governance

Education

Advanced degree in Statistics, Mathematics, Data Science, Computer Science

Tools

Airflow

dbt

Terraform

Snowflake

Databricks

Kafka

Spark

Flink

Job description

Join to apply for the Data Engineer role at ECF Data

1 month ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

About Us:

At Data Society, we provide bespoke, leading-edge data and AI solutions for Fortune 1,000 companies and governmental organizations. We partner with our clients to educate, equip, and empower their workforces with the necessary skills to achieve their goals and expand their impact. Our focus is on empowering the future workforce, from data literacy for all employees to supporting data engineers and data scientists in training on complex AI and Machine Learning skills.

Job Summary:

The Data Engineer is responsible for building scalable, performant data pipelines that support operational and analytical applications. The role involves working closely with data science teams to run ML/AI models on enterprise-scale data and to build supporting data scaffolding for orchestration, testing, and monitoring. This customer-facing role requires managing timelines, working autonomously and collaboratively, and effective communication. US Citizenship is required due to federal security contract requirements.

Responsibilities:

1. Build full data pipelines from ingestion to processing, transformation, loading, and analysis.
2. Design and manage large-scale data warehouses, lakehouses, and data marts.
3. Build and optimize data transformation pipelines using tools like dbt.
4. Ensure data governance, lineage, documentation, and metadata standards are maintained.
5. Create efficient SQL queries and Python data processing jobs.
6. Balance computational load, performance, and cost effectively.

Skills Required:

1. Advanced degree in Statistics, Mathematics, Data Science, Computer Science, or related fields.
2. 5+ years of data and analytics engineering experience in cloud environments.
3. Expertise in SQL, Python, schema design, and data governance tools.
4. Experience with data transformation, ETL, and orchestration tools like Airflow, dbt, and cloud deployment tools like Terraform.
5. Excellent communication skills.
6. Ability to work independently and in teams.
7. Experience with Snowflake, Databricks, Kafka, Spark, or Flink is a plus.

Note: This role is remote but based out of Washington, DC, with possible travel to client sites. Flexible work-from-home options are available.