Senior Analytics Data Engineer — Cloud Pipelines & AI

Corner Alliance; Washington (District of Columbia); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

401k matching

PTO

Health benefits

Job summary

Corner Alliance is seeking an Analytics Data Engineer with 6+ years of experience to support a Federal government client. You will design and implement data pipelines, work with a data solutions architect, and build a Lakehouse using Databricks and cloud tooling.

Responsibilities include developing scalable ETL pipelines, modeling data, enabling CI/CD, and refreshing dashboards for program financials and risk management.

Qualifications

• 6+ years of experience in a data engineer or related role.
• Bachelor's degree or higher in a related field (e.g., CS, engineering, analytics).
• Experience designing and building scalable ETL data pipelines from diverse sources.
• Proficiency in Python, PySpark, and SQL for data manipulation and cleaning.
• Experience with automation scripts, data storage systems, and CI/CD.
• Experience with cloud platforms (Azure, AWS, or GCP) and data lakehouse environments.
• US citizenship and ability to pass public trust clearance.

Responsibilities

• Establish data platform strategy with data solutions architect.
• Design, develop, implement, and test data pipelines.
• Collaborate to enforce data development lifecycle for consistency.
• Model data, map lineage, and apply business rules for operational needs.
• Build end-to-end pipelines and integrate CI/CD in Databricks.
• Establish an authoritative Lakehouse for post-award reporting.
• Refresh dashboards on program financials, risk, and engagement.
• Leverage AI/LLMs to analyze unstructured data and support decision making.
• Identify automation opportunities with stakeholders.

Skills

Python

PySpark

SQL

ETL design

Data pipelines

Cloud platforms

Databricks

US citizenship

CI/CD

Education

Bachelor's degree

Tools

Databricks

Job description

Corner Alliance is seeking an Analytics Data Engineer with 6+ years of experience to support a Federal government client. You will design and implement data pipelines, work with a data solutions architect, and build a Lakehouse using Databricks and cloud tooling.

Responsibilities include developing scalable ETL pipelines, modeling data, enabling CI/CD, and refreshing dashboards for program financials and risk management.