Data Engineer: AI/ML Data Pipelines & Lakehouse

DataJobs; Washington (District of Columbia); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

401k plan with employer contribution

Paid holidays

Vacation

Tuition reimbursement

Job summary

Black Canyon Consulting is seeking a Data Engineer to design, build, and operate data pipelines powering AI/ML and analytics. This onsite role in Washington, DC focuses on reliable, scalable infrastructure from ingestion to deployment to support downstream applications.

You will implement ETL/ELT workloads, integrate data platforms, ensure data quality, and collaborate with data scientists and engineers to meet data requirements throughout the project lifecycle.

Qualifications

• Design, build, and maintain scalable data pipelines for analytics and AI/ML workloads.
• Implement and optimize ETL and ELT workflows.
• Integrate databases, data lakes, data warehouses, or similar platforms.
• Ensure data reliability, accessibility, quality, and readiness for analysis and ML.

Responsibilities

• Design, implement, and maintain scalable data pipelines for analytical and AI/ML workloads.
• Build, monitor, troubleshoot, and optimize ETL and ELT data pipelines.
• Create workflows to ingest, transform, process, and deliver data.
• Configure and integrate databases, data lakes, data warehouses, feature stores, and related data platforms.
• Develop and maintain data transformation and feature engineering processes.
• Maintain data reliability, accessibility, quality, and operational readiness.
• Develop APIs and service layers that expose data to downstream applications and systems.
• Collaborate with data scientists, software engineers, analysts, and other technical teams to meet data requirements.
• Monitor pipeline performance and resolve data processing or integration issues.
• Implement processes to validate data accuracy, completeness, and consistency.
• Support deployment and operation of data infrastructure across the system lifecycle.
• Identify improvements to scalability, performance, maintainability, and efficiency.
• Document data pipelines, integrations, transformations, and technical processes.

Skills

Data pipelines

ETL/ELT

Databases

APIs

Data reliability

Monitoring pipelines

Data modeling

Programming

Collaboration

Tools

Data lakes

Data warehouses

Feature stores

Job description

Black Canyon Consulting is seeking a Data Engineer to design, build, and operate data pipelines powering AI/ML and analytics. This onsite role in Washington, DC focuses on reliable, scalable infrastructure from ingestion to deployment to support downstream applications.

You will implement ETL/ELT workloads, integrate data platforms, ensure data quality, and collaborate with data scientists and engineers to meet data requirements throughout the project lifecycle.