AI-Driven Data Engineer: Cloud Pipelines & CI/CD

Guidehouse; Arlington (VA); On-site; USD 89,000 - 148,000; Full time

Benefits offered by this job

Medical, Rx, Dental & Vision Insurance

401(k) Retirement Plan

Paid Holidays

Vacation & Sick Time

Tuition Reimbursement

Employee Assistance Program

Discretionary bonus

Job summary

Guidehouse in Arlington, VA is seeking a Data Engineer with AI experience to design, build, and optimize data pipelines, AI solutions, and analytics platforms. You will work with modern data engineering tools, CI/CD, and version control to deliver scalable data solutions.

Candidates should have 5+ years in data engineering, Java/Python/SQL, experience with Databricks, REST/SOAP APIs, and cloud basics (Azure).

Qualifications

• Bachelor's degree in a related field.
• 5 years of experience in data engineering or related roles.
• Proficient in Java, Python, SQL, and PySpark; API development (RESTful & SOAP).
• Experience with Databricks and CI/CD.
• Experience with relational and NoSQL databases (MySQL, PostgreSQL, SQL Server, MongoDB).
• Experience with CI/CD tools and Git-based workflows.
• Experience in Agile environments.

Responsibilities

• Design, develop, test and maintain data pipelines and ETL processes from diverse sources (SQL, R, Python).
• AI experience with prompt engineering, ML, and RAG concepts
• Build and optimize data architectures to support analytics and reporting.
• Implement CI/CD pipelines for data workflows; use Git.
• Develop and deploy cloud-based solutions (Azure Functions), and containerization (Docker, Kubernetes).
• Collaborate with DBAs and developers to design data models, stored procedures, APIs.
• Ensure data quality with validation, monitoring, logging.
• Handle multiple priorities and production issue resolution.
• Document data flows and solutions for knowledge sharing and compliance.
• Stay current with data engineering, cloud, and DevOps best practices.

Skills

Data pipelines design

CI/CD pipelines

Python

Java

SQL

PySpark

RESTful APIs

SOAP APIs

Git

Kubernetes

Azure

Education

Bachelor's degree

Tools

Databricks

GitHub

Jira

Confluence

Job description

Guidehouse in Arlington, VA is seeking a Data Engineer with AI experience to design, build, and optimize data pipelines, AI solutions, and analytics platforms. You will work with modern data engineering tools, CI/CD, and version control to deliver scalable data solutions.

Candidates should have 5+ years in data engineering, Java/Python/SQL, experience with Databricks, REST/SOAP APIs, and cloud basics (Azure).