Data Engineer for AI-Powered Pipelines

Guidehouse; Atlanta (GA); On-site; USD 89,000 - 148,000; Full time

Benefits offered by this job

Discretionary bonus

Job summary

Guidehouse seeks a Data Engineer with some AI experience to design, build, test and maintain data pipelines, AI solutions, and analytics platforms. The role requires hands-on experience with modern data engineering tools, AI solutions, CI/CD, and version control, and you will collaborate with cross‑functional teams to deliver high‑quality, scalable data solutions.

Requirements include U.S. Citizenship or Green Card and ability to obtain and maintain a Federal or DHS Public Trust, a bachelor’s

Qualifications

• U.S. Citizenship/ Green Card is required and Must be able to OBTAIN and MAINTAIN a Federal or DHS 'PUBLIC TRUST'.
• A bachelor’s degree is required.
• FIVE (5) years of experience in data engineering, software development, or related roles.
• Experience in programming languages and technologies, including Java, Python, SQL, and PySpark, as well as API development (RESTful and SOAP).
• Experience with Co-Pilot and CodeX.
• Experience designing and developing data pipelines and ETL processes.
• Extensive experience with relational and NoSQL databases, such as MySQL, PostgreSQL, SQL Server, and MongoDB, including stored procedure development.
• Experience working with Databricks.
• Experience with CI/CD tools and pipelines, such as Git and GitHub.
• Experience operating in Agile development environments.

Responsibilities

• Design, develop, test and maintain data pipelines and ETL processes for ingesting, transforming, and loading data from diverse sources (SQL, R, Python).
• AI experience with prompt engineering, machine learning, agentic AI and RAG concepts
• Build and optimize data architectures and models to support analytics, reporting, and operational needs.
• Implement and manage CI/CD pipelines for data engineering workflows using tools such Git.
• Develop and deploy cloud-based solutions leveraging Azure Functions, and containerization (Docker, Kubernetes).
• Collaborate with DBAs and application developers to design and integrate data models, stored procedures, and APIs.
• Ensure data quality and integrity through validation, monitoring, and logging.
• Successfully juggle multiple tasks across different priorities.
• Troubleshoot and resolve issues in production environments, ensuring high availability and reliability.
• Document data flows, processes, and technical solutions for knowledge sharing and compliance.
• Stay current with emerging technologies and best practices in data engineering, cloud, and DevOps.

Skills

Java

Python

SQL

PySpark

API development

Agile methodologies

CI/CD

Education

Bachelor's degree

Tools

Databricks

Git

GitHub

Docker

Kubernetes

Azure Functions

RESTful APIs

SOAP

MySQL

PostgreSQL

SQL Server

MongoDB

Job description

Guidehouse seeks a Data Engineer with some AI experience to design, build, test and maintain data pipelines, AI solutions, and analytics platforms. The role requires hands-on experience with modern data engineering tools, AI solutions, CI/CD, and version control, and you will collaborate with cross‑functional teams to deliver high‑quality, scalable data solutions.

Requirements include U.S. Citizenship or Green Card and ability to obtain and maintain a Federal or DHS Public Trust, a bachelor’s