Data Engineer | AI-Driven Pipelines & Cloud

Guidehouse; Atlanta (GA); On-site; USD 89,000 - 148,000; Full time

Benefits offered by this job

Medical Insurance

401(k) Plan

Tuition Reimbursement

Employee Assistance Program

Paid Holidays

Job summary

Guidehouse seeks a Data Engineer with AI experience to design, build, and optimize data pipelines and analytics platforms. You will work with SQL, R, Python, and modern data tools, contributing to scalable data solutions and AI-enabled analytics.

The role requires hands-on experience with CI/CD, Git, Databricks, Docker, Kubernetes, and Azure Functions, plus collaboration across teams to deliver high-quality data products.

Qualifications

• Five years of experience in data engineering, software development, or related roles.
• Experience in Java, Python, SQL, and PySpark, plus API development (RESTful and SOAP).
• Extensive experience with relational and NoSQL databases (MySQL, PostgreSQL, SQL Server, MongoDB) including stored procedures.
• Experience with Databricks, CI/CD tools, and Git/GitHub.
• Experience operating in Agile development environments.

Responsibilities

• Design, develop, test and maintain data pipelines and ETL processes for ingesting, transforming, and loading data from diverse sources (SQL, R, Python).
• AI experience with prompt engineering, machine learning, agentic AI and RAG concepts.
• Build and optimize data architectures and models to support analytics, reporting, and operational needs.
• Implement and manage CI/CD pipelines for data engineering workflows using tools like Git.
• Develop and deploy cloud-based solutions leveraging Azure Functions, and containerization (Docker, Kubernetes).
• Collaborate with DBAs and application developers to design and integrate data models, stored procedures, and APIs.
• Ensure data quality and integrity through validation, monitoring, and logging.
• Troubleshoot and resolve issues in production environments, ensuring high availability and reliability.
• Document data flows, processes, and technical solutions for knowledge sharing and compliance.
• Stay current with emerging technologies and best practices in data engineering, cloud, and DevOps.

Skills

Java

Python

SQL

PySpark

RESTful APIs

SOAP APIs

Git

GitHub

Databricks

CI/CD

Docker

Kubernetes

Azure Functions

Education

Bachelor's degree

Tools

Databricks

Git

GitHub

Azure Functions

Docker

Kubernetes

Job description

Guidehouse seeks a Data Engineer with AI experience to design, build, and optimize data pipelines and analytics platforms. You will work with SQL, R, Python, and modern data tools, contributing to scalable data solutions and AI-enabled analytics.

The role requires hands-on experience with CI/CD, Git, Databricks, Docker, Kubernetes, and Azure Functions, plus collaboration across teams to deliver high-quality data products.