AI-Driven Data Engineer – Pipelines, Azure & AI

Guidehouse; Houston (TX); On-site; USD 89,000 - 136,000; Full time

Benefits offered by this job

Medical insurance

Parental leave

401(k) Retirement Plan

Employee assistance program

Tuition reimbursement

Job summary

Guidehouse seeks a Data Engineer with AI experience to design, build, and maintain data pipelines and analytics platforms in a fast-paced environment. You will work with SQL, Python, Java, and PySpark to ingest, transform, and load data from diverse sources, while implementing CI/CD and cloud-based solutions using Azure Functions, Docker, and Kubernetes.

The role requires 5 years of data engineering or related experience, a Bachelor's degree, and the ability to obtain a federal public trust.

Qualifications

• Bachelor's degree in a related field.
• 5 years of experience in data engineering, software development, or related roles.
• Proficiency in Java, Python, SQL, and PySpark.
• Experience with API development (RESTful and SOAP).
• Experience with Databricks, CI/CD, and version control (Git).

Responsibilities

• Design, develop, test and maintain data pipelines and ETL processes.
• Build and optimize data architectures to support analytics and reporting.
• Implement CI/CD pipelines for data workflows using Git-based tools.
• Develop cloud-based solutions using Azure Functions, Docker, and Kubernetes.
• Collaborate with DBAs and developers to design data models and APIs.
• Ensure data quality, monitor pipelines, and troubleshoot production issues.
• Document data flows and technical solutions for knowledge sharing.

Skills

Java

Python

SQL

PySpark

API development (REST/SOAP)

AI/ML concepts

CI/CD

Version control (Git)

Agile development

Data pipelines

Education

Bachelor's degree

Tools

Databricks

Docker

Kubernetes

Git

GitHub

Jira

Confluence

Spring Boot

Tableau

Kibana

Job description

Guidehouse seeks a Data Engineer with AI experience to design, build, and maintain data pipelines and analytics platforms in a fast-paced environment. You will work with SQL, Python, Java, and PySpark to ingest, transform, and load data from diverse sources, while implementing CI/CD and cloud-based solutions using Azure Functions, Docker, and Kubernetes.

The role requires 5 years of data engineering or related experience, a Bachelor's degree, and the ability to obtain a federal public trust.