Data Engineer - AI & Cloud Data Pipelines

Dovel Technologies, Inc; Atlanta (GA); On-site; USD 89,000 - 148,000; Full time

Benefits offered by this job

Medical, dental & vision insurance

401(k) retirement plan

Paid holidays & sick time

Parental leave

Professional development

Job summary

Guidehouse is seeking a Data Engineer with AI experience to build and optimize data pipelines, AI solutions, and analytics platforms using SQL, Python, and PySpark. You will implement CI/CD, version control, and cloud deployments with Docker, Kubernetes, and Azure Functions, collaborating with DBAs and developers to deliver scalable data solutions.

U.S. Citizenship/Green Card is required and you must obtain Public Trust; a bachelor’s degree and 5 years in data engineering or related roles are

Qualifications

• U.S. Citizenship/Green Card is required and must be able to obtain and maintain a Federal or DHS Public Trust.
• A bachelor’s degree is required.
• Five (5) years of experience in data engineering, software development, or related roles.
• Experience with Java, Python, SQL, and PySpark, and API development (RESTful and SOAP).
• Experience with Co-Pilot and CodeX and data pipelines/ETL.
• Extensive experience with relational and NoSQL databases (MySQL, PostgreSQL, SQL Server, MongoDB) and stored procedures.
• Experience with Databricks, CI/CD tools, and Git/GitHub; Agile environment.

Responsibilities

• Design, develop, test and maintain data pipelines and ETL for diverse sources (SQL, R, Python).
• AI experience with prompt engineering, ML, agentic AI, and RAG concepts.
• Build and optimize data architectures to support analytics, reporting, and operations.
• Implement and manage CI/CD pipelines for data workflows using Git.
• Develop and deploy cloud-based solutions leveraging Azure Functions, Docker, and Kubernetes.
• Collaborate with DBAs and developers to design data models, stored procedures, and APIs.
• Ensure data quality and integrity through validation, monitoring, and logging.
• Troubleshoot production issues and ensure high availability.
• Document data flows and solutions for knowledge sharing and compliance.
• Stay current with emerging data engineering, cloud, and DevOps practices.

Skills

Data pipelines

ETL processes

SQL

Python

PySpark

CI/CD

Agile

Education

Bachelor's degree

Tools

Git

GitHub

Docker

Kubernetes

Azure Functions

Databricks

Job description

Guidehouse is seeking a Data Engineer with AI experience to build and optimize data pipelines, AI solutions, and analytics platforms using SQL, Python, and PySpark. You will implement CI/CD, version control, and cloud deployments with Docker, Kubernetes, and Azure Functions, collaborating with DBAs and developers to deliver scalable data solutions.

U.S. Citizenship/Green Card is required and you must obtain Public Trust; a bachelor’s degree and 5 years in data engineering or related roles are