Data Engineer

Guidehouse; Fairview Heights (IL); On-site; USD 89,000 - 148,000; Full time

Benefits offered by this job

Medical Insurance

401(k) Retirement Plan

Paid Holidays

Parental Leave

Tuition Reimbursement

Job summary

Guidehouse seeks a Data Engineer with AI experience to support building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. You will work with modern data engineering tools, CI/CD, and version control, collaborating with cross‑functional teams to deliver scalable data solutions.

Qualifications include Java, Python, SQL, PySpark, Databricks, and experience with CI/CD and Agile environments.

Qualifications

• Bachelor’s degree required.
• 5 years in data engineering or related roles.
• Experience with Java, Python, SQL, PySpark and API development.
• Experience with CI/CD tools and Git.
• Experience with relational and NoSQL databases (MySQL, PostgreSQL, SQL Server, MongoDB).
• Experience with Databricks.
• Experience with agile development.

Responsibilities

• Design, develop, test and maintain data pipelines and ETL processes.
• AI experience with prompt engineering, machine learning, agentic AI and RAG concepts
• Build and optimize data architectures and models for analytics and reporting.
• Implement CI/CD pipelines for data workflows using Git.
• Develop and deploy cloud-based solutions using Azure Functions and containerization (Docker, Kubernetes).
• Collaborate with DBAs and application developers to design data models and APIs.
• Ensure data quality via validation, monitoring, and logging.
• Troubleshoot production issues to ensure high availability.
• Document data flows and solutions for knowledge sharing and compliance.
• Stay current with emerging technologies in data engineering, cloud, and DevOps.

Skills

Java

Python

SQL

PySpark

APIs

CI/CD

Kubernetes

Docker

Databricks

Agile

Education

Bachelor's degree

Tools

Git

GitHub

Databricks

Kubernetes

Docker

Azure Functions

Job description

What You Will Do

Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands‑on experience with modern data engineering tools, AI solutions, CI/CD, and version control, and will collaborate with cross‑functional teams to deliver high‑quality, scalable data solutions.

• Design, develop, test and maintain data pipelines and ETL processes for ingesting, transforming, and loading data from diverse sources (SQL, R, Python).
• AI experience with prompt engineering, machine learning, agentic AI and RAG concepts
• Build and optimize data architectures and models to support analytics, reporting, and operational needs.
• Implement and manage CI/CD pipelines for data engineering workflows using tools such Git.
• Develop and deploy cloud-based solutions leveraging Azure Functions, and containerization (Docker, Kubernetes).
• Collaborate with DBAs and application developers to design and integrate data models, stored procedures, and APIs.
• Ensure data quality and integrity through validation, monitoring, and logging.
• Successfully juggle multiple tasks across different priorities.
• Troubleshoot and resolve issues in production environments, ensuring high availability and reliability.
• Document data flows, processes, and technical solutions for knowledge sharing and compliance.
• Stay current with emerging technologies and best practices in data engineering, cloud, and DevOps.

What You Will Do

Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands‑on experience with modern data engineering tools, AI solutions, CI/CD, and version control, and will collaborate with cross‑functional teams to deliver high‑quality, scalable data solutions.

• Design, develop, test and maintain data pipelines and ETL processes for ingesting, transforming, and loading data from diverse sources (SQL, R, Python).
• AI experience with prompt engineering, machine learning, agentic AI and RAG concepts
• Build and optimize data architectures and models to support analytics, reporting, and operational needs.
• Implement and manage CI/CD pipelines for data engineering workflows using tools such Git.
• Develop and deploy cloud-based solutions leveraging Azure Functions, and containerization (Docker, Kubernetes).
• Collaborate with DBAs and application developers to design and integrate data models, stored procedures, and APIs.
• Ensure data quality and integrity through validation, monitoring, and logging.
• Successfully juggle multiple tasks across different priorities.
• Troubleshoot and resolve issues in production environments, ensuring high availability and reliability.
• Document data flows, processes, and technical solutions for knowledge sharing and compliance.
• Stay current with emerging technologies and best practices in data engineering, cloud, and DevOps.

Job Family

Data Science & Analysis

Travel Required

Up to 10%

Clearance Required

Ability to Obtain Public Trust

What You Will Need

• U.S. Citizenship/ Green Card is required and Must be able to OBTAIN and MAINTAIN a Federal or DHS "PUBLIC TRUST".
• A bachelor’s degree is required.
• FIVE (5) years of experience in data engineering, software development, or related roles.
• Experience in programming languages and technologies, including Java, Python, SQL, and PySpark, as well as API development (RESTful and SOAP).
• Experience with Co-Pilot and CodeX.
• Experience designing and developing data pipelines and ETL processes.
• Extensive experience with relational and NoSQL databases, such as MySQL, PostgreSQL, SQL Server, and MongoDB, including stored procedure development.
• Experience working with Databricks.
• Experience with CI/CD tools and pipelines, such as Gi and, GitHub.
• Experience operating in Agile development environments.

What Would Be Nice To Have

• Experience supporting federal programs and/or large-scale data modernization projects.
• Familiarity with version control and collaboration tools, including Git, Jira, and Confluence.
• Ability to work independently in a fast-paced environment.
• Strong analytical and troubleshooting skills.
• Excellent verbal and written communication skills, with the ability to clearly communicate complex technical concepts to diverse audiences.
• Familiarity with containerization and orchestration technologies
• Experience with data visualization tools (e.g., Kibana, Tableau).
• Familiarity with security best practices and compliance in federal environments.
• Experience with microservices, Spring Boot, and integration of AI/ML components.
• Previous consulting experience

The annual salary range for this position is $89,000.00-$148,000.00. Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs.

What We Offer

Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.

Benefits Include

• Medical, Rx, Dental & Vision Insurance
• Personal and Family Sick Time & Company Paid Holidays
• Parental Leave
• 401(k) Retirement Plan
• Group Term Life and Travel Assistance
• Voluntary Life and AD&D Insurance
• Health Savings Account, Health Care & Dependent Care Flexible Spending Accounts
• Transit and Parking Commuter Benefits
• Short-Term & Long-Term Disability
• Tuition Reimbursement, Personal Development, Certifications & Learning Opportunities
• Employee Referral Program
• Corporate Sponsored Events & Community Outreach
• Care.com annual membership
• Employee Assistance Program
• Supplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.)
• Position may be eligible for a discretionary variable incentive bonus

About Guidehouse

Guidehouse is an Equal Opportunity Employer–Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.

Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.

If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at [e-mail]. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.

All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or [e-mail]. Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse. Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.

If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse’s Ethics Hotline. If you want to check the validity of correspondence you have received, please contact [e-mail]. Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant’s dealings with unauthorized third parties.

Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.