Data Engineer

Guidehouse; Houston (TX); On-site; USD 89,000 - 136,000; Full time

Benefits offered by this job

Medical insurance

Parental leave

401(k) Retirement Plan

Employee assistance program

Tuition reimbursement

Job summary

Guidehouse seeks a Data Engineer with AI experience to design, build, and maintain data pipelines and analytics platforms in a fast-paced environment. You will work with SQL, Python, Java, and PySpark to ingest, transform, and load data from diverse sources, while implementing CI/CD and cloud-based solutions using Azure Functions, Docker, and Kubernetes.

The role requires 5 years of data engineering or related experience, a Bachelor's degree, and the ability to obtain a federal public trust.

Qualifications

• Bachelor's degree in a related field.
• 5 years of experience in data engineering, software development, or related roles.
• Proficiency in Java, Python, SQL, and PySpark.
• Experience with API development (RESTful and SOAP).
• Experience with Databricks, CI/CD, and version control (Git).

Responsibilities

• Design, develop, test and maintain data pipelines and ETL processes.
• Build and optimize data architectures to support analytics and reporting.
• Implement CI/CD pipelines for data workflows using Git-based tools.
• Develop cloud-based solutions using Azure Functions, Docker, and Kubernetes.
• Collaborate with DBAs and developers to design data models and APIs.
• Ensure data quality, monitor pipelines, and troubleshoot production issues.
• Document data flows and technical solutions for knowledge sharing.

Skills

Java

Python

SQL

PySpark

API development (REST/SOAP)

AI/ML concepts

CI/CD

Version control (Git)

Agile development

Data pipelines

Education

Bachelor's degree

Tools

Databricks

Docker

Kubernetes

Git

GitHub

Jira

Confluence

Spring Boot

Tableau

Kibana

Job description

Job Family:Data Science & AnalysisTravel Required:Up to 10%Clearance Required:Ability to Obtain Public TrustWhat You Will Do:Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands-on experience with modern data engineering tools, AI solutions, CI/CD, and version control, and will collaborate with cross-functional teams to deliver high-quality, scalable data solutions.Design, develop, test and maintain data pipelines and ETL processes for ingesting, transforming, and loading data from diverse sources (SQL, R, Python).AI experience with prompt engineering, machine learning, agentic AI and RAG conceptsBuild and optimize data architectures and models to support analytics, reporting, and operational needs.Implement and manage CI/CD pipelines for data engineering workflows using tools such Git.Develop and deploy cloud-based solutions leveraging Azure Functions, and containerization (Docker, Kubernetes).Collaborate with DBAs and application developers to design and integrate data models, stored procedures, and APIs.Ensure data quality and integrity through validation, monitoring, and logging.Successfully juggle multiple tasks across different priorities.Troubleshoot and resolve issues in production environments, ensuring high availability and reliability.Document data flows, processes, and technical solutions for knowledge sharing and compliance.Stay current with emerging technologies and best practices in data engineering, cloud, and DevOps.What You Will Need:U.S. Citizenship/ Green Card is required and Must be able to OBTAIN and MAINTAIN a Federal or DHS "PUBLIC TRUST".A bachelor’s degree is required.FIVE (5) years of experience in data engineering, software development, or related roles.Experience in programming languages and technologies, including Java, Python, SQL, and PySpark, as well as API development (RESTful and SOAP).Experience with Co-Pilot and CodeX.Experience designing and developing data pipelines and ETL processes.Extensive experience with relational and NoSQL databases, such as MySQL, PostgreSQL, SQL Server, and MongoDB, including stored procedure development.Experience working with Databricks.Experience with CI/CD tools and pipelines, such as Gi and, GitHub.Experience operating in Agile development environments.What Would Be Nice To Have:Experience supporting federal programs and/or large-scale data modernization projects.Familiarity with version control and collaboration tools, including Git, Jira, and Confluence.Ability to work independently in a fast-paced environment.Strong analytical and troubleshooting skills.Excellent verbal and written communication skills, with the ability to clearly communicate complex technical concepts to diverse audiences.Familiarity with containerization and orchestration technologiesExperience with data visualization tools (e.g., Kibana, Tableau).Familiarity with security best practices and compliance in federal environments.Experience with microservices, Spring Boot, and integration of AI/ML components.Previous consulting experienceThe annual salary range for this position is $89,000.00-$148,000.00. Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, and other business and organizational needs.What We Offer:Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.Benefits include:Medical, Rx, Dental & Vision InsurancePersonal and Family Sick Time & Company Paid HolidaysParental Leave401(k) Retirement PlanGroup Term Life and Travel AssistanceVoluntary Life and AD&D InsuranceHealth Savings Account, Health Care & Dependent Care Flexible Spending AccountsTransit and Parking Commuter BenefitsShort-Term & Long-Term DisabilityTuition Reimbursement, Personal Development, Certifications & Learning OpportunitiesEmployee Referral ProgramCorporate Sponsored Events & Community OutreachCare.com annual membershipEmployee Assistance ProgramSupplemental Benefits via Corestream (Critical Care, Hospital Indemnity, Accident Insurance, Legal Assistance and ID theft protection, etc.)Position may be eligible for a discretionary variable incentive bonusAbout GuidehouseGuidehouse is an Equal Opportunity Employer–Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at [e-mail]. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or [e-mail]. Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse. Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse’s Ethics Hotline. If you want to check the validity of correspondence you have received, please contact [e-mail]. Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant’s dealings with unauthorized third parties.Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.