Senior Data Engineer: Cloud Data Pipelines & Platforms

Guidehouse; San Antonio (TX); On-site; USD 80,000 - 133,000; Full time

Benefits offered by this job

Competitive compensation package

Flexible benefits

Job summary

Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms and pipelines. You will lead technical efforts, collaborate with multidisciplinary teams, and deliver mission-critical data solutions in cloud and hybrid environments.

Responsibilities include building scalable pipelines, data architectures, and CI/CD pipelines while mentoring junior engineers and ensuring data quality and governance across production systems.

Qualifications

• Bachelor's degree in Computer Science or a related technical field.
• 3+ years in data engineering, software engineering, analytics engineering, or a related discipline.
• Experience with Python, SQL, and Spark or PySpark.
• Experience designing, developing, and supporting production-grade data pipelines and ETL/ELT processes.
• Experience with cloud platforms such as AWS and/or Azure.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build and optimize data architectures, data models, and storage solutions across cloud and hybrid environments.
• Develop and maintain data engineering solutions using Python, SQL, Spark, and related technologies.
• Implement cloud-native data platforms leveraging AWS, Azure, Databricks, and other modern technologies.
• Design and implement CI/CD pipelines and DevOps best practices for data engineering workflows.
• Collaborate with architects, developers, analysts, and business stakeholders to translate requirements into technical solutions.
• Lead data integration, migration, and modernization initiatives, including legacy system transformation efforts.
• Ensure data quality, integrity, security, and governance standards are incorporated into solution designs.
• Monitor, troubleshoot, and optimize data pipelines and production environments to ensure reliability and performance.
• Mentor junior data engineers and support technical knowledge sharing across project teams.
• Contribute to technical architecture discussions, technology evaluations, and engineering best practices.
• Develop and maintain technical documentation including data flows, system designs, deployment procedures, and operational guides.

Skills

Python

SQL

Spark

PySpark

Data pipelines

AWS

Azure

Databricks

Snowflake

CI/CD

Git

Data governance

Agile

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, Data Science, or a related technical field

Tools

Databricks

Snowflake

Git

GitHub

GitLab

Jenkins

Azure DevOps

Terraform

CloudWatch

Kibana

Datadog

Job description

Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms and pipelines. You will lead technical efforts, collaborate with multidisciplinary teams, and deliver mission-critical data solutions in cloud and hybrid environments.

Responsibilities include building scalable pipelines, data architectures, and CI/CD pipelines while mentoring junior engineers and ensuring data quality and governance across production systems.