Senior Data Engineer: Cloud Data Pipelines & Platform Lead

Guidehouse; Houston (TX); On-site; USD 80,000 - 133,000; Full time

Benefits offered by this job

Medical, Rx, Dental & Vision Insurance

401(k) Retirement Plan

Parental Leave

Tuition Reimbursement, Certifications

Employee Assistance Program

Corporate Sponsored Events

Job summary

Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms, pipelines, and cloud-based analytics solutions. You will lead technical efforts while collaborating with multidisciplinary teams to deliver data solutions.

Requirements include 4+ years in data/analytics engineering, strong Python/SQL/Spark skills, and experience with AWS or Azure and Databricks/Snowflake. The role involves governance, CI/CD, and mentoring junior engineers.

Qualifications

• Bachelor's degree in a technical field as listed.
• 4+ years in data engineering, software or analytics engineering.
• Experience with Python, SQL, and data processing frameworks like Spark/PySpark.
• Experience designing and supporting production-grade data pipelines.
• Experience with relational and non-relational databases and query optimization.
• Experience with cloud platforms (AWS and/or Azure).
• Experience with Databricks or Snowflake.
• Experience implementing CI/CD and version control (Git, GitHub, GitLab, Jenkins, Azure DevOps).
• Experience with data quality, monitoring, and op-support; experience in Agile environments.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build and optimize data architectures and storage across cloud/hybrid environments.
• Develop data engineering solutions using Python, SQL, Spark.
• Implement cloud-native data platforms using AWS/Azure/Databricks.
• Design CI/CD pipelines and DevOps for data workflows.
• Collaborate with architects, analysts, and stakeholders to translate requirements.
• Lead data integration, migration, and modernization initiatives.
• Ensure data quality, security, and governance in designs.
• Monitor and optimize pipelines and production environments.
• Mentor junior data engineers and share knowledge.
• Contribute to architecture discussions and evaluations.
• Develop technical docs including data flows and deployment procedures.

Skills

Data engineering

Python

SQL

Spark

Cloud analytics

CI/CD

Agile

Leadership

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, Data Science, or related field

Tools

Databricks

Snowflake

Git/GitHub/GitLab

Jenkins/Azure DevOps

AWS

Azure

Terraform/CloudFormation

Job description

Guidehouse seeks a Senior Data Engineer to design, develop, and optimize modern data platforms, pipelines, and cloud-based analytics solutions. You will lead technical efforts while collaborating with multidisciplinary teams to deliver data solutions.

Requirements include 4+ years in data/analytics engineering, strong Python/SQL/Spark skills, and experience with AWS or Azure and Databricks/Snowflake. The role involves governance, CI/CD, and mentoring junior engineers.