Senior Data Engineer - Cloud Platform Lead (Hybrid, Remote 2x/wk)

The Addison Group; Austin (TX); Hybrid; USD 103,000 - 110,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401(k)

Job summary

The Addison Group seeks a Senior Data Engineer to design, build, and support modern cloud-based data platforms and analytics solutions in Austin, TX. This hybrid role combines hands-on engineering with solution design and production support.

You will lead data pipelines, integrate batch and streaming workloads, and partner with architecture, engineering, and business stakeholders to deliver scalable, well-governed data capabilities.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, Data Science, or a related discipline.
• 8+ years of experience in data engineering, analytics engineering, or data platform development.
• Experience designing and implementing cloud-based data solutions.
• Experience building large-scale data integration and transformation processes.
• Experience leading technical initiatives and delivering production-ready solutions.
• Experience supporting enterprise production environments and operational processes.
• Experience working within regulated or compliance-driven environments is a plus.

Responsibilities

• Design, develop, and maintain scalable data pipelines, transformation processes, and reusable data assets.
• Build and support data integration solutions across batch, near real-time, and streaming workloads.
• Develop reusable frameworks, automation, and platform components that improve engineering efficiency and solution quality.
• Lead technical design efforts for complex projects and provide guidance through implementation and deployment.
• Partner with architecture, engineering, and business stakeholders to deliver scalable, secure, and well-governed solutions.
• Establish and promote engineering standards, best practices, and code quality measures.
• Implement data quality, monitoring, metadata, lineage, and security capabilities.
• Build and maintain CI/CD pipelines, automated testing frameworks, and deployment processes.
• Support platform observability, performance tuning, reliability improvements, and cost optimization initiatives.
• Participate in production support activities, incident response, troubleshooting, and root cause analysis.
• Maintain technical documentation, operational procedures, and knowledge-sharing materials.
• Contribute to roadmap planning, solution estimation, technology evaluations, and modernization initiatives.
• Mentor team members and provide technical leadership across projects.

Skills

SQL

Python

PySpark

Spark optimization

Cloud data platforms

Data governance

CI/CD practices

Stakeholder collaboration

Education

Bachelor's degree

Tools

Azure Databricks

Delta Lake

Unity Catalog

Databricks Workflows

Delta Live Tables

Job description

The Addison Group seeks a Senior Data Engineer to design, build, and support modern cloud-based data platforms and analytics solutions in Austin, TX. This hybrid role combines hands-on engineering with solution design and production support.

You will lead data pipelines, integrate batch and streaming workloads, and partner with architecture, engineering, and business stakeholders to deliver scalable, well-governed data capabilities.