Principal Platform Engineer – Data Ops Engineer

DIRECTV; El Segundo (CA); Remote; USD 127,000 - 233,000; Full time

Job summary

Join a forward-thinking company as a Data Ops Engineer, where your expertise in automation and orchestration will drive efficient cloud-based data workflows. Collaborate with cross-functional teams to enhance data operations and implement innovative solutions that deliver real business value. This remote position offers a dynamic environment where your contributions will significantly impact the organization. If you are passionate about scalable data solutions and thrive in a collaborative setting, this is the perfect opportunity to advance your career in a leading-edge technology landscape.

Qualifications

• 5-7 years of experience in programming with Python, PySpark, and JavaScript.
• Expertise in Apache Airflow and multi-cloud orchestration.

Responsibilities

• Define orchestration strategies for workflows across Snowflake, Databricks, and AWS.
• Lead automation initiatives and establish CI/CD standards.

Skills

Python

Apache Airflow

CI/CD

Databricks

AWS

Shell scripting

Performance monitoring

Data orchestration

Analytical skills

Education

Master’s in Computer Science

Tools

Jenkins

GitLab

Datadog

CloudWatch

JMeter

Job description

DIRECTV Data Analytics and Operations Team is seeking a highly motivated Data Ops Engineer with expertise in automation, orchestration, and optimization of cloud-based data workflows across Snowflake, Databricks, and AWS. The ideal candidate will have deep knowledge of Apache Airflow, CI/CD, automation, and performance monitoring, with a passion for scalable and efficient data operations.

This role involves collaborating with data engineering, DevOps, security, and business teams to design and implement advanced orchestration, automation, and data deployment strategies that enhance efficiency, reliability, and cost-effectiveness.

This is an excellent opportunity to join a dynamic team that solves real-world problems and drives business value.

Key Responsibilities

1. Platform Architecture & Data Orchestration Strategy (30%)
   • Define long-term orchestration strategies and standards for workflows across Snowflake, Databricks, and AWS.
   • Lead the design, implementation, and optimization of workflows using Apache Airflow.
   • Mentor teams on best practices for DAG design, error handling, and resilience.
   • Support cross-platform orchestration aligned with data mesh principles.
2. Engineering Excellence & Automation Frameworks (25%)
   • Guide development of reusable automation frameworks in Python, Spark, and Shell.
   • Lead automation initiatives, setting standards for coding and modularization.
   • Explore emerging technologies to accelerate automation efforts.
3. Enterprise CI/CD Governance & DevOps Leadership (20%)
   • Establish and maintain CI/CD standards using Jenkins, GitLab, and AWS CodePipeline.
   • Promote Infrastructure as Code (IaC) and GitOps practices.
   • Provide technical leadership for DevOps integration with other teams.
4. Performance Engineering & Platform Optimization (15%)
   • Conduct performance audits and capacity planning for Snowflake, Databricks, and workflows.
   • Develop monitoring and optimization frameworks using Datadog, CloudWatch, and JMeter.
   • Collaborate on self-healing systems and auto-scaling solutions.
5. Operational Resilience & Leadership Collaboration (10%)
   • Manage incident resolution, post-mortems, and preventive measures.
   • Create runbooks, incident response plans, and training programs.
   • Act as a liaison to align platform roadmaps and mitigate risks.

Experience Requirements

• 5-7 years of experience; 16+ years in software engineering preferred, including 10+ years as a Big Data Architect.
• 5-7 years of hands-on programming experience with Python, PySpark, JavaScript, Shell scripting.
• 5+ years designing configuration-driven frameworks in PySpark on Databricks.
• 5-7 years in CI/CD pipeline development with tools like GitLab, Jenkins, and Databricks APIs.
• 5-7 years in Snowflake, Databricks, AWS, including migration and optimization.
• 7+ years in performance monitoring with tools like Datadog, JMeter, CloudWatch.
• 7+ years in Tier 2/3 support, incident resolution, and automation.
• 4+ years with dbt, including modular modeling and CI/CD integration.
• Expertise in Apache Airflow and multi-cloud orchestration.
• Strong analytical skills for complex data pipeline design and optimization.

Preferred Certifications

• Databricks Certified Data Engineer
• SnowPro Advanced Architect
• AWS Certified DevOps Engineer – Professional
• Apache Airflow Certification
• ITIL 4 Managing Professional
• Certified ScrumMaster (CSM)

Education

• Master’s in Computer Science or Data Engineering preferred.

Note: A background check may be required due to access to proprietary data. Qualified applicants with criminal records will be considered per local laws.

This is a remote position, open nationwide in the US, with preference for Los Angeles, Dallas, or Atlanta. #LI-Remote

Our compensation is competitive and market-aligned, with salary ranges based on role, level, and location.

Salary Range: $127,965 - $232,415, depending on location and experience.

Click HERE for more info on major DMAs. Recruiters can provide specific salary details during hiring.

Includes base salary, with additional benefits and bonuses.