Hybrid Cloud Data DevOps Engineer (AWS/GCP)

AAA Auto Club Enterprises; Coppell (TX); Hybrid; USD 140,000 - 180,000; Full time

Benefits offered by this job

Health coverage

401(k) plan

Tuition assistance

Floating holidays

Paid parental leave

Wellness programs

Employee discounts

Job summary

AAA Auto Club Enterprises is seeking a Senior Data Engineer to design, deploy, and maintain scalable cloud infrastructure on AWS and GCP. You will build fault-tolerant, secure data platforms and develop ingestion frameworks to support growing analytics needs.

You will automate tasks, implement CI/CD for data apps, optimize pipelines, and collaborate with data engineers, data scientists, and business users to ensure best practices and high-quality code.

Qualifications

• Extensive hands-on expertise in Automation, troubleshooting logs, and optimizing system performance.
• Deep understanding of Cloud and data security in AWS or Google Cloud.
• Good experience with networking, Linux and Unix OS, and shell scripting.
• Demonstrated aptitude for identifying the underlying issues in Cloud services such as Glue, Lambda, Big Query, and Cloud Functions.
• Good experience with Cloud platforms AWS and/or Google Cloud in supporting Data pipelines and integrations.
• Experience with Cloud Automations using CloudFormation or Terraform.
• Good understanding of network infrastructures and protocols such as TCP/IP, TLS.
• Familiarity with data integration from different sources into Big Data systems is preferable.
• Familiarity with SQL and programming languages such as Python, Spark, YAML, and Bash.
• Cloud Certification in DevOps in AWS or Google Cloud is a plus.

Responsibilities

• Design, deploy, and maintain scalable and reliable cloud infrastructure on AWS and GCP.
• Build scalability, fault-tolerance, security, and performance into our data platforms to meet our growing data & analytics needs.
• Develop cloud data ingestion and processing frameworks.
• Automate routine tasks to improve efficiency and reduce manual intervention.
• Implement and maintain CI/CD pipelines for data applications.
• Optimize data pipelines and processes for performance and scalability.
• Troubleshoot and resolve issues related to data pipelines and data processing.
• Work with our data engineering teams, data science teams, and analytical business users to review and ensure best practices are followed and high-quality code gets implemented.
• Partner with Information Security, Application Security, and Cloud Infrastructure Services teams to ensure data is secure both at-rest and in-flight.
• Ensure data platforms remain current to take advantage of the latest features and support.
• Mentor, teach, champion, and encourage an Automation mindset amongst the IT department and other business units.
• Communicate the status of assigned work to management and follow agile practices, standard procedures, and policies.
• Seek guidance when direction is needed and speak up about technology risks identified.

Skills

Automation

Cloud security

Networking

Linux/Unix

Scripting

Python

SQL

Spark

Terraform

CloudFormation

Big Data

CI/CD

Tools

AWS

GCP

BigQuery

Glue

Lambda

CloudFormation

Terraform

Job description

AAA Auto Club Enterprises is seeking a Senior Data Engineer to design, deploy, and maintain scalable cloud infrastructure on AWS and GCP. You will build fault-tolerant, secure data platforms and develop ingestion frameworks to support growing analytics needs.

You will automate tasks, implement CI/CD for data apps, optimize pipelines, and collaborate with data engineers, data scientists, and business users to ensure best practices and high-quality code.