Cloud Data Engineer - Scalable ETL & Analytics Pipelines

Vanguard; Dallas (TX); Hybrid; USD 110,000 - 150,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Vanguard is seeking a Data Engineer, Specialist to design, develop, and maintain scalable data pipelines and modern data infrastructure for analytics initiatives. You will build robust ETL processes, manage databases, and optimize cloud data platforms to seamlessly integrate data from multiple sources.

You will collaborate with data scientists and analysts to understand data needs, develop data solutions, and enable self-service analytics across the organization.

Qualifications

• Three+ years of data engineering, programming, database administration, or data management experience.
• Undergraduate degree or equivalent combination of training and experience.
• Strong proficiency in SQL and Python for data manipulation, automation and pipeline development.

Responsibilities

• Develop and maintain scalable ETL processes to extract, transform, and load data from diverse sources.
• Design and optimize database architectures and data pipelines for high performance, availability, and security.
• Integrate data from multiple sources including APIs and cloud/on-prem databases to create unified datasets for analytics.
• Collaborate with data scientists, analysts and stakeholders to understand data needs and enable self-service analytics.
• Develop automated workflows and data processing scripts using Python, Spark, SQL, or other technologies.
• Optimize data storage and retrieval in cloud data warehouses ensuring scalability and cost-efficiency.
• Maintain and improve data quality with validation, anomaly detection, and data cleansing.
• Test code thoroughly and review with end users to ensure clarity and accuracy.
• Provide tool and data support to business users and team members.
• Conduct regression testing for new releases and coordinate with vendors for deployment.

Skills

SQL

Python

Apache Spark

Hadoop

Kafka

AWS

Education

Bachelor's degree

Tools

AWS Glue

S3

Lambda

Databricks

Synapse

Data Factory

Job description

Vanguard is seeking a Data Engineer, Specialist to design, develop, and maintain scalable data pipelines and modern data infrastructure for analytics initiatives. You will build robust ETL processes, manage databases, and optimize cloud data platforms to seamlessly integrate data from multiple sources.

You will collaborate with data scientists and analysts to understand data needs, develop data solutions, and enable self-service analytics across the organization.