Senior Teradata Data Engineer | PySpark & Big Data

Veriipro; Charlotte (NC); On-site; USD 110,000 - 150,000; Full time

Job summary

Veriipro is seeking an experienced Teradata Data Engineer to design, develop, and optimize scalable data pipelines and integration solutions for enterprise analytics. The role collaborates with stakeholders and tech teams to ensure data quality, performance, and compliance with data management standards.

You will work across Teradata, PySpark, Hive, and Impala, building robust data processing workflows and contributing to automated testing and CI/CD.

Qualifications

• 7+ years of advanced SQL development and relational DB tech.
• 5+ years with Teradata and utilities like BTEQ and TPT.
• 4+ years PySpark and big data tools (Hive/Impala).
• 3+ years in financial services data development and reporting.
• Strong ETL, data warehousing, and pipeline optimization.
• Hands-on with Autosys, shell scripting, and automation.

Responsibilities

• Design, develop, and maintain enterprise data integration and processing solutions.
• Develop and optimize SQL queries, Teradata scripts, and data workflows.
• Build scalable pipelines using Teradata, PySpark, Hive, and Impala.
• Translate business requirements into technical data engineering solutions.
• Implement metadata management, data quality controls, and workload dependencies.
• Develop and optimize large-scale data processing with non-functional requirements in mind.
• Identify data quality issues and performance bottlenecks across platforms.
• Participate in Agile ceremonies and technical design activities.
• Create automated test cases for integration, regression, and performance testing.
• Follow CI/CD practices and automated deployments; support production releases.
• Provide mentoring and guidance to junior data engineers.

Skills

Advanced SQL

Teradata

PySpark

Hive

Impala

BTEQ

TPT

Autosys

Shell scripting

GitHub

Bitbucket

Ansible

Agile methodologies

Scrum

CI/CD

Communication

Team collaboration

Problem solving

Tools

BTEQ

TPT

Autosys

GitHub

Bitbucket

Ansible

JIRA

CI/CD tools

Job description

Veriipro is seeking an experienced Teradata Data Engineer to design, develop, and optimize scalable data pipelines and integration solutions for enterprise analytics. The role collaborates with stakeholders and tech teams to ensure data quality, performance, and compliance with data management standards.

You will work across Teradata, PySpark, Hive, and Impala, building robust data processing workflows and contributing to automated testing and CI/CD.