Teradata Data Engineer: SQL, Spark & Data Pipelines

Tata Consultancy Services; Charlotte (NC); On-site; USD 100,000 - 105,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage

401K Plan

Certification & Training Reimbursement

Vacation & Holidays

Job summary

Tata Consultancy Services in Charlotte, NC is seeking a senior Data Engineer to develop and maintain data pipelines for analytics across mobile and online platforms. You will work with stakeholders and other engineers to implement data requirements and optimize performance.

The role requires 7+ years of SQL, Teradata and PySpark/Impala, plus strong Agile experience. You will mentor junior engineers and contribute to CI/CD practices, with comprehensive benefits and a competitive salary range.

Qualifications

• 7+ years of advanced SQL experience and understanding of relational databases.
• 5+ years of experience with Teradata and utilities (BTEQ, TPT, etc).
• 4+ years of experience working on Pyspark, Impala/Hive.
• Must have working knowledge of Agile software delivery practices and Scrum.
• Advanced Microsoft Excel, Access, SharePoint skills.
• Attention to detail with strong organizational and planning capabilities.
• Ability to communicate with business and technology partners effectively.
• Experience with Autosys scheduling software.
• Shell scripting experience; Bitbucket, Github, Ansible experience.

Responsibilities

• Codes design and delivery tasks for data integration, cleaning, transformation and control in analytics data systems.
• Collaborates with stakeholders, Product Owners and data engineers to refine requirements and troubleshoot issues.
• Develops complex data pipelines and ensures data quality and governance.
• Assembles large, complex data sets meeting functional/non-functional requirements.
• Builds processes for data transformation, structures, metadata and workload management.
• Contributes to test suites and analyzes test results for issues.
• Documents deployment, maintenance and business functionality details.
• Leads and mentors junior data engineers and coaches on CI/CD practices.

Skills

Advanced SQL

Communication

Organizational skills

Problem solving

Time management

Education

Bachelor of Computer Science

Tools

Teradata

PySpark

Impala

Hive

Autosys

Bitbucket

Github

Ansible

Oracle

Tableau

.NET

JIRA

Data Management tools

Job description

Tata Consultancy Services in Charlotte, NC is seeking a senior Data Engineer to develop and maintain data pipelines for analytics across mobile and online platforms. You will work with stakeholders and other engineers to implement data requirements and optimize performance.

The role requires 7+ years of SQL, Teradata and PySpark/Impala, plus strong Agile experience. You will mentor junior engineers and contribute to CI/CD practices, with comprehensive benefits and a competitive salary range.