Engineer

Tata Consultancy Services; Dallas (TX); On-site; USD 120,000 - 130,000; Full time

Benefits offered by this job

Annual incentive

Medical coverage

Parental leaves

Auto & Home Insurance

Certification reimbursement

Vacation & Holidays

401K plan

Job summary

Tata Consultancy Services in Dallas is seeking a PySpark Developer with 5-10 years of data engineering experience to design, develop, and maintain scalable data pipelines for BI needs.

The role emphasizes Spark-based transformations, SQL querying, and robust data-quality practices, with on-site responsibilities and collaboration with analysts to deliver actionable insights.

Qualifications

• 5–10 years of data engineering experience required.
• Bachelor's degree in Computer Science or related field.
• Proficient in PySpark and SQL with hands-on coding experience.

Responsibilities

• Onsite role with strong experience in Apache Spark framework including good understanding of core concepts, performance optimization and industry best practices.
• Proficient in PySpark with hands-on coding experience and ability to implement complex business level transformations.
• Collaborate with the stakeholders and analysts to understand data requirement and deliver robust, creative and innovative solutions.
• Familiarity with unit testing, object‑oriented programming concepts and interpreting test results.
• Proficient to write complex and efficient SQL queries to extract the business critical insights from large-scale data.
• Experience with scheduling of the transformation jobs as per business requirement.
• Perform root-cause analysis and troubleshoot errors on data pipelines, evaluating data quality issues, and implementing corrective fixes

Skills

PySpark

Apache Spark

SQL

Data engineering

ETL

OOPS concepts

Education

Bachelor of Computer Science

Tools

Apache Spark

Job description

Job Description

Must Have Technical/Functional Skills

PySpark Developer with 5-10 years experience in data engineering practice. Responsible for designing, developing and maintaining scalable data pipelines, optimizing data workflows and ensuring the integrity and availability of data for business intelligence

Roles & Responsibilities

• Onsite role with strong experience in Apache Spark framework including good understanding of core concepts, performance optimization and industry best practices.
• Proficient in PySpark with hands‑on coding experience and ability to implement complex business level transformations.
• Collaborate with the stakeholders and analysts to understand data requirement and deliver robust, creative and innovative solutions.
• Familiarity with unit testing, object‑oriented programming (OOPS) concepts and interpreting test results.
• Proficient to write complex and efficient SQL queries to extract the business critical insights from large-scale data.
• Experience with scheduling of the transformation jobs as per business requirement.
• Perform root-cause analysis and troubleshoot errors on data pipelines, evaluating data quality issues, and implementing corrective fixes

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range: $120,000 - $130,000 a year

Qualifications:

BACHELOR OF COMPUTER SCIENCE