Jr Data Engineer

Tata Consultancy Services Limited

Charlotte (NC)

On-site

USD 85,000 - 90,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Tata Consultancy Services Limited is seeking a data engineer to design, build, operate, and improve reliable data pipelines and distributed data-processing solutions in a regulated environment. You will ensure data quality, security, and governance while collaborating with cross-functional teams.

The role requires strong Python/SQL skills, experience with Spark/Hadoop ecosystems, and familiarity with cloud-based data platforms. On-site in Charlotte, NC with competitive compensation.

Qualifications

  • Demonstrated experience in Data Engineering or a related technical discipline.
  • Strong proficiency in Python and SQL for advanced data transformations.
  • Hands-on experience designing and building ETL/ELT pipelines, data-ingestion processes, and distributed data-processing jobs.
  • Practical experience with distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems.
  • Experience building and managing datasets in relational and/or cloud-based data platforms, such as Teradata, Snowflake, SQL Server, Azure, AWS, or GCP.
  • Solid understanding of data modeling, metadata, data-quality controls, data lineage, and secure data management.
  • Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development.
  • Knowledge of CI/CD pipelines, version control using Git, and automated deployment practices.
  • Experience adhering to enterprise data-governance, compliance, and operational-risk frameworks.
  • Ability to troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
  • Strong communication skills and the ability to collaborate across engineering, product, and business teams.
  • Experience implementing monitoring and observability for data pipelines, including logs, metrics, and health checks.
  • Advanced experience tuning the performance of SQL, Spark, or distributed data workflows.
  • Knowledge of data-security practices, including encryption, masking, and PII handling.
  • Experience supporting analytical workloads, BI tools, or data-science teams.
  • Prior experience in a financial institution or another regulated industry.

Responsibilities

  • Design, build, operate, and improve data pipelines and distributed data-processing solutions.
  • Collaborate with engineering, product, and business teams to ensure data quality and governance.
  • Troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
  • Contribute to automated tests and support test-driven development.

Skills

PySpark
Hive
Python
SQL Server
Hadoop

Education

Bachelor of Computer Science

Tools

Unix
Agile delivery practices
Production support

Job description

Job Description
Role Purpose

Design, build, operate, and improve reliable data pipelines and distributed data-processing solutions while maintaining data quality, security, governance, and operational stability.

Must-Have Technical and Functional Skills
Primary Skills
  • PySpark
  • Hive
  • Python
  • SQL Server
  • Hadoop
Secondary Skills
  • Unix
  • Agile delivery practices
  • Production support
Required Experience and Responsibilities
  • Demonstrated experience in Data Engineering, Software Engineering, or a related technical discipline, with the ability to perform the responsibilities of the role.
  • Strong proficiency in Python and SQL for advanced data transformations.
  • Hands-on experience designing and building ETL/ELT pipelines, data-ingestion processes, and distributed data-processing jobs.
  • Practical experience with distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems.
  • Experience building and managing datasets in relational and/or cloud-based data platforms, such as Teradata, Snowflake, SQL Server, Azure, AWS, or GCP.
  • Solid understanding of data modeling, metadata, data-quality controls, data lineage, and secure data management.
  • Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development.
  • Knowledge of CI/CD pipelines, version control using Git, and automated deployment practices.
  • Experience adhering to enterprise data-governance, compliance, and operational-risk frameworks.
  • Ability to troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
  • Strong communication skills and the ability to collaborate across engineering, product, and business teams.
  • Experience implementing monitoring and observability for data pipelines, including logs, metrics, and health checks.
  • Advanced experience tuning the performance of SQL, Spark, or distributed data workflows.
  • Knowledge of data-security practices, including encryption, masking, and PII handling.
  • Experience supporting analytical workloads, BI tools, or data-science teams.
  • Prior experience in a financial institution or another regulated industry.
Preferred Skills and Experience
  • Production support experience, including root-cause analysis of production issues across Hadoop, Oracle, and MongoDB environments.
  • Knowledge of Autosys.
  • Experience troubleshooting performance issues, supporting application-governance requirements, implementing version-upgrade changes, and delivering small enhancements.

Salary Range: $85,000 - $90,000 a year

Location

Charlotte, NC

Function

TECHNOLOGY

Role

Engineer

ID

439324

Skills

Python | SQL Server | Unix Shell Scripting

Salary Range

$85,000 - $90,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Teradata Developer
Teradata Developer

Tata Consultancy Services Limited • Charlotte (NC)

On-site
USD 100,000 - 105,000
Discretionary Annual Incentive
Comprehensive Medical Coverage
Certification & Training Reimbursement
Data Engineer
Data Engineer

Tata Consultancy Services Limited • Charlotte (NC)

On-site
USD 95,000 - 115,000
PySpark Data Engineer
PySpark Data Engineer

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 90,000 - 120,000
Discretionary Annual Incentive
Medical Coverage (Health, Dental & Vis
401K Plan
+1
Data Engineer
Data Engineer

The Value Maximizer • United States

On-site
USD 90,000 - 120,000
Data Engineer
Data Engineer

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 125,000 - 140,000
Data Engineer
Data Engineer

TechDigital Group • Burbank (CA)

On-site
USD 120,000 - 150,000
Jr. Data Engineer
Jr. Data Engineer

Continuus Technologies LLC • Town of Germantown (WI)

On-site
USD 55,000 - 85,000
Senior Data Engineer
Senior Data Engineer

Tata Consultancy Services Limited • Sunnyvale (CA)

On-site
USD 110,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage: Health
Dental & Vision
+6
Hadoop Developer
Hadoop Developer

Tata Consultancy Services Limited • Charlotte (NC)

On-site
USD 100,000 - 120,000
Discretionary Annual Incentive
Medical Coverage: Medical & Health, 9/
Dental & Vision
+3
AWS Data Engineer
AWS Data Engineer

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 90,000 - 110,000