Junior Data Engineer: Spark, ETL & Data Pipelines

Tata Consultancy Services Limited

Charlotte (NC)

Presencial

USD 85.000 - 90.000

Jornada completa

Hace 5 días
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Tata Consultancy Services Limited is seeking a data engineer to design, build, operate, and improve reliable data pipelines and distributed data-processing solutions in a regulated environment. You will ensure data quality, security, and governance while collaborating with cross-functional teams.

The role requires strong Python/SQL skills, experience with Spark/Hadoop ecosystems, and familiarity with cloud-based data platforms. On-site in Charlotte, NC with competitive compensation.

Formación

  • Demonstrated experience in Data Engineering or a related technical discipline.
  • Strong proficiency in Python and SQL for advanced data transformations.
  • Hands-on experience designing and building ETL/ELT pipelines, data-ingestion processes, and distributed data-processing jobs.
  • Practical experience with distributed data tools such as Apache Spark, Databricks, or Hadoop ecosystems.
  • Experience building and managing datasets in relational and/or cloud-based data platforms, such as Teradata, Snowflake, SQL Server, Azure, AWS, or GCP.
  • Solid understanding of data modeling, metadata, data-quality controls, data lineage, and secure data management.
  • Experience contributing to automated test suites, analyzing test failures, and supporting test-driven development.
  • Knowledge of CI/CD pipelines, version control using Git, and automated deployment practices.
  • Experience adhering to enterprise data-governance, compliance, and operational-risk frameworks.
  • Ability to troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
  • Strong communication skills and the ability to collaborate across engineering, product, and business teams.
  • Experience implementing monitoring and observability for data pipelines, including logs, metrics, and health checks.
  • Advanced experience tuning the performance of SQL, Spark, or distributed data workflows.
  • Knowledge of data-security practices, including encryption, masking, and PII handling.
  • Experience supporting analytical workloads, BI tools, or data-science teams.
  • Prior experience in a financial institution or another regulated industry.

Responsabilidades

  • Design, build, operate, and improve data pipelines and distributed data-processing solutions.
  • Collaborate with engineering, product, and business teams to ensure data quality and governance.
  • Troubleshoot pipeline issues, performance bottlenecks, and data discrepancies.
  • Contribute to automated tests and support test-driven development.

Conocimientos

PySpark
Hive
Python
SQL Server
Hadoop

Educación

Bachelor of Computer Science

Herramientas

Unix
Agile delivery practices
Production support

Descripción del empleo

Tata Consultancy Services Limited is seeking a data engineer to design, build, operate, and improve reliable data pipelines and distributed data-processing solutions in a regulated environment. You will ensure data quality, security, and governance while collaborating with cross-functional teams.

The role requires strong Python/SQL skills, experience with Spark/Hadoop ecosystems, and familiarity with cloud-based data platforms. On-site in Charlotte, NC with competitive compensation.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior PySpark Data Engineer - Hadoop & ETL
Senior PySpark Data Engineer - Hadoop & ETL

Tata Consultancy Services Limited • Charlotte (NC)

Presencial
USD 100.000 - 110.000
Discretionary annual incentive
Comprehensive medical coverage
Family leaves
+4
Teradata Data Engineer: SQL, Spark & Data Pipelines
Teradata Data Engineer: SQL, Spark & Data Pipelines

Tata Consultancy Services Limited • Charlotte (NC)

Presencial
USD 100.000 - 105.000
Discretionary Annual Incentive
Comprehensive Medical Coverage
401K Plan
+2
Production Data Engineer: Spark, ETL & Data Ops
Production Data Engineer: Spark, ETL & Data Ops

Tata Consultancy Services Limited • Charlotte (NC)

Presencial
USD 95.000 - 115.000
Senior Databricks Python Engineer
Senior Databricks Python Engineer

Tata Consultancy Services Limited • Jersey City (NJ)

Presencial
USD 100.000 - 115.000
Senior Hadoop Data Engineer — Spark, PySpark & Kafka
Senior Hadoop Data Engineer — Spark, PySpark & Kafka

Tata Consultancy Services Limited • Charlotte (NC)

Presencial
USD 100.000 - 120.000
Discretionary Annual Incentive
Medical Coverage: Medical & Health, 9/
Dental & Vision
+3
Senior Data Engineer: Azure Spark & Real-Time Pipelines
Senior Data Engineer: Azure Spark & Real-Time Pipelines

Tata Consultancy Services Limited • Eden Prairie (MN)

Presencial
USD 110.000 - 120.000
Medical Coverage
401K Plan
Paid Time Off
Spark Data Engineer (PySpark) - Cloud ETL & Pipelines
Spark Data Engineer (PySpark) - Cloud ETL & Pipelines

Tata Consultancy Services Limited • Irving (TX)

Presencial
USD 90.000 - 120.000
Discretionary Annual Incentive
Medical Coverage (Health, Dental & Vis
401K Plan
+1
Data Engineer: Scalable Pipelines with Spark & Hive
Data Engineer: Scalable Pipelines with Spark & Hive

Tata Consultancy Services Limited • Irving (TX)

Presencial
USD 125.000 - 140.000
Data Engineer: Cloudera, Spark & Hive Pipelines
Data Engineer: Cloudera, Spark & Hive Pipelines

Tata Consultancy Services Limited • Irving (TX)

Presencial
USD 125.000 - 145.000
Senior Data & Analytics Engineer: Spark + Core Java
Senior Data & Analytics Engineer: Spark + Core Java

Tata Consultancy Services Limited • Alpharetta (GA)

Presencial
USD 120.000 - 130.000
Discretionary Incentive
Medical Coverage
Dental & Vision
+7