Data Engineer

Tata Consultancy Services; Atlanta (GA); Presencial; USD 100.000 - 135.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Discretionary annual incentive

Comprehensive medical coverage

Family support: Maternal & Parental Le

Auto & Home Insurance

Commuter Benefits

Certification & Training Reimbursement

Vacation & Holidays

401K plan

Performance Bonus

College Fund

Student Loan Refinancing

Descripción de la vacante

Tata Consultancy Services Limited in Atlanta, GA is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines.

You will work with Python, Spark, Kafka, and AWS to ingest, transform, validate, and govern data for analytics, ML, and BI teams, collaborating across projects and mentoring junior engineers.

Formación

• Proficient in Python and PySpark for large-scale data processing.
• Strong SQL querying and data modeling skills.
• Experience with data ingestion, transformation, cleansing, and validation.
• Data warehouse and large-scale data processing experience.
• Experience with streaming data using Kafka and Spark Streaming.

Responsabilidades

• Design, develop, and maintain scalable data pipelines and ETL solutions.
• Build and optimize data ingestion frameworks for structured and unstructured data.
• Implement data quality, validation, standardization, and governance processes.
• Support analytics, reporting, machine learning, and business intelligence initiatives.
• Work with Data Scientists and BI teams to prepare and curate data for analytics.
• Develop scalable solutions for Big Data processing and streaming workloads.
• Lead and mentor junior data engineers.

Conocimientos

Agile methodologies

Herramientas

Python

PySpark

Spark SQL

Apache Spark

Hadoop

Kafka

Hive

HDFS

Sqoop

IBM DataStage

Tibco

AWS S3

AWS Glue

AWS Lambda

AWS Kinesis/MSK

Tableau

Power BI

Spotfire

OAC

Descripción del empleo

• Python and PySpark
• Spark SQL and Apache Spark
• Big Data technologies: Hadoop, Spark, Kafka, Hive, HDFS, Sqoop
• Strong SQL querying and data modeling
• Data ingestion, transformation, cleansing, and validation
• Data warehouse and large-scale data processing experience
• Experience with streaming data using Kafka and Spark Streaming
• Agile methodologies (Scrum, Kanban, SAFe)

Preferred Skills:

• Scala / Scala-Spark
• IBM DataStage, Tibco, or similar ETL tools
• AWS services: S3, Glue, Lambda, Kinesis/MSK
• BI Tools: Tableau, Power BI, Spotfire, OAC
• Data governance and retention modeling
• Design, develop, and maintain scalable data pipelines and ETL solutions.
• Build and optimize data ingestion frameworks for structured and unstructured data.
• Implement data quality, validation, standardization, and governance processes.
• Support analytics, reporting, machine learning, and business intelligence initiatives.
• Work with Data Scientists and BI teams to prepare and curate data for analytics.
• Develop scalable solutions for Big Data processing and streaming workloads.
• Analyze data and provide actionable insights and recommendations to business stakeholders.
• Gather requirements from business teams and translate them into technical solutions.
• Lead and mentor junior data engineers.
• Collaborate across multiple projects as the Data Engineering SME.
• Drive adoption of Data Engineering best practices and standards.

Salary Range-$100,000-$135,000 a year

TCS Employee Benefits Summary:

Discretionary Annual Incentive.

Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

Family Support: Maternal & Parental Leaves.

Insurance Options: Auto & Home Insurance, Identity Theft Protection.

Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement

Time Off: Vacation, Time Off, Sick Leave & Holidays.

Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.