Walk-in | Pyspark Data Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Tata Consultancy Services (TCS) in Hyderabad will host a walk-in for a PySpark Data Engineer. The candidate will design and maintain data processing solutions using PySpark, Spark, and Python, and will develop robust data pipelines across cloud platforms.

Excellent collaboration skills and strong data quality focus are required. The walk-in is scheduled for 19 Sep 26 with reporting time from 9:00 AM to 1:00 PM, at multiple locations including Hyderabad, Bengaluru, and Kolkata.

Qualifications

• 4 to 10 years of experience in PySpark data engineering.
• Experience with PySpark, Spark and Python.
• Experience with cloud platforms (AWS/Azure/Google Cloud).

Responsibilities

• Data Processing: Design, develop, and maintain data processing solutions using PySpark, Apache Spark, and Python.
• Data Pipeline Development: Develop and optimize data pipelines using PySpark, Apache Spark, and cloud-based data platforms.
• Data Integration: Integrate data from various sources, including relational databases, NoSQL databases, and cloud storage.
• Data Transformation: Develop and implement data transformation logic using PySpark, Apache Spark, and Python.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.

Skills

PySpark

Data Processing

Cloud Experience

Spark SQL & DataFrames

Distributed computing

Programming languages

Communication

Job description

TCSWALK-INDRIVE!!!!

Walk-InLocations: Hyderabad,Bengaluru, Kolkata
Mode: PhysicalWalk-Indrive In-Person (Face to Face)

Walk-InDrive Date: 19 Sep 26 (sat)

Reporting Time: 9.00 AM to 1:00 PM

Skill - Pyspark Data Engineer

Experience - 4 to 10 years

Responsibilities:

• Data Processing: Design, develop, and maintain data processing solutions using PySpark, Apache Spark, and Python.
• Data Pipeline Development: Develop and optimize data pipelines using PySpark, Apache Spark, and cloud-based data platforms.
• Data Integration: Integrate data from various sources, including relational databases, NoSQL databases, and cloud storage.
• Data Transformation: Develop and implement data transformation logic using PySpark, Apache Spark, and Python.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.

Required Skills

• PySpark: In-depth knowledge of PySpark, Apache Spark, and Python.
• Data Processing: Strong understanding of data processing concepts, including data ingestion, data transformation, and data storage.
• Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.
• Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines
• Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark
• Programming: Proficiency in programming languages, including Python, Java, or Scala.
• Communication: Excellent communication and collaboration skills.

Preferred Skills

• Apache Spark Certifications: Relevant certifications, such as Apache Spark Certification or Cloudera Certified Spark Developer.
• Big Data: Experience with big data technologies, including Hadoop, HBase, or Cassandra.
• Machine Learning: Experience with machine learning frameworks, including TensorFlow, PyTorch, or Scikit-learn.
• Data Science: Experience with data science tools, including Jupyter Notebook, Pandas, or NumPy