BigData + Python + Pyspark - Bangalore / Chennai
Tech Mahindra
4 days ago
Be an early applicant
Application generator
Turn this role into an interview — a resume and cover letter built around what this employer wants.
Get past ATS filters
Job summary
Tech Mahindra in Chennai is seeking a Bigdata Engineer to design and optimize data pipelines using PySpark and SQL. The role requires strong Linux shell scripting, data analytics, and experience with large-scale data platforms.
The candidate will work on core data platforms, orchestrate workflows with Airflow, and leverage tools like Iceberg, MinIO, and Kubernetes for scalable data processing. This position is based in Chennai, India, with opportunities to grow in DevOps practices.
Qualifications
- Proficient in analyzing data processes and deriving insights.
- Experience with large-scale data platforms and ETL pipelines.
Skills
Analytical skills
Core Big Data Platform
Tools
Linux & Shell Scripting
Python / PySpark
SQL
Apache Iceberg
Apache Airflow
Kubernetes
MinIO - S3
Job description
Bigdata Engineer JD
Skills
- Core Big Data Platform
Must have - Linux & Shell Scripting
Must have - Python / PySpark
Must have - SQL
Must have - Analytical skills
Must have - DevOps
Nice to have - Apache Iceberg
Nice to have - Apache Airflow (Orchestration)
Nice to have - Kubernetes (SKE/AKS)
Nice to have - MinIO - S3
Nice to have
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
