Data Engineer | Rasyosys | Chennai – Hybrid

Tech Junction Ltd; Chennai District; Hybrid; INR 1,500,000 - 2,300,000; Full time

Job summary

Rasyosys is seeking an experienced Data Engineer in Chennai to design, build and optimize scalable ETL pipelines with Apache Spark. You will work with data scientists, software architects, and business stakeholders to translate complex data requirements into reliable storage and transformation solutions.

The ideal candidate has 4+ years in data engineering, deep expertise in Spark, SQL, Python or Scala, and hands-on experience with Elasticsearch/OpenSearch.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Engineering, Software Engineering, Information Technology, or a related technical discipline.
• Minimum 4+ years of professional experience in data engineering, ETL development, or big data architecture.
• Strong proficiency with Apache Spark and distributed data processing.
• Extensive experience in ETL development, data integration, data transformation, and pipeline orchestration.
• Proven expertise in database design, relational modeling, and enterprise data modeling principles.
• Strong programming skills in Python or Scala for automation and pipelines.
• Experience with search and analytics engines such as Elasticsearch or OpenSearch.

Responsibilities

• Design, develop, test, and maintain robust ETL/ELT data pipelines using Apache Spark and distributed frameworks.
• Lead data integration, cleaning, and transformation workflows across enterprise sources.
• Architect and implement enterprise data models, dimensional schemas, and data warehouse structures.
• Optimize Spark jobs, SQL queries, and database indexing to reduce latency and resource use.
• Integrate and manage Elasticsearch/OpenSearch for high-speed data retrieval.
• Collaborate with data scientists, engineers, and business analysts to gather data requirements.
• Develop automation scripts and pipeline orchestration using Python or Scala.
• Troubleshoot pipeline failures and data quality issues with robust remediation.
• Maintain technical docs, blueprints, runbooks, and schema registries.
• Ensure governance, privacy regulations, and security best practices.

Skills

Apache Spark

Python

Scala

ETL Development

Data Modeling

SQL

Distributed Data Processing

OpenSearch

Elasticsearch

Education

Bachelor's or Master's in CS / Data Eng / SE / IT

Tools

Elasticsearch

OpenSearch

Job description

Position Summary:

Rasyosys is seeking an experienced, highly technical, and accomplished Data Engineer with 4+ years of professional big data engineering, ETL development, and data modeling experience to join our client engagement team on a full-time contract basis with hybrid work arrangements in Chennai. In this specialized data engineering role, you will spearhead designing, building, and optimizing high-performance data pipelines, data integration frameworks, and enterprise data models utilizing Apache Spark. You will work closely with data scientists, software architects, and business stakeholders to translate complex data requirements into scalable, reliable data storage and transformation solutions. Ideal candidates bring a robust academic degree in computer science or data engineering, deep practical mastery of distributed data processing, SQL, Python, and immediate availability for hybrid deployment in Chennai.

Detailed Job Description:

As a Data Engineer at Rasyosys in Chennai, you will take full ownership of end-to-end ETL pipeline development, data integration workflows, data modeling initiatives, and big data architecture optimization. Your day-to-day responsibilities encompass developing scalable data pipelines with Apache Spark, transforming structured and unstructured datasets, implementing dimensional and relational data models, and integrating search engines like Elasticsearch and OpenSearch. You will collaborate proactively with analytics and engineering squads to troubleshoot data latency issues, optimize query performance, and ensure rigorous data quality governance. Working in a fast-paced technology consulting environment, you will drive data-driven decision making and platform reliability.

Key Responsibilities:

• Design, develop, test, and maintain robust ETL/ELT data pipelines utilizing Apache Spark and distributed computing frameworks.
• Spearhead data integration, data cleaning, and complex transformation workflows across disparate enterprise data sources.
• Architect and implement enterprise data models, dimensional schemas, and data warehouse structures.
• Optimize large-scale Spark jobs, SQL queries, and database indexing to reduce processing latency and resource consumption.
• Integrate and manage search and analytics engines including Elasticsearch and OpenSearch for high-speed data retrieval.
• Collaborate proactively with data scientists, software developers, and business analysts to gather data requirements.
• Author automation scripts, data ingestion utilities, and pipeline orchestration workflows utilizing Python or Scala.
• Troubleshoot data pipeline failures, investigate data quality anomalies, and execute robust root-cause remediation.
• Maintain comprehensive technical documentation, data architecture blueprints, pipeline runbooks, and schema registries.
• Ensure strict adherence to corporate data governance, data privacy regulations, and security best practices.

Required Qualifications & Skills:

• Bachelor's or Master's degree in Computer Science, Data Engineering, Software Engineering, Information Technology, or a related technical discipline.
• Minimum 4+ years of professional working experience in data engineering, ETL development, or big data architecture.
• Strong technical proficiency and hands-on operational mastery of Apache Spark and distributed data processing.
• Extensive practical experience in ETL development, data integration, data transformation, and pipeline orchestration.
• Proven expertise in database design, relational modeling, and enterprise data modeling principles.
• Strong programming proficiency in Python or Scala for data engineering task automation and pipeline construction.
• Practical experience with search and analytics engines such as Elasticsearch or OpenSearch.
• Professional availability for full-time contract employment with hybrid work arrangements in Chennai (Application email: [e-mail]).

Nice-to-Have Skills:

• Professional certifications such as Databricks Certified Data Engineer, AWS Certified Data Analytics, or Google Cloud Professional Data Engineer.
• Hands-on experience with cloud-based data warehouses (Snowflake, BigQuery, Azure Synapse Analytics) and streaming platforms (Apache Kafka).
• Prior working experience in tier-1 enterprise technology consulting firms, financial services, or e-commerce data platforms.
• Advanced performance tuning experience for large-scale distributed datasets.
• Bilingual proficiency in English and regional languages.

Recruitment Pro Tip:

When applying for data engineering roles in Chennai, ensure your resume explicitly highlights your Apache Spark tuning depth, complex ETL pipeline architecture, and Python/Scala coding proficiency.

Salary/Rate: Competitive market rate commensurate with experience

Deadline: Open until filled

Notice Period: Immediate to short notice preferred

Contract Duration: Contract / Full-Time Hybrid (Chennai)