AWS-Scala Data Engineer

Coforge; Dadri; On-site; INR 2,400,000 - 3,600,000; Full time

Job summary

Coforge in India is seeking an AWS-Scala Data Engineer to design, build, and maintain scalable data pipelines on AWS. You will develop ETL workflows with Airflow, write Python code, and use SQL to query and analyze large datasets, collaborating with data scientists and business stakeholders.

Desirable experience includes Spark, Hadoop, and CI/CD practices; strong problem solving and data quality focus are essential for success in this role.

Qualifications

• Strong Scala skills for data manipulation and automation.
• Advanced SQL querying and optimization.
• Hands-on AWS experience with data pipelines (ETL).

Responsibilities

• Design and implement robust, scalable data pipelines on AWS.
• Develop and maintain ETL workflows using Airflow.
• Write efficient and optimized Python for data processing and transformation.
• Work with SQL to query, manipulate, and analyze large datasets.
• Collaborate with data scientists, analysts, and business stakeholders.
• Ensure data quality, integrity, and security across data platforms.
• Monitor and troubleshoot data pipeline performance and reliability.

Skills

Scala

SQL

Airflow

Python

Tools

Airflow

Spark

Hadoop

CI/CD

Job description

We are hiring for a highly skilled and experienced AWS-Scala Data Engineer to join our dynamic team. The ideal candidate will have a strong background in cloud-based data engineering with at least 4 years of hands-on experience in AWS. You will be responsible for designing, building, and maintaining scalable data pipelines and solutions using modern data engineering tools and frameworks.

Key Responsibilities:

• Design and implement robust, scalable, and high-performance data pipelines on AWS.
• Develop and maintain ETL workflows using Airflow.
• Write efficient and optimized code in Python for data processing and transformation.
• Work with SQL to query, manipulate, and analyze large datasets.
• Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders.
• Ensure data quality, integrity, and security across all data platforms.
• Monitor and troubleshoot data pipeline performance and reliability.

Mandatory Skills:

• Scala– strong programming skills for data manipulation and automation.
• SQL – advanced querying and optimization techniques.

Preferred Qualifications:

• Experience with big data technologies (e.g., Spark, Hadoop).
• Familiarity with CI/CD pipelines and DevOps practices.
• Knowledge of data warehousing concepts and tools.