ETL Tester

NovintiX

Coimbatore

On-site

INR 900,000 - 1,500,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

NovintiX is seeking a capable Data Engineer to design, build, and maintain scalable ETL/ELT pipelines using Python, PySpark, SQL, and Azure cloud technologies. You will develop data workflows in Azure Data Factory and Databricks, optimize batch and streaming processes, and collaborate with analysts to meet analytics and governance requirements.

The role requires 4–6 years of experience in data engineering, strong data warehousing knowledge, and hands-on Azure experience.

Qualifications

  • Bachelor's degree in CS/IT or related field.
  • 4–6 years of professional experience in data engineering and ETL development.
  • Strong Python, PySpark and SQL skills.
  • Experience designing and building ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
  • Knowledge of data warehousing concepts, dimensional modeling, and big data processing.
  • Experience with Azure Data Lake, Azure SQL, and Azure Storage.
  • Hands-on experience with Spark optimization, data transformations, and distributed processing.
  • Familiarity with REST APIs, JSON, Parquet, Delta Lake, and other data formats.
  • Understanding CI/CD pipelines, Git version control, and DevOps practices.
  • Experience in regulated industries such as life sciences or healthcare is a plus.

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines for data integration and analytics.
  • Develop data engineering solutions using Python, PySpark, SQL, and Azure cloud technologies.
  • Build and optimize batch and real-time data processing pipelines using Azure Databricks.
  • Develop and orchestrate data workflows with Azure Data Factory (ADF).
  • Design and maintain data models, data lakes, and cloud-based data platforms for analytics.
  • Optimize data processing performance with Spark transformations and tuning.
  • Collaborate with analysts and architects to deliver scalable data solutions.
  • Ensure data quality, governance, and security across platforms.
  • Monitor and troubleshoot ETL jobs, pipelines, and bottlenecks.
  • Implement CI/CD and deployment strategies for data workflows.
  • Participate in Agile/Scrum ceremonies and maintain technical docs.

Skills

Python
PySpark
SQL
Data modeling
Agile/Scrum
Stakeholder comms

Education

Bachelor's degree in CS/IT

Tools

Azure Data Factory
Azure Databricks
Azure Data Lake
Azure SQL
Azure Storage
Spark
Git
CI/CD
Delta Lake
REST APIs
Parquet

Job description

NovintiX is a fast-growing engineering and digital transformation company serving top Life Sciences, MedTech, and Healthcare clients across the US, Ireland, and Europe. We specialize in delivering high-impact digital programs, engineering services, and talent solutions that accelerate innovation, efficiency, and compliance.

Responsibilities
  • Design, develop, and maintain scalable ETL/ELT pipelines for enterprise data integration and analytics solutions.
  • Develop data engineering solutions using Python, PySpark, SQL, and Azure cloud technologies.
  • Build and optimize batch and real-time data processing pipelines using Azure Databricks.
  • Develop and orchestrate data workflows using Azure Data Factory (ADF).Perform data extraction, transformation, and loading activities from multiple structured and unstructured data sources.
  • Design and maintain data models, data lakes, and cloud-based data platforms for analytics and reporting requirements.
  • Optimize data processing performance through efficient Spark transformations, partitioning, and query tuning techniques.
  • Collaborate with business analysts, data architects, and engineering teams to understand business requirements and deliver scalable data solutions.
  • Ensure data quality, integrity, governance, and security standards across enterprise data platforms.
  • Monitor and troubleshoot ETL jobs, pipeline failures, and performance bottlenecks.
  • Implement CI/CD and deployment strategies for data engineering workflows and cloudbased solutions.
  • Participate in Agile/Scrum ceremonies including sprint planning, daily stand-ups, and retrospectives.
  • Create and maintain technical documentation, data flow diagrams, and operational support documents.
Required Skills
  • Bachelor's degree in computer science, Information Technology, or related field. 4–6 years of professional experience in Data Engineering and ETL development.
  • Strong hands-on experience in Python, PySpark, and SQL development.
  • Expertise in designing and developing ETL/ELT pipelines using Azure Data Factory and Azure Databricks.
  • Strong understanding of data warehousing concepts, dimensional modeling, and big data processing.
  • Experience working with Azure cloud services including Azure Data Lake, Azure SQL, and Azure Storage Accounts.
  • Hands-on experience with Spark optimization techniques, data transformations, and distributed data processing.
  • Experience handling large-scale, structured and unstructured datasets.
  • Familiarity with REST APIs, JSON, Parquet, Delta Lake, and other modern data formats.
  • Understanding CI/CD pipelines, Git version control, and DevOps practices.
  • Knowledge of performance tuning, troubleshooting, and monitoring of ETL/data pipelines.
  • Strong analytical, troubleshooting, and problem-solving skills.
  • Effective stakeholder communication and requirements gathering skills.
  • Experience working in regulated industries such as MedTech, Pharma, Healthcare, or Manufacturing is preferred.
  • Hands-on experience with Python, PySpark, SQL, Azure Databricks, Azure Data Factory, Azure Data Lake, Git, and cloud-based data platforms.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

NovintiX • Coimbatore District

On-site
INR 1,000,000 - 1,500,000
Software Engineer - Data Engineer
Software Engineer - Data Engineer

Optum • Hyderabad

On-site
INR 900,000 - 1,600,000
Etl Developer
Etl Developer

ADP Private Limited • Hyderabad

Hybrid
INR 1,200,000 - 1,800,000
ETL Testing with Bigquery
ETL Testing with Bigquery

enGen Global • Hyderabad, Chennai

On-site
INR 1,200,000 - 1,600,000
ETL Data Testing/ Data Quality Engineer- Databricks
ETL Data Testing/ Data Quality Engineer- Databricks

Tredence Inc. • Bengaluru

On-site
INR 1,000,000 - 1,500,000
SSIS and Azure Data Engineer
SSIS and Azure Data Engineer

Weekday • Maharashtra

On-site
INR 1,200,000 - 2,000,000
Data Engineer
Data Engineer

Cnx • Bengaluru

On-site
INR 1,200,000 - 1,500,000
ETL Tester with Python and Databricks Experience
ETL Tester with Python and Databricks Experience

InfoBeans • Indore District, Pune District

On-site
INR 700,000 - 1,000,000
Data Engineer
Data Engineer

Tibil Solutions • Bengaluru

On-site
INR 900,000 - 1,500,000
ETL Tester - Data Quality Engineer
ETL Tester - Data Quality Engineer

EPAM Systems Inc • Gurugram District

Hybrid
INR 1,200,000 - 2,400,000