Ataccama DQ Senior Engineer

5 Star Recruitment; Karnataka; Hybrid; INR 2,000,000 - 4,000,000; Full time

Job summary

5 Star Recruitment is seeking an Ataccama DQ Senior Engineer in India. The role focuses on building and maintaining scalable ETL pipelines on big data and cloud platforms, aligning with business owners to collect requirements and drive data solutions.

You will mentor junior engineers, ensure execution aligns with the business vision, and collaborate across teams to deliver robust data tools. Hybrid work model with immediate notice period preferred.

Qualifications

• Experience in building and maintaining reliable and scalable ETL pipelines on big data and cloud platforms.
• Proficiency in PySpark and Python with strong SQL knowledge.
• Experience with Databricks, AWS cloud and DevOps practices.
• Strong data warehouse concepts and data lake/lakehouse understanding.

Responsibilities

• Collaborate with business owners and cross-functional teams to gather technical requirements.
• Design, develop and deploy data tools supporting operations and product use cases.
• Oversee activities of junior data engineers and ensure task execution aligns with business vision.
• Mentor junior engineers and drive data quality initiatives and validations.

Skills

ETL pipelines

PySpark

Python

AWS

Databricks

SQL

Hadoop

Spark

Data modelling

Data quality

Education

16 years of full-time education

Tools

Informatica

Jira

Databricks

Job description

Rs 2,000,000.00 - 4,000,000.00 (Indian Rupee)

About the job Ataccama DQ Senior Engineer

Responsibilities:

Works closely with the business owner / Product owner / Cross functional Team and gathering

technical requirements

Experience in building and maintaining reliable and scalable ETL pipeline on big data & / or Cloud

platform through the collection, storage, processing, and transformation of large datasets

Collaborate with other teams to design, develop and deploy data tools that support both operations

and product use cases

Work with the team in solving problems in big data technologies and prototype solutions to improve

Must Have:

Ensuring proper execution of tasks and alignment with business vision and objectives

Oversee activities of the junior data engineering teams

Works closely with the business owner / Product owner / Cross functional Team and gathering

technical requirements

Experience in building and maintaining reliable and scalable ETL pipeline on big data/Cloud platform

through the collection, storage, processing, and transformation of large data-sets

Experience working with varied forms of data infrastructure inclusive of relational databases such as

SQL, Hadoop, Spark

Proficiency in scripting languages in PySpark, python

Experience in AWS cloud & DevOps

Experience in Databricks

Must have strong experience in data warehouse concepts, understanding Data Lake, Lake House

Concepts, any new Big Data eco system.

Experience in testing and validation in order to support the accuracy of data transformations anddata verification

Should be able to independently drive the requirements, have solutioning mindset facing business

stakeholders

Soft Skills:

Excellent Verbal and Communication skills needed.

Should be a excellent team player.

Good knowledge on Agile principles and experience working in scrum teams using Jira

Should be comfortable to mentor junior engineers in the team (For Senior Data Engineers)

Should be able to operate in an ambiguous environment with minimal guidance.

Must-Haves

Experience in Ataccama is mandatory

candidate must have exp in data quality

Experience working with ETL Informatica

16 years full time education

Experience in Databricks, Database design/data modelling

Mode of work: Hybrid (3 days WFO)

Joining time / Notice Period: Immediate to 30 days