Senior Data Engineer

Finarb Analytics Consulting; Kolkata District, Hyderabad; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Finarb Analytics Consulting in India is seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines and workflows using Azure Data Factory and related technologies.

You will ensure data quality, support modeling and BI efforts, and collaborate with teams to deliver robust ETL solutions for real-time and batch processing.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proficiency in SQL and relational database design.
• Strong scripting skills for data/file manipulation (e.g., Python).
• 3+ years of experience with Azure Data Factory, SQL Server, or similar tools for data integration and transformation.
• Hands-on experience with scalable data systems, including batch and real-time processing.
• Strong understanding of ETL pipelines, data modeling, and BI systems.
• Solid knowledge of event processing and workflow orchestration.
• Ability to write high-quality, maintainable code and follow best practices in software engineering.
• Excellent problem-solving and debugging skills.
• A team player with strong communication skills and a drive for results.

Responsibilities

• Designing, building, and maintaining scalable data pipelines and workflows.
• Developing and optimizing data ingestion, transformation, and integration processes.
• Working with Azure Data Factory and related technologies to build and orchestrate data workflows.
• Ensuring data quality and integrity through robust validation and monitoring systems.
• Supporting data modeling efforts, including relational and dimensional modeling.
• Building reporting and monitoring solutions to ensure efficient and accurate data operations.
• Processing, logging, and correlating data from multiple sources to support business needs.

Skills

SQL

Azure Data Factory

Python

Data pipelines

ETL

Business Intelligence

Problem solving

Team communication

Education

Bachelor's degree in Computer Science / Engineering

Tools

Azure Data Factory

SQL Server

Power BI

Azure Data Lake

Job description

Responsibilities:

• Designing, building, and maintaining scalable data pipelines and workflows.
• Developing and optimizing data ingestion, transformation, and integration processes.
• Working with Azure Data Factory and related technologies to build and orchestrate data workflows.
• Ensuring data quality and integrity through robust validation and monitoring systems.
• Supporting data modeling efforts, including relational and dimensional modeling.
• Building reporting and monitoring solutions to ensure efficient and accurate data operations.
• Processing, logging, and correlating data from multiple sources to support business needs.

Requirements:

• Bachelors degree in Computer Science, Engineering, or a related field.
• Proficiency in SQL and relational database design.
• Strong scripting skills for data/file manipulation (e.g., Python or similar languages).
• 3+ years of Experience with Azure Data Factory, SQL Server, or similar tools for data integration and transformation.
• Hands-on experience with scalable data systems, including batch and real-time
• processing.
• Strong understanding of ETL pipelines, data modeling, and Business Intelligence
• systems.
• Solid knowledge of event processing and workflow orchestration.
• Ability to write high-quality, maintainable code and follow best practices in
• software engineering.
• Excellent problem-solving and debugging skills.
• A team player with strong communication skills and a drive for results.

Nice to Have:

• Experience with cloud platforms, particularly Azure or AWS.
• Advanced knowledge of SQL and relational database performance optimization.
• Familiarity with tools like Azure Data Lake, Power BI, or similar analytics platforms.