Senior Data Engineer

Infobeans; Indore District, Pune District; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Infobeans in Indore seeks a Senior Data Engineer to lead data lakehouse development, including requirements gathering, modeling, ETL design, and analytics dashboards.

You will build ETL pipelines with Talend, SQL and Python, ingest data into Azure Synapse, Hive or Snowflake, implement data quality checks, optimize storage, and collaborate with product managers and data scientists on insights for decision makers.

Qualifications

• Minimum 5 years of experience in ETL development and data mappings validation.
• Hands-on experience with ETL Tool Talend (minimum 5 years).
• Proficient in SQL with at least 8 years of experience developing complex queries for data validation, troubleshooting and business analysis. Experience in Python for data processing and transformation tasks.

Responsibilities

• Data lakehouse development including requirements gathering, modeling, ETL design and analytics dashboards.
• Collaborate with stakeholders to analyze operational data and provide data-driven recommendations.
• Develop SQL-based analyses and actionable insights for reporting and analytics.

Job description

As a Senior Data Engineer, you will be involved in data Lakehouse development including requirements gathering, database modeling, ETL design development and dashboard/report development activities.

You will be working with the Customer Experience team to build and enhance a cloud-based warehouse of operational data to drive analytics.

You will be responsible for developing ETL/data pipelines using Talend, SQL, Python and ingesting data from various external sources into large MPP data warehouses such as Azure Synapse, Hive, Snowflake, or similar platforms.

You will frequently conduct data analysis, ingest data from various internal and external sources, write advanced SQL queries, and optimize data storage needed by business and executive operations.

You will partner with business stakeholders to analyze operational data, investigate trends, answer ad hoc business questions, and provide data-driven recommendations that support strategic and operational decision-making.

You will perform exploratory data analysis, validate data quality, identify anomalies,reconcile data across multiple sources, and translate business requirements into SQL-based analyses and actionable insights.

You will develop complex SQL queries to extract, profile, reconcile, and analyze large datasets, helping stakeholders understand business performance, customer behavior,operational metrics, and data quality issues.

You will collaborate closely with Product Managers, Business Analysts, BI Developers,and Data Scientists to ensure data is accurate, reliable, and optimized for reporting,advanced analytics, and machine learning initiatives.

Position Requirements

Minimum 5 years of experience in ETL development and coding, including validation of complex data mappings.

Hands-on experience with ETL Tool Talend (minimum 5 years).

Proficient in SQL with at least 8 years of experience developing complex SQL queries for data validation, troubleshooting, and business analysis. Experience in Python for data processing and transformation tasks.Strong experience with data warehouse databases such as Azure Synapse, Hive,Snowflake, SQL Server, or Redshift.