Senior Software Engineer

SmartStream; Maharashtra; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

SmartStream is seeking a Data Engineering Leader to drive enterprise data integration and modernization initiatives. You will design cloud-native ETL architectures and guide migration from legacy platforms toward scalable data solutions.

In this role, you will partner with BI teams to optimize reporting with Power BI and Tableau, and mentor ETL developers and analysts while shaping governance and development standards.

Qualifications

• 7+ years of data integration and data engineering experience.
• "Expert in Talend and/or Informatica."
• "Advanced SQL expertise."
• "Python and PySpark proficiency."
• "Experience with PostgreSQL and Oracle."
• "Hands-on with Databricks and Snowflake."
• "Proficient in Power BI and Tableau."
• "Experience with Azure Data Factory and/or AWS Glue."
• "Experience with Apache Airflow."
• "Git, CI/CD, and DevOps practices."

Responsibilities

• Lead enterprise data integration and modernization initiatives.
• Design and implement cloud-native ETL architectures.
• Drive migration from legacy platforms to modern data engineering solutions.
• Partner with BI teams to design scalable reporting and semantic data models.
• Establish best practices for Power BI and Tableau data consumption layers.
• Optimize enterprise reporting performance.
• Architect end-to-end solutions using Databricks, Snowflake, Azure Data Factory, AWS Glue, Airflow, Spark.
• Drive AI-enabled development practices and AI-assisted code conversion.
• Develop intelligent monitoring, reconciliation, and anomaly detection capabilities.
• Establish development standards and governance; mentor ETL Developers and Analysts; participate in hiring and onboarding.

Skills

Data Integration

ETL/ELT

Leadership

SQL

Python

PySpark

Problem Solving

Education

Bachelor's degree in Computer Science or related

Tools

Talend

Informatica

Databricks

Snowflake

Azure Data Factory

AWS Glue

Apache Airflow

Power BI

Tableau

PostgreSQL

Oracle

Spark

Git

CI/CD

Job description

Data Engineering Leadership

• Lead enterprise data integration and modernization initiatives.
• Design and implement cloud-native ETL architectures.
• Drive migration efforts from legacy platforms to modern Data Engineering solutions.

Analytics Enablement

• Partner with BI teams to design scalable reporting and semantic data models.
• Establish best practices for Power BI and Tableau data consumption layers.
• Optimize enterprise reporting performance.

Architecture & Modern Platforms

• Architect end-to-end solutions leveraging:
• • Databricks
  • Snowflake
  • Azure Data Factory
  • AWS Glue
  • Apache Airflow
  • Spark

AI-Driven ETL Modernization

• Drive adoption of AI-enabled development practices.
• Lead ETL migration projects using Generative AI-assisted code conversion and test automation.
• Develop intelligent monitoring, reconciliation, and anomaly detection capabilities.

Leadership & Mentorship

• Establish development standards and governance policies.
• Mentor ETL Developers and ETL Analysts.
• Participate in hiring, technical assessments, and onboarding.

Additional Technical Skills (Senior ETL Developer)

Required

• 7+ years of Data Integration and Data Engineering experience
• Expert in Talend and/or Informatica
• Advanced SQL expertise
• Python and PySpark
• PostgreSQL and Oracle
• Databricks
• Snowflake
• Power BI and Tableau
• Azure Data Factory and/or AWS Glue
• Apache Airflow
• Git, CI/CD, DevOps

Preferred

• Microsoft Azure Data Engineer Certification
• AWS Data Analytics Certification
• SnowPro Certification
• Experience with Collibra, Alation, or Informatica Data Governance
• Experience leading ETL modernization programs