Senior Software Engineer

Smartstream Limited; Pune District; On-site; INR 4,000,000 - 6,000,000; Full time

Job summary

Smartstream Limited seeks a Data Engineering Leader to drive enterprise data integration and modernization in Pune. You will design cloud-native ETL architectures and lead migrations from legacy systems to modern Data Engineering solutions, while partnering with BI teams to optimize reporting and semantic data models.

You will mentor ETL developers, set development standards, and guide architecture across Databricks, Snowflake, ADF, Glue, Airflow, and Spark, shaping analytics-driven outcomes.

Qualifications

• 7+ years of Data Integration and Data Engineering experience.
• Expert in Talend and/or Informatica.
• Advanced SQL expertise.
• Python and PySpark experience.
• Databricks and Snowflake proficiency.
• Power BI and Tableau understanding.
• Azure Data Factory and/or AWS Glue experience.
• Apache Airflow, Git, CI/CD and DevOps basics.

Responsibilities

• Lead enterprise data integration and modernization initiatives.
• Design and implement cloud-native ETL architectures.
• Drive migration from legacy platforms to modern Data Engineering solutions.
• Partner with BI teams to design scalable reporting and semantic data models.
• Establish best practices for Power BI and Tableau data consumption layers.
• Architect end-to-end solutions leveraging Databricks, Snowflake, ADF, Glue, Airflow, Spark.
• Drive AI-enabled ETL modernization and test automation.
• Mentor ETL Developers and Analysts; participate in hiring and onboarding.

Skills

Data Integration

Data Engineering

Advanced SQL

Python

PySpark

Databricks

Snowflake

Power BI

Tableau

Azure Data Factory

AWS Glue

Apache Airflow

Git CI/CD DevOps

Education

Bachelor's degree in Computer Science or related field

Tools

Talend

Informatica

PostgreSQL

Oracle

Databricks

Snowflake

Power BI

Tableau

Azure Data Factory

AWS Glue

Apache Airflow

Git

CI/CD

Job description

Data Engineering Leadership

• Lead enterprise data integration and modernization initiatives.
• Design and implement cloud-native ETL architectures.
• Drive migration efforts from legacy platforms to modern Data Engineering solutions.

Analytics Enablement

• Partner with BI teams to design scalable reporting and semantic data models.
• Establish best practices for Power BI and Tableau data consumption layers.
• Optimize enterprise reporting performance.

Architecture & Modern Platforms

• Architect end-to-end solutions leveraging:
  • Databricks
  • Snowflake
  • Azure Data Factory
  • AWS Glue
  • Apache Airflow
  • Spark

AI-Driven ETL Modernization

• Drive adoption of AI-enabled development practices.
• Lead ETL migration projects using Generative AI-assisted code conversion and test automation.
• Develop intelligent monitoring, reconciliation, and anomaly detection capabilities.

Leadership & Mentorship

• Establish development standards and governance policies.
• Mentor ETL Developers and ETL Analysts.
• Participate in hiring, technical assessments, and onboarding.

Additional Technical Skills (Senior ETL Developer)

Required

• 7+ years of Data Integration and Data Engineering experience
• Expert in Talend and/or Informatica
• Advanced SQL expertise
• Python and PySpark
• PostgreSQL and Oracle
• Databricks
• Snowflake
• Power BI and Tableau
• Azure Data Factory and/or AWS Glue
• Apache Airflow
• Git, CI/CD, DevOps

Preferred

• Microsoft Azure Data Engineer Certification
• AWS Data Analytics Certification
• SnowPro Certification
• Experience with Collibra, Alation, or Informatica Data Governance
• Experience leading ETL modernization programs