Software Engineering Manager

Careernet; Hyderabad, Bengaluru; On-site; INR 3,500,000 - 6,500,000; Full time

Job summary

Careernet is seeking a senior data engineering leader to drive technical delivery while mentoring teams in Hyderabad. You will oversee end-to-end data pipelines, enforce data quality and profiling standards, and champion scalable analytics platforms across the organization.

The role requires extensive Python and PySpark experience, Databricks proficiency, and strong SQL capabilities to enable analytics-driven decision making. Collaboration with business stakeholders is essential.

Qualifications

• 11–13 years of experience in data management, data analysis, data profiling, and statistical techniques.
• 5 years managing data engineering teams.
• Strong Python and PySpark experience; Databricks exposure.

Responsibilities

• Lead and manage data engineering teams, balancing technical delivery with people leadership and execution.
• Own data quality practices across pipelines, including profiling, validation, and remediation workflows.
• Develop and optimize data processing using Python and PySpark on Databricks.
• Write and maintain advanced SQL queries across multiple databases to support analytics and data products.
• Ensure data pipelines follow ETL/ELT standards and support downstream analytics ecosystems.

Skills

People Management

Data quality

Data profiling

Data validation

Stakeholder management

Problem solving

Education

Any Graduation

Tools

Databricks

PySpark

SQL

Python

AWS

ETL

Job description

Key Skills: Pyspark, People Management, Databricks, SQL, Python, Data Engineer, Data quality, AWS, ETL

Roles and Responsibilities:

• Lead and manage data engineering teams, balancing technical delivery with people leadership and execution.
• Own data quality practices across pipelines, including profiling, validation, and remediation workflows.
• Develop and optimize data processing using Python and PySpark on Databricks.
• Write and maintain advanced SQL queries across multiple databases to support analytics and data products.
• Ensure data pipelines follow ETL/ELT standards and support downstream analytics ecosystems.

Skills Required:

• 11 - 13 years of experience in data management, data analysis, data profiling, and statistical techniques; including 5 years managing data engineering teams
• Strong experience in Python and PySpark.
• Hands-on experience with Databricks.
• Strong knowledge of SQL and complex query development.
• Experience in Data Engineering and ETL/ELT.
• Strong understanding of Data Quality, Data Profiling, and Data Validation.
• Experience managing and mentoring data engineering teams.Good understanding of data pipelines and analytics data platforms.
• Strong problem-solving, communication, and stakeholder management skills.

Good to Have

• Experience with AWS cloud services.
• Knowledge of data governance and data management practices.
• Experience with statistical and data analysis techniques.

Education:

Any Graduation