Software Engineer

Mastek Limited; Mumbai; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Mastek Limited is hiring a Software Engineer – AWS-Snowflake Data Engineer based in India. The role centers on building scalable data pipelines using AWS, Snowflake, and Python, with a focus on data ingestion, transformation, and delivery for analytics and AI/ML use cases.

You will work on batch and real-time integration, optimize ELT/ETL processes, and ensure data quality, governance, and security across cloud platforms.

Qualifications

• B.Tech/B.E. in Computer Science or related field
• Snowflake or AWS data engineer certifications preferred
• Strong knowledge of AWS services and data engineering concepts
• Experience with Python and SQL

Responsibilities

• Design, develop, and maintain scalable, secure, and high-performance data pipelines using AWS, Snowflake, and Python.
• Build end-to-end data engineering solutions, covering data ingestion, transformation, validation, storage, and consumption layers.
• Develop batch and real-time data integration frameworks to support business reporting, analytics, and AI/ML use cases.
• Create and optimize ELT/ETL processes to ensure efficient data movement across multiple source systems and cloud platforms.
• Implement robust data quality frameworks and proactively identify, analyze, and resolve data anomalies, inconsistencies, and performance issues.
• Perform root cause analysis for data-related incidents and implement preventive measures to improve platform reliability.
• Design and optimize Snowflake data models, schemas, warehouses, and workloads for performance and cost efficiency.
• Develop reusable Python components, automation scripts, and frameworks to improve engineering productivity and operational efficiency.
• Collaborate with business, analytics, and technology teams to understand data requirements and translate them into scalable technical solutions.
• Implement monitoring, alerting, logging, and observability mechanisms for data pipelines and platforms.
• Follow and promote engineering best practices, including code reviews, version control, CI/CD, automated testing, documentation, and secure development standards.
• Ensure adherence to data governance, security, compliance, and access control requirements.
• Continuously evaluate and adopt emerging technologies, tools, and best practices to improve the overall data platform ecosystem.

Skills

AWS services

Snowflake

Python

End-to-end data pipelines

SQL

Airflow

Data governance

Education

B.Tech/B.E. in CS/EC or related field

Tools

Airflow

Snowflake

Job description

Select how often (in days) to receive an alert:

Job Title

Software Engineer – AWS-Snowflake Data Engineer

Expected Work Experience

3 to 6 Years

Job Location

India

Key Roles and Responsibilities

• Design, develop, and maintain scalable, secure, and high-performance data pipelines using AWS, Snowflake, and Python.
• Build end-to-end data engineering solutions, covering data ingestion, transformation, validation, storage, and consumption layers.
• Develop batch and real-time data integration frameworks to support business reporting, analytics, and AI/ML use cases.
• Create and optimize ELT/ETL processes to ensure efficient data movement across multiple source systems and cloud platforms.
• Implement robust data quality frameworks and proactively identify, analyze, and resolve data anomalies, inconsistencies, and performance issues.
• Perform root cause analysis for data-related incidents and implement preventive measures to improve platform reliability.
• Design and optimize Snowflake data models, schemas, warehouses, and workloads for performance and cost efficiency.
• Develop reusable Python components, automation scripts, and frameworks to improve engineering productivity and operational efficiency.
• Collaborate with business, analytics, and technology teams to understand data requirements and translate them into scalable technical solutions.
• Implement monitoring, alerting, logging, and observability mechanisms for data pipelines and platforms.
• Follow and promote engineering best practices, including code reviews, version control, CI/CD, automated testing, documentation, and secure development standards.
• Ensure adherence to data governance, security, compliance, and access control requirements.
• Continuously evaluate and adopt emerging technologies, tools, and best practices to improve the overall data platform ecosystem.

Skills & Competencies

Technical Skills

• Strong hands-on experience with AWS services such as S3, Lambda, Glue, Airflow, EventBridge, IAM, and related cloud-native services.
• Advanced proficiency in Snowflake, including procedures, data modeling, performance tuning, Snowpipe, Streams, Tasks, Dynamic Tables, and security frameworks.
• Strong programming skills in Python with experience developing scalable data processing frameworks and automation solutions.
• Expertise in building and maintaining end-to-end data pipelines in cloud environments.
• Strong knowledge of SQL and database design principles.
• Experience with data orchestration and workflow management tools such as Airflow or equivalent.
• Experience working with structured, semi-structured, and unstructured data.
• Knowledge of data quality, data lineage, metadata management, and monitoring practices.
• Familiarity with API integrations, data lake architectures, and modern analytics platforms.

Competencies

• Strong analytical and problem-solving skills with the ability to identify and resolve complex data issues.
• Proven ability to detect, investigate, and remediate data anomalies and quality concerns.
• Strong understanding of scalable architecture and data engineering design patterns.
• Commitment to coding standards, development best practices, and documentation.
• Excellent stakeholder communication and collaboration skills.
• Ability to work independently in a fast-paced, agile environment.
• Continuous learning mindset with a focus on innovation and operational excellence.
• Strong ownership, accountability, and attention to detail.

Other Pointers

• Experience bracket for this requirement in terms of years – 3 to 6 years
• Education – B. Tech.
• Certifications – preferable - Snowflake or AWS certified data engineer
• Skillsets – AWS (S3, Lambda, Glue, Airflow, IAM, etc.), Snowflake, Python
• Dedicated/Remote Support – Dedicated
• Service window like:
  • time -9 AM To 6 PM
  • days – Monday to Friday
  • region like india/global – India, IST
  • location of service – Kurla office
• Deliverables like documentation/knowledge transfer – Yes.
  • Documentation of all jobs/ design diagrams, etc.
  • and KT needs to be completed before marking the project as completion.