Data Engineer - AWS&Snowflake

Letitbex AI; Telangana; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Letitbex AI is hiring a Data Engineer with 3+ years of experience to design, build and maintain BI data backends, including data warehouses and data lakes. The role focuses on AWS-based data pipelines using PySpark, Glue, and S3, with data integration across business teams.

You will translate requirements into scalable data architectures, optimize ETL processes, and collaborate closely with analytics teams to ensure timely, accurate insights.

Qualifications

• Bachelor’s or Master’s Degree in Computer Science or equivalent experience.
• 3+ years of experience in application design, development and analysis.
• Experience in AWS Cloud Solutions & GCP; Retail industry experience preferred.
• Implement data transformations and data structures for data warehouse and lake/repository.
• Manage cloud/on-premises solutions for data transfer and storage.
• Collaborate with data analysts to ensure data meets reporting needs.
• Experience creating ETL frameworks using AWS services: Lambda, Glue, PySpark, Step Functions, SNS, SQS and Batch.
• Proven ability to drive data governance and strategic ownership.

Responsibilities

• Design, develop, maintain and enhance BI data backend including data warehouse and lakes.
• Coordinate with Business teams for data integration and alignment.
• Build frameworks and pipelines using AWS PySpark and Glue.
• Read data from AWS S3 and apply transformations with Python and GCP.
• Understand and work with AWS Lambda, SNS, SQS events.
• Propose standards and best practices leveraging AWS services.
• Assist application teams in onboarding feeds into built frameworks.
• Follow best design practices during ETL implementation.

Skills

AWS

PySpark

Snowflake

ETL design

Data integration

Python scripting

Education

Bachelor’s or Master’s Degree in Computer Science

Tools

AWS

Glue

S3

Lambda

GCP

Snowflake

Job description

Letitbex AI is a fast-growing AI-driven technology company focused on building intelligent, scalable, and enterprise-grade solutions. We work at the intersection of AI, data engineering, cloud, and business transformation, helping organizations unlock real value from artificial intelligence.

Experience: 3+ Years

Notice Period: Can be considered up to 20 Days

Data Engineer with strong expertise in AWS, PySpark, and Snowflake

• Sound working experience in AWS cloud tech stack and Snowflake
• Coordinate closely with the Business teams for data integration and alignment
• Design,Develop, Maintain, support, and enhance the business intelligence data backend, including data warehouse and datalakes
• Ability to assess the current environment , requirements and propose the Data Engineering Solutions
• Adapt quickly to change in requirements and be willing to work with different technologies if required
• Ability to build frameworks and pipelines using AWS PySpark and Glue
• Able to enhance various Extraction, Ingestion and Enriched Frameworks that are already built using PySpark and Glue
• Able to build the logic by reading the data from AWS S3 and apply the transformations using Python and GCP
• Able to understand the existing AWS Lambda, SNS and SQS Events
• Able to work with platform team in problem solving and troubleshooting activities.
• Propose Standard and Best Practices by leveraging AWS Services
• Apply creative thinking/approach to arrive at technical solutions that enhance business goals and align with corporate technology strategies.
• Help Application teams in onboarding the feeds in to the built-in frameworks
• Make sure to follow best design practices during the implementation of ETL Frameworks
• Develop prototypes, technical proof of concepts and code with various solutions and convert platform architecture blueprints to real life working artifacts

Qualification:

• Bachelor’s or Master’s Degree in Computer Science or equivalent experience
• At least 3+yrs years of experience in application design, development and analysis
• Experience in AWS Cloud Solutions & GCP. Retail Industry experience preferred.
• Implement data transformations and data structures for data warehouse and lake/repository.
• Manage cloud and/or on-premises solutions for data transfer and storage.
• Manage cloud and/or on-premises solutions for data transfer and storage.
• Collaborate and work with data analysts in various functions to ensure that data meets their reporting and analysis needs.
• Experience in creating Various ETL Frameworks in processing or extracting the data from cloud databases by using AWS Services by leveraging Lambda, Glue, PySpark, Step Functions, SNS, SQS and Batch.
• Proven ability to be a strategic thinker to drive the necessary ownership and data governance within the organization
• Ability to evaluate risks and provide business recommendations / solutions in a timely manner
• Ability to remain calm in high stress situations while navigating and leading during times of conflict
• Should have sound knowledge in various AWS Services
• Able to understand the existing Frameworks built in AWS PySpark and Glue
• Able to scan ETL Frameworks and propose optimizations and cost savings.
• Able to work independently and able to take key decisions.
• Comfortable interacting with stakeholders at all levels through Business and IT.