Interesting Job Opportunity: Auxo AI - Senior Data Engineer - AWS

Auxo AI; Bengaluru; Hybrid; INR 1,800,000 - 3,000,000; Full time

Job summary

AuxoAI in Bengaluru is seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines using AWS services such as S3, Glue, EMR, Lambda, and Redshift. You will collaborate with data scientists to support analytics and machine learning initiatives, while optimizing storage and retrieval for performance and cost efficiency.

The role emphasizes data governance and security, troubleshooting, and staying current with new data technologies.

Qualifications

• 6-8 years of prior data engineering experience with designing and building data pipelines.
• Strong proficiency in AWS services: S3, Glue, EMR, Lambda and Redshift.
• Solid programming skills in Python, Java, or Scala.
• Experience with SQL and NoSQL databases and big data technologies.
• Familiarity with containers (Docker/Kubernetes) and orchestration tools (Airflow).

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes using AWS services.
• Collaborate with data scientists and analysts to meet data requirements for analytics and ML initiatives.
• Optimize data storage and retrieval for performance, reliability, and cost efficiency.
• Implement data governance and security best practices to ensure compliance and data integrity.
• Troubleshoot data pipeline issues and provide timely resolution and monitoring.
• Stay updated on emerging data engineering technologies and trends to enhance capabilities.

Skills

Data Engineering

ETL design

Analytics collaboration

Education

Bachelor's or Master's in Computer Science or Engineering

Tools

AWS S3

AWS Glue

AWS EMR

AWS Lambda

AWS Redshift

Docker

Kubernetes

Apache Airflow

Job description

About AuxoAI

AuxoAI is a global platform-based services firm. We help companies turn their strategies into practical digital and AI solutions. By understanding how our clients make decisions, we use digital and Artificial Intelligence (AI) technologies to drive growth, enhance their operations, improve customer experiences, and provide clear, actionable insights from their data.

What We Do

We work across various industries such as healthcare, high-tech, consumer packaged goods (CPG), finance etc., and in sales, marketing, and customer support functions. We help our clients with accelerating their digital and AI journeys through :

• AI Application Development
• Data, Digital and Cloud acceleration using AI
• AI Native Product Engineering

Location

Bangalore (Hybrid - 3 Days a week in Office)

Positions

Senior Associate/ Manager

Required Experience

6 to 9 years

Role Summary

AuxoAI is seeking a skilled and experienced Data Engineer to join our dynamic team. The ideal candidate will have 6-8 years of prior experience in data engineering, with a strong background in AWS (Amazon Web Services) technologies. This role offers an exciting opportunity to work on diverse projects, collaborating with cross-functional teams to design, build, and optimize data pipelines and :

• Design, develop, and maintain scalable data pipelines and ETL processes leveraging AWS services such as S3, Glue, EMR, Lambda, and Redshift.
• Collaborate with data scientists and analysts to understand data requirements and implement solutions that support analytics and machine learning initiatives.
• Optimize data storage and retrieval mechanisms to ensure performance, reliability, and cost-effectiveness.
• Implement data governance and security best practices to ensure compliance and data integrity.
• Troubleshoot and debug data pipeline issues, providing timely resolution and proactive monitoring.
• Stay abreast of emerging technologies and industry trends, recommending innovative solutions to enhance data engineering capabilities.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 6-8 years of prior experience in data engineering, with a focus on designing and building data pipelines.
• Proficiency in AWS services, particularly S3, Glue, EMR, Lambda, and Redshift.
• Strong programming skills in languages such as Python, Java, or Scala.
• Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools (e.g. Apache Airflow) is a plus.

(ref:hirist.tech)