Cloud Data Engineer (AWS-Big Data)

InfoCepts; Pune District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

A leading data solutions company in Pune is seeking a Cloud Data Engineer. The role involves building data models and integrating AWS services to enhance cloud journey and analytics. Candidates should have at least 5 years of IT experience, with 3 years focused on AWS projects, and a Bachelor's in a relevant field. Strong skills in SQL, AWS services, and Big Data technologies are essential. This position emphasizes talent development and expertise sharing within the team.

Qualifications

• 5+ years of IT experience and 3+ years in AWS-related projects.
• Master's degree is a plus.
• Technical certifications or continued learning is advantageous.

Responsibilities

• Develop and share expertise in cloud solutions.
• Integrate AWS services to create seamless workflows.
• Design and maintain scalable data pipelines using AWS.

Skills

AWS Services

Big Data

Strong SQL Skills

Scala

Python

Shell Scripts

PySpark

Education

Bachelor's degree in computer science or related field

Tools

AWS S3

AWS EC2

AWS EMR

Hadoop

Kafka

Informatica

Job description

Purpose of the Position

As a Cloud Data Engineer, this position requires candidate who are enthusiastic about specialized skills in AWS Services and Big Data. As a member of the team, you will help our clients, by building Models that supports to progress on their AWS cloud journey.

Key Result Areas and Activities

• Share and Build Expertise- Develop and share expertise in cloud solutioning domain and actively mine the experience and expertise in the organization for sharing across teams and clients in the firm. Support the cloud COE initiatives.
• Nurture and Grow Talent- Provide support for recruitment, coaching and mentoring, and building practice capacity in the firm in Cloud.
• AWS Integration- Integrate various AWS services to create seamless workflows and data processing solutions.
• Data Pipeline Development- Design, build, and maintain scalable data pipelines using AWS services to support data processing and analytics.
• Knowledge of following AWS Services required: S3, EC2, EMR, Severless, Athena, AWS Glue, Lambda, Step Functions
• Big Data- Hadoop, Hive, Spark, YARN
• Programming Language– Scala, Python, Shell Scripts, PySpark
• Operating System- Any flavor of Linux, Windows
• Strong SQL Skills
• Hands-on in developing ETL workflows comprising complex transformations like SCD, deduplications, aggregations, etc.
• Experience and Technical Knowledge in Databricks
• Strong Experience with event stream processing technologies such as Kafka, KDS
• Knowledge of Operating System- Any flavor of Linux, ETL Tools Informatica, Talend
• Experience with at least one major Hadoop platform (Cloudera, Hortonworks, MapR) will be a plus

Qualifications

• Overall 5+years of IT experience & 3+ years of AWS related project
• Bachelors degree in computer science, engineering, or related field (Masters degree is a plus)
• Demonstrated continued learning through one or more technical certifications or related methods

Qualities

• Hold strong technical knowledge and experience
• Should have the capability to deep dive and research in various technical related fields
• Self-motivated and focused on delivering outcomes for a fast growing team and firm
• Able to communicate persuasively through speaking, writing, and client presentations