Hiring For Data Engineer: Big Data-AWS at Kolkata

Kotak Mahindra; Kolkata; On-site; INR 6,00,000 - 12,00,000; Full time

Job summary

Join a forward-thinking company where you'll leverage your expertise in AWS and Python to create innovative data solutions. This role offers the opportunity to work within a dynamic team at the IBM Client Innovation Center, focusing on enhancing the hybrid cloud and AI journey for clients across various sectors. You'll collaborate with industry visionaries and utilize cutting-edge technologies to drive meaningful change and innovation. Embrace a culture that values curiosity, creativity, and personal growth while making a significant impact in the world of technology. If you're passionate about data engineering and eager to challenge the status quo, this is the perfect opportunity for you.

Benefits

Health insurance

Flexible working hours

Professional development opportunities

Work-life balance initiatives

Qualifications

• Proficient in AWS, Python, and SQL with experience in data engineering.
• Familiarity with open-source technologies and cloud services is essential.

Responsibilities

• Develop data engineering solutions on AWS Cloud ecosystem.
• Implement scalable data ingestion and processing solutions.

Skills

AWS

Python

SQL

Pyspark

Apache Airflow

dbt

Spark

Django

Pyramid

Flask

Education

Bachelor's Degree in Computer Science or related field

Tools

AWS Glue

AWS S3

AWS Lambda

Job description

Introduction
In this role, you’ll work in our IBM Client Innovation Center (CIC), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. These centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
A career in IBM Consulting is rooted by long-term relationships and close collaboration with clients across the globe.
You’ll work with visionaries across multiple industries to improve the hybrid cloud and AI journey for the most innovative and valuable companies in the world. Your ability to accelerate impact and make meaningful change for your clients is enabled by our strategic partner ecosystem and our robust technology platforms across the IBM portfolio; including Software and Red Hat.
Curiosity and a constant quest for knowledge serve as the foundation to success in IBM Consulting. In your role, you’ll be encouraged to challenge the norm, investigate ideas outside of your role, and come up with creative solutions resulting in groundbreaking impact for a wide network of clients. Our culture of evolution and empathy centers on long-term career growth and development opportunities in an environment that embraces your unique skills and experience.

Your Role and Responsibilities
– Develop data engineering solutions on AWS Cloud ecosystem using AWS, Python, and Pyspark.
– Proficient with using other open-source technologies like Apache Airflow and dbt, Spark / Python or Spark / Scala on AWS Platform.
– SQL OR PL/SQL AND AWS AND Python AND (django or pyramid or flask).
– AWS services – Glue, S3, Lambda.
– SQL scripting coding experience mandatory.

Required Technical and Professional Expertise
– SQL OR PL/SQL AND AWS AND Python AND (django or pyramid or flask).
– AWS services – Glue, S3, Lambda.
– SQL scripting coding experience mandatory.

Preferred Technical and Professional Expertise
– Understanding of DevOps.
– Experience in building scalable end-to-end data ingestion and processing solutions.
– Experience with object-oriented and/or functional programming languages, such as Python, Java, and Scala.

About Business Unit
IBM Consulting is IBM’s consulting and global professional services business, with market-leading capabilities in business and technology transformation. With deep expertise in many industries, we offer strategy, experience, technology, and operations services to many of the most innovative and valuable companies in the world. Our people are focused on accelerating our clients’ businesses through the power of collaboration.

This job requires you to be fully COVID-19 vaccinated prior to your start date. Proof of vaccination status will be required before your start date. During the onboarding process, you will be asked to confirm your vaccination status. If you are unable to get vaccinated for any reason, you can let us know at that stage. Please let us know if you are unable to be vaccinated due to medical or religious reasons. IBM will consider such requests on a case-by-case basis subject to submission of required proof by the candidate before a stipulated date.

Your Life @ IBM
In a world where technology never stands still, we understand that dedication to our clients' success, innovation that matters, and trust and personal responsibility in all our relationships, lives in what we do as IBMers as we strive to be the catalyst that makes the world work better.

Are you ready to be an IBMer?

About IBM
IBM’s greatest invention is the IBMer. We believe that through the application of intelligence, reason, and science, we can improve business, society, and the human condition, bringing the power of an open hybrid cloud and AI strategy to life for our clients and partners around the world.

Location Statement
When applying to jobs of your interest, we recommend that you do so for those that match your experience and expertise. Our recruiters advise that you apply to not more than 3 roles in a year for the best candidate experience.

Being You @ IBM
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics.