Data Engineer-Staff Software Engineer

Kayavlon Impex Pvt. Ltd; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Kayavlon Impex Pvt. Ltd in Hyderabad is seeking an experienced Data Engineer to support the technology hub. The role involves collaborating with product managers and providing technical input while driving innovative data solutions.

The ideal candidate will have a graduate degree in Computer Science, 9-11 years of experience, and proficiency in Spark, Python, and cloud environments. This position supports a growing technology team.

Qualifications

• 9-11 years of experience in a Data Engineer role.
• High problem-solving skills with analytical thinking.
• Experience with Spark platform and common Python libraries.

Responsibilities

• Analyze customer technical requirements with stakeholders.
• Guide team on design patterns and code quality metrics.
• Continuously improve coding and testing practices across applications.

Skills

Data Engineering

Spark SQL

Python

DevOps

Cloud environments (Azure)

Data pipeline building

Root cause analysis

Automation scripting

Education

Graduate degree in Computer Science or equivalent

Tools

PowerBI

MicroStrategy

GitHub

Jenkins

Databricks

Job description

About the Role

Gap Tech drives innovative retail, e-commerce and global enterprise technology for our headquarters operations and our five iconic brands across the world. We push boundaries. We challenge the status quo. Innovation sits at the core of everything we do. And we’re not here just to execute; we’re here to learn and grow. As individuals, we’re passionate, diverse, innovative and wickedly talented. As a team, we’re making amazing things happen in our offices, our stores and our communities. We are diversifying our talent globally and expanding our reach by opening a technology hub in Hyderabad, India. Growing over time, this center will become critical in enabling technology that powers Gap Inc. business globally.

What You’ll Do

• Partner with Product Managers, and Solution Architects to define and analyze customer’s technical requirements.
• Provides technical input to Statement of Work for External Service Providers
• Ability to break down product management stories into detailed design specifications for medium to complex business problems.
• Experience with building data pipeline from several business applications
• Ability to collaborate with business stakeholders to identify and meet data requirements.
• Guides team members on the use of design patterns and adherence to code quality metrics
• Uses software code management tools and processes to ensure code traceability and good governance.
• Conducts code reviews with other team members (either internal or external service providers)
• Makes continuous improvement to our coding and test practices across applications.
• Works in DevOps team which uses continuous development, integration and testing with automated releases to lower and higher environments with application monitoring plus supporting the product.
• Experience performing root cause analysis on all data and processes to answer specific questions and identify opportunities for improvement.
• Participates in recommending emerging technologies and application solutions.
• Development experience with Enterprise integration patterns

Who You Are

• Candidate with 9-11 years of experience in a Data Engineer role.
• Graduate degree in Computer Science or equivalent
• High Problem-Solving Skills with analytical thinking and logical reasoning
• Having experience working on Spark platform, Spark SQL, Python and common Python libraries.
• Working experience on cloud-based environments such as Databricks on Azure, ADF, PySpark etc.
• Hands on experience writing notebooks using Python/Spark
• Hands on experience in reporting tools like PowerBI, MicroStrategy.
• Well versed with relational databases, nonrelational databases, data streams, and file stores
• Experience with source control systems such as GitHub and Jenkins build and continuous integration tools.
• Automation using Linux shell & Python scripting.