Senior Data Engineer - L3

Wayfair; Bengaluru; Hybrid; INR 4,000,000 - 7,000,000; Full time

Job summary

Wayfair in Bengaluru is seeking a Senior Data Engineer to join the Data Engineering team. The role is inherently multi-functional, collaborating with Client Experience, Data Science, Analysts, and Application teams to drive data-driven product development.

You will design data models, build pipelines, and launch data products focused on Search, Recommendations, and Marketing. Strong data modeling, ETL, and Big Data tech experience are essential, along with leadership and communication skills.

Qualifications

• Bachelor/Master in Computer Science or related field or equivalent experience.
• 6+ years of data engineering experience with web-scale datasets.
• Strong data modeling, ETL development, and data lake architecture.
• Experience with Hadoop, Spark, Hive, Presto, Airflow and related tools.
• Proficiency in Python or Scala.
• Experience building distributed data systems and performance tuning.
• Leadership, mentoring, and cross-functional collaboration skills.
• Strong business acumen and ability to communicate technical results.

Responsibilities

• Design, build, and launch data models, pipelines, and data products for Search, Recommendations, and Marketing.
• Help teams derive insights, create features using data, and power ML models.
• Build cross-functional relationships to understand data needs and standardize metrics.
• Utilize modern data engineering tech including streaming and cloud infrastructure.

Skills

Data modeling

ETL development

Data lake architecture

Big Data technologies

Python

Scala

Distributed systems

Data Warehousing

Leadership

Communication

Education

Bachelor/Master in Computer Science or related

Tools

Hadoop

Spark

Hive

Presto

Airflow

BigQuery

Dataproc

GCS

Dataflow

Job description

Candidates for this position are preferred to be based in Bangalore, India and will be expected to comply with their team's hybrid work schedule requirements.

About the Role

As a Senior Data Engineer, you will be part of the Data Engineering team with this role being inherently multi-functional, and the ideal candidate will work with Client Experience, Data Scientist, Analysts, Application teams across the company, as well as all other Data Engineering squads at Wayfair. We are looking for someone with a love for data, handling ambiguous requirements and the ability to iterate quickly. Successful candidates will have strong engineering skills and communication and a belief that data-driven processes lead to phenomenal products.

What you'll do

• Drive the design, building, and launching of new data models, data pipelines, and data products focussed on Search and Recommendations and Marketing Org.
• Helping teams push the boundaries of insights, creating new product features using data, and powering machine learning models.
• Build cross-functional relationships to understand data needs, build key metrics and standardize their usage across the organization.
• Utilize current and leading edge technologies in software engineering, big data, streaming, and cloud infrastructure

What You'll Need

• Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience 6+ years relevant work experience in the Data Engineering field with web scale data sets.
• Demonstrated strength in data modeling, ETL development and data lake architecture.
• Data Warehousing Experience with Big Data Technologies (Hadoop, Spark, Hive, Presto, Airflow etc.).
• Coding proficiency in at least one modern programming language (Python, Scala, etc)
• Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing and query performance tuning skills of large data sets.
• Industry experience as a Big Data Engineer and working along cross functional teams such as Software Engineering, Analytics, Data Science with a track record of manipulating, processing, and extracting value from large datasets.
• Strong business acumen. Experience leading large-scale data warehousing and analytics projects, including using GCP technologies – Big Query, Dataproc, GCS, Cloud Composer, Dataflow or related big data technologies in other cloud platforms like AWS, Azure etc.
• Experience providing technical leadership and mentor other engineers for the best practices on the data engineering space
• Strong project management skills, including work prioritization, planning, and task delegation
• Ability to effectively communicate (both written and verbally) technical information and the results of engineering design at all levels of the organization