Senior Data Engineer

Berkadia Proprietary Holding LLC; Bengaluru; Hybrid; INR 2,500,000 - 4,000,000; Full time

Benefits offered by this job

Leaves policy

Transportation

Medical Insurance

Learn while you Earn

Wellness program

Job summary

Berkadia in Bengaluru seeks a Senior Data Engineer to build and scale data pipelines, integrating data warehousing concepts and modern big data tools. You will own end-to-end data ingestion, transformation, and delivery while collaborating across teams.

The role emphasizes design, implementation, mentoring, and adherence to best practices, with a focus on AWS, CI/CD, and scalable architectures in a hybrid work environment.

Qualifications

• 7+ years of professional experience in data engineering or a closely related field.
• 5–7years hands-on data engineering with end-to-end ownership of optimized ingestion & transformation data flows.
• Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks such as PostgreSQL, Docker, Apache Airflow, AWS Step Functions, or similar.
• 5+ years of experience building high-performance algorithms in scalable languages such as Scala, Python and R
• Strong expertise in SQL (complex queries, performance tuning, analytical functions) & Python (PySpark).
• Proven ability to understand complex requirements, provide concise updates and maintain project timelines.
• Proven experience mentoring junior engineers and performing code reviews
• Strong logical, analytical, problem solving and reporting skills
• 5+ years’ experience with cloud computing in AWS (EMR, AirFlow, Spark, S3, etc…)
• Experience with modern data warehousing and/or lakehouse architecture.
• Well versed with CI/CD, Git, and agile development practices.
• Experience managing large scale products with a passion for quality/efficiency and enforcement of best practices.

Responsibilities

• Research new technology and share knowledge with team and peers
• Design, implement and release data applications in AWS using big data technologies
• Coordinate development efforts across the organization
• Influence team in development standards and processes
• Teach and mentor peers
• Other duties as assigned

Skills

SQL

Python

PySpark

Scala

Data Modeling

ETL/ELT

AWS

Airflow

Spark

PostgreSQL

Docker

CI/CD

Git

Education

Bachelor’s degree in IT/CS/Data Engineering

Post Graduate degree in CS/ML/DE/DS

Tools

PostgreSQL

Docker

Apache Airflow

AWS Step Functions

Spark

S3

EMR

Git

Kubernetes

Job description

Integrity is Everything I We Take the Long View I We believe People Matter I We Stand for Excellence I We Love our Jobs I We Innovate

Job title: Senior Data Engineer

Full Time – Hybrid work model (subject to Berkadia policy changes)

Working HoursSplit Shift (3:00pm to 12:00am)

The Opportunity

As a member of the Data Pipelineteamyou’llbe at the center of building our platform that enables us to redefine the Commercial Real Estate industry.We’rebuilding a data pipeline thatmerges withthe tested design of data warehousing and the latest big data technologies. You will be designing and building data projects while securing core data elements.

In this role, individual willbe requiredto work on one or multiple aspects ofInnovationverticals with the following key responsibilities –

• Researchnew technologyand share knowledge with team and peers
• Design,implementand release data applications in AWS using big data technologies
• Coordinate development efforts across the organization
• Influence team in development standards and processes
• Teach and mentor peers
• Other duties as assigned

Your Qualification

Education

• Bachelor’s degree in information technology, Computer Science,DataEngineering, Information Systems, or a closely related technologyfield;or equivalent practical experience.
• Preferably Post Graduate degreewith a focusinComputer Science, Machine Learning, Data Engineering or Data Science.

Qualifications

Qualifications to perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the experiencerequired:

• 7+ years of professional experience in data engineering or a closely related field.
• 5 –7years ofhands-ondata engineering with end-to-end ownership of optimized ingestion & transformation data flows.
• Proven experience building and maintaining ETL/ELT pipelines using tools/frameworks suchasPostgreSQL,Docker, Apache Airflow, AWSStep Functions, or similar.
• 5+years of experience building high-performance algorithms in scalable languages such as Scala, Python and R
• Strongexpertisein SQL(complex queries, performance tuning, analytical functions)& Python (PySpark).
• Proven ability to understand complex requirements, provide conciseupdatesandmaintainproject timelines.
• Proven experience mentoring junior engineers and performing code reviews
• Strong logical, analytical, problem solving and reporting skills
• 5+ years’ experience with cloud computing in AWS(EMR,AirFlow, Spark, S3,etc…)
• Experience with modern data warehousing and/orlakehousearchitecture.
• Well versedwith CI/CD, Git, and agile development practices.
• Experience managing large scaleproductswith a passionfor quality/efficiency and enforcement of best practices.

Berkadia offers the best-in-class benefits to enable an enjoyable work environment for the employees. Key benefits include –

• Leaves: Berkadia offers a comprehensive leave policy that not only helps you to plan holidays and personalmilestones, butalso covers exigencies such as sickness and bereavement.
• Transportation: Berkadia offers free transportation to every employee, irrespective of their shift timings.
• Medical Insurance: Berkadia has an inclusive medical insurance policy that covers the family members of the employees, including parents.
• Learn while youEarn: Berkadia encourages employees to learn new skills by sponsoring degrees, certifications, training, and workshops.
• Wellness: Berkadia has an extensive wellness program that includes annual health check, eye checkup, dental screening, OPD reimbursement, and Employee Assistance Program.

Berkadia offers the best-in-class benefits to enable an enjoyable work environment for the employees. Key benefits include –

• Leaves: Berkadia offers a comprehensive leave policy that not only helps you to plan holidays and personal milestones, but also covers exigencies such as sickness and bereavement.
• Transportation: Berkadia offers free transportation to every employee, irrespective of their shift timings.
• Medical Insurance: Berkadia has an inclusive medical insurance policy that covers the family members of the employees, including parents.
• Learn while you Earn: Berkadia encourages employees to learn new skills by sponsoring degrees, certifications, training, and workshops.
• Wellness: Berkadia has an extensive wellness program that includes annual health check, eye checkup, dental screening, OPD reimbursement, and Employee Assistance Program.

About Us

Berkadia, a joint venture of Berkshire Hathaway and Jefferies Financial Group, is a leader in the commercial real estate industry, offering a robust suite of services to our multifamily and commercial property clients. Powered by deep relationships and industry-changing technology, our people sell, finance, and service commercial real estate, providing support for the entire life cycle of our clients’ assets.

While this job description is intended to be an accurate reflection of the job requirements, management reserves the right to modify, add, or remove duties and to assign other duties, as necessary.