Sr. Databricks Engineer

Milestone Technologies, Inc.

Hyderabad

On-site

INR 1,200,000 - 1,800,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A global IT managed services firm is seeking a Sr. Databricks Engineer to develop and implement data strategy. The ideal candidate will have strong skills in Python, PySpark, SQL, cloud platforms, and Databricks. This role involves ensuring data quality and building scalable data solutions in a SAFE Agile environment. The position is based in Hyderabad, India, and offers full-time employment with a mid-senior level designation.

Qualifications

Hands-on experience with cloud platforms (AWS, Azure, GCP) is essential.
Experience in data modeling and ETL orchestration is preferred.
Development knowledge in Databricks is crucial.

Responsibilities

Design, develop, and implement data pipelines and ETL processes.
Manage timelines and risks for data pipeline projects.
Ensure data quality and integrity through testing and monitoring.

Skills

Proficiency in Python

Proficiency in PySpark

Proficiency in SQL

Analytical skills

Education

Doctorate degree

Master’s degree and 4 to 6 years of Information Systems experience

Bachelor’s degree and 6 to 8 years of Information Systems experience

Diploma and 10 to 12 years of Information Systems experience

Tools

AWS

Azure

GCP

Databricks

JIRA

Git

Job description

Join to apply for the Sr. Databricks Engineer role at Milestone Technologies, Inc.

1 week ago Be among the first 25 applicants

Join to apply for the Sr. Databricks Engineer role at Milestone Technologies, Inc.

Company Overview

Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milestone culture is built to provide a collaborative, inclusive environment that supports employees and empowers them to reach their full potential.

Our seasoned professionals deliver services based on Milestone’s best practices and service delivery framework. By leveraging our vast knowledge base to execute initiatives, we deliver both short-term and long-term value to our clients and apply continuous service improvement to deliver transformational benefits to IT. With Intelligent Automation, Milestone helps businesses further accelerate their IT transformation. The result is a sharper focus on business objectives and a dramatic improvement in employee productivity. Through our key technology partnerships and our people-first approach, Milestone continues to deliver industry-leading innovation to our clients. With more than 3,000 employees serving over 200 companies worldwide, we are following our mission of revolutionizing the way IT is deployed.

Job Overview

In this vital role you will be responsible for the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Data Engineer, you will play a crucial role in building, and optimizing our data pipelines and platforms in a SAFE Agile product team.

Chip in to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions.
Deliver for data pipeline projects from development to deployment, managing, timelines, and risks.
Ensure data quality and integrity through meticulous testing and monitoring.
Leverage cloud platforms (AWS, Databricks) to build scalable and efficient data solutions.
Work closely with product team, and key collaborators to understand data requirements.
Enforce to data engineering industry standards and standards.
Experience developing in an Agile development environment, and comfortable with Agile terminology and ceremonies.
Familiarity with code versioning using GIT and code migration tools.
Familiarity with JIRA.
Stay up to date with the latest data technologies and trends

Win

Basic Qualifications

What we expect of you

Doctorate degree OR
Master’s degree and 4 to 6 years of Information Systems experience OR
Bachelor’s degree and 6 to 8 years of Information Systems experience OR
Diploma and 10 to 12 years of Information Systems experience.
Demonstrated hands-on experience with cloud platforms (AWS, Azure, GCP)
Proficiency in Python, PySpark, SQL.
Development knowledge in Databricks.
Good analytical and problem-solving skills to address sophisticated data challenges.

Preferred Qualifications

Experienced with data modeling
Experienced working with ETL orchestration technologies
Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and DevOps
Familiarity with SQL/NOSQL database

Soft Skills

Skilled in breaking down problems, documenting problem statements, and estimating efforts.
Effective communication and interpersonal skills to collaborate with multi-functional teams.
Excellent analytical and problem solving skills.
Strong verbal and written communication skills
Ability to work successfully with global teams
High degree of initiative and self-motivation.
Team-oriented, with a focus on achieving team goals

Compensation

Estimated Pay Range:

Exact compensation and offers of employment are dependent on circumstances of each case and will be determined based on job-related knowledge, skills, experience, licenses or certifications, and location.

Our Commitment to Diversity & Inclusion

At Milestone we strive to create a workplace that reflects the communities we serve and work with, where we all feel empowered to bring our full, authentic selves to work. We know creating a diverse and inclusive culture that champions equity and belonging is not only the right thing to do for ouremployees butis also critical to our continued success.

Milestone Technologies provides equal employment opportunity for all applicants and employees. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of race, color, religion, gender, gender identity, marital status, age, disability, veteran status, sexual orientation, national origin, or any other category protected by applicable federal and state law, or local ordinance. Milestone also makes reasonable accommodations for disabled applicants and employees.

We welcome the unique background, culture, experiences, knowledge, innovation, self-expression and perspectives you can bring to our global community. Our recruitment team is looking forward to meeting you.

Seniority level