Sr Data Engineer- Databricks

Simbus Technologies; United States; Remote; USD 80,000 - 120,000; Full time

Job summary

This innovative firm is on the lookout for a Senior Data Engineer with expertise in Databricks. The ideal candidate will leverage their extensive experience to design and maintain robust data pipelines, ensuring data integrity and security. You will collaborate with a diverse team to deliver high-quality data solutions while mentoring junior engineers. Enjoy a transparent work culture focused on employee satisfaction and a strong emphasis on learning and innovation. If you're ready to tackle challenging projects in a supportive environment, this opportunity is perfect for you.

Benefits

Work from home policy

Industry leading pay scale

Employee delight focus

Collaborative work culture

Clear growth path

Qualifications

• 4+ years of experience in data engineering with a focus on Databricks.
• Strong understanding of data modeling, ETL processes, and data warehousing.

Responsibilities

• Design and maintain scalable data pipelines using Databricks.
• Collaborate with stakeholders to deliver high-quality data solutions.
• Implement CI/CD pipelines for efficient deployment processes.

Skills

Data Engineering

Databricks

SQL

Python

Scala

Apache Spark

Hadoop

Education

Bachelor's Degree in IT/Computer Science

Tools

Databricks

Apache Spark

Hadoop

Job description

Dear Candidate

Greetings!

Currently we are hiring Sr Data Engineer- Databricks for our team. Kindly find JD below.

Its a Remote opportunity.

Please Note: Databricks-professional certification s mandatory for this role.

And Immediate joiner is preferred.

JOB OVERVIEW:

We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in Databricks to join our dynamic team. The ideal candidate will have over 4 years of experience in data engineering, with a comprehensive understanding of end-to-end development and CICD on Databricks. This role will involve designing, developing, and maintaining scalable data pipelines and systems to support data-driven initiatives.

WHAT YOULL BRING:

• Bachelors degree in IT/Computer Science or a related field.
• 4+ years of experience in data engineering, with a strong focus on Databricks.
• Strong understanding of data modeling, ETL processes, and data warehousing concepts with Mastery in SQL.
• Proficiency in programming languages such as Python/Scala.
• Databricks Data Engineering Professional certification is a must.
• Experience with big data technologies such as Apache Spark and Hadoop with hands-on ability to handle large volumes of data in day-to-day tasks.

WHAT YOU’LL DO:

• Design, develop, and maintain scalable data pipelines and systems using Databricks.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Implement and manage CI/CD pipelines for data engineering projects to ensure smooth and efficient deployment processes.
• Optimize and tune data processing workflows for performance and scalability.
• Ensure data quality, integrity, and security across all data engineering processes.
• Develop and maintain documentation for data engineering processes, systems, and workflows.
• Stay up to date with the latest industry trends and best practices in data engineering and Databricks.
• Mentor and guide junior data engineers, providing technical leadership and support.

WHAT WE’LL OFFER YOU:

•An open transparent work culture with focus on employee delight.

•Opportunity to work on challenging projects.

•A strong process-oriented work environment using modern work tools to drive efficiency in service delivery.

•A work from home policy focused on optimum work life balance.

•Industry leading pay scale with benefits.

•A collaborative work culture with emphasis on learning and innovation.

•A clear growth path intended to achieve personal aspirations and goals.

KEY COMPETENCIES & SKILLS (Good to have) :

• Experience with machine learning and Gen AI capabilities on Databricks (with knowledge on MLflow)
• Certification in Azure/AWS Engineering area is a plus
• Experience working in an Agile environment (Scrum, Agile) is a plus.
• External contributions like Git, Medium etc. will be a plus.

If you think that you meet the requirements, please connect with us on

[e-mail] or [e-mail]

Please visit our website https://www.simbustech.com to find out more about Simbus.

Thanks and regards

HR Team

Simbus Technologies Private Limited