Azure Databricks /Python / Pyspark Senior Data Engineer (Developer)

Exusia, Inc.; Orlando (FL); Remote; USD 90,000 - 150,000; Full time

Job summary

Join a cutting-edge digital transformation consultancy as a Senior Data Engineer. You'll design, develop, and maintain large-scale data engineering solutions, working with clients to implement data governance and analytical reporting. This role offers the opportunity to collaborate with stakeholders, tackle complex data challenges, and lead projects that drive impactful business outcomes. With a strong focus on innovation and growth, this company is recognized for its leadership in the IT services sector. If you're passionate about data and looking to make a difference in a dynamic environment, this role is for you.

Qualifications

• 6+ years in Data Management with hands-on experience in Python, Pyspark, and Databricks.
• Strong understanding of Data Governance principles and experience with multiple databases.

Responsibilities

• Gather and analyze business requirements for Data Analytics and Data Governance.
• Build optimized data processing solutions and provide technical leadership.

Skills

Data Management

Data Engineering

Data Governance

Python

Pyspark

Databricks

Spark SQL

Java

Scala

Education

Bachelor of Engineering

Bachelor of Science in Computer and Information Sciences

Tools

Databricks

Microsoft Azure

Oracle

SQL Server

Job description

About The Position

Sr Data Engineers & Tech Leads – Python/Pyspark/Databricks

Department: Sales and Delivery Team - Empower

Industry: Information Technology & Services, Computer Software, Management Consulting

Location: WFH/ India Remote

Experience Range: 6 - 10 years

Basic Qualification: Bachelor of Engineering or Equivalent

Exusia, a cutting-edge digital transformation consultancy, is looking for top talent in the Data Engineering space with specific skills in Python/Pyspark/Databricks to join our global delivery team's Industry Analytics practice in India.

What’s the Role?

Full-time job to work with Exusia's clients to design, develop, and maintain large-scale data engineering solutions. The right candidates will also get a chance to work across the entire data landscape including Data Governance, Metadata Management, and will work closely with client stakeholders to capture the requirements, design, and implement Analytical reporting, Compliance, and Data Governance solutions.

Criteria for the Role!

1. Have a minimum of 6 years’ experience in Data Management, Data Engineering & Data Governance space with hands-on project experience using Python, Pyspark & Databricks
2. Should have worked on large data initiatives and should have exposure to different flavours of Spark including Pyspark/Spark SQL/Scala/Java
3. Education Qualification – Bachelor of Science (preferably in Computer and Information Sciences or Business Information Technology) or an Engineering degree in the above areas

Key Responsibilities:

1. Work with business stakeholders to gather and analyze business requirements, building a solid understanding of the Data Analytics and Data Governance domain
2. Document, discuss, and resolve business, data, and reporting issues within the team, across functional teams, and with business stakeholders
3. Should be able to work independently and come up with solution design
4. Build optimized data processing and data governance solutions using the given toolset
5. Provide hands-on technical leadership and work on multiple projects if required
6. Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
7. Contribute to talent recruitment, competency building, and providing mentorship to junior resources for these skills

Requirements

Mandatory Skills:

1. Must have strong Data Warehousing / Data Engineering background
2. Strong conceptual understanding of Data Management & Data Governance principles
3. Experience working with multiple databases like Oracle/SQL Server/Other DBs
4. Exposure to Microsoft Azure storage and compute services and should have hands-on experience with Databricks on Azure
5. Hands-on experience using Python and Pyspark and should have completed min 2 projects
6. Hands-on experience using Databricks and should be fluent with Pyspark & Spark SQL

Nice-to-Have Skills:

1. Exposure to BFSI domain and Data Governance is a big plus
2. Exposure to Java & Scala
3. Understanding of data governance tools like ASG & Collibra is an added advantage
4. Exposure to cloud platforms like AWS, Azure & GCP

Exusia (http://www.exusia.com/) is a global technology consulting company that empowers its clients to gain a competitive edge by accelerating business outcomes and providing strategy and execution capabilities around digital, analytics, and cloud solutions. The company has established its leadership position by solving some of the world's largest and most complex data engineering and analytical problems in the healthcare, financial, telecommunications, consumer products, and high technology industries.

Exusia’s mission is to transform the world through the innovative use of information.

Over the past 3 years, Exusia was recognized by Inc. 5000 and by Crain’s publications as one of the fastest growing privately held companies in the world. Since the company’s founding in 2012, Exusia has experienced an impressive seven years of revenue growth and has expanded its operations in the Americas, Asia, and Africa. Exusia has recently also been recognized by publications such as the CIO Review, Industry Era, Insight Success, and the CIO Bulletin for the company’s innovation in IT Services, the Telecommunications and Healthcare industries and its entrepreneurship. The company is headquartered in Miami, Florida, United States with development centers in India.