Senior Big Data Engineer (Databricks)

SoftServe; Abu Dhabi; On-site; USD 60,000 - 100,000; Full time

Job summary

An innovative digital solutions company seeks passionate Data Engineers to join their dynamic team. In this role, you will work with cutting-edge technologies and collaborate with global clients across various sectors, including healthcare and finance. You will design and implement robust data solutions, ensuring effective data management and analysis. This position offers opportunities for continuous learning and professional growth, supported by a dedicated career plan and access to extensive training resources. Join a forward-thinking team that values creativity, collaboration, and impact in every project.

Benefits

Access to Udemy learning courses

Professional certification support

Career development plans

Collaboration with leading companies

Qualifications

• 2+ years of experience in designing data models and building ETL pipelines.
• Proficient in Azure cloud technologies and Databricks Lakehouse architecture.

Responsibilities

• Engage in the entire project lifecycle from design to implementation.
• Collaborate with a diverse range of customers and stakeholders.

Skills

Python

PySpark

Databricks Lakehouse

ETL pipelines

Azure Data Factory

Azure DevOps

SQL

Data modeling

Streaming data pipelines

Stakeholder communication

Tools

Azure Synapse

Azure Data Lake Services

Job description

WE ARE

SoftServe is a global digital solutions company with headquarters in Austin, Texas, founded in 1993. Our associates are currently working on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, who make a difference, who have fun, and who love their work.

Big Data & Analytics Center of Excellence, data consulting and data engineering branch at SoftServe. Starting as a group of three enthusiasts back in 2013, hundreds of Data Engineers and Architects nowadays build Data & Analytics end-to-end solutions from strategy through technical design and PoC to full-scale implementation. We have customers in Healthcare, Finance, Manufacturing, Retail, and Energy domains.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others.

IF YOU ARE

Experienced with Python/PySpark

Proficient working with Databricks Lakehouse architecture and principles

Having 2+ years of designing data models, building ETL pipelines, and wrangling data to solve business problems

Experienced with Azure cloud technologies Modern Data Estate such as Azure Data Factory, Azure DevOps, Azure Synapse, Azure Data Lake Services

Skilled with advanced SQL working with relational databases

Knowledgeable of database and data warehouse design best practices

Experienced designing, building, and scaling streaming and batch data pipelines

Able to suggest the best solution among different options and conduct trade-off analysis, solve the problems

Engaging in communication with stakeholders in written and verbal form (Upper-Intermediate English level)

YOU WANT TO

Be part of a team of data-focused Engineers dedicated to continuous learning, improvement, and knowledge sharing every day.

Work with a cutting-edge technology stack, including pioneering services from major cloud providers that are at the forefront of innovation.

Engage with customers of diverse backgrounds, ranging from large global corporations to emerging start-ups preparing to launch their first product.

Be involved in the entire project lifecycle, from initial design and proof of concept (PoC) to minimum viable product (MVP) development and full-scale implementation.

TOGETHER WE WILL

Address different business and technology challenges, engage in impactful projects, use top-notch technologies, and drive multiple initiatives as a part of the Center of Excellence.

Support your technical and personal growthwe have a dedicated career plan for all roles in our company.

Investigate new technologies, build internal prototypes, and share knowledge with SoftServe Data Community.

Upskill with full access to Udemy learning courses.

Pass professional certifications, encouraged and covered by the company.

Adopt best practices from experts while working in a team of top-notch Engineers and Architects.

Collaborate with world-leading companies and attend professional events

All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability, sexual orientation, gender identity/expression, or protected veteran status. SoftServe is an Equal Opportunity Employer.