Senior Data Engineer

DataNimbus Inc.; Hyderabad; On-site; INR 1,800,000 - 3,600,000; Full time

Job summary

DataNimbus invites an experienced data engineer to join our Hyderabad team to design and deliver end-to-end data and AI solutions using Databricks. You will work with clients to architect reference architectures and productionize use cases, driving impact across data platforms.

You will leverage PySpark, Python, SQL, and cloud platforms to implement scalable data architectures, collaborate with data scientists, and mentor junior engineers.

Qualifications

• 4+ years of experience in data engineering and data architecture.
• 3+ years with Databricks, PySpark, Python, and SQL.
• Consulting or client-facing experience with external clients.
• Experience with cloud ecosystems (AWS, Azure, or GCP).
• Knowledge of CI/CD for production deployments.
• Familiarity with MLOps methodologies.
• Ability to design and implement end-to-end data architectures.
• Strong communication and collaboration skills.

Responsibilities

• Handle a variety of customer technical projects including reference architectures and productionizing use cases.
• Scope professional services work with input from the customer.
• Guide strategic customers in end-to-end big data and AI projects across design, build and deployment.
• Consult on architecture and design and enable customer adoption of Databricks.
• Support customer operational issues with escalated assistance.
• Ensure engagement components meet customer needs with PM/Architect/teams.
• Collaborate with data scientists and analysts to deliver high‑quality data solutions.
• Mentor junior data engineers and team members.

Skills

Databricks

PySpark

Python

SQL

Data Engineering

Data Architecture

Cloud (AWS/Azure/GCP)

CI/CD (GitHub/Azure DevOps)

MLOps familiarity

Consulting / Client-facing

Communication skills

Tools

Databricks Platform

Apache Spark

Job description

At DataNimbus, we are on a mission to redefine how organizations leverage Data and AI to drive growth, innovation, and efficiency. Our pioneering products, such as DataNimbus Designer (a cloud-native ETL designer), datanimbus.io (a comprehensive data and integration platform), FinHub.ai (payment modernization platform) empower businesses to simplify complex workflows, adopt cutting-edge technology, and achieve sustainable scalability.

With headquarters in the U.S. and offices in India and Canada, DataNimbus operates globally, fostering a culture of responsible innovation, adaptability, and customer-centricity. We pride ourselves on being a trusted partner for customers navigating the complexities of Data+AI and payment modernization.

Why Join DataNimbus?

At DataNimbus, we believe in shaping a sustainable, AI-driven future while offering an environment that prioritizes learning, innovation, and growth. Our core values—Customer-Centricity, Simplicity, Curiosity, Responsibility, and Adaptability—are the foundation of our workplace, ensuring every team member can make a meaningful impact. Joining DataNimbus means being part of a dynamic team where you can:

• Work with cutting-edge technologies and revolutionize workflows in Data+AI solutions.
• Contribute to solutions that are trusted by global businesses for their scalability, security, and efficiency.
• Grow personally and professionally in a culture that values curiosity and continuous learning.

If you are passionate about innovation, ready to solve complex challenges with simplicity, and eager to make a difference, DataNimbus is the place for you.

What do we want you to do:

• Handle a variety of impactful customer technical projects which may include designing and building reference architectures, creating how-to's and productionalizing customer use cases
• Work with engagement managers to scope variety of professional services work with input from the customer
• Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications
• Consult on architecture and design, bootstrap or implement customer projects which leads to a customers' successful understanding, evaluation and adoption of Databricks.
• Support customer operational issues with an escalated level of support.
• Ensure that the technical components of the engagement are delivered to meet customer's needs by working with the Project Manager, Architect, and Customer teams.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Mentor and provide guidance to junior data engineers and team members.

What would help make your case:

• 4+ years experience in data engineering, data architecture, data platforms & analytics
• At least 3+ years experience with Databricks, PySpark, Python, and SQL.
• Consulting / customer facing experience, working with external clients across a variety of industry markets
• Comfortable writing code in both Python and SQL
• Proficiency in SQL and experience with data warehousing solutions
• Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one
• Strong understanding of data modeling, ETL processes, and data architecture principles.
• Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals
• Familiarity with CI/CD for production deployments - GitHub, Azure DevOps, Azure Pipelines
• Working knowledge of MLOps methodologies
• Design and deployment of performant end-to-end data architectures
• Experience with technical project delivery - managing scope and timelines
• Documentation and white-boarding skills
• Experience working with clients and managing conflicts
• Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects
• Good to have Databricks Certifications
• Strong communication and collaboration skills