DataNimbus - Data Architect

DataNimbus; Kolkata District; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

DataNimbus is seeking a Databricks Certified Data Engineer to design and deliver end-to-end big data and AI solutions for global customers. The role involves architecture design, productionizing use cases, and guiding clients through tech adoption within Databricks ecosystems.

You will collaborate with engagement managers and cross-functional teams to ensure successful design, build, and deployment, while mentoring junior engineers and expanding your own cloud and data engineering expertise.

Qualifications

• 6+ years experience in data engineering and analytics on Databricks platform.
• Experience with large-scale data migrations to/from Databricks.
• Consulting or customer-facing experience with external clients.

Responsibilities

• Handle a variety of customer technical projects including reference architectures and productionizing use cases.
• Scope professional services engagements with input from the customer.
• Lead end-to-end design, build and deployment of big data and AI applications for strategic customers.
• Provide escalated support for customer operational issues.
• Collaborate with Project Manager, Architect and Customer teams to ensure delivery meets needs.
• Mentor junior data engineers and team members.

Skills

Databricks experience

Python

Scala

Cloud knowledge

Tools

Databricks

Apache Spark

CI/CD

MLOps

Python

Scala

AWS

Job description

Job Description

Role : Databricks Certified Data Engineer

At DataNimbus, we are on a mission to redefine how organizations leverage Data and AI to drive growth, innovation, and efficiency. Our pioneering products, such as DataNimbus Designer (a cloud-native ETL designer), datanimbus.io (a comprehensive data and integration platform), and FinHub.ai (payment modernization platform), empower businesses to simplify complex workflows, adopt cutting-edge technology, and achieve sustainable scalability.

With headquarters in the U.S. and offices in India and Canada, DataNimbus operates globally, fostering a culture of responsible innovation, adaptability, and customer-centricity. We pride ourselves on being a trusted partner for customers navigating the complexities of Data+AI and payment modernization.

Why Join DataNimbus?

At DataNimbus, We Believe In Shaping a Sustainable, AI-driven Future While Offering An Environment That Prioritizes Learning, Innovation, And Growth. Our Core ValuesCustomer-Centricity, Simplicity, Curiosity, Responsibility, And Adaptabilityare The Foundation Of Our Workplace, Ensuring Every Team Member Can Make a Meaningful Impact. Joining DataNimbus Means Being Part Of a Dynamic Team Where You Can

• Work with cutting-edge technologies and revolutionize workflows in Data+AI solutions.
• Contribute to solutions that are trusted by global businesses for their scalability, security, and efficiency.
• Grow personally and professionally in a culture that values curiosity and continuous learning.

If you are passionate about innovation, ready to solve complex challenges with simplicity, and eager to make a difference, DataNimbus is the place for you.

What Do We Want You To Do

• Handle a variety of impactful customer technical projects which may include designing and building reference architectures, creating how-to's and productionalizing customer use cases.
• Work with engagement managers to scope variety of professional services work with input from the customer.
• Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications.
• Consult on architecture and design; bootstrap or implement customer projects which leads to a customers' successful understanding, evaluation and adoption of Databricks.
• Provide an escalated level of support for customer operational issues.
• Collaborate with the Project Manager, Architect and Customer teams to ensure the technical components of the engagement are delivered to meet customer's needs.
• Mentor and provide guidance to junior data engineers and team members.

What Would Help Make Your Case

• 6+ years experience in data engineering, data platforms & analytics on Databricks platform.
• Experience with large scale data migrations to/from Databricks.
• Consulting / customer facing experience, working with external clients across a variety of industry markets.
• Comfortable writing code in either Python or Scala.
• Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one.
• Deep experience with distributed computing with Apache Spark and knowledge of Spark runtime internals.
• Familiarity with CI/CD for production deployments.
• Working knowledge of MLOps.
• Design and deployment of performant end-to-end data architectures.
• Experience with technical project delivery - managing scope and timelines.
• Documentation and white-boarding skills.
• Experience working with clients and managing conflicts.
• Deployment and integration of Databricks-based solutions to complete customer projects.
• Must have Databricks Certifications.
• Strong communication and collaboration skills.
• Excellent problem-solving skills.
• Ability to travel up to 30% when needed.

(ref:hirist.tech)