Data Engineer — Databricks & Spark

Inspired Infotech LLC.; Hyderabad; On-site; INR 700,000 - 1,800,000; Full time

Job summary

Inspired Infotech LLC. in Hyderabad invites a data engineer to build lakehouse data platforms on Databricks and Spark for global clients. You will develop Spark pipelines, implement medallion architectures, and ensure data quality.

Ideal candidates have 3–6 years of data engineering experience, strong PySpark/SQL, Databricks hands-on experience, and cloud exposure (AWS or Azure). The role offers permanent full-time work and growth opportunities.

Qualifications

• 3–6 years of data engineering experience.
• Strong PySpark and SQL.
• Hands-on Databricks experience.
• Experience with a cloud platform (AWS or Azure).

Responsibilities

• Develop Spark pipelines on Databricks.
• Implement medallion (bronze/silver/gold) architectures.
• Build data quality checks and monitoring.
• Optimise jobs for performance and cost.
• Prepare data for ML and RAG use cases.

Skills

PySpark

SQL

Spark pipelines

Data quality checks

Cloud platform experience

Tools

Databricks

Delta Lake

Unity Catalog

Airflow

AWS

Azure

Job description

Build lakehouse data platforms on Databricks and Spark that feed analytics and AI for global clients.

What you will do

• Develop Spark pipelines on Databricks
• Implement medallion (bronze/silver/gold) architectures
• Build data quality checks and monitoring
• Optimise jobs for performance and cost
• Prepare data for ML and RAG use cases

What you will bring

• 3–6 years of data engineering experience
• Strong PySpark and SQL
• Hands-on Databricks experience
• Experience with a cloud platform (AWS or Azure)

Nice to have

• Databricks certifications
• Delta Live Tables / Unity Catalog
• Streaming experience

Tech stack

Databricks, PySpark, Delta Lake, SQL, Unity Catalog, Airflow, AWS / Azure

What we offer

• A permanent, full-time role
• Enterprise projects for clients in the US and worldwide
• Hands-on work across AI, cloud and modern engineering
• A friendly, collaborative team
• Clear paths for professional growth

Work authorization

This role is based in Hyderabad, India. Applicants must be legally eligible to work in India.