Senior / Lead Engineer - Data & AI

QBurst

Thiruvananthapuram

On-site

INR 900,000 - 1,300,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

QBurst is seeking a backend developer with data engineering or AI workflow focus in India. You will design and maintain REST APIs, build data pipelines with Kafka, Airflow, and Spark, and integrate LLMs for AI workloads. Hybrid collaboration with teams and a path toward owning data pipelines within 6–9 months.

You should be proficient in at least one backend stack (Python, Ruby, Java, or Node.js), strong SQL, and familiar with cloud platforms. Exposure to Airflow, dbt, Spark, and NoSQL is a plus.

Qualifications

  • Production backend experience with at least one stack (Python, Ruby on Rails, Java, or Node.js).
  • Strong SQL with joins, window functions, and optimization.
  • Solid data structures, algorithms, and system design basics.
  • Experience with message queues or event streaming (Kafka, RabbitMQ, SQS, Pub/Sub).
  • Hands‑on experience with REST APIs, Git, Docker, and CI/CD.
  • Familiarity with AWS, Google Cloud, or Azure.
  • Experience scaling backend systems and reducing latency.
  • Exposure to NoSQL databases.
  • Experience with Airflow, dbt, Spark; data platforms like BigQuery, Snowflake, Databricks, Fabric; or vector stores is a plus.
  • Familiarity with LLM APIs/frameworks (LangChain, LlamaIndex, LangGraph) is welcome but not required.
  • Experience with asynchronous programming, distributed systems, or data-intensive apps is a plus.

Responsibilities

  • Design, build, and maintain backend services and REST APIs for web applications and full-stack projects.
  • Complete structured training in data engineering or agentic AI and apply learnings on projects.
  • On data engineering projects, build and maintain batch and streaming pipelines using Kafka, Airflow, and Spark.
  • On agentic AI projects, integrate LLMs and build workflows using retrieval, tool calls, and orchestration.
  • Ensure production reliability with testing, monitoring, retries, idempotent processing, and robust error handling.
  • Deploy and maintain services using Docker, CI/CD, and cloud infrastructure.
  • Collaborate with product teams, data scientists, and senior engineers, and contribute to design and code reviews.
  • Work toward owning a data pipeline or AI workflow within your first 6–9 months.

Skills

Backend development
SQL proficiency
Distributed systems
Data engineering
REST APIs
Docker
CI/CD
Cloud platforms

Tools

Kafka
Airflow
Spark
dbt
LangChain
Git
Docker
BigQuery
Snowflake
Databricks

Job description

Responsibilities


  • Design, build, and maintain backend services and REST APIs for web applications and full-stack projects.

  • Complete structured training in data engineering or agentic AI and apply what you learn on project assignments.

  • On data engineering projects, build and maintain batch and streaming pipelines using tools such as Kafka, Airflow, and Spark. Design data models and write performant SQL for relational databases and data warehouses.

  • On agentic AI projects, integrate LLMs and build workflows that use retrieval, tool and function calling, and orchestration. Use open-source agent frameworks and evaluate workflow quality and reliability.

  • Build for production reliability through testing, monitoring, retries, idempotent processing, and effective failure handling.

  • Deploy and maintain services and workflows using Docker, CI/CD pipelines, and cloud infrastructure.

  • Collaborate with product teams, data scientists, and senior engineers, and contribute to technical design and code reviews.

  • Progress toward owning a data pipeline or AI workflow within your first 6–9 months.


Requirements


  • Production experience with at least one backend stack, such as Python (FastAPI, Django, or Flask), Ruby on Rails, Java (Spring Boot), or Node.js.

  • Strong SQL skills, including joins, window functions, schema design, and query optimization.

  • Solid understanding of data structures, algorithms, and system design fundamentals.

  • Experience with message queues or event-streaming systems such as Kafka, RabbitMQ, Amazon SQS, or Google Cloud Pub/Sub.

  • Hands‑on experience with REST APIs, Git, Docker, and CI/CD.

  • Familiarity with at least one cloud platform: AWS, Google Cloud, or Azure.

  • Experience scaling backend systems and optimizing latency.

  • Exposure to at least one NoSQL database.

  • Exposure to tools such as Airflow, dbt, or Spark; data platforms such as BigQuery, Snowflake, Databricks, or Microsoft Fabric; or vector stores is welcome but not required.

  • Experimentation with LLM APIs or frameworks such as LangChain, LlamaIndex, or LangGraph is welcome but not required.

  • Experience with asynchronous programming, distributed systems, or data‑intensive applications is a plus, as are relevant side projects and open‑source contributions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Backend Engineer
Backend Engineer

Sequoia • Bengaluru

On-site
INR 1,800,000 - 3,000,000
Senior Software Engineer
Senior Software Engineer

EMB Global • Ernakulam

On-site
INR 1,800,000 - 2,900,000
Senior Full Stack Engineer (Python / AI Platforms)
Senior Full Stack Engineer (Python / AI Platforms)

Kenmore Senior Living • Jaipur

On-site
INR 2,500,000 - 4,500,000
Senior AI Software Engineer
Senior AI Software Engineer

AppSierra • Hyderabad

On-site
INR 1,500,000 - 2,300,000
Senior Intergration AI Engineer
Senior Intergration AI Engineer

Ensylon • Pune

On-site
INR 3,500,000 - 5,500,000
Founding Engineer
Founding Engineer

Knowl • Bengaluru

On-site
INR 3,500,000 - 7,000,000
Senior AI Data Engineer
Senior AI Data Engineer

EXL • Maharashtra

On-site
INR 1,200,000 - 1,800,000
Senior AI Engineer
Senior AI Engineer

TheMathCompany Inc. • Bengaluru

On-site
INR 2,400,000 - 4,200,000
AI Engineer/Lead AI Engineer
AI Engineer/Lead AI Engineer

Salesforce, Inc. • Bengaluru, Hyderabad

On-site
INR 4,000,000 - 8,000,000
Full Stack Engineer
Full Stack Engineer

Synergy Technologies • Hyderabad

On-site
INR 3,000,000 - 5,200,000