Senior Data Engineer.

PrimeSoft Solutions, Inc.; Hyderabad; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

PrimeSoft Solutions, Inc. is seeking a Senior Data Engineer to own the end-to-end data platform, from raw data ingestion through transformation to trusted datasets.

You will design, build, and maintain scalable data pipelines powering analytics across the organization. The role requires strong architectural skills, production-grade delivery, and collaboration with analysts and stakeholders to align data solutions with business needs.

Qualifications

• BE/BTech, ME/MTech, BSc, MSc degrees or equivalent.
• Strong SQL proficiency with complex query optimization and data modeling.
• Solid understanding of data warehousing concepts and dimensional modeling.
• Experience with modern data transformation frameworks such as dbt and SQLMesh.
• Knowledge of workflow orchestration, DAG design, dependency management, and data lineage.
• Experience building production-grade data pipelines and data quality frameworks.
• Familiarity with AI/LLM integration in engineering workflows.

Responsibilities

• Design, build, and maintain end-to-end data pipelines from ingestion to curated data models.
• Develop scalable data transformation layers using modern frameworks (dbt, SQLMesh).
• Design and optimize data warehouse schemas to support reporting and analytics.
• Write highly efficient SQL and optimize complex queries for performance.
• Build and monitor orchestration workflows with proper data lineage.
• Implement data quality, validation, monitoring, and reliability practices.
• Make architecture decisions balancing scalability and delivery speed.
• Collaborate with analysts, engineers, and stakeholders to translate requirements into robust data solutions.
• Identify improvements in data architecture and pipeline performance.
• Leverage LLMs and AI-assisted tools to improve productivity and delivery.

Skills

SQL

Data warehousing concepts

Dimensional modeling

Analytical database design

DAG design

AI/LLM integration

Production-grade data pipelines

Systems thinking

Agile methodologies

Data quality

Education

BE/BTech

ME/MTech

BSc

MSc

Tools

dbt

SQLMesh

Databricks

Job description

Qualification : BE/B tech, ME/M tech, Bsc, Msc.

Location : Hyderabad, Bangalore and Mumbai

Job Description

As a Senior Data Engineer, you will own the end-to-end data platform, from raw data ingestion through transformation to trusted, business-ready datasets. You will be responsible for designing, building, and maintaining scalable, reliable, and high-quality data pipelines that power analytics and decision-making across the organization.

This role requires someone who can make sound architectural decisions, balance trade-offs, and deliver production-grade solutions in a fast-paced environment. You'll partner closely with analysts, engineers, and business stakeholders, ensuring data solutions are reliable, maintainable, and aligned with business needs. A strong bias for action, systems thinking, and expertise in modern data engineering practices are essential.

Key Responsibilities

• Design, build, and maintain end-to-end data pipelines from ingestion to curated, trusted data models.
• Develop scalable and maintainable data transformation layers using modern transformation frameworks.
• Design and optimize data warehouse schemas and data models to support reporting and analytics.
• Write highly efficient, production-grade SQL and optimize complex queries for performance.
• Build, maintain, and monitor orchestration workflows, ensuring proper dependency management and data lineage.
• Implement data quality, validation, monitoring, and reliability practices to ensure trusted datasets.
• Make architecture and design decisions while balancing scalability, maintainability, and delivery speed.
• Collaborate closely with analysts, engineers, and business stakeholders to understand requirements and translate them into robust data solutions.
• Proactively identify improvements in data architecture, pipeline performance, and engineering practices.
• Leverage Large Language Models (LLMs) and AI-assisted development tools to improve engineering productivity and accelerate delivery.
• Build solutions that are production-ready, scalable, and resilient while maintaining high development velocity.

Must-Have Skills

Technical Skills

• Expert-level proficiency in SQL, including complex query optimization, performance tuning, and advanced data modeling.
• Strong expertise in data warehousing concepts, dimensional modeling, and analytical database design.
• Hands-on experience with modern data transformation frameworks such as:
• dbt
• SQLMesh
• Strong understanding of workflow orchestration, DAG design, dependency management, and data lineage.
• Experience designing and maintaining reliable, production-grade data pipelines.
• Strong knowledge of data quality frameworks, testing, validation, and monitoring.
• Excellent systems thinking with the ability to design scalable and maintainable data architectures.
• Proven ability to deliver high-quality solutions in fast-paced, agile environments.

AI & LLM Skills (Mandatory)

Demonstrated hands-on experience using Large Language Models (LLMs) as a core part of the software development lifecycle, including:

• Retrieval-Augmented Generation (RAG)
• Vector embeddings and vector search
• Token optimization and context management
• LLM evaluations and quality assessment
• Guardrails and hallucination mitigation
• Function calling, tool use, and AI workflow orchestration

Candidates should have practical experience integrating AI into engineering workflows rather than limited exposure or experimentation.

Professional Skills

• Strong communication and stakeholder management skills.
• Ability to challenge requirements constructively and provide technical guidance.
• Strong ownership mindset with the ability to make informed technical decisions independently.
• Bias toward execution, continuous improvement, and delivering business value.

Nice-to-Have Skills

• Hands-on experience building and operating data platforms on Databricks.
• Experience with AI-assisted or "vibe coding" approaches to software development.
• Exposure to fintech, banking, payments, or financial services data platforms.
• Familiarity with modern DevOps, CI/CD, Infrastructure as Code (IaC), and observability practices.
• Experience working in high-growth startups or small engineering teams with broad ownership.