Data Engineer

Jacobs

Bengaluru

Hybrid

INR 1,800,000 - 2,400,000

Full time

12 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Jacobs Engineering Group is hiring for a data engineering role in Bengaluru. The candidate will design, develop and maintain scalable data pipelines and data integration solutions across cloud services.

You will work with Python and SQL to transform and validate data and collaborate with AI/ML teams to deliver analytics-ready datasets. Experience with Azure Data Lake, Data Factory, Databricks and Spark is preferred, along with DX CI/CD and data quality practices.

Qualifications

  • Experience building cloud-based data pipelines and integration solutions.
  • Proficiency with Python and SQL for data extraction, transformation and validation.
  • Hands-on with cloud data platforms and Azure services.

Responsibilities

  • Design, develop and maintain scalable data pipelines and data integration solutions using cloud-based technologies.
  • Build batch and near-real-time ingestion and transformation workflows across structured and unstructured data sources.
  • Use Python and SQL to extract, transform, validate and manage data.
  • Work with cloud data platforms and services, with Microsoft Azure experience particularly relevant.
  • Apply data processing technologies such as Apache Spark, PySpark and Delta Lake when appropriate.
  • Develop and maintain data models, data structures and curated datasets for analytics, enterprise applications and AI/ML use cases.
  • Profile, cleanse, standardise and validate data in collaboration with SME teams.

Skills

Python
SQL
Azure
Databricks
Spark
Pyspark
Delta Lake
Docker
CI/CD
Power BI

Tools

Azure Data Lake
Azure Data Factory
Azure Functions
Databricks
Power BI

Job description

At Jacobs, we're challenging today to reinvent tomorrow by solving the world's most critical problems for thriving cities, resilient environments, mission-critical outcomes, operational advancement, scientific discovery and cutting-edge manufacturing, turning abstract ideas into realities that transform the world for good.

Your impact
  • Design, develop and maintain scalable data pipelines and data integration solutions using cloud-based technologies.
  • Build batch and, where required, near-real-time ingestion and transformation workflows across structured and unstructured data sources.
  • Use Python and SQL to extract, transform, validate and manage data.
  • Work with cloud data platforms and services, with Microsoft Azure experience particularly relevant. Technologies may include Azure Data Lake, Azure Data Factory, Azure Functions, Microsoft Fabric, Databricks and equivalent services.
  • Apply data processing technologies such as Apache Spark, PySpark and Delta Lake when appropriate.
  • Develop and maintain data models, data structures and curated datasets for analytics, enterprise applications and AI/ML use cases.
  • Profile, cleanse, standardise and validate data, working with subject matter experts where domain interpretation is required.
  • Implement data quality checks, testing, monitoring, logging, security and performance controls.
  • Support processing of documents and other unstructured information, including metadata extraction and transformation where appropriate.
  • Contribute to data architecture, integration patterns and technical design decisions.
  • Work with AI engineers, software developers, solution architects, analysts and business stakeholders to translate requirements into deliverable solutions.
  • Support deployment, troubleshooting, maintenance and continuous improvement of data workflows.
  • Produce clear technical documentation and contribute to knowledge transfer across distributed teams.
NICE TO HAVE
  • Experience with Apache Spark, PySpark or Delta Lake.
  • Experience with document processing, unstructured data, metadata extraction or knowledge-management solutions.
  • Experience preparing data for machine learning, generative AI or retrieval-augmented generation (RAG) applications.
  • Familiarity with vector search, embeddings or AI data preparation workflows.
  • Experience with Docker, CI/CD pipelines, automated testing or infrastructure-as-code practices.
  • Experience with Power BI or semantic data modelling.
  • Experience in engineering, infrastructure, utilities, transport or other complex technical domains.
  • Relevant Microsoft, Databricks or cloud certifications.

AtJacobs we value people. Having the right balance of belonging, career and lifestyle enables us to consistently deliver and exceed clients’ expectations.

Working alongside industry leaders, you will have the opportunity to develop your career working on key projects in an environment which encourages collaboration, knowledge sharing and innovation. To support your professional growth, Jacobs flexible working arrangements, extended leave options and a host of social, health and wellbeing events and initiatives will underpin our commitment to you.

At Jacobs it’s all about what you do, not where you are, which counts!

We value collaboration and believe that in-person interactions are crucial for both our culture and client delivery. We empower employees with our hybrid working policy, allowing them to split their work week between Jacobs offices/projects and remote locations enabling them to deliver their best work.

Your application experience is important to us, and we’re keen to adapt to make every interaction even better. If you require further support or reasonable adjustments with regards to the recruitment process (for example, you require the application form in a different format), please contact the team via Careers Support .

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or disability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Jacobs • Bengaluru

Hybrid
INR 900,000 - 1,500,000
Sr. AI Data Engineer
Sr. AI Data Engineer

Jacobs • Bengaluru

Hybrid
INR 1,500,000 - 2,500,000
Flexible working arrangements
Extended leave options
Health and wellbeing programs
AI Developer
AI Developer

Jacobs Engineering Group • Bengaluru

On-site
INR 1,200,000 - 2,100,000
Hybrid working policy
Career development opportunities
AI Developer
AI Developer

Jacobs • Bengaluru

Hybrid
INR 6,000,000 - 9,000,000
Run Team Support Engineer – Augmented Delivery (Data & Engineering Platforms)
Run Team Support Engineer – Augmented Delivery (Data & Engineering Platforms)

Jacobs • Bengaluru

Hybrid
INR 2,000,000 - 3,500,000
Run Team Support Engineer – Augmented Delivery (Data & Engineering Platforms)
Run Team Support Engineer – Augmented Delivery (Data & Engineering Platforms)

Jacobs • Maharashtra

Hybrid
INR 3,000,000 - 5,000,000
Engineer-Process
Engineer-Process

Jacobs • Gurugram District

On-site
INR 2,400,000 - 4,000,000
Hybrid working policy
Consultant - Smart Cities
Consultant - Smart Cities

Jacobs • Gurugram District

Hybrid
INR 1,200,000 - 2,400,000
Hybrid working policy
Consultant - Smart Cities
Consultant - Smart Cities

Jacobs • Bengaluru

Hybrid
INR 1,200,000 - 1,800,000
Flexible working
Extended leave
Wellbeing initiatives
+1
Proposal Co-ordinator
Proposal Co-ordinator

Jacobs Engineering Group • Chennai

Hybrid
INR 700,000 - 1,300,000