Software Engineer III

RELX International; Chennai District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

LexisNexis Risk Solutions is seeking a Data Engineer to design, build, and optimize scalable data pipelines across enterprise environments using Azure Data Factory, Databricks, and HPCC with ECL. You will ingest data from multiple sources and implement transformations in Spark SQL and PySpark, delivering reliable analytics-ready datasets.

The role emphasizes collaboration with business analysts, data scientists, and application teams to support reporting, analytics, and operational needs in a

Qualifications

• Strong proficiency in SQL and data transformation logic with solid understanding of data warehousing concepts and ETL/ELT patterns.
• Hands-on experience with Azure Databricks, Spark SQL, and PySpark.
• Experience with Azure Data Factory, ADLS Gen2, and Azure Synapse.
• Experience working with large-scale, structured and semi-structured datasets.
• Experience with Agile development methodologies.
• Knowledge of SDLC processes and design patterns; strong documentation skills.
• Excellent communication skills – verbal and written, with Insurance terminology knowledge.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Azure storage services.
• Ingest data from multiple sources including relational databases, APIs, and file-based systems into Azure data platforms.
• Implement data transformations on HPCC using ECL and on Azure platform using SparkSQL and PySpark in Azure Databricks.
• Develop and optimize notebooks and jobs using Azure Databricks.
• Write efficient Spark jobs for large-scale data processing.
• Design and implement data models on HPCC using ECL and Delta Lake/Parquet etc.
• Optimize ECL code, SQL, and Spark workloads for performance and scalability.
• Collaborate with business analysts, data scientists, and application teams to understand data requirements and promote data engineering best practices.

Skills

SQL

Azure Databricks

Spark SQL

PySpark

Azure Data Factory

ADLS Gen2

Azure Synapse

HPCC

ECL

Delta Lake

Parquet

Spark

Education

Bachelor's degree in Computer Science or related field

Tools

HPCC

ECL

Azure Databricks

Azure Data Factory

Azure Data Lake Storage Gen2

Azure Synapse

Job description

Are you excited to build scalable data platforms and transform complex data into actionable insights?

Do you enjoy collaborating with cross-functional teams to deliver high-quality data solutions that drive business outcomes?

About The Business

LexisNexis Risk Solutions is the essential partner in the assessment of risk. Within our Business Services vertical, we offer a multitude of solutions focused on helping businesses of all sizes drive higher revenue growth, maximize operational efficiencies, and improve customer experience. Our solutions help our customers solve difficult problems in the areas of Anti-Money Laundering/Counter Terrorist Financing, Identity Authentication & Verification, Fraud and Credit Risk mitigation and Customer Data Management. You can learn more about LexisNexis Risk at https://risk.lexisnexis.com/

About The Team

Data Intelligence Team is tech hub for rest of the organization and hence working across multiple domains – US Healthcare, Insurance, Government etc. Team primarily works on data extraction, manipulation, loading, and analytics using technologies like Python, PySpark, Bigdata – HPCC, language ECL, Talend, Azure tools (Synapse, ADF etc), Power BI, Essbase etc.

About The Role

As a Data Engineer, you will design, build, and optimize data pipelines and platforms that enable reliable, scalable, and secure data processing across enterprise environments. You will work with modern Azure technologies and collaborate with business analysts, data scientists, and application teams to deliver high-quality data solutions that support analytics, reporting, and operational needs.

Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory, Databricks, and Azure storage services.
• Ingest data from multiple sources including relational databases, APIs, and file-based systems into Azure data platforms.
• Implement data transformations on HPCC using ECL and on Azure platform using SparkSQL and PySpark in Azure Databricks.
• Develop and optimize notebooks and jobs using Azure Databricks.
• Write efficient Spark jobs for large-scale data processing.
• Design and implement data models on HPCC using ECL and also using Delta Lake, Parquet, or other columnar storage formats.
• Optimize ECL code, SQL, and Spark workloads for performance and scalability.
• Work closely with business analysts, data scientists, and application teams to understand data requirements and promote data engineering best practices.

Requirements

• Strong proficiency in SQL and data transformation logic with Solid understanding of data warehousing concepts and ETL/ELT patterns.
• Hands-on experience with Azure Databricks, Spark SQL, and PySpark.
• Experience with Azure Data Factory, Azure Data Lake Storage (ADLS Gen2), and Azure SQL / Synapse.
• Experience working with large-scale, structured and semi-structured datasets.
• Experience with Agile development methodologies.
• Must have a positive attitude and desire to learn new processes and technologies.
• Knowledge of SDLC process like requirement gathering, design, implementation (Coding), testing, deployment, and maintenance. Solid understanding of software development principles, design patterns, and best practices. Proficient in requirement gathering and documentation.
• Excellent communication skills – verbal and written, Strong problem-solving skills with good knowledge of Insurance terminology.

Our Commitment to Inclusion

We welcome applications from individuals of all backgrounds, including underrepresented groups, people with disabilities, career changers, and candidates with non-traditional education or experience. If you require accommodations at any stage of the recruitment process, please let us know. We are committed to supporting your success.

Learn more about the LexisNexis Risk Solutions team and how we work

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.