Data Engineer

I-Net Software Solutions; Hounslow; Hybrid; GBP 40,000 - 50,000; Full time

Benefits offered by this job

On-site parking

UK visa sponsorship

Job summary

I-Net Software Solutions is seeking a dynamic Data Engineer to lead the design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security.

You will leverage Informatica and scripting in Python or Bash to transform data into actionable insights for business decisions.

Qualifications

• Experience as a Data Engineer in big data environments.
• Strong Java and Python programming skills.
• Extensive knowledge of AWS cloud services related to storage, compute and data processing.
• Hands-on experience with SQL-based databases including Oracle and SQL Server.
• Familiarity with Hadoop, Spark, Hive and related ecosystem components.
• Experience with Informatica for data integration.
• Ability to analyze complex datasets to derive insights.

Responsibilities

• Design, develop, and implement large-scale data pipelines using Spark, Hadoop, and Hive.
• Collaborate with cross-functional teams to translate data requirements into efficient architectures.
• Optimize data workflows in AWS cloud environments for performance and reliability.
• Maintain data warehouses on Oracle and SQL Server to support analytics.
• Develop automation scripts using Python, Bash to streamline processing tasks.
• Ensure data quality, security, and governance.
• Lead data integration efforts using Informatica and manage Hadoop ecosystems.
• Analyze complex datasets to uncover actionable insights.

Skills

Java

Python

SQL

Big data

Data modeling

Spark

Hadoop

Apache Hive

AWS

Bash

Tools

Informatica

Oracle

Microsoft SQL Server

Hadoop

Spark

Hive

AWS services

Job description

Job Description:

Reference: INET/DE/Oct26

Location: Hounslow

Salary: £40,000.00 to £50,000.00 (Based on experience)

Job Open date: 12th October 2026

Close date: 11th November 2026

Job Summary

We are seeking a dynamic and highly skilled Data Engineer to lead the development, optimization, and maintenance of our data infrastructure. In this role, you will harness your expertise in big data technologies, cloud platforms, and database design to build scalable data pipelines that empower data-driven decision-making across the organization. Your innovative approach and technical leadership will ensure our data environment is robust, efficient, and ready to support advanced analytics and business insights.

Responsibilities

• Design, develop, and implement large-scale data pipelines using tools such as Apache Spark, Hadoop, and Apache Hive to process vast amounts of structured and unstructured data.
• Collaborate with cross-functional teams to understand data requirements and translate them into efficient database architectures and workflows.
• Optimize existing data workflows for performance, scalability, and reliability within cloud environments like AWS.
• Maintain and enhance data warehouses built on platforms such as Oracle, Microsoft SQL Server, or similar systems to support analytical needs.
• Develop automated scripts using Python, Bash (Unix shell), Shell Scripting, or VBA to streamline data processing tasks.
• Ensure data quality, security, and compliance by implementing best practices in database design and management.
• Lead efforts in integrating diverse data sources through tools like Informatica and manage big data ecosystems involving Hadoop clusters.
• Conduct analysis of complex datasets to uncover insights that drive strategic business decisions.

Experience

• Proven experience as a Data Engineer or in a similar role with a focus on big data environments.
• Strong proficiency in programming languages such as Java and Python for building scalable data solutions.
• Extensive knowledge of cloud platforms, particularly AWS services related to storage, computing, and data processing.
• Hands-on experience with SQL-based databases including Oracle and Microsoft SQL Server; solid understanding of database design principles.
• Familiarity with big data frameworks like Hadoop, Spark, Apache Hive, and related ecosystem components.
• Experience working with ETL tools such as Informatica for data integration tasks.
• Demonstrated ability to analyze complex datasets using advanced analysis skills to derive actionable insights.
• Knowledge of scripting languages including Bash (Unix shell) for automation purposes.
• Strong understanding of Data Warehouse concepts and architecture to support enterprise analytics initiatives.

Join us to shape the future of our organization’s data landscape! We value energetic professionals who thrive on innovation, collaboration, and continuous learning - empowering teams with the tools they need to succeed in a fast-paced digital world!

Benefits

• On-site parking
• UK visa sponsorship

Work Location: Hybrid remote in Hounslow TW4 6JQ