Senior Data Engineer - Cloud, Big Data Pipelines (Hybrid)

I-Net Software Solutions; Hounslow; Hybrid; GBP 40.000 - 50.000; Vollzeit

Benefits dieser Stelle

On-site parking

UK visa sponsorship

Zusammenfassung

I-Net Software Solutions is seeking a dynamic Data Engineer to lead the design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security.

You will leverage Informatica and scripting in Python or Bash to transform data into actionable insights for business decisions.

Qualifikationen

• Experience as a Data Engineer in big data environments.
• Strong Java and Python programming skills.
• Extensive knowledge of AWS cloud services related to storage, compute and data processing.
• Hands-on experience with SQL-based databases including Oracle and SQL Server.
• Familiarity with Hadoop, Spark, Hive and related ecosystem components.
• Experience with Informatica for data integration.
• Ability to analyze complex datasets to derive insights.

Aufgaben

• Design, develop, and implement large-scale data pipelines using Spark, Hadoop, and Hive.
• Collaborate with cross-functional teams to translate data requirements into efficient architectures.
• Optimize data workflows in AWS cloud environments for performance and reliability.
• Maintain data warehouses on Oracle and SQL Server to support analytics.
• Develop automation scripts using Python, Bash to streamline processing tasks.
• Ensure data quality, security, and governance.
• Lead data integration efforts using Informatica and manage Hadoop ecosystems.
• Analyze complex datasets to uncover actionable insights.

Kenntnisse

Java

Python

SQL

Big data

Data modeling

Spark

Hadoop

Apache Hive

AWS

Bash

Tools

Informatica

Oracle

Microsoft SQL Server

Hadoop

Spark

Hive

AWS services

Jobbeschreibung

I-Net Software Solutions is seeking a dynamic Data Engineer to lead the design, development, and optimization of our data infrastructure in a hybrid role based in Hounslow. You will build scalable pipelines with Spark, Hadoop, Hive, and AWS, maintain data warehouses on Oracle/SQL Server, and drive data quality and security.

You will leverage Informatica and scripting in Python or Bash to transform data into actionable insights for business decisions.