Data Integration Specialist

Lancesoft; King of Prussia (Montgomery County); Remote; USD 80,000 - 100,000; Full time

Job summary

An innovative firm is seeking a talented Data Integration Engineer to join their dynamic team. In this pivotal role, you'll design and implement custom integrations between Apache products and various data systems, contributing to the development of a robust data lake architecture. Collaborating with cross-functional teams, you'll identify integration requirements and ensure seamless data flow. This contract position offers an exciting opportunity to work on cutting-edge technology in a supportive and forward-thinking environment, where your expertise will help shape the future of data integration.

Qualifications

• 5+ years in data integration and software development.
• Strong knowledge of Apache products and integration technologies.

Responsibilities

• Design and implement custom integrations for data systems.
• Ensure seamless data flow and support data lake architecture.

Skills

Data Integration

Software Development

Apache NiFi

Apache Kafka

Apache Spark

Java

Python

Scala

Problem-Solving

Tools

AWS

Azure

Google Cloud

Git

Job description

Job Title: Data Integration Engineer

Location: Remote

Duration: 12 months contract (Possibility Temp to hire)

Shift: 1st shift

Pay range: $70.00 - $98.00/hr (W2)

Job Description

The Chief Data and AI Office (CDAO) is seeking a skilled Data Integration Engineer to join the All Domain Data EnableR (ADDER) team. As a Data Integration Engineer, you will play a key role in designing, developing, and implementing custom integrations between Apache products and other data systems to support the creation of a robust data lake and lake house architecture. You will work closely with cross-functional teams to identify integration requirements, develop solutions, and ensure seamless data flow between systems.

Basic Qualifications:

1. 5+ years of experience in data integration, software development, or a related field
2. Experience with data lakes and lake houses, including architecture and design principles
3. Strong knowledge of Apache products (e.g., Apache NiFi, Apache Kafka, Apache Spark)
4. Experience with software integration patterns and technologies (e.g., APIs, messaging queues)
5. Proficiency in programming languages such as Java, Python, or Scala
6. Excellent problem-solving skills and attention to detail

Preferred Qualifications:

1. Experience with cloud-based data platforms (e.g., AWS, Azure, Google Cloud)
2. Knowledge of data governance, security, and compliance principles
3. Experience with agile development methodologies and version control systems (e.g., Git)
4. Familiarity with data cataloging and metadata management tools
5. Experience working with large-scale data sets and distributed computing environments
6. Certification in Apache products or related technologies (e.g., Cloudera, Hortonworks)

Seniority level

Director

Employment type

Contract

Job function

Engineering and Information Technology

Industries

Aviation and Aerospace Component Manufacturing, Defense and Space Manufacturing, and Military and International Affairs