Senior Data Engineer

Incedo Inc.; Dallas (TX); On-site; USD 110,000 - 170,000; Full time

Job summary

Incedo Inc. in Dallas seeks a highly motivated Data Engineer to build scalable data pipelines and data integration frameworks, supporting BI, analytics, and data-driven decisions.

The ideal candidate has hands-on experience with Python, PySpark, Java, Kafka, Hadoop, REST APIs and SQL, and thrives in cross-functional Agile teams.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 4+ years of experience in Data Engineering or Big Data development.
• Hands-on experience with Python, PySpark, Java, Kafka, Hadoop, REST APIs, and SQL.
• Strong analytical and problem-solving abilities.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build and optimize large-scale data processing solutions using Python, PySpark, and Java.
• Develop data ingestion frameworks for structured and unstructured data sources.
• Integrate data from various systems through REST APIs, streaming platforms, and batch processing.
• Work with large datasets in distributed computing environments.
• Develop and support real-time and batch data processing solutions using Kafka and Hadoop ecosystem technologies.

Skills

Python

PySpark

Java

Education

Bachelor's degree in CS/IT/Engineering

Tools

Kafka

Hadoop

REST APIs

SQL

Jira

Job description

Incedo Inc. is a high-growth Digital, Data and AI Transformation Specialist firm headquartered in New Jersey. We

are a long-term strategy execution partner for Fortune 500 enterprises, operating at the intersection of business

and technology across Banking & Payments, Wealth Management, Telecom, Hi-Tech, and Life Sciences.

We are building Incedo 4.0 - an AI-native, execution-focused, founder-led organization designed for scale, speed,

and long-term impact.

Incedo delivers ROI from AI @ Scale through the “Power of 3”:

Engineering & Operations excellence.

Job Summary

We are seeking a highly motivated Data Engineer to join our growing team. The ideal candidate will have strong expertise in building scalable data pipelines, data integration frameworks, and distributed data processing solutions. The candidate should possess hands-on experience with Python, PySpark, Java, Kafka, Hadoop, REST APIs, and SQL, along with strong analytical and problem-solving skills.

This role requires collaboration with cross-functional teams to design, develop, and optimize enterprise data solutions that support business intelligence, analytics, and data-driven decision-making initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build and optimize large-scale data processing solutions using Python, PySpark, and Java.
• Develop data ingestion frameworks for structured and unstructured data sources.
• Integrate data from various systems through REST APIs, streaming platforms, and batch processing.
• Work with large datasets in distributed computing environments.
• Develop and support real-time and batch data processing solutions using Kafka and Hadoop ecosystem technologies.
• Implement scalable streaming data pipelines and event-driven architectures.
• Monitor and optimize data workflows for performance and reliability.

Database & Data Management

• Write complex SQL queries for data extraction, transformation, and analysis.
• Design and optimize database schemas and data models.
• Ensure data quality, consistency, and governance standards are maintained.
• Participate in Agile ceremonies including sprint planning, daily stand-ups, backlog grooming, and retrospectives.
• Use Jira for project tracking, issue management, and sprint execution.
• Collaborate with Data Architects, Data Scientists, Business Analysts, and Application Development teams.
• Work independently as well as within a collaborative team environment.

Performance & Support

• Troubleshoot and resolve data-related issues across environments.
• Perform root cause analysis and implement long-term solutions.
• Support production deployments and ongoing maintenance activities.

Required Skills

Programming Languages

• Python
• PySpark
• Java

Data Technologies

• Hadoop Ecosystem
• SQL
• Data Warehousing Concepts
• ETL/ELT Development

Integration Technologies

• REST APIs
• Data Integration Frameworks
• Streaming and Batch Processing

Tools & Methodologies

• Jira
• Agile/Scrum

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 4+ years of experience in Data Engineering or Big Data development.
• Hands-on experience with Python, PySpark, Java, Kafka, Hadoop, REST APIs, and SQL.
• Strong analytical and problem-solving abilities.
• Ability to work effectively in both team-oriented and independent environments.

Preferred Skills

• Experience with cloud platforms such as AWS, Azure, or GCP.
• Knowledge of Spark optimization and performance tuning.
• Experience with Data Lakes and Data Warehouses.
• Exposure to CI/CD pipelines and DevOps practices.
• Familiarity with data governance and data quality frameworks.