Data engineer

Matrix Global

United States

Remote

USD 110,000 - 170,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Matrix seeks an experienced Data Pipeline Engineer to develop, implement, and maintain production-grade data pipelines. You will build scalable data flows, support ML and analytics, and optimize large-scale processing environments.

T he role requires Python, PySpark, Spark, SQL, Airflow, and Hadoop ecosystem expertise. Collaborate with customers and internal teams to deliver reliable data solutions with a business focus.

Qualifications

  • Hands-on experience with Python and Pandas.
  • Experience with Spark and PySpark for distributed processing.
  • Strong SQL skills and large dataset analysis.
  • Practical Airflow and workflow orchestration.
  • Familiarity with Hadoop ecosystem (Hive, Impala, HDFS, Sqoop).
  • Experience with Git and production data pipelines.
  • Understanding of structured and semi-structured data formats.
  • Exposure to Kubernetes workloads and LLM-related tooling.

Responsibilities

  • Implement, maintain, and support production data pipelines.
  • Design use-case data flows and ML pipelines for analytics teams.
  • Build and optimize data processing with Spark, PySpark, Python, SQL, and Airflow.
  • Work with Hadoop ecosystem (Hive/Impala/HDFS/Sqoop).
  • Analyze data characteristics to inform pipeline design.
  • Deploy workloads in Kubernetes environments.
  • Collaborate with customers and cross-functional teams.
  • Apply business-oriented approaches to data workflows.
  • Leverage LLMs and AI agents to accelerate delivery.

Skills

Pandas
PySpark
SQL
Airflow
Hadoop
Kubernetes
Git
LLMs / AI agents

Tools

Spark
Hive
Impala
HDFS
Sqoop
Airflow

Job description

Descripción Data Engineer Brazil or Argentina

We are seeking an experienced Data Pipeline Engineer to develop, implement, and maintain production-grade data pipelines within the platform. The role involves building scalable data flows, supporting machine learning and analytics use cases, and optimizing large-scale data processing environments. The ideal candidate will have strong hands-on experience with Python, PySpark, Apache Spark, SQL, and big-data technologies, along with an understanding of data pipeline architecture and production operations. The candidate will collaborate closely with customers and internal technical teams to deliver reliable, business-focused data solutions.

Key Responsibilities
  • Implement, maintain, and support production data pipeline flows within the platform based on solution designs and business requirements.
  • Design and develop use-case-specific data flows, machine learning pipelines, and data tools for analytics and data science teams.
  • Build and optimize data processing workflows using Apache Spark, PySpark, Python (Pandas), SQL, Git, and Apache Airflow.
  • Work with Hadoop ecosystem technologies, including Hive, Impala, HDFS, and Sqoop.
  • Analyze structured and semi-structured datasets to understand data characteristics and support pipeline design and implementation.
  • Optimize big-data pipelines, processing architectures, and datasets to improve performance, scalability, and reliability.
  • Deploy and manage data processing workloads in Kubernetes-based environments.
  • Collaborate with customers and cross-functional teams to understand requirements and deliver effective technical solutions.
  • Apply a business-oriented approach when designing and implementing data workflows.
  • Leverage Large Language Models (LLMs), agentic coding, LLM cost optimization, and AI agent development to accelerate delivery and build data tools for internal and external use cases.
Required Skills and Experience
  • Strong hands-on experience with Python, including Pandas.
  • Experience with Apache Spark and PySpark for distributed data processing.
  • Strong SQL skills and experience analyzing large datasets.
  • Practical experience with Apache Airflow and workflow orchestration.
  • Familiarity with Hadoop ecosystem technologies such as Hive, Impala, HDFS, and Sqoop.
  • Experience with Git and production data pipeline development.
  • Understanding of structured and semi-structured data formats.
  • Experience optimizing data pipelines and workloads in Kubernetes environments.
  • Exposure to LLMs, agentic coding, AI agents, and LLM cost optimization.
  • Strong problem-solving and customer collaboration skills.
Why Join Us?

You’ll work with a talented global team, contribute to meaningful technical initiatives, and help shape a high performing DevOps culture. Matrix is a global, dynamic, and fast growing technology services and consulting company with over 17,000 employees worldwide. Founded in 2001, Matrix has grown through significant organic expansion and strategic acquisitions, executing some of the largest and most impactful technology projects in the market. We specialize in the design, development, and implementation of advanced technologies, software solutions, and digital products. Our services include infrastructure and consulting, IT outsourcing and offshore delivery, training and assimilation programs, and acting as a trusted implementation and delivery partner for the world’s leading software vendors. With deep expertise across both the private and public sectors—spanning Finance, Telecom, Healthcare, Hi Tech, Education, Defense, and Security—Matrix serves a strong customer base in Israel alongside a continuously expanding global client portfolio. At Matrix, our people are at the heart of our success. We are a community of talented, creative, and dedicated professionals who are passionate about innovation and excellence. We actively attract, develop, and retain top talent, recognizing that every employee’s contribution is critical to our continued growth and future success. Matrix’s success is built on a challenging and engaging work environment, competitive compensation and benefits, and meaningful career development opportunities. We foster a diverse, inclusive culture that encourages collaboration, continuous learning, and growth—together. Join the winning team. Be challenged, grow your career, and enjoy the journey in a highly respected global organization.

To learn more, visit: www.matrix-ifs.com

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: Scalable Pipelines, Spark & AI Tools
Data Engineer: Scalable Pipelines, Spark & AI Tools

Matrix Global • United States

Remote
USD 110,000 - 170,000
Data Engineer
Data Engineer

Nimble Gravity • United States

Remote
USD 120,000 - 180,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 110,000 - 150,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 160,000
Data Engineer
Data Engineer

Nimble Gravity • United States

Remote
USD 120,000 - 180,000
Data Engineer Sr
Data Engineer Sr

Sequoia Connect • United States

Remote
USD 120,000 - 160,000
Data Engineer
Data Engineer

The Value Maximizer • United States

On-site
USD 90,000 - 120,000
Data Engineer ID43228
Data Engineer ID43228

AgileEngine, LLC. • Miami (FL)

On-site
USD 90,000 - 120,000
Professional growth opportunities
Competitive USD-based compensation
Flexible work schedule
Data Engineer
Data Engineer

Prediktive • Atlanta (GA)

Remote
USD 120,000 - 180,000
Data scientist
Data scientist

Matrix IT Ltd • United States

On-site
USD 120,000 - 180,000