Data Engineer

CloudBigD

Charlotte (NC)

On-site

USD 91,000 - 124,000

Full time

Just now
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CloudBigD in Charlotte, NC is seeking a Data Engineer to design, build, and maintain scalable data pipelines using Python/Java, GCP, and PySpark. The role focuses on distributed processing, real-time streaming, REST APIs, and database integration with Oracle and S3.

You'll work with Spark and Flink in a Tier-1 vendor environment, collaborating with cross-functional teams to deliver robust data integration solutions.

Qualifications

  • Strong Python or Java development experience.
  • Solid data engineering and data pipeline development expertise.
  • Hands-on experience with GCP.
  • Practical experience with PySpark.
  • Experience building and deploying pipelines using Apache Spark.
  • Understanding of Apache Flink and distributed data systems.
  • Hands-on experience with real-time streaming architectures.
  • Experience working with REST APIs and database connectors.
  • Proficiency with relational databases such as Oracle.
  • Experience using Amazon S3 APIs for data storage and integration.
  • Prior Tier 1 vendor experience is mandatory.

Responsibilities

  • Design, develop, and deploy scalable data pipelines using Python, Java, and PySpark.
  • Build and maintain data processing solutions on Google Cloud Platform (GCP).
  • Work with distributed data processing frameworks such as Apache Spark and Apache Flink.
  • Develop and support real-time streaming data architectures.
  • Integrate data sources and services using REST APIs and database connectors.
  • Work with relational databases, including Oracle, for data storage and processing.
  • Implement data storage and integration solutions using Amazon S3 APIs.
  • Troubleshoot, optimize, and maintain data pipelines for performance, scalability, and reliability.
  • Collaborate with cross-functional teams to deliver data engineering solutions.

Skills

Python
Java
PySpark
GCP
REST APIs
Oracle
S3 APIs
Spark
Flink
Data pipelines

Tools

Google Cloud Platform
Apache Spark
Apache Flink
Amazon S3
Oracle Database

Job description

US Citizen, Green Card, OPT-EAD, CPT, Other

Job Title: Data Engineer
Location: Charlotte, NC
Duration: 8 Months + Extension
Bill Rate: $78/hour (C2C)
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
JOB DESCRIPTION:

We are seeking a Data Engineer with strong expertise in Python/Java, GCP, and PySpark to build, deploy, and maintain scalable data pipelines. The ideal candidate will have experience with distributed data processing, real-time streaming architectures, REST APIs, and database integration. Prior experience working through a Tier 1 vendor is mandatory. The detailed job description is expected to be shared tomorrow.

KEY RESPONSIBILITIES:
  • Design, develop, and deploy scalable data pipelines using Python, Java, and PySpark.
  • Build and maintain data processing solutions on Google Cloud Platform (GCP).
  • Work with distributed data processing frameworks such as Apache Spark and Apache Flink.
  • Develop and support real-time streaming data architectures.
  • Integrate data sources and services using REST APIs and database connectors.
  • Work with relational databases, including Oracle, for data storage and processing.
  • Implement data storage and integration solutions using Amazon S3 APIs.
  • Troubleshoot, optimize, and maintain data pipelines for performance, scalability, and reliability.
  • Collaborate with cross-functional teams to deliver data engineering solutions.
REQUIRED SKILLS & EXPERIENCE:
  • Strong Python or Java development experience.
  • Solid data engineering and data pipeline development expertise.
  • Good hands-on experience with GCP.
  • Practical experience with PySpark.
  • Experience building and deploying pipelines using Apache Spark.
  • Understanding of Apache Flink and distributed data systems.
  • Hands-on experience with real-time streaming architectures.
  • Experience working with REST APIs and database connectors.
  • Proficiency with relational databases such as Oracle.
  • Experience using Amazon S3 APIs for data storage and integration.
  • Prior Tier 1 vendor experience is mandatory.
PREFERRED SKILLS:
  • Experience with Apache Iceberg.
  • Exposure to advanced distributed data processing and streaming technologies.
GOOD TO HAVE:
  • Experience optimizing large-scale data pipelines in cloud environments.
  • Exposure to hybrid cloud data integration using GCP and Amazon S3.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Robotic Process Automation LLC • Charlotte (NC)

On-site
USD 84,000 - 114,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Charlotte (NC)

On-site
USD 82,000 - 117,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Woodbridge Township (NJ)

On-site
USD 90,000 - 130,000
Data Engineer
Data Engineer

Quantum Technologies LLC • Charlotte (NC)

On-site
USD 96,000 - 131,000
Data Engineer
Data Engineer

Valiant Technologies LLC • Woodbridge Township (NJ)

On-site
USD 90,000 - 150,000
Data Engineer
Data Engineer

Ethereum Technologies LLC • Woodbridge Township (NJ)

On-site
USD 110,000 - 165,000
Senior Data Engineer
Senior Data Engineer

Quantum Technologies LLC • Charlotte (NC)

On-site
USD 91,000 - 124,000
Senior Data Engineer
Senior Data Engineer

Ethereum Technologies LLC • Charlotte (NC)

On-site
USD 89,000 - 126,000
Senior Data Engineer
Senior Data Engineer

Valiant Technologies LLC • Charlotte (NC)

On-site
USD 91,000 - 124,000
Data Engineer
Data Engineer

Quantum Technologies. LLC • Charlotte (NC)

On-site
USD 91,000 - 124,000