Data Platform Engineer (Cloudera)

BCforward; Charlotte (NC); On-site; USD 90,000 - 96,000; Full time

Job summary

BCforward is seeking an experienced Software Engineer / Data Platform Engineer (Cloudera) in Charlotte, NC. The role emphasizes distributed computing, cloud and containerized deployments, and Python-based automation to build secure, scalable APIs and optimize platform performance according to enterprise standards.

The candidate will design and maintain solutions across distributed platforms, develop Python automation, and ensure security/compliance while collaborating with senior technologists

Qualifications

• 3-5 years of experience designing, implementing, and maintaining distributed systems.
• Deep expertise with Cloudera Hadoop ecosystem: HDFS, YARN, Spark, Impala, Ranger.
• Knowledge of Apache Iceberg and object storage such as S3 or Ozone.
• Strong Python development for automation and services using FastAPI, GUNICORN, or similar.
• Proficiency with Python libraries: spaCy, NumPy, Pandas, Polars.
• Strong knowledge of Docker, containers, and Kubernetes for deployment and orchestration.
• Intermediate to advanced Linux/Unix skills, including bash and shell scripting.
• Demonstrable troubleshooting and problem-solving skills, including error analysis and root-cause identification.
• Experience with Jupyter environments and integrating ML libraries under enterprise security practices.
• Expertise in Big Data technologies: Hive, HBase, Scala, PySpark, and distributed computing principles.
• Knowledge of cloud services with preference for AWS, Azure, and Databricks.

Responsibilities

• Design, implement, and maintain solutions across distributed computing platforms.
• Develop and optimize Python-based automation and API services using modern frameworks.
• Integrate tools and technologies to improve platform reliability, performance, and security.
• Troubleshoot complex issues across data, application, and infrastructure layers.
• Ensure compliance with enterprise security standards and governance practices.
• Collaborate with senior technologists and cross-functional stakeholders to deliver initiatives on schedule.

Skills

Distributed systems design

Python development

Docker

Kubernetes

Big Data technologies

Tools

FastAPI

GUNICORN

Apache Spark

Hive

Impala

Job description

Software Engineer / Data Platform Engineer (Cloudera)

Location: Charlotte, NC

Contract: 12 months

Pay Range: $65.05/hr (W2)

Job ID: 410144

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking an experienced Software Engineer / Data Platform Engineer (Cloudera) to join our dynamic team. The ideal candidate will have strong experience in distributed computing ecosystems, cloud and containerized deployments, and Python-based automation, and a proven ability to build secure, scalable APIs and optimize platform performance in alignment with enterprise standards.

Responsibilities

• Design, implement, and maintain solutions across distributed computing platforms.
• Develop and optimize Python-based automation and API services using modern frameworks.
• Integrate tools and technologies to improve platform reliability, performance, and security.
• Troubleshoot complex issues across data, application, and infrastructure layers.
• Ensure compliance with enterprise security standards and governance practices.
• Collaborate with senior technologists and cross-functional stakeholders to deliver initiatives on schedule.

Required Skills & Qualifications

• 3-5 years of experience designing, implementing, and maintaining distributed systems.
• Deep expertise with Cloudera Hadoop ecosystem: HDFS, YARN, Spark, Impala, Ranger.
• Knowledge of Apache Iceberg and object storage such as S3 or Ozone.
• Strong Python development for automation and services using FastAPI, GUNICORN, or similar.
• Proficiency with Python libraries: spaCy, NumPy, Pandas, Polars.
• Strong knowledge of Docker, containers, and Kubernetes for deployment and orchestration.
• Intermediate to advanced Linux/Unix skills, including bash and shell scripting.
• Demonstrable troubleshooting and problem-solving skills, including error analysis and root-cause identification.
• Experience with Jupyter environments and integrating ML libraries under enterprise security practices.
• Expertise in Big Data technologies: Hive, HBase, Scala, PySpark, and distributed computing principles.
• Knowledge of cloud services with preference for AWS, Azure, and Databricks.

Preferred Skills

• Experience building and managing secure APIs at scale in containerized environments.
• Background working in Agile or Scrum teams with strong documentation practices.

Why BCforward?

• Competitive compensation and benefits.
• Opportunities for growth with global clients.
• A supportive, inclusive culture that values innovation and people.
• Exposure to cutting-edge technologies and projects.

Additional Details

• Expectation for start: 2-4 weeks after offer. This role requires a specific start date and candidates must be able to meet the outlined start date.
• Hours per day: 8.
• Labor type: Technical.

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.