Data Platform Engineer (Cloudera) — Cloud & API Automation

BCforward; Charlotte (NC); On-site; USD 90,000 - 96,000; Full time

Job summary

BCforward is seeking an experienced Software Engineer / Data Platform Engineer (Cloudera) in Charlotte, NC. The role emphasizes distributed computing, cloud and containerized deployments, and Python-based automation to build secure, scalable APIs and optimize platform performance according to enterprise standards.

The candidate will design and maintain solutions across distributed platforms, develop Python automation, and ensure security/compliance while collaborating with senior technologists

Qualifications

• 3-5 years of experience designing, implementing, and maintaining distributed systems.
• Deep expertise with Cloudera Hadoop ecosystem: HDFS, YARN, Spark, Impala, Ranger.
• Knowledge of Apache Iceberg and object storage such as S3 or Ozone.
• Strong Python development for automation and services using FastAPI, GUNICORN, or similar.
• Proficiency with Python libraries: spaCy, NumPy, Pandas, Polars.
• Strong knowledge of Docker, containers, and Kubernetes for deployment and orchestration.
• Intermediate to advanced Linux/Unix skills, including bash and shell scripting.
• Demonstrable troubleshooting and problem-solving skills, including error analysis and root-cause identification.
• Experience with Jupyter environments and integrating ML libraries under enterprise security practices.
• Expertise in Big Data technologies: Hive, HBase, Scala, PySpark, and distributed computing principles.
• Knowledge of cloud services with preference for AWS, Azure, and Databricks.

Responsibilities

• Design, implement, and maintain solutions across distributed computing platforms.
• Develop and optimize Python-based automation and API services using modern frameworks.
• Integrate tools and technologies to improve platform reliability, performance, and security.
• Troubleshoot complex issues across data, application, and infrastructure layers.
• Ensure compliance with enterprise security standards and governance practices.
• Collaborate with senior technologists and cross-functional stakeholders to deliver initiatives on schedule.

Skills

Distributed systems design

Python development

Docker

Kubernetes

Big Data technologies

Tools

FastAPI

GUNICORN

Apache Spark

Hive

Impala

Job description

BCforward is seeking an experienced Software Engineer / Data Platform Engineer (Cloudera) in Charlotte, NC. The role emphasizes distributed computing, cloud and containerized deployments, and Python-based automation to build secure, scalable APIs and optimize platform performance according to enterprise standards.

The candidate will design and maintain solutions across distributed platforms, develop Python automation, and ensure security/compliance while collaborating with senior technologists