Big Data Engineer / Data Platform Engineer

BCforward; Charlotte (NC); Hybrid; USD 90.000 - 94.000; Vollzeit

Zusammenfassung

BCforward is seeking a Big Data Engineer / Data Platform Engineer to build and maintain large-scale data platforms in the financial sector. You will work on batch and streaming pipelines, leverage Hadoop, Spark, Hive, and Kafka, and implement CI/CD with Jenkins and GitHub Actions.

The role involves collaboration with risk, compliance, and architecture teams and requires on-site presence in hybrid setup. Hybrid work arrangement with a strong emphasis on data quality, monitoring via Splunk, and

Qualifikationen

• Hands-on experience with Big Data technologies.
• Proficiency with Hadoop ecosystem: HDFS, Hive, Spark, and YARN.
• Experience building and optimizing batch and streaming data pipelines.
• Experience implementing CI/CD with Jenkins and GitHub Actions.
• Familiarity with data quality, governance, and monitoring tools.

Aufgaben

• Build and maintain large-scale data platforms in the financial domain.
• Contribute to data engineering, platform stability, and deployment automation.
• Partner with business, risk, compliance, and architecture teams to deliver data solutions.
• Develop on Big Data platforms using Hadoop ecosystem components including HDFS, Hive, Spark, and YARN.
• Design and operate streaming pipelines using Kafka or similar technologies.
• Translate business requirements into scalable data solutions and technical implementations.
• Troubleshoot and optimize data processing jobs across batch and streaming workloads.
• Ensure data quality, performance, and reliability across systems.
• Implement and maintain CI/CD pipelines with tools such as Jenkins and GitHub Actions.
• Support automated deployments and release processes using infrastructure as code.
• Monitor and troubleshoot platforms using tools like Splunk to improve reliability and efficiency.

Kenntnisse

Leadership

Client relationships

Delivery under pressure

Team collaboration

Tools

Hadoop

HDFS

Hive

Spark

YARN

Kafka

Jenkins

GitHub Actions

Splunk

Jobbeschreibung

Job Title: Big Data Engineer / Data Platform Engineer

Location: Jersey City, NJ or Charlotte, NC

Duration: Contract - 12 months

Pay Range: Jersey City, NJ (Pay Rate: $68.25)Charlotte, NC (Pay Rate: $65.06)

Job ID: 410963

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients.

Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Responsibilities

• Build and maintain large-scale data platforms in the financial domain.
• Contribute to data engineering, platform stability, and deployment automation.
• Partner with business, risk, compliance, and architecture teams to deliver data solutions.
• Develop on Big Data platforms using Hadoop ecosystem components including HDFS, Hive, Spark, and YARN.
• Design and operate streaming pipelines using Kafka or similar technologies.
• Translate business requirements into scalable data solutions and technical implementations.
• Troubleshoot and optimize data processing jobs across batch and streaming workloads.
• Ensure data quality, performance, and reliability across systems.
• Implement and maintain CI/CD pipelines with tools such as Jenkins and GitHub Actions.
• Support automated deployments and release processes using infrastructure as code.
• Monitor and troubleshoot platforms using tools like Splunk to improve reliability and efficiency.

Required Skills & Qualifications

• Hands-on experience with Big Data technologies and distributed systems.
• Proficiency with Hadoop ecosystem: HDFS, Hive, Spark, and YARN.
• Experience building and optimizing batch and streaming data pipelines, preferably with Kafka.
• Experience implementing CI/CD and automated deployments using tools such as Jenkins and GitHub Actions.
• Exposure to infrastructure as code and platform monitoring with Splunk or similar tools.
• Demonstrated leadership and client relationship skills with a strong professional work ethic.
• Ability to work under pressure and deliver on time, individually and within a team.

Preferred Skills

• Experience with Git-based workflows and release management in regulated environments.
• Background in financial services data platforms.

Schedule & Start Details

• Hybrid schedule with a minimum of 3 days per week onsite.
• Start date targeted within 2 to 4 weeks after offer to meet business needs.
• Glider candidate ID verification required.

Why BCforward?

At BCforward, we believe in advancing lives and careers.

When you join our team, you gain access to:

• Competitive compensation and benefits.
• Opportunities for growth with global clients.
• A supportive, inclusive culture that values innovation and people.
• Exposure to cutting-edge technologies and projects.

About Our Commitment

BCforward is an equal opportunity employer.

We value diversity and are committed to creating an inclusive environment for all employees.

All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.