BigData Engineer

Synechron; Charlotte (NC); Presencial; USD 90.000 - 97.000; Tempo integral

Benefícios oferecidos por esta vaga

Competitive compensation

Global exposure

Paid leave 10 days

Resumo da vaga

Synechron, a global consulting firm, is seeking a senior Big Data Engineer in Charlotte, NC. You will design, develop, and maintain scalable data pipelines using PySpark and Hadoop, enabling analytics and BI across financial services clients.

The role requires 6+ years of data engineering experience, strong Spark/PySpark, Python, SQL, and Hadoop ecosystem proficiency. You will collaborate with data scientists, analysts, and engineers while following best practices in security and deployment.

Qualificações

• 6+ years of experience in data engineering or related role.
• Strong hands-on experience with Apache Spark and PySpark.
• Practical experience with the Hadoop ecosystem (HDFS, Hive, YARN).
• Proficiency in Python and SQL; experience with ETL/ELT pipelines.

Responsabilidades

• Design, develop, and maintain scalable data pipelines using PySpark and Hadoop.
• Build and optimize batch and real-time data processing workflows.
• Develop data ingestion processes from structured, semi-structured, and unstructured sources.
• Collaborate with data scientists, analysts, engineers, and business stakeholders.
• Write efficient Spark applications and optimize Hive SQL queries.

Conhecimentos

Spark / PySpark

Python

SQL

Hadoop ecosystem

ETL pipelines

Distributed computing

Ferramentas

HDFS

Hive

YARN

Sqoop

Git

Descrição da vaga

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile‑first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 17,000+, and has 58 offices in 22 countries within key global markets.

We are seeking a skilled Big Data Engineer with strong experience in Hadoop, PySpark, and distributed data processing technologies. The successful candidate will design, develop, and maintain scalable data pipelines and big data solutions that support analytics, reporting, and business intelligence initiatives.

The ideal candidate has hands‑on experience working with large and complex datasets, cloud or on‑premises data platforms, and modern data engineering practices.

Additional Information*

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $90k - $97k/year & benefits (see below).

The Role

Responsibilities:

• Design, develop, and maintain scalable data pipelines using PySpark and Hadoop.
• Build and optimize batch and, where applicable, real‑time data processing workflows.
• Develop data ingestion processes from structured, semi‑structured, and unstructured data sources.
• Work with Hadoop ecosystem components such as:

• HDFS
• Hive
• HBase
• YARN
• Sqoop

• Write efficient PySpark applications for data transformation, cleansing, aggregation, and enrichment.
• Develop and optimize Hive SQL queries and data models.
• Perform data profiling, validation, quality checks, and reconciliation.
• Optimize Spark jobs, including partitioning, caching, joins, memory usage, and resource allocation.
• Collaborate with data scientists, analysts, software engineers, and business stakeholders.
• Implement monitoring, logging, error handling, and alerting for production data pipelines.
• Troubleshoot performance, reliability, and data quality issues.
• Maintain technical documentation for data flows, processes, and system architecture.
• Follow best practices for security, governance, version control, testing, and deployment.
• Participate in code reviews and contribute to continuous improvement of the data platform.

Required Qualifications

• 6 years of experience in data engineering or a related role.
• Strong hands‑on experience with Apache Spark and PySpark.
• Practical experience with the Hadoop ecosystem, including HDFS, Hive, and YARN.
• Strong proficiency in Python and SQL.
• Experience designing and developing ETL/ELT data pipelines.
• Good understanding of distributed computing, data partitioning, parallel processing, and fault tolerance.
• Experience working with relational and NoSQL databases.
• Knowledge of data warehousing concepts, dimensional modeling, and data lake architecture.
• Experience with Git or other version control systems.
• Strong analytical, troubleshooting, and problem‑solving skills.
• Ability to work effectively in a collaborative, fast‑paced environment.

We offer:

• A highly competitive compensation and benefits package.
• A multinational organization with 58 offices in 22 countries and the possibility to work abroad.
• 10 days of paid annual leave (plus sick leave and national holidays).
• Maternity & paternity leave plans.
• A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
• Retirement savings plans.
• A higher education certification policy.
• Commuter benefits (varies by region).
• Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
• On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
• Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
• Cutting edge projects at the world’s leading tier‐one banks, financial institutions and insurance firms.
• A flat and approachable organization.
• A truly diverse, fun‑loving, and global work culture.

S YNECHRON’S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.