PySpark Developer

Synechron Inc.; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Flexible workplace arrangements

Learning and development programs

Job summary

Synechron Inc. is seeking a PySpark Developer located in Bengaluru. The candidate will be responsible for building data pipelines and developing ML pipelines while working with technologies like Python, Spark, and Hadoop.

A degree in computer science or a related field is required, alongside at least 5 years of relevant experience. Effective communication skills and the ability to work under pressure are essential in this dynamic environment.

Qualifications

• 5 years of previous commercial experience in a data-driven role.
• 5 years of hands-on experience building data pipelines.
• Ability to write clean, maintainable, and robust code in Python.

Responsibilities

• Build data pipelines in production.
• Develop ML pipelines for streaming/batch workflows.
• Communicate effectively with technical and non-technical audiences.

Skills

Python

Spark (PySpark)

Data Pipeline Development

Hands-on ML Pipeline

Exploratory Data Analysis (EDA)

Git

SQL and No-SQL DBMS

Jupyter

Education

Degree in computer science, engineering, mathematics, or equivalent experience

Tools

Hadoop

Pandas

Apache Airflow

Jenkins

Job description

## PySpark DeveloperApplylocations: Bengaluru - Thanissandra (BCIT)time type: Full timeposted on: Posted Todayjob requisition id: JR1040510**Education*** Degree in computer science, engineering, mathematics, or equivalent experience**Experiences:*** 5 years of previous commercial experience as a leader in a data-driven role* 5 years of hands-on experience building data pipelines in production and ability to work across structured, semi-structured and unstructured data* 5 years of experience in ML pipeline for streaming/batch workflow**Knowledge & Skills*** Ability to write clean, maintainable, and robust code in Python* Understanding and expertise of software engineering concepts and best practices* Knowledge of testing frameworks and libraries* Experience with analytics (descriptive, predictive, EDA), feature engineer, algorithms, anomaly detection, data quality assessment and python visualization libraries *- e.g. matplotlib, seaborn or other** Comfortable with notebook and source code development - *Jupyter, Pycharm/VScode** Hands-on experience of technologies like Python, Spark/Pyspark, Hadoop/MapReduce/HIVE, Pandas etc.* Familiarity with query languages and database technologies, CI/CD, testing and validation of data and software* Tech stack and activities that you would use and preform on a daily basis + Python + Spark (PySpark) + Jupyter + SQL and No-SQL DBMS + Git (as source code versioning and CI/CD) + Exploratory Data Analysis (EDA) + Imputation Techniques + Data Linking / Cleansing + Feature Engineering + Apache Airflow/ Jenkins scheduling and automation, Github and Github Actions* Collaborative - able to build strong relations that enable robust debate and resolve periodic disagreements regarding priorities.* Excellent interpersonal, and communication skills* Ability to communicate effectively with technical and non-technical audience* Ability to work under pressure with a solid sense for setting priorities* Ability to lead technical work with strong sense of ownership* Strong command of English language (both verbal and written)**Behavioral Competencies*** Thinking Related* People Related* Self-Related* Practical and action oriented* Compelling communicator* Excellent stakeholder management* Foster and promote entrepreneurial spirit and curiosity amongst team members* Team player* Quick learner***S******YNECHRON’S DIVERSITY & INCLUSION STATEMENT***Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.Candidate Application Notice### About UsAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span **end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering**, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our **FinLabs** we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.Over the last **20+ years**, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of **14,500+,** and has **58** **offices in 21 countries** within key global markets.For more information on the company, please visit our website or LinkedIn community.### Sustainability and Health Safety CommitmentAt Synechron, we are committed to integrating *sustainability* into our business *strategy*, ensuring *responsible growth* while minimizing *environmental impact*. Employees play a *key role* in driving our sustainability *initiatives*, from reducing our *carbon footprint* to fostering *ethical* and sustainable business *practices* across *global operations*. All positions are required to adhere to our *Sustainability and Health Safety standards*, demonstrating a commitment to *environmental stewardship*, *workplace safety*, and *sustainable practices.*