Senior Data Engineer

Inizio Partners Corp; Foster City (CA); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading technology firm in California is seeking a software developer with over 10 years of hands-on experience. The ideal candidate will have strong skills in SQL and Spark, along with a Bachelor's degree in computer science or a related field. Responsibilities include designing and implementing software applications, ensuring high-quality code delivery, and working collaboratively within a team.

Qualifications

• 10+ years hands-on experience in software development.
• Strong in algorithms and data structures, knowledge of Object-oriented design.
• Good architecture skills to understand end-to-end flows/data pipelines.

Responsibilities

• Design, implement, and support multi-tier software applications.
• Create solutions that meet business requirements.
• Deliver very high-quality code that is thoroughly tested.

Skills

Software development

Algorithms and data structures

Troubleshooting and debugging

SQL skills

Spark debugging and tuning

Python

Big data architecture

Knowledge of Unix

Education

Bachelor's degree in computer science

Tools

Hadoop

Hive

Airflow

GitHub

Job description

• 10+ years hands on experience in software development.
• Strong in algorithms and data structures, knowledge of Object-oriented design, Design Patterns
• Multi-threaded programming
• Strong troubleshooting, debugging, and analytical skills.

Mandatory Skills

• SQL skills (BQ, Hive and Spark)
• Spark jobs debugging and tuning
• Python, PySpark
• Good architecture skills to understand end to end flows/data pipelines
• -big data architecture, hadoop, hive, Sql, and airflow
• Knowledge of Unix, Github

Secondary skills

• Offshore team and delivery management
• Certification in relevant skills

Responsibilities

• The candidate must have complete understanding with hands-on experience in design, coding, and testing aspects
• Design, implement, and support multi-tier software applications, document and test systems, modify as necessary
• Work independently and with other engineers, and Ops teams, design and develop strategic and tactical processes, and create solutions that meet business requirements.
• Demonstrate thought processes in solving business and technical problems. Design and code should be easy to maintain, available, performing well, and can be reused across a sub-system or feature. Code may persist for the lifetime of a software version.
• Own to deliver very high-quality code that is thoroughly tested and is supported by unit tests for a flawless execution
• Can be relied on to deliver features and sub-systems on time and to requirements
• Works well within a team and contributes effectively to the success of those they interact with regularly.

Education:

Bachelors degree in computer science, Software Engineering, MIS or equivalent combination of education and experience