Software Engineer- Data Engineer

Clarivate; United States; Remote; USD 80,000 - 120,000; Full time

Job summary

A leading company is seeking a Software Engineer - Data Engineer to join their team in the US. This role involves developing scalable data processing solutions and collaborating with engineers to implement best practices in software development. Candidates should possess strong skills in Python, SQL, and AWS services, with a commitment to quality and efficiency in coding. This position offers an exciting opportunity to work on diverse projects and grow within a dynamic team.

Qualifications

• Minimum 2 years of experience in software development.
• Experience in building scalable distributed data processing solutions.
• Strong knowledge of Relational Database Management Systems.

Responsibilities

• Write clean, efficient, and maintainable code following coding standards.
• Collaborate with senior engineers to enhance technical knowledge.
• Conduct manual and unit testing of applications.

Skills

Python 3

Apache Spark

Databricks

SQL

PL/SQL

XML

JSON

Continuous Integration

Education

Bachelor’s or Master’s degree in engineering or related fields

Tools

AWS

Git

GitHub

Cassandra

Hadoop

Apache Hive

Snowflake

Jupyter Notebook

Job description

We are looking for a Software Engineer - Data Engineer to join our team in India. This is an exciting opportunity to work on various projects with our Data Engineering team, which possesses diverse competencies to foster learning and growth. Our team has strong expertise in PySpark, AWS, Apache, and Databricks. We are eager to connect with candidates skilled in testing applications developed with the latest tools and technologies.

About You – Experience, Education, Skills, and Accomplishments:

1. Bachelor’s or Master’s degree in engineering or related fields (BE, ME, BTech, MTech, MCA, MS)
2. Minimum 2 years of experience in software development
3. At least 2 years’ experience in building scalable distributed data processing solutions
4. At least 2 years’ experience in database design and development
5. Solid experience in a commercial IT environment
6. Strong knowledge of Relational Database Management Systems including Oracle, PostgreSQL, etc.
7. Proficient in Python 3, with experience in Apache Spark, Databricks, and Airflow
8. Proficient in writing complex SQL queries and PL/SQL procedures
9. Good understanding of XML and JSON formats
10. Knowledge of Continuous Integration and Deployment tools and concepts

Preferred Skills:

1. Knowledge of technologies/tools like Cassandra, Hadoop, Apache Hive, Snowflake, Jupyter Notebook, Databricks stack
2. Experience with AWS services such as EC2, ECS, RDS, EMR, S3, AWS Glue
3. Experience with version control software like Git and GitHub

Key Responsibilities:

1. Write clean, efficient, and maintainable code following coding standards
2. Collaborate with senior engineers to enhance technical knowledge
3. Apply best practices in software development
4. Understand and implement software development lifecycle and delivery methodologies
5. Suggest alternative methods or techniques to achieve desired outcomes
6. Stay updated with technological advances
7. Conduct manual and unit testing of applications
8. Participate in engineering projects as a team member
9. Document application technical details
10. Adhere to team policies, procedures, and work instructions

About the Team

Our team is distributed across India, the US, and Europe.

Hours of Work

Standard working hours in India.

At Clarivate, we are dedicated to providing equal employment opportunities to all qualified individuals, respecting all applicable laws and regulations regarding non-discrimination in hiring, compensation, promotion, training, and other employment terms.