Senior Software Engineer- Data Engineer

Clarivate; United States; Remote; USD 100,000 - 150,000; Full time

Job summary

A leading company is seeking a Senior Software Engineer- Data Engineer to join their team. This role involves designing data solutions and leading cloud-based data pipelines, requiring strong experience in software development, proficiency in Python and AWS, and a commitment to technical best practices.

Qualifications

• At least 5+ years of experience in software development.
• Strong knowledge in RDBMS including Oracle, PostGreSQL.
• Experience designing cloud-based data pipelines & solutions.

Responsibilities

• Provide technical thought leadership and design data lake platforms.
• Enforce technical best practices for Big Data management.
• Lead technical investigations & set up new project infrastructure.

Skills

Python3

SQL

PL/SQL

XML

JSON

Agile/Scrum

Education

Bachelor's degree in engineering

Master's degree (BE, ME, B Tech, MTech, MCA, MS)

Tools

Apache Spark

AWS

Databricks

Cassandra

Hadoop

Oracle

PostGreSQL

Job description

We are looking for a Senior Software Engineer- Data Engineer to join our team in India. This is an amazing opportunity to work on different project with our Data engineering team having different competencies to compete and learn together. We have a great skill set in the team related to Pypark, AWS, Apahe, databrics.

About You – experience, education, skills, and accomplishments:

• Bachelor’s degree in engineering or master’s degree (BE, ME, B Tech, MTech, MCA, MS)
• At least 5+ years of experience in working in software development
• Strong technical knowledge in Relation Database Management System including Oracle, PostGres etc
• Proficient in Python3 and experience with Apache Spark and/or Databricks.
• Proficient in SQL, PL/SQL, XML, JSON
• Experience in designing cloud-based data pipelines & solutions
• Solid development experience in a commercial IT environment
• Passionate about code and software architecture
• Effective communicator at all levels, excellent interpersonal skills, strong business focus
• Highly self-motivated, confident to work on projects alone as well as in a team
• An enthusiastic approach to extending knowledge and learning new skills
• Strong commitment to quality of work and good attention to detail
• Experience with Agile\Scrum Software Development Methodologies

It would be great if you also had:

• Knowledge on any of these technologies\tools: Cassandra, Hadoop, Apache Hive, Snowflake, Jupiter notebook, databricks stack
• Continuous Integration and Deployment Concepts and tools
• AWS services, EC2, ECS, RDS, EMR, S3, AWS Glue
• Experience in: PL/SQL Packages, Oracle GoldenGate, Rundeck
• GIT

What will you be doing in this role?

• Provide technical thought leadership, compare different technologies to meet business requirements and cost control drivers.
• Work with Business and IT groups to design and deliver a data lake platform.
• Produce & maintain the overall solution design for the entire Data Lake Platform.
• Execution of data strategy, help in the design and architecture of solutions on the platform
• Enforce technical best practices for Big Data management and solutions, from software selection to technical architectures and implementation processes.
• Ensures all functional solutions and components of the Data Lake platform service are designed and implemented in a way to always meet SLAs.
• Contributes to the continuous improvement of the support & delivery functions by maintaining awareness of technology developments and making appropriate recommendations to enhance application services.

• Lead on technical investigations & proof of concepts, both individually and as part of a team, including being hands-on with code, to make technical recommendations
• Take a lead role in setting up new project infrastructure, in collaboration with team lead & DevOps team

About the Team

We are team located in India, US, and Europe.

Hours of Work

Regular working timing in India.

At Clarivate, we are committed to providing equal employment opportunities for all qualified persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.