Data Engineering- SSEII

First American (India); Bengaluru; On-site; INR 2,400,000 - 4,000,000; Full time

Job summary

First American (India) invites a seasoned Data Platform Engineer to join its GCC. You will operationalize a unified Databricks Lakehouse on Azure, build scalable data pipelines, and integrate APIs for reliable data transfer.

You will deploy technologies like Spark, Kafka and Airflow, ensure data quality, and collaborate with engineers, analysts and scientists to optimize workflows. The role demands 5+ years of development and strong knowledge of Python/Scala/Java/C#, with extensive experience in

Qualifications

• 5+ years of development experience in Python, Scala, Java, or C# with Python preferred.
• 5+ years with data engineering tools including Databricks, Snowflake, BigQuery, Spark, Hive, Hadoop, Cloudera, or Redshift.
• Strong data architecture and high-performance pipeline design with guarantees and observability.
• Experience with containerized environments such as Docker, Rancher, or Kubernetes.
• Experience with Apache Airflow or similar for data orchestration.
• Bachelor's degree in CS or related field, or equivalent experience.

Responsibilities

• Operationalize our Databricks Lakehouse: develop and maintain a unified data platform using Azure Databricks.
• Build data pipelines, API integrations, ETL processes, and ensure data quality and integrity.
• Deploy data tech using Spark, Kafka, and Airflow; test, monitor, and troubleshoot for reliability.
• Collaborate with data engineers, analysts and scientists to optimize data workflows.

Skills

Python

Scala

Java

C#

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Snowflake

BigQuery

Apache Spark

Hive

Hadoop

Cloudera

Redshift

PySpark on Databricks

Job description

Company Summary

First American (India) is a GCC (Global Capability Center) of the First American Financial Corporation (NYSE: FAF) family of companies. FAI is a proud member of the FORTUNE 500 companies and has been amongst the Fortune 100 Best Companies to Work For list for eight consecutive years. First American Financial Corporation provides comprehensive title insurance, closing/settlement, property data and technology solutions. First American (India) creates quality solutions for its customers by combining software, back office, and knowledge processing operations to fulfill First American's business requirements. Our priorities are our employees, customers, and shareholders - in that order. First American (India) has been ranked amongst India's Best Companies To Work For 2023: Listed amongst the Top 100 by Great Place To Work India, FAI is also certified Best Workplaces for Women and Workplace with Inclusive Practices. Software Services helps build First American's product suite that encompasses the best in class Title Insurance, Settlement and Mortgage solutions platforms. Leverages technology product stack across Microsoft platform predominantly to develop, enhance and maintain the best in class applications. The R & D division delivers solutions for the title insurance industry leveraging the best of NLP, AI and ML.

Job Summary

What You'll Do:

• Operationalizeour Databricks Lakehouse: Develop and maintain a unified data platform using Azure Databricks, enabling efficient data storage, processing, and analysis across the organization.
  • Build Data Pipelines: Design, develop, and maintain scalable data pipelines; establish API integrations for efficient data transfer. Implement ETL processes and ensure data integrity and quality.
• Deploy Data Technology: Utilize technologies such as Spark, Kafka, and Airflow to manage large-scale data processing. Test, monitor and troubleshoot systems to ensure smooth operation.
• Collaborate: Work closely with data engineers, analysts, and scientists to understand their needs and optimize the performance of data workflows
  

What You'll Bring:

• Development Experience: 5+ years with Python, Scala, Java, or C#. Experience with Python is preferred.
• Data Engineering Tools: 5+ years with Databricks, Snowflake, BigQuery, Apache Spark, HIVE, Hadoop, Cloudera, or RedShift. Experience with PySpark on Databricks is preferred.[TN1]
• Data Architecture: Proficiency in high-performance data pipeline design and mastery of pipeline guarantees, such as Idempotency, At-Least-Once Processing, Exact-Once Processing, Fault Tolerance, Eventual Consistency, Streaming Consistency, Transactional Consistency, and Observability.
• Containerization: Experience developing in a containerized environment like Docker, Rancher, or Kubernetes.
• Data Orchestration: Experience with Apache Airflow (or similar tool) for orchestrating data processing jobs.
• Education: Bachelor's degree in Computer Science (or related field) or equivalent combination of education and experience.

Educational Qualification and Experience:

Minimum of 15 years of formal education - Graduate / Post Graduate in Computer Science / Information Technology

FAI is committed to create an environment that respects, supports and inspires all individuals. We do not discriminate on the basis of color, religion, sex, gender identity, sexual orientation and age. At FAI, we celebrate diversity and believe that an inclusive workforce benefits employees, the organization and our community. We are an Equal Opportunity Employer. For more information about our company and dedication to putting People First, check out https://firstam.wd1.myworkdayjobs.com/faicareers