Principal Solutions Engineer

Jobright.ai; Kansas City (MO); On-site; USD 120,000 - 160,000; Full time

Job summary

Jobright.ai is seeking a Principal Solutions Engineer responsible for architecting cloud-based solutions on Microsoft Azure and Databricks. The ideal candidate will have strong expertise in big data tools like Apache Spark and Hadoop, alongside exceptional communication skills to collaborate with both technical and non-technical stakeholders. This role will focus on creating efficient data architectures, ensuring compliance with security standards, and driving data strategies within the organization.

Qualifications

• Strong experience with big data tools like Apache Spark, Hadoop, and Delta Lake.
• Excellent communication and interpersonal skills for engaging with technical and non-technical stakeholders.

Responsibilities

• Develop and maintain a scalable Azure/Databricks data architecture, ensuring it aligns with business strategy.
• Design and implement data integration solutions, including ETL processes to consolidate data from various sources.
• Collaborate with stakeholders to automate Azure deployments using PowerShell, Azure DevOps repositories, and pipelines.

Skills

Communication Skills

Interpersonal Skills

Tools

Apache Spark

Hadoop

Delta Lake

Job description

Join to apply for the Principal Solutions Engineer role at Jobright.ai

Job Summary:

Lockton is an insurance brokerage organization that offers services such as extensive assessment, research, and best-fit programs. The Principal Solutions Engineer is responsible for designing and implementing cloud-based solutions on the Microsoft Azure & Databricks platform, ensuring efficient data processing and integration while collaborating with various stakeholders to align with business goals.

Responsibilities:

1. Develop and maintain a scalable Azure/Databricks data architecture, ensuring it aligns with business strategy and industry best practices.
2. Design, build, and maintain scalable data pipelines and data streams.
3. Design and implement data integration solutions, including ETL processes, to consolidate data from various sources.
4. Develop and manage warehousing, data lakes, and other data storage solutions using Azure services.
5. Use data technologies like Azure Databricks, Azure Data Factory, and Azure AI tools to process and analyze large datasets.
6. Ensure data solutions comply with security and privacy regulations, implementing necessary measures to protect data.
7. Stay updated with the latest Azure technologies and industry trends to continuously improve data architecture.
8. Provide technical guidance, ensuring adherence to best practices and standards.
9. Work closely with business partners, analysts, and stakeholders to understand data needs and deliver effective solutions.
10. Collaborate with Lockton product leads to understand business goals and technical needs, ensuring optimal use of the Azure/Databricks platform.
11. Help optimize performance for large-scale data processing, streaming, and machine learning workflows on Databricks.
12. Guide stakeholders and teams on best practices in data engineering, machine learning, and AI using Azure/Databricks.
13. Identify business needs, define GTM Data strategy, and execute that strategy.
14. Work with stakeholders to automate Azure deployments using PowerShell, Azure DevOps repositories, and pipelines.
15. Gather and analyze proposed solutions in Azure Databricks.
16. Lead efforts in crafting innovative solutions following industry best practices.
17. Enhance and improve the performance of all applications implemented.
18. Promote best practices for Azure resource optimization aligned with organizational priorities.

Qualifications:

Required:

• Strong experience with big data tools like Apache Spark, Hadoop, and Delta Lake.
• Excellent communication and interpersonal skills for engaging with technical and non-technical stakeholders.

Preferred:

• Exposure to other cloud platforms.
• Experience with advanced analytics and AI tools.
• Knowledge of data governance and data quality best practices.
• Knowledge of DevOps practices and tools.
• Relevant Databricks or Azure Cloud certifications (e.g., Azure Data Engineer, Azure Solutions Engineer).
• Experience in the financial services or insurance industry.

Company:

Lockton is an insurance brokerage organization founded in 1966, headquartered in Kansas City, Missouri, with over 10,001 employees. The company offers extensive assessment, research, and best-fit programs and has a history of sponsoring H1B visas. The position is at the Director level, full-time, in the software development industry.