Job Description

Job Title: Site Reliability Engineer Databricks & Snowflake

Job Summary: We are looking for a skilled Site Reliability Engineer with expertise in optimizing Databricks jobs and Snowflake queries. As an SRE you will play a critical role in ensuring the performance reliability and scalability of our data processing systems. You should have a deep understanding of Databricks and Snowflake platforms with a focus on performance tuning and production support. This role requires a strong grasp of SQL experience in query optimization and the ability to conduct regression testing on ETL pipelines posttuning.

Key Responsibilities:

• Analyze Databricks jobs and Snowflake queries to identify performance bottlenecks and inefficiencies.
• Develop and implement strategies for optimizing query performance without compromising data integrity.
• Collaborate closely with data engineering teams to understand requirements and finetune complex SQL queries.
• Conduct regression testing on ETL pipelines after query optimizations to ensure consistency and reliability.
• Utilize your expertise in Spark to optimize Spark SQL queries running on the Databricks platform.
• Monitor system performance metrics and proactively address issues to maintain high availability and reliability.
• Document performance improvements best practices and guidelines for data processing workflows.
• Provide technical support to L2 teams and play a key role in resolving production issues related to performance.

Qualifications:

• Proven experience as a Site Reliability Engineer or similar role with a strong focus on Databricks and Snowflake.
• Indepth understanding of Databricks architecture Snowflake data warehousing and their respective query languages.
• Handson experience in optimizing SQL queries for performance in largescale data environments.
• Experience with regression testing methodologies for ETL pipelines and data workflows.
• Strong analytical and problemsolving skills with a keen attention to detail.
• Excellent communication skills and ability to collaborate effectively with crossfunctional teams.
• Bachelors degree in Computer Science Engineering or a related technical field.

Preferred Skills:

• Certification in Databricks or Snowflake platforms is a plus.
• Familiarity with cloud platforms such as AWS Azure or GCP.
• Knowledge of DevOps practices and experience with CI/CD pipelines.

This position offers an exciting opportunity for a proactive and technically proficient individual to contribute to the optimization and reliability of our data processing systems using cuttingedge technologies like Databricks and Snowflake.

Databricks architecture,Snowflake data warehousing

Job Tags

Similar Jobs