Site Reliability Engineer - Databricks Snowflake Job at dhanutek, Dallas, TX

bW9ab2dWUER0eDlWT213cVZVYUxXNUs0OFE9PQ==
  • dhanutek
  • Dallas, TX

Job Description

Job Title: Site Reliability Engineer Databricks & Snowflake

Job Summary: We are looking for a skilled Site Reliability Engineer with expertise in optimizing Databricks jobs and Snowflake queries. As an SRE you will play a critical role in ensuring the performance reliability and scalability of our data processing systems. You should have a deep understanding of Databricks and Snowflake platforms with a focus on performance tuning and production support. This role requires a strong grasp of SQL experience in query optimization and the ability to conduct regression testing on ETL pipelines posttuning.

Key Responsibilities:

  • Analyze Databricks jobs and Snowflake queries to identify performance bottlenecks and inefficiencies.
  • Develop and implement strategies for optimizing query performance without compromising data integrity.
  • Collaborate closely with data engineering teams to understand requirements and finetune complex SQL queries.
  • Conduct regression testing on ETL pipelines after query optimizations to ensure consistency and reliability.
  • Utilize your expertise in Spark to optimize Spark SQL queries running on the Databricks platform.
  • Monitor system performance metrics and proactively address issues to maintain high availability and reliability.
  • Document performance improvements best practices and guidelines for data processing workflows.
  • Provide technical support to L2 teams and play a key role in resolving production issues related to performance.

Qualifications:

  • Proven experience as a Site Reliability Engineer or similar role with a strong focus on Databricks and Snowflake.
  • Indepth understanding of Databricks architecture Snowflake data warehousing and their respective query languages.
  • Handson experience in optimizing SQL queries for performance in largescale data environments.
  • Experience with regression testing methodologies for ETL pipelines and data workflows.
  • Strong analytical and problemsolving skills with a keen attention to detail.
  • Excellent communication skills and ability to collaborate effectively with crossfunctional teams.
  • Bachelors degree in Computer Science Engineering or a related technical field.

Preferred Skills:

  • Certification in Databricks or Snowflake platforms is a plus.
  • Familiarity with cloud platforms such as AWS Azure or GCP.
  • Knowledge of DevOps practices and experience with CI/CD pipelines.

This position offers an exciting opportunity for a proactive and technically proficient individual to contribute to the optimization and reliability of our data processing systems using cuttingedge technologies like Databricks and Snowflake.

Databricks architecture,Snowflake data warehousing

Job Tags

Full time,

Similar Jobs

Solomon Page

Freelance Print Designer Home Goods Job at Solomon Page

 ...We are working on a full time freelance assignment for a designer in the home/bedding space. Will be working on print/patterns/textiles for a variety of categories.Responsibilities:~Collaborate and assist Senior Design Director on creating original and saleable designs... 

Sapsol Technologies Inc

Entry level SAP Consultant Needed for Project Implementation- Remote Job at Sapsol Technologies Inc

 ...Configuration and integration of respective modules as per blueprint. Develop test strategy and document test results. Troubleshoot and...  ...No need to add a link to apply (one is added automatically) Remote Workers Include the tools that people need for remote work,... 

Dell Careers

Senior Principal Thermal Mechanical Engineer Job at Dell Careers

 ...Senior Principal Thermal Mechanical Engineer Our Network HW engineering team provides definition, design, analysis, prototype, sourcing & the debugging and validation of layouts or routes to deliver state-of-the-art products for a changing world. The Thermal Mechanical... 

Sysco Hawaii

Local Delivery Driver Job at Sysco Hawaii

 ...Sysco has immediate job openings for dependable local CDL A Delivery Truck Drivers to safely and efficiently operate a tractor-trailer...  .../deliver various products (meats, produce, frozen foods, groceries, dry goods, supplies, etc.) to customer locations on an assigned... 

Enterprise Medical Recruiting

Physician / Pain Management / Indiana / Permanent / Fort Wayne, IN Outpatient Interventional Pain Management - W2 or 1099 Options Job Job at Enterprise Medical Recruiting

Enterprise Medical Recruiting is assisting a large Pain Management group in recruiting a new interventional pain management provider in Fort Wayne/Logansport, Indiana. This is a full-time position in a hospital-based