Lead Data Engineer Job at Snowrelic Inc, Charlotte, NC

Rmd3N09mdUI5ZE5PM1ozb25nQlc1M0EyL3c9PQ==
  • Snowrelic Inc
  • Charlotte, NC

Job Description

Position: Lead Data Engineer

Location: Cincinnati ,OH / Charlotte ,NC

  • Design and implement scalable data pipelines and architectures on Azure Databricks.

  • Optimize ETL/ELT workflows, ensuring efficiency in data processing, storage, and retrieval.

  • Leverage Apache Spark, Delta Lake, and Azure-native services to build high-performance data solutions.

  • Ensure best practices in data governance, security, and compliance within Azure environments.

  • Troubleshoot and fine-tune Spark jobs for optimal performance and cost efficiency.

  • Lead the migration of Azure SQL to Azure Databricks, ensuring a seamless transition of data workloads.

  • Design and implement scalable data pipelines to extract, transform, and load (ETL/ELT) data from Azure SQL into Databricks Delta Lake.

  • Optimize Azure SQL queries and indexing strategies before migration to enhance performance in Databricks.

Job Tags

Full time, Part time, Internship, Seasonal work,

Similar Jobs

Bilfinger

Metal Man/ Insulator Job at Bilfinger

 ...Metal Man/ Insulator Location: Lafayette , Indiana Bilfinger is a leading international industrial services provider, active primarily in Continental Europe, Northwest Europe, North America, and the Middle East. With over 4,500 skilled employees in North America... 

Google

Industrial Designer, Devices and Services Job at Google

Minimum qualifications:+ Bachelor's in Industrial Design or equivalent practical experience.+ 6 years of visual design experience in product design or UX/UI design.+ Experience in design (e.g., proportions, color form, typography presentation).+ Include a portfolio,... 

Ipsun Solar

Solar O&M Technician Job at Ipsun Solar

 ...Solar O&M Technician If youre looking to join a nationwide and fast-growing industry, join the team thats striving every day to...  ...private equity-backed provider. We have a dedicated team of clean energy professionals who wake up every day ready to replace dirty energy... 

ManpowerGroup

WorkDay Analyst - AZ Job at ManpowerGroup

Our client, a leader in HR Technology, is seeking a WorkDay Analyst to join their team. As a WorkDay Analyst, you will be part of the HR Technology department supporting various teams. The ideal candidate will have strong analytical skills, excellent communication abilities... 

Greenbrook Manor Care and Rehabilitation LLC

Licensed Nursing Home Administrator Job at Greenbrook Manor Care and Rehabilitation LLC

 ...Licensed Nursing Home Administrator Main responsibility of directing the day-to-day functions of the facility in accordance with current federal, state, and local standards, guidelines, and regulations that govern long-term care facilities to assure that the highest...