Data Engineering / Databricks Professional

Location

Bhilai, Chhattisgarh, India

Salary

Not specified

Company

Akash pawar

Job description

• Role & Company / Project Overview: HireEase is hiring experienced Data Engineering / Databricks Professionals with strong hands-on expertise in Databricks, Apache Spark, and AWS for an on-site position in Bhilai. • Key Responsibilities & Daily Duties: - Design, build, and optimize data engineering pipelines using Databricks and Apache Spark. - Implement cluster sizing and performance tuning. - Manage Delta Lake storage optimization (Partitioning vs. Clustering vs. Liquid Clustering). - Develop workflows and data processing pipelines utilizing Lakeflow (SDP) and PySpark. - Design and execute Medallion Architecture across data pipelines. - Support and execute AWS to Databricks migrations. - Implement and administer Unity Catalog & data governance. - Manage Databricks Workflows, job orchestration, monitoring, and debugging. • Required Qualifications, Skills & Experience: - Strong practical and hands-on experience in Data Engineering. - Solid understanding of Apache Spark fundamentals and Databricks platform basics. - Expertise in PySpark hands-on programming. - Deep knowledge of Delta Lake, storage optimization techniques, and Medallion Architecture. - Experience in AWS to Databricks migration projects. - Hands-on expertise with Unity Catalog & Governance, Databricks Workflows, and pipeline monitoring/debugging. - Candidate must be willing to shift/relocate to Bhilai. • Working Hours, Shifts & Location Details: - Location: Bhilai, Chhattisgarh, India. - Work Mode: Work From Office (Onsite only; relocation required if not currently in Bhilai). • Application Instructions: - Serious candidates with relevant hands-on experience should submit their CV via email.