Databricks Developer - Sydney

Location

Sydney, New South Wales, Australia

Salary

Not specified

Company

akash pawar

Job description

Role & Company / Project Overview: Greetings from Resource Corner. We are looking for an experienced Databricks Developer with strong expertise in data engineering, PySpark, Delta Lake and SQL to design, develop and maintain scalable data pipelines and enterprise data solutions. Employment Type: Permanent. Key Responsibilities & Daily Duties: • Design, develop and maintain scalable data pipelines using Databricks, Delta Lake and PySpark. • Build and optimise data transformation processes using SQL and Spark SQL. • Develop batch and operational data processing solutions. • Implement unit testing, integration testing and data quality practices. • Manage source code, branching and deployments using Git and CI/CD. • Work with Databricks Workflows, Jobs and Unity Catalog. • Monitor platform performance and troubleshoot production issues. • Collaborate with technical teams, product owners and business stakeholders. • Participate in Agile ceremonies, code reviews and continuous improvement initiatives. Required Qualifications, Skills & Experience: • Strong hands-on experience with Databricks. • Expertise in PySpark, Apache Spark and Spark SQL. • Strong knowledge of Delta Lake. • Experience developing and optimising data pipelines. • Knowledge of Databricks Workflows, Jobs and Unity Catalog. • Experience with Git, CI/CD and automated testing. • Good understanding of data governance and data quality. • Strong communication and stakeholder management skills. Working Hours, Shifts & Location Details: • Permanent employment located in Sydney, Australia. Application Instructions: • Interested candidates can share their updated resumes via email or reach out by phone.