Azure Databricks Lead - Washington, DC
- Location
- Washington, District of Columbia, United States
- Salary
- Not specified
- Company
- Akash pawar
Job description
• Role & Company / Project Overview Hiring experienced, genuine local candidates for an onsite C2C opportunity as an Azure Databricks Lead based in Washington, DC. • Key Responsibilities & Daily Duties - Lead data engineering initiatives, architecture, and mentoring technical teams. - Architect, build, and optimize scalable data pipelines using Azure Databricks, Delta Lake, and Medallion Architecture. - Design and implement Databricks Workflows and Airflow pipelines for complex data orchestration. - Implement data governance and security frameworks using Unity Catalog and Databricks SQL. - Perform enterprise-level performance tuning on large-scale Apache Spark / PySpark / Scala workloads. - Maintain code repositories, CI/CD pipelines, and data modeling best practices. • Required Qualifications, Skills & Experience - 15+ years of relevant experience. - Mandatory Skills: Databricks, Delta Lake, Apache Spark / PySpark, Python, SQL, ADK, Azure / Cloud, Unity Catalog, Delta Live Tables, Databricks SQL, Airflow / Databricks Workflows, Data Modelling / Medallion Architecture, Git & CI/CD. - Active Databricks Certification is mandatory. - Strong Apache Spark / PySpark / Scala experience. - Strong hands-on Databricks experience and advanced Python & SQL skills. - Enterprise-level performance tuning capability. - Experience leading data engineering initiatives and mentoring teams. • Strict Submission Guidelines - Local profiles only: Candidate must currently be local to Washington, DC. - DO NOT submit candidates from Osmania University. - LinkedIn profile must have been created before 2018. - No fabricated or misrepresented visa/work authorization. - No fake or misleading profiles. - PP (Passport) is required for submission. • Working Hours, Shifts & Location Details - Work Model: Onsite in Washington, DC. - Employment Type: Contract (C2C). • Compensation & Benefits - Competitive C2C hourly/contract rate. • Application Instructions - Send the following details for submission: Updated Resume, Current Location, Work Authorization, LinkedIn ID, Passport (PP), Databricks Certification, Overall Experience, and Alternate Email Address to the designated email contact.