Senior Data Engineer – Databricks
- Location
- Across United States
- Salary
- Not specified
- Company
- Akash pawar
Job description
• Role & Company / Project Overview: AcquityNode is hiring a Senior Data Engineer specializing in Databricks for a 100% remote opportunity in the USA. The position is open on a C2C / W2 contract basis and is restricted to Green Card (GC) holders and U.S. Citizens (USC) only. • Key Responsibilities & Daily Duties: - Design, develop, and maintain scalable, reliable data pipelines using Databricks, PySpark, and dbt. - Implement Medallion Architecture across Bronze, Silver, and Gold layers. - Build and optimize Lakehouse solutions utilizing Delta Lake. - Migrate legacy on-premises data pipelines to Databricks and cloud platforms. - Implement robust data governance and access control mechanisms using Unity Catalog. - Develop and support modern data workflows using Lakeflow. - Troubleshoot complex production issues, debug, and optimize pipeline performance. - Collaborate effectively with cross-functional data, analytics, and business teams. • Required Qualifications, Skills & Experience: - 9+ years of overall experience in Data Engineering with strong expertise in data pipelines and data processing. - 5+ years of hands-on experience with Databricks, including data pipeline development and Lakehouse solutions. - 3+ years of experience with PySpark, Python, and SQL for data engineering, data transformation, and pipeline development. - 2+ years of experience with Lakehouse Architecture and Delta Lake. - 2+ years of experience migrating on-premises data pipelines to Databricks/cloud platforms. - 2+ years of hands-on experience with dbt for data transformation and data modeling. - 1+ year of experience with Unity Catalog for data governance and access management. - 1+ year of experience with Databricks Genie Agents for data and analytics use cases. - Experience with Lakeflow and modern Databricks data pipeline development. - Proven expertise in designing, developing, optimizing, and supporting scalable data pipelines. - Excellent troubleshooting, debugging, and performance optimization skills. - Mandatory Skills: dbt, PySpark, Medallion Architecture (Bronze, Silver, Gold), and Databricks. - Work Authorization: Green Card (GC) or U.S. Citizen (USC) only. • Working Hours, Shifts & Location Details: - 100% Remote within the USA. - Employment Type: C2C / W2 contract. • Compensation & Benefits: - Not specified. • Application Instructions: Interested candidates should share their updated resume with the recruiting contact email.