Azure Databricks Data Engineer
- Location
- Minnetonka Mills, Minnesota, United States
- Salary
- Not specified
- Company
- Akash pawar
Job description
• Role & Company / Project Overview Galaxy i Tech is hiring an experienced, full-time Azure Databricks Data Engineer with strong hands-on expertise in Azure Cloud, Databricks, PySpark, and Azure Data Factory to build modern cloud data platforms and AI-enabled data solutions. • Key Responsibilities & Daily Duties - Design, develop, and optimize scalable cloud-based data pipelines. - Build and maintain robust ETL/ELT workflows utilizing Azure Databricks, PySpark, Azure Data Factory (ADF), and Delta Lake. - Work with large-scale datasets and engineer efficient data models and transformations. - Implement cloud data solutions leveraging Azure Data Lake Storage (ADLS) Gen2 and Unity Catalog. - Conduct performance tuning and ensure reliable, production-grade data pipelines. - Develop and integrate REST and GraphQL APIs. - Support API deployments utilizing Kubernetes and Azure Kubernetes Service (AKS). - Implement API security standards, contract definitions, robust error handling, and performance best practices. - Uphold rigorous data governance, security protocols, GitHub version control, and CI/CD automation practices. - Collaborate actively with cross-functional teams and business stakeholders while taking end-to-end ownership of data solutions. • Required Qualifications, Skills & Experience - 4 to 6 years of relevant data engineering experience. - Strong expertise in Azure Databricks, PySpark, Azure Data Factory (ADF), and Azure Cloud. - Proficient in Delta Lake, ADLS Gen2, and Unity Catalog. - Hands-on proficiency in Python and SQL. - Proven background in ETL/ELT workflows, data modeling, GitHub, and CI/CD pipelines. - Experience with REST and GraphQL APIs, along with Kubernetes/AKS. - Working knowledge of enterprise data governance and security best practices. - Nice to have: Experience with AI/ML, LLMs, Agentic AI frameworks, Databricks AI/ML, AI tools (such as Codex, Claude, or similar), and Scala programming. • Working Hours, Shifts & Location Details - Employment Type: Full-Time. - Location: Minnetonka Mills, Minnesota. • Compensation & Benefits - Full-time employment with Galaxy i Tech (compensation details not specified). • Application Instructions - Interested candidates are invited to submit an updated resume or reach out directly for additional details.