Job Details
Location: Across United States
Salary: Not specified
Company: ApnaWorker
We are seeking a Senior Data Engineer with 6+ years of experience in data engineering. Core expertise includes building scalable batch and real-time data pipelines, lakehouse architecture with Delta Lake and Unity Catalog, collaboration with ML/AI teams for operational analytics and digital twin platforms, strong hands-on with Databricks, PySpark, Databricks SQL, Delta Live Tables, Python, SQL, Apache Kafka, and data pipeline development with data quality and governance. Additional skills include Unity Catalog for lineage, metadata management and access control, Teradata for data warehousing and BI, real-time event processing and time-series data modeling, digital twin and simulation platforms, operational analytics, data profiling and anomaly detection. Role expectations include designing and implementing robust pipelines for real-time and batch workloads, ensuring data quality, governance, and lineage across enterprise systems, partnering with ML/AI teams to enable advanced analytics and simulations, and driving data reliability, scalability, and performance optimization.