AWS Data Engineer - New York, NY
- Location
- New York, New York, United States
- Salary
- Not specified
- Company
- Akash pawar
Job description
• Role & Company / Project Overview We are hiring an experienced AWS Data Engineer for a full-time W2 role. The position involves end-to-end pipeline ownership and key architecture decisions, focusing on actively building data pipelines rather than merely maintaining existing ones. • Key Responsibilities & Daily Duties - Build and architect robust, scalable end-to-end data pipelines. - Perform dimensional modeling, SCDs (Slowly Changing Dimensions), and fact/dimension schema design. - Implement data quality frameworks including validation rules, automated data reconciliation, and anomaly detection. - Perform deep PySpark and SQL performance tuning to optimize data processing workloads. - Take full ownership of pipeline architecture and operational excellence. • Required Qualifications, Skills & Experience - 5+ years of hands-on data engineering experience specifically focused on building pipelines. - Strong expertise across the AWS Stack: Amazon S3, AWS Glue (PySpark), Amazon Athena, and Apache Airflow / AWS Step Functions. - Proven expertise in data modeling (dimensional modeling, SCDs, fact and dimension design). - Demonstrated proficiency in data quality management (validation rules, reconciliation, anomaly detection). - High-level competency in PySpark and SQL performance tuning. - Eligible Visas: GC, USC, H4 EAD, L2 EAD only (No C2C). • Working Hours, Shifts & Location Details - Work Type: W2 Full Time. - Work Mode: Hybrid model requiring 2-3 days onsite per week in New York, New York. • Compensation & Benefits - Comprehensive Medical, Dental, and Health Benefits. - Paid Time Off: 15 PTO days + 5 Sick Leaves. • Application Instructions - Qualified candidates should submit their updated resume for consideration.