Big Data PySpark Developer
- Location
- Irving, Texas, United States
- Salary
- Not specified
- Company
- akash pawar
Job description
• Role & Company / Project Overview We are looking for an experienced Big Data PySpark Developer to join our team in Irving, TX. • Key Responsibilities & Daily Duties - Design scalable Spark-based ETL data pipelines. - Handle complex data workflows using Apache Airflow. - Perform data analysis, database testing, and data quality validation. - Develop automation frameworks for ETL and API testing. - Work with CI/CD, source control, code reviews, and build processes. • Required Qualifications, Skills & Experience - 7+ years of experience (6+ to 7+ years minimum). - Mandatory Skills: Apache Spark, PySpark / Python, Big Data / Hadoop Ecosystem, SparkSQL, Unix/Linux & Shell Scripting, SQL & Complex Joins, Apache Airflow, ETL & Data Validation, Data Quality & Automation Frameworks. - Strong analytical and problem-solving skills. • Working Hours, Shifts & Location Details - Full-Time position. - Location: Irving, Texas (Hybrid: 3 Days Onsite). • Application Instructions Interested candidates can share their updated resume with the hiring team.