Data Engineer
- Location
- Charlotte, North Carolina, United States
- Salary
- Not specified
- Company
- Akash pawar
Job description
Role & Company / Project Overview: We are seeking an experienced Data Engineer with 10+ years of professional experience and deep expertise in Python/Java, real-time data streaming, and distributed data architectures to join our technical team in Charlotte, NC. Key Responsibilities & Daily Duties: • Optimize data pipelines utilizing Amazon Kinesis and Oracle databases. • Develop resilient services for NetApp Object Store utilizing Amazon S3 APIs. • Architect, construct, and deploy scalable pipelines using Apache Spark and Apache Flink. • Generate and maintain analytical datasets formatted in Parquet and Apache Iceberg. • Implement comprehensive exception handling mechanisms and robust data quality monitoring frameworks. • Develop automation scripts for data cleanup, archiving, and log compression. Required Qualifications, Skills & Experience: • Minimum of 10+ years of proven data engineering experience. • Strong programming proficiency in Python and/or Java. • Demonstrated hands-on experience with real-time streaming architectures and distributed computing systems. • Solid working knowledge of Oracle databases, REST APIs, and database connectivity. • Hands-on development experience utilizing Amazon S3 APIs. • Practical experience with Apache Iceberg is considered a strong plus. Working Hours, Shifts & Location Details: • Location: Charlotte, North Carolina (NC), United States. • Work arrangement: Onsite / Location-based. Application Instructions: • Qualified and interested candidates should submit an updated resume directly to the designated recruiter email address.