Big Data Engineer

Location

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia

Salary

Not specified

Company

Akash pawar

Job description

Role & Company / Project Overview: We are seeking an experienced Big Data Engineer to join our team in Kuala Lumpur, Malaysia. In this role, you will help build, maintain, and optimize large-scale, scalable data platforms and distributed systems to turn data into real impact. Key Responsibilities & Daily Duties: • Design and implement scalable big data architectures, including Lambda and Kappa architectures • Develop, maintain, and optimize large-scale data processing platforms • Optimize data processing performance and system stability • Conduct performance tuning for Spark, Flink, and other big data frameworks • Troubleshoot complex technical issues across data pipelines • Collaborate closely with data analysts, algorithm teams, and other engineering teams Required Qualifications, Skills & Experience: • 3+ years of experience in Big Data Development • Hands-on experience with Hadoop, Apache Spark, and Apache Flink • Proficiency with Kafka or Pulsar and streaming architecture • Strong SQL skills, along with Hive, Python, Java, or Scala • Experience with Doris / StarRocks and SQL performance tuning • Good to have: Experience with 50TB+ data platforms, real-time computing / real-time data processing • Good to have: Modern data lake technologies (Iceberg, Delta Lake, Paimon) • Good to have: Cloud-native big data platforms (EMR / CDH, Kubernetes) Working Hours, Shifts & Location Details: • Location: Q Central, Kuala Lumpur, Malaysia • Employment Type: Full-time • Work Setup: Onsite Compensation & Benefits: • Not specified Application Instructions: • Send your updated CV via LinkedIn DM or contact via WhatsApp to explore this opportunity.