Senior Kafka Engineer / Administrator - St. Louis, MO
- Location
- St. Louis, Missouri, United States
- Salary
- Not specified
- Company
- Akash pawar
Job description
• Role & Company / Project Overview Pathblend Solutions is hiring an experienced Senior Kafka Engineer / Administrator for a 12-month W-2 contract position based in St. Louis, MO. The role involves managing robust data streaming platforms with strong production experience in Apache Kafka, Cloudera, Confluent Platform, AWS MSK, Terraform, and CI/CD automation. • Key Responsibilities & Daily Duties - Manage and administer Apache Kafka, Confluent Platform, Cloudera, and AWS MSK clusters in enterprise production environments. - Execute Kafka cloud migration initiatives with minimal disruption to business operations. - Implement infrastructure automation using Terraform and GitLab CI/CD pipelines. - Configure and manage Datadog for monitoring, dashboards, performance metrics, and alerting. - Maintain deep operational focus on Kafka internals including Partitions, Replication, In-Sync Replicas (ISR), Offsets, Consumer Groups, and Delivery Semantics. - Collaborate across engineering teams to ensure high availability, resilience, and scalability of streaming infrastructure. • Required Qualifications, Skills & Experience - 5+ years of experience in Data / Platform / Infrastructure Engineering. - 4+ years of hands-on Apache Kafka production experience. - Hands-on administration experience with Cloudera & Confluent Platform. - Proven production experience with AWS MSK. - Demonstrated Kafka cloud migration experience with minimal disruption. - Strong proficiency in Terraform and GitLab CI/CD automation. - Hands-on expertise using Datadog for monitoring, dashboarding, and alerting. - Deep understanding of Kafka core mechanics: Partitions, Replication, ISR, Offsets, Consumer Groups, and Delivery Semantics. - Strong AWS fundamentals: VPC, Security Groups, IAM, KMS, CloudWatch, and PrivateLink. - Strong Linux administration, networking fundamentals, and scripting skills in Bash and Python. - Excellent communication and cross-team coordination abilities. - Key Technologies: Apache Kafka, Confluent, Cloudera, AWS MSK, AWS, Terraform, GitLab CI/CD, Datadog, Linux, Python, Bash. • Working Hours, Shifts & Location Details - Location: St. Louis, Missouri. - Duration: 12 Months Contract (W-2 positions only; note: no C2C resumes). • Compensation & Benefits - Contract W-2 engagement. • Application Instructions - Send updated resume or reach out via WhatsApp.