Big Data Engineer - Washington, DC
- Location
- Washington, District of Columbia, United States
- Salary
- Not specified
- Company
- akash pawar
Job description
Role & Company / Project Overview: Adroit Innovative Solutions is hiring an experienced Big Data Engineer with strong hands-on expertise in building, optimizing, and supporting large-scale data processing platforms and data-intensive applications. The ideal profile is a hands-on engineer who has built large-scale data platforms and pipelines and understands how to create the data infrastructure required for analytics, data science, and machine learning. Key Responsibilities & Daily Duties: • Design and develop scalable data processing pipelines. • Build reliable ingestion, transformation, and storage solutions. • Optimize pipelines for performance, scalability, and reliability. • Develop datasets and features supporting analytics and machine learning. • Implement automated testing and data quality controls. • Troubleshoot production data pipelines. • Collaborate closely with Data Scientists, Analysts, and Engineering teams. • Evaluate emerging technologies and improve data engineering practices. Required Qualifications, Skills & Experience: • Strong Big Data Engineering experience. • Proficiency in Apache Spark & Hadoop. • Strong Python and/or Scala programming skills. • Hands-on experience with large-scale distributed data processing systems. • Expertise in data ingestion, transformation, storage & processing. • Experience creating scalable and high-performance data pipelines. • Practical knowledge of cloud-based data platforms and services. • Experience with data quality, automated testing & continuous testing. • Background in unit, integration, system & end-to-end testing. • Production monitoring, troubleshooting & optimization experience. • Experience supporting Data Science / ML workflows. • Strong problem-solving and debugging skills. • Graph data / graph technologies experience is a plus. Working Hours, Shifts & Location Details: • Location: Washington, DC. • Work Model: Hybrid (3 Days Onsite + 2 Days Remote). • Requirements: Only local candidates; in-person interview required. Application Instructions: Interested candidates should share an updated resume along with current location, contact number, work authorization, and availability through the designated contact channels.