Data Engineer - Druid, Kafka, and Hbase
Rate:DOE
Location: Remote
Client: Telecommunication
cloudingest is seeking a highly motivated and experienced Data Engineer with expertise in Druid, Kafka, and HBase to join our dynamic data engineering team. As a key member of our team, you will play a pivotal role in architecting, developing, and maintaining our real-time data processing and analytics solutions.
Collaborate with cross-functional teams to design scalable and efficient data architectures that leverage Druid, Kafka, and HBase for real-time data processing, streaming, and storage.
•Lead the implementation and management of Druid clusters for high-performance, real-time analytics.
•Design and optimize Druid data schemas to support complex querying and aggregation requirements
•Develop and manage Kafka topics and brokers.
•Ensure data ingestion, streaming, and processing pipelines are reliable and scalable
•Build real-time data processing applications using Kafka Streams, Spark Streaming, or other relevant technologies. Qualifications:
•Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
•Proven experience as a data engineer, data architect, or similar role with a focus on Druid, Kafka, and HBase.
•In-depth knowledge of Druid, Kafka, and HBase architecture, configuration, and optimization.
•Proficiency in programming languages like Java, Scala, or Python.
•Experience with real-time data processing frameworks and tools.
•Strong analytical and problem-solving skills with attention to detail.
•Excellent communication and teamwork abilities.
•Familiarity with data security, compliance, and governance practices.
