Data Engineer - Kafka, Python and Hadoop
Square One Resources
Design and build Kafka-based streaming applications (Kafka Streams/ksqlDB) in Scala/Python for transformation, enrichment and routing. Implement end-to-end streaming pipelines with producers, stream processors and consumers, ensure data quality and DLQ patterns, model topics and schemas (Avro/Protobuf/JSON) and enable batch/stream interoperability with Spark Structured Streaming for storage in Parquet/ORC.