Stream Process - watermark
Apache Beam with Spark streaming runner on Youtube
Blog Posts
Recent posts
Spark Structured Stream Process - Watermark
Spark Structured Streaming Watermark Concept.
Kafka - GenericRecord vs SpecificRecord
Kafka has two types of record on producing and consuming Kafka messages which are called GenericRecord and SpecificRecord. Main difference between GenericRec...
Gradle - java-library plugin from 7.x version
Gradle 7+ removed compile configuration so all existing gradle projects using compile configuration should be migrated. Instead java-library plugin was intro...
Apache Beam Key Concepts
Apache Beam has the following key concepts.