migrated to latest shodowJar plugin, gradle warnings

gAmUssA · gAmUssA · commit 1eb7b2d7c950 · 2025-02-27T00:34:53.000-05:00
diff --git a/README.adoc b/README.adoc
@@ -1,5 +1,5 @@
 = Apache Flink for Java Developers Workshop
-Viktor Gamov <viktor@confluent.io>
+Viktor Gamov <viktor@confluent.io>, Sandon Jackobs <sjacobs@confluent.io>
 v1.0, 2025-02-17
 :toc:
 
@@ -13,87 +13,100 @@ Deadlines were looming, and the team needed a breakthrough.
 
 And when you learned about Apache Flink.
 
-We’ll explore how the DataStream API allowed efficient real-time data processing and how the Table API and SQL features simplified complex queries with familiar syntax. 
+We will explore how the *DataStream API* allowed efficient real-time data processing and how the *Table API* and *SQL* features simplified complex queries with familiar syntax. 
 Testing became more straightforward, and managing the application state was no longer a headache.
 
 You’ll learn:
 
-• Harnessing the DataStream API: Process unbounded data streams efficiently to make your applications more responsive.
-• Unlocking Table API and SQL: Use SQL queries within Flink to simplify data processing tasks without learning new languages.
-• Effective Testing Strategies: Implement best practices for testing Flink applications to ensure your code is robust and reliable.
-• Stateful Stream Processing: Manage application state effectively for complex event processing and real-time analytics.
+- Harnessing the DataStream API: Process unbounded data streams efficiently to make your applications more responsive.
+- Unlocking Table API and SQL: Use SQL queries within Flink to simplify data processing tasks without learning new languages.
+- Effective Testing Strategies: Implement best practices for testing Flink applications to ensure your code is robust and reliable.
+- Stateful Stream Processing: Manage application state effectively for complex event processing and real-time analytics.
 
-By the end of this talk, you’ll be equipped to tackle real-time data challenges. 
-Whether you are building analytics dashboards, event-driven systems, or handling data streams, Apache Flink can be the game-changer you’ve been searching for.
+By the end of this talk, you will be equipped to tackle real-time data challenges. 
+Whether you're building analytics dashboards, event-driven systems, or handling data streams, Apache Flink can be the game-changer you’ve been searching for.
 
 == 💻 Technical Prerequisites
-1. *Basic Programming Knowledge* – Familiarity with **Java** or **Scala** (ugh) (Flink supports both but not for long).
-2. *Understanding of Stream Processing Concepts* – Awareness of real-time data pipelines, event-driven architectures, and streaming frameworks.
-3. *SQL Proficiency* – Basic understanding of SQL for working with Flink’s **Table API**.
-4. *Linux/macOS Command Line Experience* – Ability to execute terminal commands and navigate a Unix-like environment.
+
+. *Basic Programming Knowledge* – Familiarity with **Java** or **Scala** (ugh) (Flink supports both but not for long).
+. *Understanding of Stream Processing Concepts* – Awareness of real-time data pipelines, event-driven architectures, and streaming frameworks.
+. *SQL Proficiency* – Basic understanding of SQL for working with Flink’s **Table API**.
+. *Linux/macOS Command Line Experience* – Ability to execute terminal commands and navigate a Unix-like environment.
 
 == 🔧 Required Software and Setup
 
 === 1️⃣ Docker & Docker Compose (Mandatory)
-*Why?* Flink and Kafka components will be containerized.
-*Download & Install:* https://www.docker.com/get-started[Docker Website]
-*macOS Alternative:* https://orbstack.dev/[OrbStack] (recommended for better performance)
+
+- *Why?* Flink and Kafka components will be containerized.
+- *Download & Install:* https://www.docker.com/get-started[Docker Website]
+- *macOS Alternative:* https://orbstack.dev/[OrbStack] (recommended for better performance)
 
 === 2️⃣ Confluent Cloud Account (Mandatory)
-*Why?* Required for Kafka-based streaming exercises.
-*Sign Up & Get API Keys:* https://www.confluent.io/confluent-cloud/[Confluent Cloud]
+
+- *Why?* Required for Kafka-based streaming exercises.
+- *Sign Up & Get API Keys:* https://www.confluent.io/confluent-cloud/[Confluent Cloud]
 
 === 3️⃣ Java 21 Installed
-*Why?* Apache Flink will run on Java 21.
-*Download Java 21 (Adoptium Temurin):* https://adoptium.net/[Adoptium Temurin]
-*Verify Installation:* Run `java -version` in the terminal.
+
+- *Why?* Apache Flink will run on Java 21.
+- *Download Java 21 via SDKMAN:* https://sdkman.io[SDKMAN]
+- *Verify Installation:* Run `java -version` in the terminal.
 
 === 4️⃣ Git Installed
-*Why?* For cloning repositories and working with project files.
-*Download Git:* https://git-scm.com/downloads[Git Website]
 
-=== 5️⃣ IDE with Flink Support
-*Why?* Recommended for Flink development.
-*Download IntelliJ IDEA (Recommended):* https://www.jetbrains.com/idea/download/[IntelliJ IDEA]
-*Download VS Code (Alternative):* https://code.visualstudio.com/download[VS Code]
+- *Why?* For cloning repositories and working with project files.
+- *Download Git:* https://git-scm.com/downloads[Git Website]
+
+=== 5️⃣ IDE with Gradle Support
+
+- *Why?* Recommended for Flink development.
+- *Download IntelliJ IDEA (Recommended):* https://www.jetbrains.com/idea/download/[IntelliJ IDEA]
+- *Download VS Code (Alternative):* https://code.visualstudio.com/download[VS Code]
+    - *Confluent Extension for VSCode:* https://marketplace.visualstudio.com/items?itemName=confluentinc.confluent-vscode[link] 
 
 === 6️⃣ Gradle Installed via Wrapper (No Need for Local Installation)
-*Why?* The workshop will use the **Gradle Wrapper**, eliminating the need for manual installation.
-*Gradle Docs:* https://docs.gradle.org/current/userguide/gradle_wrapper.html[Gradle Wrapper Documentation]
+
+- *Why?* The workshop will use the **Gradle Wrapper**, eliminating the need for manual installation.
+- *Gradle Docs:* https://docs.gradle.org/current/userguide/gradle_wrapper.html[Gradle Wrapper Documentation]
 
 === 7️⃣ Quick Setup for macOS Users with Homebrew
-*Why?* Simplifies installation of all required dependencies.
-*How?* This project includes a `Brewfile` for managing dependencies.
-*Setup:* Run `make setup-mac` to install all required dependencies using Homebrew.
-*Update:* Run `make update-brew-deps` to update dependencies.
+
+- *Why?* Simplifies the installation of all required dependencies.
+- *How?* This project includes a `Brewfile` for managing dependencies.
+- *Setup:* Run `make setup-mac` to install all required dependencies using Homebrew.
+- *Update:* Run `make update-brew-deps` to update dependencies.
 
 == 🌐 Network & System Requirements
 
-1. *Stable Internet Connection* – Required for downloading dependencies and connecting to Confluent Cloud.
-2. *8GB+ RAM Recommended* – Running Flink, Kafka, and other services may require significant memory.
-3. *Sufficient Disk Space (At Least 10GB Free)* – For Docker images, logs, and data processing.
+. *Stable Internet Connection* – Required for downloading dependencies and connecting to Confluent Cloud.
+. *8GB+ RAM Recommended* – Running Flink, and other services may require significant memory.
+. *Sufficient Disk Space (At Least 10GB Free)* – For Docker images, logs, and data processing.
 
 == ⚙️ Optional but Recommended
 
 === 1️⃣ Terraform Installed
-*Why?* Useful for automated infrastructure setup.
-*Download Terraform:* https://developer.hashicorp.com/terraform/downloads[Terraform Website]
+
+- *Why?* Useful for automated infrastructure setup in Confluent Cloud.
+- *Download Terraform:* https://developer.hashicorp.com/terraform/downloads[Terraform Website]
 
 === 2️⃣ Basic Understanding of Terraform and IaC (Infrastructure as Code)
-*Why?* If Terraform scripts are used, a fundamental knowledge of how it works would be beneficial.
-*Terraform Getting Started Guide:* https://developer.hashicorp.com/terraform/tutorials[Terraform Tutorials]
+
+- *Why?* If Terraform scripts are used, a fundamental knowledge of how it works would be beneficial.
+- *Terraform Getting Started Guide:* https://developer.hashicorp.com/terraform/tutorials[Terraform Tutorials]
 
 === 3️⃣ Confluent CLI
-*Why?* The workshop will use the commands in the Confluent CLI to get useful information about new Confluent infrastructure.
-*Download and Install:* https://docs.confluent.io/confluent-cli/current/install.html[Confluent CLI Installation Instructions]
+
+- *Why?* The workshop will use the commands in the Confluent CLI to get useful information about new Confluent infrastructure.
+- *Download and Install:* https://docs.confluent.io/confluent-cli/current/install.html[Confluent CLI Installation Instructions]
 
 === 4️⃣ jq
-*Why?* The workshop will use jq to build configuration files used to demonstrate the Confluent Flink Table API.
-*Download and Install:* https://jqlang.org/download/[jq Download Instructions]
+
+- *Why?* The workshop will use jq to build configuration files used to demonstrate the Confluent Flink Table API.
+- *Download and Install:* https://jqlang.org/download/[jq Download Instructions]
 
 == 📌 Pre-Workshop Setup Tasks
 
-1. *Sign up for Confluent Cloud & Configure API Keys* – Ensure access credentials are available before the workshop.
-2. *Clone the Workshop Repository* – The repo will include pre-built examples and configuration files (GitHub link will be shared before the workshop).
-3. *Set Up Environment Variables* – Configure `JAVA_HOME` and authentication variables for Confluent Cloud.
-4. *Run a Simple Docker-Based Flink Job* – Validate that the environment is correctly configured.
+. *Sign up for Confluent Cloud & Configure API Keys* – Ensure access credentials are available before the workshop.
+. *Clone the Workshop Repository* – The repo will include pre-built examples and configuration files (GitHub link will be shared before the workshop).
+. *Set Up Environment Variables* – Configure `JAVA_HOME` and authentication variables for Confluent Cloud.
+. *Run a Simple Docker-Based Flink Job* – Validate that the environment is correctly configured.
diff --git a/build.gradle.kts b/build.gradle.kts
@@ -1,10 +1,11 @@
 import org.gradle.api.tasks.testing.logging.TestExceptionFormat
 import org.gradle.api.tasks.testing.logging.TestLogEvent
+import com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar
 
 plugins {
     java
     application
-    id("com.github.johnrengelman.shadow") version "8.1.1" apply false
+    id("com.gradleup.shadow") version "8.3.6" apply false
 }
 
 allprojects {
@@ -21,30 +22,30 @@ allprojects {
 
 subprojects {
     apply(plugin = "java")
-    
+
     val flinkVersion = "1.20.0"
     val confluentVersion = "7.9.0"
     val junitVersion = "5.10.2"
     val logbackVersion = "1.4.14"
     val slf4jVersion = "2.0.11"
-    
+
     dependencies {
         // Logging
         implementation("org.slf4j:slf4j-api:$slf4jVersion")
         implementation("ch.qos.logback:logback-classic:$logbackVersion")
-        
+
         // Testing
         testImplementation("org.junit.jupiter:junit-jupiter-api:$junitVersion")
         testImplementation("org.junit.jupiter:junit-jupiter-params:$junitVersion")
         testRuntimeOnly("org.junit.jupiter:junit-jupiter-engine:$junitVersion")
     }
-    
+
     java {
         toolchain {
             languageVersion.set(JavaLanguageVersion.of(21))
         }
     }
-    
+
     tasks.test {
         useJUnitPlatform()
         testLogging {
@@ -55,7 +56,7 @@ subprojects {
             showStackTraces = true
         }
     }
-    
+
     tasks.withType<JavaCompile> {
         options.encoding = "UTF-8"
         options.compilerArgs.add("-parameters")
@@ -65,25 +66,25 @@ subprojects {
 // Configuration for the main application modules
 configure(subprojects.filter { it.name == "flink-streaming" || it.name == "flink-sql" }) {
     apply(plugin = "application")
-    apply(plugin = "com.github.johnrengelman.shadow")
-    
+    apply(plugin = "com.gradleup.shadow")
+
     val flinkVersion = "1.20.0"
     val confluentVersion = "7.9.0"
-    
+
     dependencies {
         // Common modules
         implementation(project(":common:models"))
         implementation(project(":common:utils"))
-        
+
         // Flink Core
         implementation("org.apache.flink:flink-streaming-java:$flinkVersion")
         implementation("org.apache.flink:flink-clients:$flinkVersion")
         implementation("org.apache.flink:flink-runtime-web:$flinkVersion")
-        
+
         // Flink Connectors
         implementation("org.apache.flink:flink-connector-kafka:3.4.0-1.20")
         implementation("org.apache.flink:flink-connector-files:$flinkVersion")
-        
+
         // Confluent
         implementation("io.confluent:kafka-schema-registry-client:$confluentVersion")
         implementation("io.confluent:kafka-json-schema-serializer:$confluentVersion")
@@ -95,26 +96,26 @@ configure(subprojects.filter { it.name == "flink-streaming" || it.name == "flink
 project(":flink-sql") {
     dependencies {
         val flinkVersion = "1.20.0"
-        
+
         // Flink Table API & SQL
         implementation("org.apache.flink:flink-table-api-java-bridge:$flinkVersion")
         implementation("org.apache.flink:flink-table-planner-loader:$flinkVersion")
         implementation("org.apache.flink:flink-table-runtime:$flinkVersion")
     }
-    
+
     tasks.jar {
         manifest {
             attributes["Main-Class"] = "io.confluent.developer.sql.FlinkSqlMain"
         }
     }
-    
-    tasks.named<com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar>("shadowJar") {
+
+    tasks.named<ShadowJar>("shadowJar") {
         archiveBaseName.set("flink-sql")
         archiveClassifier.set("")
         archiveVersion.set("")
         mergeServiceFiles()
     }
-    
+
     application {
         mainClass.set("io.confluent.developer.sql.FlinkSqlMain")
     }
@@ -127,21 +128,15 @@ project(":flink-streaming") {
             attributes["Main-Class"] = "io.confluent.developer.streaming.FlinkStreamingMain"
         }
     }
-    
-    tasks.named<com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar>("shadowJar") {
+
+    tasks.named<ShadowJar>("shadowJar") {
         archiveBaseName.set("flink-streaming")
         archiveClassifier.set("")
         archiveVersion.set("")
         mergeServiceFiles()
     }
-    
+
     application {
         mainClass.set("io.confluent.developer.streaming.FlinkStreamingMain")
     }
 }
-
-// Gradle wrapper task
-tasks.wrapper {
-    gradleVersion = "8.5"
-    distributionType = Wrapper.DistributionType.BIN
-}
diff --git a/common/utils/build.gradle.kts b/common/utils/build.gradle.kts
@@ -1,11 +1,24 @@
+plugins {
+    `jvm-test-suite`
+}
+
 dependencies {
     // Test dependencies
-    testImplementation("org.junit.jupiter:junit-jupiter-api:5.10.0")
-    testImplementation("org.junit.jupiter:junit-jupiter-params:5.10.0")
-    testRuntimeOnly("org.junit.jupiter:junit-jupiter-engine:5.10.0")
+    testImplementation(platform("org.junit:junit-bom:5.10.0"))
+    testImplementation("org.junit.jupiter:junit-jupiter")
+    testImplementation("org.junit.jupiter:junit-jupiter-params")
+    testRuntimeOnly("org.junit.jupiter:junit-jupiter-engine")
     testImplementation("org.assertj:assertj-core:3.24.2")
 }
 
-tasks.test {
+testing {
+    suites {
+        val test by getting(JvmTestSuite::class) {
+            useJUnitJupiter()
+        }
+    }
+}
+
+tasks.named<Test>("test") {
     useJUnitPlatform()
 }
diff --git a/common/utils/src/main/java/io/confluent/developer/utils/ConfigUtils.java b/common/utils/src/main/java/io/confluent/developer/utils/ConfigUtils.java
@@ -3,10 +3,11 @@
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
 
-import java.io.File;
-import java.io.FileInputStream;
 import java.io.IOException;
 import java.io.InputStream;
+import java.nio.file.Files;
+import java.nio.file.Path;
+import java.nio.file.Paths;
 import java.util.Properties;
 
 /**
@@ -36,9 +37,9 @@ public static Properties loadProperties(String filePath) {
         }
         
         // Then try to load from file system
-        File file = new File(filePath);
-        if (file.exists()) {
-            try (FileInputStream input = new FileInputStream(file)) {
+        Path path = Paths.get(filePath);
+        if (Files.exists(path)) {
+            try (InputStream input = Files.newInputStream(path)) {
                 properties.load(input);
                 LOG.info("Loaded properties from file system: {}", filePath);
                 return properties;
diff --git a/flink-data-generator/build.gradle.kts b/flink-data-generator/build.gradle.kts
@@ -1,6 +1,8 @@
+import com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar
+
 plugins {
     application
-    id("com.github.johnrengelman.shadow")
+    id("com.gradleup.shadow")
 }
 
 val flinkVersion = "1.20.0"
@@ -35,7 +37,7 @@ tasks.jar {
     }
 }
 
-tasks.named<com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar>("shadowJar") {
+tasks.named<ShadowJar>("shadowJar") {
     archiveBaseName.set("flink-data-generator")
     archiveClassifier.set("")
     archiveVersion.set("")

Original file line number	Diff line number	Diff line change
`@@ -1,6 +1,8 @@`
	`1`	`+import com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar`
	`2`	`+`
`1`	`3`	`plugins {`
`2`	`4`	`application`
`3`		`- id("com.github.johnrengelman.shadow")`
	`5`	`+ id("com.gradleup.shadow")`
`4`	`6`	`}`
`5`	`7`
`6`	`8`	`val flinkVersion = "1.20.0"`
`@@ -35,7 +37,7 @@ tasks.jar {`
`35`	`37`	`}`
`36`	`38`	`}`
`37`	`39`
`38`		`-tasks.named<com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar>("shadowJar") {`
	`40`	`+tasks.named<ShadowJar>("shadowJar") {`
`39`	`41`	`archiveBaseName.set("flink-data-generator")`
`40`	`42`	`archiveClassifier.set("")`
`41`	`43`	`archiveVersion.set("")`