Skip to content

WOW Scheduling strategy #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 458 commits into from
Mar 13, 2025
Merged

WOW Scheduling strategy #13

merged 458 commits into from
Mar 13, 2025

Conversation

@Lehmann-Fabian
Copy link
Member

@Lehmann-Fabian Lehmann-Fabian commented Mar 13, 2025

No description provided.

@Lehmann-Fabian
Updated versions
495f9bc 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
FilePath getter + store triple
5a413a3 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
sortTaskInputs
c8c4917 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Use AlignmentWrapper
1bfad9b 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Location and not String as key in alignmentmap
8126223 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Fixed Bug: Format error in ftp.py
d961263 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Added cost functions
bd321d6 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Added Greedy Alignment
055e87a 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Use Greedy
dd218ea 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
CanSchedule method for node
ce66777 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Reuse getAvailable nodes for validSchedulerPlan
bae3c06 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Prefer current node for files
396f07e 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Fixed problem current node was not recognized.
421a011 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactored SchedulerWithDaemonSet
c2fb7c4 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Trace location aware scheduling
2350dfa 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Cost function configurable
9307b14 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Fixed potential bug
9f78db5 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
use computeIfAbsent
609b843 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactoring
feaac48 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Logging instead of printStackTrace
8967d92 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Search for best alignment
f4ca274 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactored code
b9eff4b 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactored ftp.py script v1
865f263 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactored ftp.py script v2
4e107c4 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactored ftp.py script V3
be3cfc7 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Download in parallel
1eb0324 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Reordered imports
cc6fe73 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Do not always request daemonset
777721e 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Log when step was finished
d709427 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Trace init runtimes
e7dcf18 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
First version of OutLabel aware scheduling
2b5621e 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Fix indent
be8e0d7 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactor to hide excludedNodes variable
034bc01 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Create Copy Tasks for tasks that ran on a node that is not responsibl…
1b67349 
…e for their labels.

Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Add documentation for Scheduler.java
544ff59 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Add a class comment to TaskOnNodeWrapper.java
e96c23c 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Comment OutputFiles.java
4518b6e 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Comment DataMissing.java
140eff3 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Comment FakeTaskInputs.java
f76693d 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Optimize Imports
ae91bb5 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Refactor and comment GroupCluster and LabelCount
de5fda5 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Fix problem that the node of the pod with the workflow engine was not…
f1a506a 
… transfered

Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Fix not all pods have an ip
ef1cdaa 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Update to Java 21 + improve Dockerfile
f715e7a 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Update Java version to 21
e915691 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Only test Java 21
1d642b8 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Add warnings if execution cannot be registered
7eea10e 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Reformat comments
3575012 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
improve comment
2d013c1 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Merge remote-tracking branch 'upstream/master' into wow-ponder
18c5347 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>

# Conflicts:
#	Dockerfile
#	pom.xml
#	src/main/java/cws/k8s/scheduler/client/CWSKubernetesClient.java
#	src/main/java/cws/k8s/scheduler/model/NodeWithAlloc.java
#	src/main/java/cws/k8s/scheduler/model/Requirements.java
#	src/main/java/cws/k8s/scheduler/model/Task.java
#	src/main/java/cws/k8s/scheduler/model/TaskConfig.java
#	src/main/java/cws/k8s/scheduler/rest/SchedulerRestController.java
#	src/main/java/cws/k8s/scheduler/scheduler/PrioritizeAssignScheduler.java
#	src/main/java/cws/k8s/scheduler/scheduler/Scheduler.java
@Lehmann-Fabian
Merge branch 'updates' into wow-ponder
6c6c399 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>

# Conflicts:
#	.github/workflows/workflow.yml
#	Dockerfile
#	pom.xml
#	src/main/java/cws/k8s/scheduler/client/KubernetesClient.java
#	src/main/java/cws/k8s/scheduler/model/Task.java
#	src/main/java/cws/k8s/scheduler/model/TaskConfig.java
#	src/main/java/cws/k8s/scheduler/rest/SchedulerRestController.java
#	src/main/java/cws/k8s/scheduler/scheduler/LocationAwareSchedulerV2.java
#	src/main/java/cws/k8s/scheduler/scheduler/Scheduler.java
#	src/main/java/cws/k8s/scheduler/scheduler/SchedulerWithDaemonSet.java
#	src/main/java/cws/k8s/scheduler/scheduler/data/NodeDataTuple.java
#	src/main/java/cws/k8s/scheduler/scheduler/data/TaskData.java
#	src/main/java/cws/k8s/scheduler/scheduler/la2/ready2run/OptimalReadyToRunToNode.java
@Lehmann-Fabian
Convert Tests to Junit 5
8a755d4 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Fix VertexDeserializerTest
21d7c6c 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Read spring-boot-maven-plugin
784df49 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
update OR-Tools to 9.12.4544
7cafa0e 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Change naming to WOW
ce39b75 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Optimize Imports
073f971 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Reorder attributes
e547e01 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian
Add WOW to Readme
a02b84b 
Signed-off-by: Lehmann_Fabian <fabian.lehmann@informatik.hu-berlin.de>
@Lehmann-Fabian Lehmann-Fabian merged commit 0bbc41c into master Mar 13, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@Lehmann-Fabian @srnbckr