Add `MigrationSequencer` for jobs#3008

Merged

nfx merged 106 commits intomainfrom

migration-sequencing-phase-1

Nov 1, 2024

Commits on Nov 1, 2024

make simple_dependency_resolver available more broadly

ericvergnaud
authored and
JCZuurmond
committed
build migration steps for workflow task

ericvergnaud
authored and
JCZuurmond
committed
fix pylint warnings

ericvergnaud
authored and
JCZuurmond
committed
fix pylint warnings

ericvergnaud
authored and
JCZuurmond
committed
add object name

ericvergnaud
authored and
JCZuurmond
committed
populate object owner

ericvergnaud
authored and
JCZuurmond
committed
be more defensive

ericvergnaud
authored and
JCZuurmond
committed
move last_node_id to sequencer

ericvergnaud
authored and
JCZuurmond
committed
cherry-pick changes

ericvergnaud
authored and
JCZuurmond
committed
use existing Ownership classes

ericvergnaud
authored and
JCZuurmond
committed
fix merge issues

ericvergnaud
authored and
JCZuurmond
committed
move package

ericvergnaud
authored and
JCZuurmond
committed
improve assert style

ericvergnaud
authored and
JCZuurmond
committed
formatting

ericvergnaud
authored and
JCZuurmond
committed
make 'incoming' transient and improve comments

ericvergnaud
authored and
JCZuurmond
committed
Lint unit test
JCZuurmond
committed
Test all steps in sequence
JCZuurmond
committed
Sort step ids
JCZuurmond
committed
Add docstring for migration sequencing
JCZuurmond
committed
Format
JCZuurmond
committed
Update docstring
JCZuurmond
committed
Use priority queue
JCZuurmond
committed
Add custom queue
JCZuurmond
committed
Add source
JCZuurmond
committed
Fix implementation of custom queue
JCZuurmond
committed
Update docs
JCZuurmond
committed
Comment counter
JCZuurmond
committed
Add typehint for migration node id
JCZuurmond
committed
Add docstrings to MigrationNodes
JCZuurmond
committed
Add TODO
JCZuurmond
committed
Add docstrings to methods
JCZuurmond
committed
Add docstrings on MigrationStep attributes
JCZuurmond
committed
Make types more consistent
JCZuurmond
committed
Make migration node frozen
JCZuurmond
committed
Add generic to priorityqueue
JCZuurmond
committed
Fix PriorityQueue type hints
JCZuurmond
committed
Update docs
JCZuurmond
committed
Resolve TODO
JCZuurmond
committed
Add seen migration node set
JCZuurmond
committed
Use ordered steps to compute step number
JCZuurmond
committed
Fix create node queue
JCZuurmond
committed
Remove update from queue
JCZuurmond
committed
Move mock admin locator to fixture
JCZuurmond
committed
Use ResourceDoesNotExists
JCZuurmond
committed
Introduce MaybeMigrationNode
JCZuurmond
committed
Test register job cluster
JCZuurmond
committed
Add happy path test for cluster
JCZuurmond
committed
Rewrite order of workflow task to job
JCZuurmond
committed
Make register workflow task hidden
JCZuurmond
committed
Use itertools.counter
JCZuurmond
committed
Move register workflow job up
JCZuurmond
committed
Rename to register job
JCZuurmond
committed
Make methods hidden
JCZuurmond
committed
Rename protected access methods
JCZuurmond
committed
Test job referencing unknown job cluster
JCZuurmond
committed
Test job with existing cluster
JCZuurmond
committed
Use MaybeMigrationNode when registering job
JCZuurmond
committed
Test register a job with non existing cluster
JCZuurmond
committed
Propagate cluster problems
JCZuurmond
committed
Update condition
JCZuurmond
committed
Fix passing job node instead of job
JCZuurmond
committed
Remove redundant import
JCZuurmond
committed
fix testing dependency problem
JCZuurmond
committed
Add docstring to registering job
JCZuurmond
committed
Register job cluster
JCZuurmond
committed
Test register job with non-existing job cluster key
JCZuurmond
committed
Test register existing job cluster
JCZuurmond
committed
Fix missing parameter
JCZuurmond
committed
Handle non-existing job cluster
JCZuurmond
committed
Test for new cluster
JCZuurmond
committed
Fix sequencing
JCZuurmond
committed
Fix parent object id
JCZuurmond
committed
Update sequencing
JCZuurmond
committed
Add type hints for problems
JCZuurmond
committed
Explain why not handling new cluster
JCZuurmond
committed
Format
JCZuurmond
committed
Sequence with new cluster
JCZuurmond
committed
Add job cluster to nodes
JCZuurmond
committed
Make job cluster id unique
JCZuurmond
committed
Make register signature similar
JCZuurmond
committed
Explain outgoing references
JCZuurmond
committed
Remove TODO
JCZuurmond
committed
Update docs and naming
JCZuurmond
committed
Update tests docs
JCZuurmond
committed
Test sequence job with task referencing job cluster
JCZuurmond
committed
Fix test sequence in docstring
JCZuurmond
committed
Add test when referencing non-existing cluster
JCZuurmond
committed
Remove unused fixtures
JCZuurmond
committed
Remove redundant comment and fix docstring
JCZuurmond
committed
Test task dependency
JCZuurmond
committed
Sequence tasks with dependencies
JCZuurmond
committed
Add TODOs for register workflow task
JCZuurmond
committed
Add todo for register cluster
JCZuurmond
committed
Add migration sequencer to RuntimeContext
JCZuurmond
committed
Add integration test for simple job
JCZuurmond
committed
Test sequencing job with task referencing existing cluster
JCZuurmond
committed
Test sequencing job with task referencing non existing cluster
JCZuurmond
committed
Format
JCZuurmond
committed
Test sequence job with task dependency
JCZuurmond
committed
Test non-existing task dependency
JCZuurmond
committed
Return early when no job.settings
JCZuurmond
committed
Fix typo's
JCZuurmond
committed
Rename administrator locator
JCZuurmond
committed
Do not expect cluster in sequence steps when not found
JCZuurmond
committed
Refactor register_job to register_jobs
JCZuurmond
committed
Remove unused import
JCZuurmond
committed

Add `MigrationSequencer` for jobs#3008nfx merged 106 commits intomaindatabrickslabs/ucx:mainfrom migration-sequencing-phase-1databrickslabs/ucx:migration-sequencing-phase-1Copy head branch name to clipboard

Commits

Commits on Nov 1, 2024

Add `MigrationSequencer` for jobs#3008
nfx merged 106 commits intomainfrom
migration-sequencing-phase-1