Improve partition support for Bulk Patch operation #7406
Merged
+820
−220
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* bump to 8.7, add version enums * changelog folder for 8.8 * increase memory to elastic search container --------- Co-authored-by: jdar <justin.dar@smiledigitalhealth.com>
* [7332] update mdm resource persistence id * [7332] add tests and changelog * [7332] update changelog * [7332] update test * [7332] update test * [7332] update changelog
* increase memory to elastic search container (#7326) Co-authored-by: jdar <justin.dar@smiledigitalhealth.com> * 7282 - Added the ability for an Interceptor to alter the HTTP Response Code when an Exception is thrown (#7303) * 7282 - Added the ability for an Interceptor to alter the HTTP Response Code when an Exception is thrown. * Enhanced the solution based on code review feedback. * Removed a class that was being used to store the Http response Code and used the existing HttpStatus class instead. * Enhanced the Unit Test. * Enhanced the Javadoc for the Pointcut.SERVER_OUTGOING_FAILURE_OPERATIONOUTCOME enum. * Changed the Interceptor Hook implementation based on Code Review feedback. * Removed an unused variable declaration. * Removed an unused variable declaration. * Ran mvn spotless:apply to apply proper formatting. * More code review feedback. * Use ResponseDetails for exception outcome modification. * Remove bit about "valid status" -- we allow anything * changelog * Replace the response object --------- Co-authored-by: Michael Buckley <michaelabuckley@gmail.com> * batch2 jobs that are cancelled will not be returned when requesting a… (#7321) (#7327) * Improve URL processing for JpaPersistedResourceValidationSupport (#7330) * Improve URL processing for JpaPersistedResourceValidationSupport * Add changelog * allow fetching subsequent pages when registering an allowed spec of r… (#7329) * allow fetching subsequent pages when registering an allowed spec of resourcetype search * 7833: add missing relationship between TermConcept and TermConceptProperty (#7346) * 7316 do not expand chain refparams (#7350) * Make sure refparams with chains are not expanded via MDM * 7316: code review feedback * [7269] bulk export history fails with client-assigned string IDs (#7300) * fixed 7269 bulk export history failure with client-assigned string IDs * fixed 7269 bulk export history failure with client-assigned string IDs * Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/8_6_0/7296-bulk-export-fails-with-string-resource-ids.yaml Co-authored-by: jdar8 <69840459+jdar8@users.noreply.github.com> * changed string ids to IResourcePersistentId * changed string ids to IResourcePersistentId * batch2 jobs that are cancelled will not be returned when requesting a… (#7321) * Bump to 8 7 (#7322) * bump to 8.7, add version enums * changelog folder for 8.8 * increase memory to elastic search container --------- Co-authored-by: jdar <justin.dar@smiledigitalhealth.com> * Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/dao/index/IdHelperService.java Co-authored-by: Michael Buckley <michaelabuckley@gmail.com> * fixed with spotless * Revert "Bump to 8 7 (#7322)" This reverts commit 40f1128. * Revert "changed string ids to IResourcePersistentId" This reverts commit 06af86a. * Revert "batch2 jobs that are cancelled will not be returned when requesting a… (#7321)" This reverts commit be08680. * changed string ids to IResourcePersistentId * fixed with spotless * Bumped version number * adding missing change to fix build --------- Co-authored-by: Rob Caruso <robert.caruso@smilecdr.com> Co-authored-by: jdar8 <69840459+jdar8@users.noreply.github.com> Co-authored-by: TipzCM <leif.stawnyczy@gmail.com> Co-authored-by: jdar <justin.dar@smiledigitalhealth.com> Co-authored-by: Michael Buckley <michaelabuckley@gmail.com> * [7332] fix mdm-query-links (#7356) * 7324 unable to access collection bundles when performing search requests (#7325) * Add failing tests * Fix * Changelog * Fix comment * Fix test * Try fixing CodeQL autobuild error * Implement revision suggestions * Add missed test case parameter * PatientIdPartitionIntercepto should allow Encounter.subject parameter (#7348) * Work on megascale enhancements part 6 * Add changelog * Test fix * Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/8_6_0/7348-allow-patientidcompartmentmode-search-encounter-subject.yaml Co-authored-by: Nathan Doef <n.doef@protonmail.com> * Test fixes --------- Co-authored-by: Nathan Doef <n.doef@protonmail.com> * Bump to spring62 (#7351) * Bump spring framework version * Replace Base64Utils with Base64.getEncoder() * Bump spring boot test deps to match spring version 6.2 * Bump junit for spring tests --------- Co-authored-by: Gary <garygraham@simpatico.ai> * 7217 with rel 8 6 (#7337) * Automated Migration Testing (HAPI-FHIR) - updated test migration scripts for 8_6_0 (#7357) * Remove dead autowire (#7365) * Don't reuse TransactionDetails for partitioned TX execution (#7363) * Fix tags on megascale * Add test * Test fix * Version bump --------- Co-authored-by: jdar <justin.dar@smiledigitalhealth.com> Co-authored-by: Kevin Dougan <72025369+KevinDougan@users.noreply.github.com> Co-authored-by: Michael Buckley <michaelabuckley@gmail.com> Co-authored-by: TipzCM <leif.stawnyczy@gmail.com> Co-authored-by: James Agnew <jamesagnew@gmail.com> Co-authored-by: another-luis <luis.bascones@smiledigitalhealth.com> Co-authored-by: Rob Caruso <robert.caruso@smiledigitalhealth.com> Co-authored-by: Rob Caruso <robert.caruso@smilecdr.com> Co-authored-by: Yaling Pei <yaling.pei@smiledigitalhealth.com> Co-authored-by: jmarchionatto <60409882+jmarchionatto@users.noreply.github.com> Co-authored-by: Nathan Doef <n.doef@protonmail.com> Co-authored-by: tadgh <garygrantgraham@gmail.com> Co-authored-by: Gary <garygraham@simpatico.ai> Co-authored-by: volodymyr-korzh <132366313+volodymyr-korzh@users.noreply.github.com> Co-authored-by: Gary Graham <gary@tadgh.io>
* Ensure streaming queries don't impose limit clauses on the sql when called in "synchronous" mode. * changelog
Co-authored-by: Elie Maamari <em@Elies-MacBook-Pro.local>
…7392) * Fix logic in Icd10CmLoader to append 7th character extensions to the leaf-level concepts in the hierarchy (rather than to just the immediate child concepts). * Fix logic in Icd10CmLoader to append 7th character extensions to the leaf-level concepts in the hierarchy (rather than to just the immediate child concepts). * Fix logic in Icd10CmLoader to append 7th character extensions to the leaf-level concepts in the hierarchy (rather than to just the immediate child concepts). --------- Co-authored-by: Ian Marshall <ian@simpatico.ai>
…#7389) * Inferno test parsing failure when 401 rejection does not contain OperationOutcome - failing test * Inferno test parsing failure when 401 rejection does not contain OperationOutcome - implementation * Inferno test parsing failure when 401 rejection does not contain OperationOutcome - changelog
* backport complete * Be more resilient to unexpected resource version IDs in database (#7216) * Handle mismatched versions * Be more resilient to unexpected resource versions in DB * Test fix * Test fix * Work on tests * Test fixes * Test fixes * Add changelog * Spotless * Address review comments * HAPI bump * Fix API breakages * api breakages * version set * changelog and versioning --------- Co-authored-by: James Agnew <jamesagnew@gmail.com> Co-authored-by: Gary Graham <gary@tadgh.io> Co-authored-by: jdar <justin.dar@smiledigitalhealth.com>
…7388) * Fix Encounter $everything not working in REQUEST_TENANT partitioning * Add test * changelog * Remove unused HttpServletRequest parameter * Remove unnecessary overriding
* bump to 8.7, add version enums * changelog folder for 8.8 * increase memory to elastic search container --------- Co-authored-by: jdar <justin.dar@smiledigitalhealth.com>
* [7332] update mdm resource persistence id * [7332] add tests and changelog * [7332] update changelog * [7332] update test * [7332] update test * [7332] update changelog
* [7332] update mdm resource persistence id * [7332] add tests and changelog * [7332] update changelog * [7332] update test * [7332] update test * [7332] update changelog
…b.com:hapifhir/hapi-fhir into ja_20251106_megascale_bulk_terminology_update
jamesagnew
requested review from
AD1306,
fil512,
michaelabuckley and
tadgh
as code owners
Contributor
|
Formatting check succeeded! |
michaelabuckley
approved these changes
Nov 25, 2025
hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/cache/ResourceVersionSvcDaoImpl.java
Outdated
Show resolved
Hide resolved
hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/batch2/Batch2DaoSvcImpl.java
Show resolved
Hide resolved
...in/java/ca/uhn/fhir/rest/server/interceptor/partition/RequestTenantPartitionInterceptor.java
Outdated
Show resolved
Hide resolved
...fhir-jpaserver-test-r4/src/test/java/ca/uhn/fhir/jpa/dao/r4/FhirResourceDaoR4CreateTest.java
Outdated
Show resolved
Hide resolved
hapi-fhir-jpaserver-test-r4/src/test/java/ca/uhn/fhir/jpa/dao/r4/PartitioningSqlR4Test.java
Show resolved
Hide resolved
hapi-fhir-storage/src/main/java/ca/uhn/fhir/jpa/partition/BaseRequestPartitionHelperSvc.java
Outdated
Show resolved
Hide resolved
...-fhir-storage-batch2/src/main/java/ca/uhn/fhir/batch2/jobs/step/GenerateRangeChunksStep.java
Outdated
Show resolved
Hide resolved
...-fhir-storage-batch2/src/main/java/ca/uhn/fhir/batch2/jobs/step/GenerateRangeChunksStep.java
Outdated
Show resolved
Hide resolved
.../java/ca/uhn/fhir/batch2/jobs/bulkmodify/framework/base/BaseBulkModifyOrRewriteProvider.java
Show resolved
Hide resolved
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds an explicit
partitionIdparameter to the bulk patch operation, and improves general support for running this batch job in a partitioned environment.