feat: Commit Reader

[OussamaSaoudi]

🥞 Stacked PR

Use this link to review incremental changes.

• stack/dlr_commit [Files changed]
  • stack/dlr_manifest [Files changed]
    • stack/dlr_driver [Files changed]
      • stack/dlr_serde [Files changed]
        • stack/dlr_add_rm_dedup [Files changed]
          • stack/dlr_immutable_add_rm_dedup [Files changed]
            • stack/dlr_leaf [Files changed]
              • stack/dlr_executor [Files changed]
                • stack/dlr_serialization_helpers [Files changed]
                  • stack/dlr_api [Files changed]

---

What changes are proposed in this pull request?

This PR adds the commit logreader, a module that will hold all the logic for processing commit files when performing log replay.

• CommitReader reads the delta log using the commit cover.
• CommitReader implements Iterator<Item = ActionBatch>.
• CommitReader can read using an arbitrary log schema.

How was this change tested?

This is tested with the app-txn-no-checkpoint which has multiple commits and multiple add actions in each commit. We ensure that the CommitReader reads the correct set of add actions.

[codecov]

Codecov Report

❌ Patch coverage is 86.11111% with 10 lines in your changes missing coverage. Please review.
✅ Project coverage is 84.77%. Comparing base (72cb27c) to head (fd419c8).

Files with missing lines	Patch %	Lines
kernel/src/log_reader/commit.rs	86.76%	1 Missing and 8 partials ⚠️
kernel/src/log_segment.rs	50.00%	0 Missing and 1 partial ⚠️

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1499   +/-   ##
=======================================
  Coverage   84.77%   84.77%           
=======================================
  Files         126      127    +1     
  Lines       35679    35739   +60     
  Branches    35679    35739   +60     
=======================================
+ Hits        30246    30297   +51     
- Misses       3965     3966    +1     
- Partials     1468     1476    +8     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[nicklan]

lgtm! one small comment

[nicklan]

should this move into test_utils? I feel like we load test tables in a few places. If there's not already a central way to do so, maybe just make a good first issue to clean that up?

[OussamaSaoudi]

Ah I ended up moving this to test_utils in the following PR because I noticed the repetition.

[scovich]

Itertools::map_ok?

Suggested change

	.map(|batch| batch.map(|b| ActionsBatch::new(b, true)));
	.map_ok(|batch| ActionsBatch::new(batch, true));