INTPYTHON-527 Add Queryable Encryption support #329

aclark4life · 2025-06-27T02:16:28Z

Previous attempts and additional context here:

INTPYTHON-527 Add Queryable Encryption config #318
- Branched from transaction support and includes only helpers
INTPYTHON-527 Add queryable encryption support #319
- In which this bug in libmongocrypt was discovered
- A fix for that bug in PyMongo is being discussed here.
INTPYTHON-527 Add Queryable Encryption support #323
- Before I understood that the shared lib for mongocrypt was included in the pymongocrypt wheel.
Add test for "Encrypted fields found" error (ensure this exception still happens)
Add check for model schema not matching encrypted fields
Document key_vault_namespace must be encrypted db
Document that fields within EmbeddedModelArrayField can't be encrypted
Document workflow:
- Develop and test local
- Deploy and run migrate
- Run showencryptedfieldsmap and set encrypted_fields_map in auto_encryption_opts
- Deploy again

tests/encryption_/tests.py

django_mongodb_backend/models.py

django_mongodb_backend/encryption.py

django_mongodb_backend/schema.py

django_mongodb_backend/base.py

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/schema.py

django_mongodb_backend/features.py

django_mongodb_backend/routers.py

django_mongodb_backend/schema.py

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/schema.py

tests/encryption_/tests.py

tests/encryption_/routers.py

tests/encryption_/models.py

tests/backend_/test_features.py

django_mongodb_backend/schema.py

tests/encryption_/models.py

django_mongodb_backend/schema.py

django_mongodb_backend/encryption.py

tests/encryption_/routers.py

django_mongodb_backend/schema.py

django_mongodb_backend/models.py

django_mongodb_backend/management/commands/get_encrypted_fields_map.py

docs/source/ref/encryption.rst

django_mongodb_backend/fields/encryption.py

django_mongodb_backend/management/commands/get_encrypted_fields_map.py

django_mongodb_backend/schema.py

tests/encryption_/tests.py

aclark4life · 2025-12-02T23:35:24Z

docs/howto/queryable-encryption.rst

+vault's collection name can be whatever you wish, but by convention, it's often
+``__keyVault``.
+
+Configuring the Automatic Encryption Shared Library


@timgraham I think we should move this section, including admonition, into the Configuring the DATABASES section.

aclark4life · 2025-12-02T23:40:36Z

docs/howto/queryable-encryption.rst

+
+Next, you'll need to configure the :ref:`manual:qe-reference-shared-library`.
+
+First, :ref:`download the shared library


And this should probably be moved to the Installation section

Via https://github.com/mongodb-labs/drivers-evergreen-tools/tree/master/.evergreen/csfle

…ove mongocryptd

… it part of the normal flow

Move crypt shared installation instructions to "Installation" section and crypt shared configuration steps to "Configuring the DATABASES setting" section.

aclark4life commented Jun 27, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

aclark4life commented Jun 27, 2025

View reviewed changes

django_mongodb_backend/models.py Outdated Show resolved Hide resolved

aclark4life commented Jun 27, 2025

View reviewed changes

django_mongodb_backend/encryption.py Outdated Show resolved Hide resolved

timgraham reviewed Jun 27, 2025

View reviewed changes

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jun 30, 2025

View reviewed changes

django_mongodb_backend/features.py Outdated Show resolved Hide resolved

timgraham reviewed Jul 1, 2025

View reviewed changes

django_mongodb_backend/routers.py Outdated Show resolved Hide resolved

timgraham reviewed Jul 1, 2025

View reviewed changes

django_mongodb_backend/schema.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jul 4, 2025

View reviewed changes

tests/encryption_/models.py Show resolved Hide resolved

timgraham reviewed Jul 7, 2025

View reviewed changes

tests/encryption_/models.py Outdated Show resolved Hide resolved

aclark4life commented Jul 7, 2025

View reviewed changes

django_mongodb_backend/schema.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

timgraham reviewed Jul 9, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

tests/encryption_/tests.py Outdated Show resolved Hide resolved

tests/encryption_/tests.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

aclark4life commented Jul 11, 2025

View reviewed changes

tests/encryption_/tests.py Outdated Show resolved Hide resolved

This comment was marked as resolved.

Sign in to view

timgraham force-pushed the INTPYTHON-527 branch 3 times, most recently from 1b0a5b9 to c770364 Compare November 26, 2025 01:45

aclark4life commented Dec 2, 2025

View reviewed changes

WaVEV and others added 23 commits December 5, 2025 11:29

Remove $facet in top level group stages

23b6e0e

Wrap query for global aggregation

acce7ec

[temp] remove Django tests for faster CI

a2aa0f6

INTPYTHON-527 Add Queryable Encryption support

73c00a4

[wip] updates to field docs

ecf643a

add QuerySet tests

afbc919

use shared library instead of mongocryptd

f88de8a

adjust message and add test for missing auto_encryption_opts error

727df35

polish howto

dabbb53

doc query limitations + docs polish + todos

0ece6d7

edit "Dynamic library path configuration"

f5dba60

combine topic guide with howto

b81d496

Remove QE from 5.2.0 beta 2 release notes

4dad3ff

Add "start csfle servers" func to evergreen config

ee0c5ea

Via https://github.com/mongodb-labs/drivers-evergreen-tools/tree/master/.evergreen/csfle

remove support for multiple kms providers

cda77e5

fix join tests following foreignField/localField refactor

d8568d5

Add tests-8-qe to evergreen buildvariants

d2e4b03

fix less than lookup on encrypted fields

adc4894

simplify "Configuring the Automatic Encryption Shared Library" to rem…

e972ae7

…ove mongocryptd

reorder "Configuring the Automatic Encryption Shared Library" to make…

ac8a8ac

… it part of the normal flow

update docs/tests for $facet removal

934ea07

Combine crypt shared w/installation & db setup

139033a

Move crypt shared installation instructions to "Installation" section and crypt shared configuration steps to "Configuring the DATABASES setting" section.

versionadded updated from 5.2.3 to 6.0.0.

f99558c

aclark4life force-pushed the INTPYTHON-527 branch from 6410366 to f99558c Compare December 5, 2025 16:30

Add pymongo clone dir for just setup-tests

a3c27ef


		Next, you'll need to configure the :ref:`manual:qe-reference-shared-library`.

		First, :ref:`download the shared library

INTPYTHON-527 Add Queryable Encryption support #329

Are you sure you want to change the base?

INTPYTHON-527 Add Queryable Encryption support #329

Uh oh!

Conversation

aclark4life commented Jun 27, 2025 • edited by timgraham Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

This comment was marked as resolved.

Uh oh!

This comment was marked as resolved.

This comment was marked as resolved.

This comment was marked as resolved.

aclark4life Dec 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

aclark4life Dec 2, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

aclark4life commented Jun 27, 2025 •

edited by timgraham

Loading

aclark4life Dec 2, 2025 •

edited

Loading