v0.1.18

What's Changed

• Support live update mode in CocoIndex engine, exposed by FlowLiveUpdater (Python SDK) and update -L / server -L (CLI).
• Offer a refresh_interval option for add_source() API in Python SDK for periodical metadata-traverse based change detection
• Update GoogleDrive data source to support detecting recent changes based on last modified time.
• Continuously show stats in live update mode.
• Make @main_fn decorator support async functions.
• Carry over more metadata for function and class decorators in Python SDK.

Full Changelog: v0.1.17...v0.1.18

v0.1.17

What's Changed

• Skip reprocessing a source row when source data and logic has no change.
• Keep source indexing states in memory to achieve lightweight incremental reprocessing when update called multiple times.
• Minor optimization for auto generated uuid as storage target key.

New Contributors

• @cocoindex-dev made their first contribution in #222

Full Changelog: v0.1.16...v0.1.17

v0.1.16

What's Changed

• Support date/time types

Full Changelog: v0.1.15...v0.1.16

v0.1.15

What's Changed

• Add UUID type, and support automatically generate stable UUID.
• Support non-required field for LLM extraction.
• Storage target setup logic robustness improvement.
• Also allow collect() taking constant.

Full Changelog: v0.1.14...v0.1.15

v0.1.14

What's Changed

• Support evaluate flow and dump output to files for offline evaluation purpose #194

Full Changelog: v0.1.13...v0.1.14

v0.1.13

What's Changed

• Remove unnecessary dependency: openssl by @badmonster0 in #169
• Add a field mime_type for GoogleDrive source. by @badmonster0 in #172
• Count source rows with ERROR during indexing. by @badmonster0 in #174
• Make error location caused by functions more clear. by @badmonster0 in #181
• StructSchema take a optional description and put in JSON schema by @badmonster0 in #186
• Use class docstring as description for struct types in Python SDK. by @badmonster0 in #187
• Correctly output unsupported type name. by @badmonster0 in #188
• Correctly handle None values for composite types. by @badmonster0 in #189
• Improve error message for encoding of field annotations. by @badmonster0 in #190
• Bug fix: correctly deal with deleted/trashed files in GoogleDrive source by @badmonster0 in #191
• Make indexing update stats more consistent with what really happened by @badmonster0 in #192
• Bug fix: make sure dangling precommit states properly handled. by @badmonster0 in #193

New Contributors

• @Anush008 made their first contribution in #182

Full Changelog: v0.1.12...v0.1.13

v0.1.12

What's Changed

• Support for more languages in SplitRecursively.
• Skip chunks without alphanumeric characters.
• Add GoogleDrive source.

Full Changelog: v0.1.11...v0.1.12

v0.1.11

What's Changed

• Add support for more languages in SplitRecursively by @badmonster0 in #144
• Add @function decorator for simple functions. by @badmonster0 in #146

Full Changelog: v0.1.10...v0.1.11

v0.1.9

What's Changed

• Use OpArgsResolver to make resolve for multiple input args easier. by @badmonster0 in #120
• Upgrade babel runtime versions for docs by @badmonster0 in #121
• Extract Rust<->Python binding logic into a module for reuse by @badmonster0 in #122
• Robust support for passing constant to functions. by @badmonster0 in #123
• Update SplitRecursively to take language and chunk sizes dynamically. by @badmonster0 in #124
• Update the documents about SplitRecursively and transform arguments. by @badmonster0 in #125

Full Changelog: v0.1.8...v0.1.9

v0.1.8

What's Changed

Added support for extracting structured information from text by LLM (#27)

See:

• ExtractByLlm function
• LLM integration
• Manual Extraction example.

New Contributors

• @wykrrr made their first contribution in #112

Full Changelog: v0.1.7...v0.1.8