v0.3.1

What's Changed

• Finish batching support
  • feat(batching): support batching for ColPali functions by @georgeh0 in #1233
  • feat(batching): support batching for embedding APIs by @georgeh0 in #1236
  • docs: add docs for enable batching in custom functions by @georgeh0 in #1238
• feat: add http::request() util for better error message and retry by @georgeh0 in #1235
• feat: consolidate progress bar and always report stats correctly by @georgeh0 in #1240

Full Changelog: v0.3.0...v0.3.1

v0.3.0

What's Changed

• Support batching of CocoIndex functions (#23)
  • feat(batching): implement batching util library by @georgeh0 in #1229
  • feat: support batching for Python SDK functions by @georgeh0 in #1232
• fix(runtime): guard sync API inside async contexts (#1085) by @samojavo in #1224
• Properly propagate cancellation and handle SIGINT during updates (#1008)
  • feat: propagate cancellations for async contexts by @georgeh0 in #1228
  • fix: use the batch runner to combine source indexer calls by @georgeh0 in #1230
• feat: report elapsed time for processing by @georgeh0 in #1231

New Contributors

• @samojavo made their first contribution in #1224

Full Changelog: v0.2.23...v0.3.0

v0.2.23

What's Changed

• [docs]order of the examples by @badmonster0 in #1220
• fix(ollama): correctly parse nested embeddings array from ollama endpoint /api/embed by @CAPsMANyo in #1227

New Contributors

• @CAPsMANyo made their first contribution in #1227

Full Changelog: v0.2.22...v0.2.23

v0.2.22

What's Changed

• docs: add custom_source_hn example to README.md by @georgeh0 in #1203
• docs: add clarification for data types by @georgeh0 in #1206
• feat: add claude skills for users to use cocoindex to develop by @georgeh0 in #1205
• cleanup: delete skills files as they're moved to cocoindex-claude repo by @georgeh0 in #1207
• docs: add docs on how to install cocoindex skill for Claude Code by @georgeh0 in #1208
• fix: allow none ordinal in indexing status API by @georgeh0 in #1202
• feat: Add Redis queue support for S3 event notifications by @belloibrahv in #1189
• fix: show continuous stats during batch updates by @thisisharsh7 in #1204
• docs(cli): improve docstring formatting for --help and markdown by @belloibrahv in #1210
• [docs]assorted Neo4j documentations by @badmonster0 in #1213
• feat: deprecate setup flag by @GooglyBlox in #1212

New Contributors

• @GooglyBlox made their first contribution in #1212

Full Changelog: v0.2.21...v0.2.22

v0.2.21

What's Changed

• Support source text files encoded in UTF-16/UTF-32
  • feat(file-decode): support files in UTF-16/UTF-32 by detecting BOM by @georgeh0 in #1185
  • fix: let bytes_to_string() return Cow to avoid unnecessary copy by @georgeh0 in #1186
• Support custom source
  • chore: always pass PyExecutionContext to the analyzer by @georgeh0 in #1195
  • feat(custom-source): add custom source support by @georgeh0 in #1197
  • feat(custom-source): make custom source API more robust and expose more error information by @georgeh0 in #1198
  • chore: allow source get API returns no ordinal by @georgeh0 in #1199
  • docs(custom-source): add docs for custom source by @georgeh0 in #1201
• fix: show proper error message when failed in loading module by @georgeh0 in #1196

Full Changelog: v0.2.20...v0.2.21

v0.2.20

What's Changed

• feat: Add AWS Bedrock LLM Support by @belloibrahv in #1173
• documentation - sources link & kuzu by @badmonster0 in #1179
• feat: improve logic fp: avoid source changes and count fn behavior ver by @georgeh0 in #1182
• cleanup: remove unused modules by @georgeh0 in #1183
• [doc] clean up sources subsections from the sources/index by @badmonster0 in #1184

Full Changelog: v0.2.19...v0.2.20

v0.2.19

What's Changed

• docs: create subpages for each source (#1126) by @esther-anierobi in #1136
• feat: Neo4j vector index method support by @belloibrahv in #1111
• feat(pg-source-filter): support filter for Postgres source by @georgeh0 in #1178

New Contributors

• @esther-anierobi made their first contribution in #1136

Full Changelog: v0.2.18...v0.2.19

v0.2.18

What's Changed

• feat(halfvec): support halfvec for postgres target by @georgeh0 in #1171
• Adjust SplitRecrsively
  • fix(split/markdown): treat code blocks as terminal nodes by @georgeh0 in #1157
  • chore: add more punctuations for pure text split by @georgeh0 in #1159
  • chore: use chunk_overlap as minimum atom size, if specified by @georgeh0 in #1160
• feat: add DetectProgrammingLanguage function by @georgeh0 in #1165
• fix: log instead of error out on live mode source-level error by @georgeh0 in #1156
• fix: auto retry explicitly for OpenAI requests by @georgeh0 in #1172
• fix: compatible with null value during foreach and get field by @georgeh0 in #1174
• docs: clarify pool limit for Supabase by @georgeh0 in #1175

Full Changelog: v0.2.17...v0.2.18

v0.2.17

What's Changed

• Python SDK improvement
  • Support pydantic with field-level description
    • support binding classes on Pydantic Models to CocoIndex Struct by @Davda-James in #1072
    • feat: Add field-level descriptions to FieldSchema by @belloibrahv in #1087
  • fix: auto-apply safe defaults for missing fields in load_engine_object by @princyballabh in #1104
  • feat: implemented str and repr methods for python schema classes by @shresthashim in #1095
• reorganize package structure
  • sources moved to sources subpackage in python sdk by @Davda-James in #1081
  • reafactored functions module in python sdk to subpackage by @Davda-James in #1082
• CLI improvement
  • feat: add --reset flag for setup, update, and server commands by @thisisharsh7 in #1106
  • generate full CLI docs from click's metadata and also added it in precommit hooks by @Davda-James in #1096
  • feat: add pretty error when no flows registered in server command by @thisisharsh7 in #1070
• Documentation updates
  • Update documentation to use cocoindex update --setup main with modu… by @mensonones in #1093
  • docs: setup dev env should happen first, also clarify pre-commit etc. by @georgeh0 in #1097
  • Update documentation to use cocoindex update module_name by @badmonster0 in #1103
• Documentation reorganization
  • organize targets in documentation by @badmonster0 in #1101
  • feat(docs): move built-in source as top level navigation by @TheVijayVignesh in #1119
  • [documentation] source overview by @badmonster0 in #1125
• feat: collect additional counter for number of rows that are being processed for stats by @Davda-James in #1105
• feat: split convert.py into 2 modules engine_object and engine_value along with splitting of tests by @Davda-James in #1120
• Target attachment / Postgres SQL command attachment
  • feat(attachment): support target attachment in the core setup engine by @georgeh0 in #1139
  • feat(attachment): create TargetSpecificAttachmentFactoryBase by @georgeh0 in #1140
  • feat(postgres-sql-attachments): add PostgresSqlAttachment by @georgeh0 in #1141
  • feat(attachment): update tracked states even if no update action needed by @georgeh0 in #1142
  • feat(postgres-sql-attachments): allow multiple statements executed by @georgeh0 in #1143
  • docs(postgres-sql-cmd): add docs for PostgresSqlCommand attachment by @georgeh0 in #1146
  • chore(postgres-sql-cmd): rename by @georgeh0 in #1147
• More comprehensive tests
  • Feature:Add tests for json_schema.rs by @aryasoni98 in #1133
• Isolate logic for states backward compatible into Cargo feature
  • feat: Add legacy-states-v0 Cargo feature for backward compatibility #1076 by @skalwaghe-56 in #1135
• Feat/postgres schema support by @thisisharsh7 in #1138
• Fix: Flatten recursion in SplitRecursively to prevent stack overflow by @siddharthbaleja7 in #1127
• fix(vertexai-retry): retry properly for Vertex AI by @georgeh0 in #1150

New Contributors

• @Davda-James made their first contribution in #1072
• @mensonones made their first contribution in #1093
• @shresthashim made their first contribution in #1095
• @belloibrahv made their first contribution in #1087
• @princyballabh made their first contribution in #1104
• @TheVijayVignesh made their first contribution in #1119
• @aryasoni98 made their first contribution in #1133
• @skalwaghe-56 made their first contribution in #1135
• @siddharthbaleja7 made their first contribution in #1127

Full Changelog: v0.2.16...v0.2.17

v0.2.16

What's Changed

• fix: avoid mypy glitches by @georgeh0 in #1064
• fix: make example paths os-friendly using os.path.join() by @thisisharsh7 in #1066
• fix: make sure a row is reexported on schema change by @georgeh0 in #1069

New Contributors

• @thisisharsh7 made their first contribution in #1066

Full Changelog: v0.2.15...v0.2.16