feat: add opt-in durable library indexing requests - #39184
shatrughnaupadhyay wants to merge 2 commits into
Conversation
|
Thanks for the pull request, @shatrughnaupadhyay! This repository is currently maintained by Once you've gone through the following steps feel free to tag them in a comment and let them know that your changes are ready for engineering review. 🔘 Get product approvalIf you haven't already, check this list to see if your contribution needs to go through the product review process.
🔘 Provide contextTo help your reviewers and other members of the community understand the purpose and larger context of your changes, feel free to add as much of the following information to the PR description as you can:
🔘 Submit a signed contributor agreement (CLA)
If you've signed an agreement in the past, you may need to re-sign. Once you've signed the CLA, please allow 1 business day for it to be processed. 🔘 Get a green buildIf one or more checks are failing, continue working on your changes until this is no longer the case and your build turns green. 🔘 Update the status of your PRYour PR is currently marked as a draft. After completing the steps above, update its status by clicking "Ready for Review", or removing "WIP" from the title, as appropriate. Where can I find more information?If you'd like to get more details on all aspects of the review process for open source pull requests (OSPRs), check out the following resources: When can I expect my changes to be merged?Our goal is to get community contributions seen and reviewed as efficiently as possible. However, the amount of time that it takes to review and merge a PR can vary significantly based on factors such as:
💡 As a result it may take up to several weeks or months to complete a review and merge your PR. |
Adds an opt-in database outbox for library create/rename indexing, post-commit Celery dispatch, bounded document batches and a recovery command. Duplicate deliveries coalesce; failures leave work pending. The feature defaults to disabled.
20 focused CMS tests passed. Disposable MySQL checks passed migration apply/rollback, concurrent requests, duplicate workers and interrupted-task replay. A real Redis outage/recovery check passed with the engine boundary mocked. Ruff, configured Pylint and migration consistency passed.
The worker holds a library row lock during indexing. Per-item writes remain outside that lock; comprehensive stale-write prevention and frontend pending-state handling need further work before activation.