- HTTP Request
- URL Parameters
- Example Request
- Response (Success)
- Error Response (Already Processing)
- Error Response (Rate Limited)
- Constraints
- Rate Limiting
- Status Requirements
- Re-ingestion Process
- Use Cases
- Content Updates
- Failed Ingestion
- Improved Processing
- Monitoring Progress
- Impact on Agents
- During Re-ingestion
- After Re-ingestion
- Best Practices
- Scheduling Re-ingestion
- Handling Failures
- Automation
- Error Codes
- See Also
Re-ingest Knowledge Item
Re-runs the ingestion pipeline (extraction, chunking, embedding, indexing) for an existing knowledge item. Useful when the source content has changed or if the initial ingestion failed.
HTTP Request
URL Parameters
Example Request
Response (Success)
Error Response (Already Processing)
Error Response (Rate Limited)
Constraints
Rate Limiting
- Must wait 1 minute between re-ingest requests for the same knowledge item
- This prevents excessive processing and ensures system stability
- The rate limit counter resets after successful completion or failure
Status Requirements
- Cannot re-ingest items that are currently
processing - Can re-ingest items with status:
pending,ready, orfailed - If status is
processing, wait until it completes before attempting re-ingest
Re-ingestion Process
When you trigger re-ingestion:
- Status Reset: Knowledge item status changes to
pending - Chunk Cleanup: Existing chunks in search index are marked for removal
- Queue Job: New ingestion job is queued
- Processing Begins: Status transitions to
processing - Fresh Extraction:
- For URLs: Fetches latest content from the URL
- For Documents: Re-processes the uploaded PDF file
- For Text: Re-processes the stored text
- Re-chunking: Content is chunked again (may produce different chunks)
- Re-embedding: New vector embeddings are generated
- Re-indexing: New chunks replace old ones in search index
- Completion: Status becomes
readyorfailed
Use Cases
Content Updates
When the source content has changed:
Failed Ingestion
Retry after fixing issues that caused initial failure:
Improved Processing
Take advantage of improved ingestion algorithms:
Monitoring Progress
After triggering re-ingestion, poll the Get Knowledge Item endpoint to monitor progress:
Status progression:
pending→processing→ready(success)pending→processing→failed(error, checkerror_message)
Impact on Agents
During Re-ingestion
- Agents that have this knowledge item attached will continue to use the old chunks during re-ingestion
- No interruption to agent functionality
- RAG retrieval uses the existing chunks until new ones are ready
After Re-ingestion
- Once status becomes
ready, agents automatically start using the new chunks - No need to re-attach the knowledge item to agents
- Immediate availability of updated knowledge
Best Practices
Scheduling Re-ingestion
- URL Sources: Re-ingest periodically (daily, weekly) to keep content fresh
- Document Sources: Re-ingest only when you upload a new version
- Text Sources: Re-ingest only if you’ve updated the content via database
Handling Failures
- Check the
error_messagefield in the response - Fix the underlying issue (e.g., broken URL, corrupted PDF)
- Wait 1 minute for rate limit to reset
- Trigger re-ingest again
Automation
Consider automating re-ingestion for URL-based knowledge items:
Error Codes
See Also
- Get Knowledge Item - Monitor re-ingestion progress
- Create Knowledge Item - Initial ingestion process
- Update Agent - Configure RAG settings
