friedrich/fastapi-interface
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Add Request size handling #7

Merged
friedrich merged 1 commit from feature/load-safety into main 2026-03-10 14:11:58 +00:00
Conversation 0 Commits 1 Files changed 3 +31 -3
friedrich commented 2026-03-10 14:11:53 +00:00
Owner
Copy link

Should improve robustness of API, as amount of supplied document is now limited to 128 for embedding, 64 for reranking. Numbers chosen more or less arbitrary, but seem sensible for now.
Could improve on this specifically and add further global limits (like max_tokens or similar).

Should improve robustness of API, as amount of supplied document is now limited to 128 for embedding, 64 for reranking. Numbers chosen more or less arbitrary, but seem sensible for now. Could improve on this specifically and add further global limits (like max_tokens or similar).
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No labels
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
friedrich/fastapi-interface!7
No description provided.