ADVANCED // CUSTOM API
MODULE 08 // EFFICIENCY
Batch Processing.
Design batch APIs that efficiently process multiple requests.
BATCH DESIGN
Batch APIs process multiple items in single request, reducing connection overhead and enabling server-side optimization. For ABIS, batching allows analyzing multiple users or events efficiently.
Design decisions: maximum batch size, parallel vs sequential processing, partial failure handling, and result ordering guarantees.
Implement partial success responses. If 3 of 100 items fail, return results for 97 successful items plus error details for 3 failures—don't fail the entire batch.
100
Max Batch Size
Maximum items per request. Balances efficiency with memory and timeout constraints.
PARTIAL
Failure Mode
Return partial results. Don't fail entire batch due to individual errors.
ORDERED
Result Order
Results returned in same order as request. Enables positional correlation.
KNOWLEDGE CHECK // Q08
Why return partial success rather than failing entire batch on individual errors?