We're excited to announce Task Rate Limits! This new feature allows you to set maximum dispatch rates for tasks to your applications, with limits ranging from 1 to 500 tasks per second or minute.
Task Rate Limits are implemented to help avoid overloading applications with an excessive number of tasks simultaneously. By leveraging a sliding log algorithm, Mergent accurately maintains the dispatch rate within the defined limits across any given time window.
Rate limits can be adjusted anytime via the Mergent Dashboard, enabling developers to dynamically manage application throughput based on current performance and workload expectations.
Default Configuration: The default rate limit is set to 500 tasks per second per project.
This feature is available in beta today, and we'll be collecting feedback and data for further improvements. Let us know what you think.
Head over to the task rate limits docs to learn more.