Comunica HTTP Rate Limit Actor

An HTTP actor that performs rate limiting, by spacing out future requests based on past request durations, in an attempt to match the number of requests sent per second to the number of responses served per second by the server. By default, the actor waits for the first request to fail for a given host prior to spacing out requests.

This module is part of the Comunica framework, and should only be used by developers that want to build their own query engine.

Click here if you just want to query with Comunica.

Install

$ yarn add @comunica/actor-http-limit-rate

Configure

After installing, this package can be added to your engine's configuration as follows:

{
  "@context": [
    "https://linkedsoftwaredependencies.org/bundles/npm/@comunica/actor-http-limit-rate/^5.0.0/components/context.jsonld"
  ],
  "actors": [
    {
      "@id": "urn:comunica:default:http/actors#limit-rate",
      "@type": "ActorHttpLimitRate"
    }
  ]
}

Config Parameters

• mediatorHttp: A mediator over the HTTP bus.
• httpInvalidator: A mediator over the HTTP invalidate bus.
• correctionMultiplier: How aggressively the request interval should follow the latest response time. Defaults to 0.1.
• failureMultiplier: The response time of a failed request is taken into account with this multiplier applied. Defaults to 10.0.
• limitByDefault: Whether the actor should do rate limiting by default, already before a request fails. Defaults to false.
• allowOverlap: Whether the actor should allow overlapping requests to be sent to the server when rate limiting is applied. Defaults to false.