Logos DX
    Preparing search index...

    Class RateLimitTokenBucket

    Token bucket implementation of rate limiting with optional persistence support.

    // Basic usage
    const bucket = new RateLimitTokenBucket({
        capacity: 10,
        refillIntervalMs: 1000
    });

    bucket.consume();
    bucket.consume();

    const rateLimited = async () => {
        // 0 ms if tokens are available
        // 1000 / 10 = 100 ms if tokens are not available
        await bucket.waitAndConsume();
        return 'success';
    }

    // With persistence (e.g., Redis backend)
    const bucket = new RateLimitTokenBucket({
        capacity: 100,
        refillIntervalMs: 60000,
        save: async (state) => {
            await redis.set('rate-limit:user:123', JSON.stringify(state));
        },
        load: async () => {
            const data = await redis.get('rate-limit:user:123');
            return data ? JSON.parse(data) : undefined;
        }
    });

    // Load state from backend before using
    await bucket.load();

    // Check and consume
    if (bucket.hasTokens()) {
        bucket.consume();
        await bucket.save();
    }
    Index

    Constructors

    constructor

    Properties

    capacity refillIntervalMs

    Accessors

    isSaveable snapshot state tokens

    Methods

    consume getNextAvailable getWaitTimeMs hasTokens load reset save waitAndConsume waitForToken

    Constructors

    Properties

    capacity: number
    refillIntervalMs: number

    Accessors

    • get snapshot(): {
          averageWaitTime: number;
          capacity: number;
          createdAt: number;
          currentTokens: number;
          refillIntervalMs: number;
          rejectedRequests: number;
          rejectionRate: number;
          successfulRequests: number;
          totalRequests: number;
          totalWaitTime: number;
          uptime: number;
          waitCount: number;
      }

      Get a snapshot of current statistics and state.

      Returns {
          averageWaitTime: number;
          capacity: number;
          createdAt: number;
          currentTokens: number;
          refillIntervalMs: number;
          rejectedRequests: number;
          rejectionRate: number;
          successfulRequests: number;
          totalRequests: number;
          totalWaitTime: number;
          uptime: number;
          waitCount: number;
      }

      Object containing usage statistics and current state

    Methods

    • Check if there are enough tokens available without consuming them.

      Parameters

      • count: number = 1

        Number of tokens to check for (default: 1)

      Returns boolean

      true if tokens are available, false otherwise

      if (bucket.hasTokens()) {
          // We're within rate limit, proceed
          bucket.consume();
      }

    • Waits for tokens to be available and consumes them atomically.

      Parameters

      • count: number = 1
      • opts: {
            abortController?: AbortController;
            jitterFactor?: number;
            onRateLimit?: (error: RateLimitError, nextAvailable: Date) => void;
        } = {}

      Returns Promise<boolean>

      const bucket = new RateLimitTokenBucket({
          capacity: 10,
          refillIntervalMs: 1000
      });

      await bucket.waitAndConsume(() => {
          console.log('Rate limit exceeded');
      });
      console.log('Token acquired and consumed');

    • Waits for the next token to be available before allowing the caller to proceed.

      Parameters

      • count: number = 1
      • opts: {
            abortController?: AbortController;
            jitterFactor?: number;
            onRateLimit?: (error: RateLimitError, nextAvailable: Date) => void;
        } = {}

      Returns Promise<void>

      const bucket = new RateLimitTokenBucket({
          capacity: 10,
          refillIntervalMs: 1000
      });

      await bucket.waitForToken(() => {
          console.log('Rate limit exceeded');
      });
      console.log('Token available');

      bucket.consume();
      console.log('Token consumed');

    Settings

    Member Visibility

    On This Page

    Constructors
    Properties
    Accessors
    Methods