AI Prompt Template Configuration

Parameters

See plugin common configurations for configuration options available to all plugins.

• templates — array[object] · required

  An array of templates.

  • name — string · required

    Name of the template. When requesting the route, the request should include the template name that corresponds to the configured template.

  • template — object · required

    Template specification.

    • model — string · optional

      Name of the LLM model, such as gpt-4 or gpt-3.5. See your LLM provider API documentation for more available models.

    • messages — array[object] · optional

      Template message specification.

      • role — string · required

        Valid values: system, user, or assistant

        Role of the message.

      • content — string · required

        Content of the message (prompt).

• max_req_body_size — integer · optional · default: 67108864

  Valid values: greater than or equal to 1

  Maximum request body size in bytes buffered into memory. Larger request bodies are rejected with HTTP 400 before template processing. Introduced in API7 Enterprise 3.9.17 and 3.10.4, and APISIX 3.18.0.