Fortinet white logo
Fortinet docs logo DOCUMENT LIBRARY
Fortinet white logo
Fortinet docs logo DOCUMENT LIBRARY
Products Best Practices Hardware Guides Products A-Z
Summary
By Solution
By 4D Pillars
By Cloud
Secure Networking
Unified SASE
Security Operations
Secure SD-WAN
Secure Access Service Edge (SASE)
ZTNA
LAN Edge
Identity and Access Management
Next Generation Firewall
Public Cloud
Private Cloud
FortiCloud
Secure Networking
  • Hybrid Mesh Firewall
  • NOC Management
  • LAN
  • WAN
    • More >>
    Unified SASE
  • Single Vendor SASE
  • Cloud Network Security
  • Secure Endpoint Connectivity
  • Web Application / API Protection
    • More >>
    Security Operations
  • Security Operations Automation
  • Identity
  • Early Detection & Prevention
    • More >>
    Secure Networking
  • Hybrid Mesh Firewall
  • NOC Management
  • LAN
  • WAN
  • Communication & Surveillance
    • Unified SASE
  • Single Vendor SASE
  • Secure Endpoint Connectivity
  • Cloud Network Security
  • Cloud-Native Security
  • Web Application / API Protection
    • Security Operations
  • Security Operations Automation
  • Endpoint
  • Data Protection
  • Identity
  • Email
  • Early Detection & Prevention
  • Expert Services
  • Edge Firewall
  • Orchestration & management
  • SD Branch
  • Application Delivery
  • Single Vendor SASE
  • Secure Endpoint Connectivity
  • Secure Private Access
  • Thin Edge
  • Identity
  • Application Gateway
  • Enterprise Asset Management
  • Endpoint Agent
  • Agentless Security Posture
  • Identity
  • Wireless
  • Switching
  • Identity
  • Privilege Acccess Management
  • Next Generation Firewall
  • Orchestration & management
  • Expert Services
  • All
  • All
  • Account Management
  • SAAS Management
  • SAAS Application Security
  • Managed Services
  • Platform as a service (PAAS)
  • Other SAAS Services
    • 4D Resources
    Solution Hubs
  • 4D Pillars
  • Cloud
  • Popular Solutions

    • Administration Guide

    Home FortiManager 7.6.1 Administration Guide
    7.6.1
    7.6.1
    7.6.0
    7.4.5
    7.4.4
    7.4.3
    7.4.2
    7.4.1
    7.4.0
    7.2.8
    7.2.7
    7.2.6
    7.2.5
    7.2.4
    7.2.3
    7.2.2
    7.2.1
    7.2.0
    7.0.13
    7.0.12
    7.0.11
    7.0.10
    7.0.9
    7.0.8
    7.0.7
    7.0.6
    7.0.5
    7.0.4
    7.0.3
    7.0.2
    7.0.1
    7.0.0
    6.4.15
    6.4.14
    6.4.13
    6.4.12
    6.4.11
    6.4.10
    6.4.9
    6.4.8
    6.4.7
    6.4.6
    6.4.5
    6.4.4
    6.4.3
    6.4.2
    6.4.1
    6.4.0
    6.2.13
    6.2.12
    6.2.11
    6.2.10
    6.2.9
    6.2.8
    6.2.7
    6.2.6
    6.2.6
    6.2.5
    6.2.3
    6.2.2
    6.2.1
    6.2.0
    6.0.12
    6.0.11
    6.0.10
    6.0.9
    6.0.8
    6.0.7
    6.0.6
    6.0.5
    6.0.4
    6.0.3
    6.0.2
    6.0.1
    6.0.0
    5.6.11
    5.6.10
    5.6.9
    5.6.8
    5.6.7
    5.6.6
    5.6.5
    5.6.4
    5.6.3
    5.6.2
    5.6.1
    5.6.0
    5.4.7
    5.4.6
    5.4.5
    5.4.4
    5.4.3
    5.4.2
    5.4.1
    5.4.0
    5.2.10
    5.2.7
    5.2.6
    5.2.4
    5.2.3
    5.2.2
    5.2.1
    5.2.0
    5.0.12
    5.0.11
    5.0.10
    5.0.9
    5.0.8
    5.0.7
    5.0.6
    5.0.5
    5.0.4
    5.0.3
    5.0.2
    4.3.8
    4.3.7
    4.3.6
    4.3.5
    4.3.4
    4.3.3
    4.3.2
    4.3.1
    4.3.0
    4.2.9
    4.2.8
    4.2.7
    4.2.6
    4.2.5
    4.2.4
    4.2.3
    4.2.2
    4.2.1
    4.2.0
    4.1.0
    4.0.3
    4.0.2
    4.0.1
    4.0.0

    FortiAI tokens

    FortiAI tokens

    When FortiManager is licensed for FortiAI, the license will include a monthly entitlement for tokens that is shared by all FortiAI users.

    How token usage is calculated

    Tokens are used in large language models (LLMs) to process text and quantify usage. Tokens usage is calculated using the following guidelines:

    • When you use the FortiAI assistant, the text in both the prompt (input) and the response (output) is processed as tokens.

    • While there is not a one-to-one relationship between words or characters and tokens, in general, more text in the query and response means using more tokens.

    • Because the FortiAI assistant uses session history to inform it's responses, queries that are a part of a long session will use more tokens than new conversations.

    Best practices

    To ensure you are using your monthly allocation of tokens effectively, consider implementing best practices for FortiAI users. For example:

    • Make your prompts concise and specific. In terms of token usage, the prompt "Can you please help me create a firewall address for 10.0.0.1 and another one for the domain awesome-domain.com?" is less effective than "Create firewall addresses for 10.0.0.1 and awesome-domain.com".

    • Use filters in your prompts to receive concise and specific responses. For example, say that you want to create a site-to-site VPN based on an uploaded topology image.

    • Use words that relate to functions existing in FortiManager. For example, using "quarantine device" concisely tells the FortiAI assistant what action is required.

    • Reference details in the existing thread when possible. This reduces redundancy and allows you to be concise and specific as you build upon previous prompts. However, note that the FortiAI assistant will not remember previous threads.

    Viewing token usage

    The monthly token usage is displayed at the bottom of the FortiAI pane in FortiManager. Mouse over the Monthly token usage % to view the following in a tooltip:

    • Current Chat Session Token Usage

    • Current Monthly Token Usage

    • Total Monthly Entitled Tokens

    Previous
    Next

    FortiAI tokens

    FortiAI tokens

    When FortiManager is licensed for FortiAI, the license will include a monthly entitlement for tokens that is shared by all FortiAI users.

    How token usage is calculated

    Tokens are used in large language models (LLMs) to process text and quantify usage. Tokens usage is calculated using the following guidelines:

    • When you use the FortiAI assistant, the text in both the prompt (input) and the response (output) is processed as tokens.

    • While there is not a one-to-one relationship between words or characters and tokens, in general, more text in the query and response means using more tokens.

    • Because the FortiAI assistant uses session history to inform it's responses, queries that are a part of a long session will use more tokens than new conversations.

    Best practices

    To ensure you are using your monthly allocation of tokens effectively, consider implementing best practices for FortiAI users. For example:

    • Make your prompts concise and specific. In terms of token usage, the prompt "Can you please help me create a firewall address for 10.0.0.1 and another one for the domain awesome-domain.com?" is less effective than "Create firewall addresses for 10.0.0.1 and awesome-domain.com".

    • Use filters in your prompts to receive concise and specific responses. For example, say that you want to create a site-to-site VPN based on an uploaded topology image.

    • Use words that relate to functions existing in FortiManager. For example, using "quarantine device" concisely tells the FortiAI assistant what action is required.

    • Reference details in the existing thread when possible. This reduces redundancy and allows you to be concise and specific as you build upon previous prompts. However, note that the FortiAI assistant will not remember previous threads.

    Viewing token usage

    The monthly token usage is displayed at the bottom of the FortiAI pane in FortiManager. Mouse over the Monthly token usage % to view the following in a tooltip:

    • Current Chat Session Token Usage

    • Current Monthly Token Usage

    • Total Monthly Entitled Tokens

    Previous
    Next