Glossary
Key terms and concepts used in AI and MyTokenGate documentation.
AI Model Terms
LLM (Large Language Model)
A type of AI model trained on vast amounts of text data to understand and generate human-like text. Examples include GPT-4, Claude, and Llama.
Token
The basic unit of text processing in LLMs. Approximately:
- 1 token ≈ 4 characters in English
- 1 token ≈ 0.75 words
- Token count varies by language
Context Window
The maximum amount of text (in tokens) that a model can process in a single request. Larger windows allow for longer conversations and documents.
Temperature
A parameter (0-2) controlling output randomness:
- 0: Deterministic, consistent outputs
- 0.7: Balanced creativity
- 1.5+: High randomness, creative outputs
Embeddings
Vector representations of text that capture semantic meaning. Used for similarity search, clustering, and retrieval.
API Terms
Chat Completion
An API endpoint for conversational AI interactions. Sends a list of messages and receives a model-generated response.
Streaming
A method of receiving responses piece by piece in real-time, rather than waiting for the complete response.
Function Calling
A feature allowing models to call external functions/tools during response generation.
Rate Limiting
Restrictions on the number of API requests within a time period to prevent abuse and ensure fair usage.
MyTokenGate Terms
API Key
A unique identifier used to authenticate API requests. Keep it secure and never share it publicly.
Base URL
The API endpoint address: https://gateway.mytokengate.com/v1
Model Router
MyTokenGate’s intelligent routing system that directs requests to the appropriate AI provider.
Billing Meter
Real-time tracking of token usage for cost calculation and invoicing.
Protocol Terms
OpenAI Protocol
The API format originally defined by OpenAI, now an industry standard. Used by many AI services for compatibility.
Anthropic Protocol
Claude’s native API format (Messages API). Supports advanced features like tool use and extended thinking.