/ IBM / Granite 13B Instruct V2 IBM / Granite
Granite 13B Instruct V2 IBM’s instruction-following adaptation of the proprietary 2.5T-token Granite 13B base.
retired Closed weights Text generation
Context window 8.2K 8,192 tokens
Maximum output Not collected Awaiting source review
Input billing Not collected IBM watsonx.ai (withdrawn)
Output billing Not collected No inferred price
Specifications Access & pricing Caching Evaluation Sources & lifecycle
Specifications Provider-documented facts. “Not collected” means we have not verified that field yet, not that the feature is unsupported.
Maximum output Not collected
Reasoning Not collected
Tool calling Not collected
Structured output Not collected
Streaming Not collected
Batch processing Not collected
Fine-tuning Not collected
Knowledge cutoff Not collected
Context caching Not collected Published price Not collected No current inference price: the reviewed hosted route has been withdrawn.
Access & pricing Prices belong to an endpoint and billing tier. A provider listing does not guarantee access for every account or region.
API model ID ibm/granite-13b-instruct-v2
Access Historical API identity. Not a currently callable endpoint; installed product versions may have separate lifecycle policies.
Regions Product, deployment, and region restrictions apply. This record does not imply global availability or residency. Endpoint pricing has not been collected. Check the provider for applicable rates.
Data & enterprise terms Retention, training use, regional processing and enterprise terms have not been summarized for this endpoint.
Caching Caching can reuse earlier input processing. Availability, lifetime and billing depend on the endpoint. A cache hit still generates a new response.
01 / INITIAL INPUT Process & retain The system processes eligible input and retains reusable state.
02 / LATER REQUEST Check available state Reuse depends on matching input, session state and the cache policy.
03 / CACHE HIT Reuse & generate Reusing state can reduce repeated work. Any charges follow the billing rules below.
IBM watsonx.ai (withdrawn) ibm/granite-13b-instruct-v2Not verified
How it works Not collected
Minimum reusable input Not collected
Lifetime & refresh Not collected
How to enable it Not collected
Usage fields Not collected
Billing rules Not collected
Limits & data boundaries Not collected No verified cache rate for this endpoint. An empty rate is not a zero charge.
What the measurements say
MMLU (5-shot) IBM · vendor-reported 45.3% IBM model card, V2 instruction checkpoint dated 17 November 2023; five-shot evaluation.
Evaluation source (opens in a new tab) Latency and throughput depend on the host, request size, reasoning settings and load. There is no measured speed or global usage figure in this record.
The record behind the model Why it is included IBM documents this proprietary product or research checkpoint. Closed-weight status applies to this exact release, not to all Granite models. Public IBM Granite and IBM Research weight inventories were reviewed separately; newer public-weight releases are excluded.
Classification evidence (opens in a new tab) Lifecycle dates Sources reviewed 