Skip to content
Model infoModelsSnapshot: 15 Oct 2026

IBM / Granite

Granite 13B Chat V2 (2.1.0)

IBM’s conversation and RAG adaptation of the proprietary 2.5T-token Granite 13B base.

availableClosed weightsText generation
Official documentation (opens in a new tab)Reviewed 14 Oct 2026
11 of 20 specification fields collected
Context window8.2K8,192 tokens
Maximum outputNot collectedAwaiting source review
Input billingSee billing notesIBM watsonx.ai dedicated deployment
Output billingSee billing notesAccess and billing notes below

Specifications

Provider-documented facts. “Not collected” means we have not verified that field yet, not that the feature is unsupported.

Context / input limit
8,192 tokensSource for Context / input limit (opens in a new tab)

Combined input and output budget; not an independent maximum output allowance.

Maximum output
Not collected
Reasoning
Not collected
Tool calling
Not collected
Structured output
Not collected
Streaming
Not collected
Batch processing
Not collected
Fine-tuning
Not collected
Knowledge cutoff
Not collected
Release date
2024-02-15Source for Release date (opens in a new tab)

Checkpoint revision 2.1.0. Original V2 was released 2023-11-30; dedicated catalog availability starts 2023-12-01.

Architecture
Decoder-only Transformer; multi-query attention; learned absolute positionsSource for Architecture (opens in a new tab)
Context caching
Not collected
Pretraining tokens
2.5TSource for Pretraining tokens (opens in a new tab)

Pretraining exposure, not a context or serving limit.

Tokenizer
GPT-NeoX 20B tokenizerSource for Tokenizer (opens in a new tab)
Alignment method
Large-scale targeted alignment with synthetic knowledge, skills and style dataSource for Alignment method (opens in a new tab)
Published price
Dedicated model hosting; no pay-as-you-go token rate listedSource for Published price (opens in a new tab)

Hosting is billable. No numeric GPU-hour tariff was verified in this review; no per-question token price is inferred.

Access & pricing

Prices belong to an endpoint and billing tier. A provider listing does not guarantee access for every account or region.

IBM watsonx.ai dedicated deployment

Provider source (opens in a new tab)
API model ID
ibm/granite-13b-chat-v2-curated

Curated catalog identifier, not a drop-in shared text-generation request selector.

Access
Deploy on demand on dedicated hardware. The catalog selector provisions a deployment; inference uses that deployment’s route. Shared pay-as-you-go retirement does not imply this deployment is retired.
Regions
Product, deployment, and region restrictions apply. This record does not imply global availability or residency.
deploymentConfiguration
MAX_SEQUENCE_LENGTH=8192,DTYPE=float16Source for deploymentConfiguration (opens in a new tab)
hardware
At least one A100 or H100 GPU in the reviewed curated catalogSource for hardware (opens in a new tab)
Processing versions
2.1.0 (2024-02-15)Source for Processing versions (opens in a new tab)

Endpoint pricing has not been collected. Check the provider for applicable rates.

Data & enterprise terms

Retention, training use, regional processing and enterprise terms have not been summarized for this endpoint.

Caching

Caching can reuse earlier input processing. Availability, lifetime and billing depend on the endpoint. A cache hit still generates a new response.

01 / INITIAL INPUTProcess & retain

The system processes eligible input and retains reusable state.

02 / LATER REQUESTCheck available state

Reuse depends on matching input, session state and the cache policy.

03 / CACHE HITReuse & generate

Reusing state can reduce repeated work. Any charges follow the billing rules below.

IBM watsonx.ai dedicated deployment

ibm/granite-13b-chat-v2-curated
Not verified
How it works
Not collected
Minimum reusable input
Not collected
Lifetime & refresh
Not collected
How to enable it
Not collected
Usage fields
Not collected
Billing rules
Not collected
Limits & data boundaries
Not collected

No verified cache rate for this endpoint. An empty rate is not a zero charge.

What the measurements say

MMLU (5-shot)

IBM · vendor-reported
57%

IBM model card, checkpoint revision 2.1.0; five-shot evaluation. Do not apply this score to the original 2.0.0 alignment.

Evaluation source (opens in a new tab)

MT-Bench

IBM · vendor-reported
6.92score

IBM model card, checkpoint revision 2.1.0. Vendor-reported multi-turn evaluation, not a live independent ranking.

Evaluation source (opens in a new tab)

Latency and throughput depend on the host, request size, reasoning settings and load. There is no measured speed or global usage figure in this record.

The record behind the model

Why it is included

IBM documents this proprietary product or research checkpoint. Closed-weight status applies to this exact release, not to all Granite models. Public IBM Granite and IBM Research weight inventories were reviewed separately; newer public-weight releases are excluded.

Classification evidence (opens in a new tab)

Lifecycle dates

Dedicated catalog: available1 Dec 2023Source (opens in a new tab)
Original V2 release30 Nov 2023Source (opens in a new tab)

Sources reviewed