Skip to content
Model infoModelsSnapshot: 15 Oct 2026

Microsoft AI / VALL-E R

VALL-E R

Private zero-shot speech research model that uses phoneme alignment and merged audio codes to improve synthesis robustness and reduce autoregressive steps.

restrictedClosed weightsText-to-speech
Official documentation (opens in a new tab)Reviewed 14 Oct 2026
14 of 27 specification fields collected
Audio sample rates24 kHz waveform representationSee specification notes below
Languages1 listedFull language list in specifications
Input billingNot collectedMicrosoft Research (prerecorded samples)
Output billingNot collectedNo inferred price

Specifications

Provider-documented facts. “Not collected” means we have not verified that field yet, not that the feature is unsupported.

Context / input limit
Not collected

No public product contract verified for this research checkpoint.

Maximum input tokens
Not collected

No public product contract verified for this research checkpoint.

Maximum output
Not collected

No public product contract verified for this research checkpoint.

Reasoning
Not collected

No public product contract verified for this research checkpoint.

Tool calling
Not collected

No public product contract verified for this research checkpoint.

Structured output
Not collected

No public product contract verified for this research checkpoint.

Streaming
Not collected

No public product contract verified for this research checkpoint.

Batch processing
Not collected

No public product contract verified for this research checkpoint.

Fine-tuning
Not collected

No public product contract verified for this research checkpoint.

Parameters
Not collected

No public product contract verified for this research checkpoint.

Knowledge cutoff
Not collected

No public product contract verified for this research checkpoint.

Release date
Not collected

No public product contract verified for this research checkpoint.

Context caching
Not collected

No public product contract verified for this research checkpoint.

Languages
EnglishSource for Languages (opens in a new tab)

Language of the documented trained checkpoint, not a claim of universal language coverage.

Endpoint availability
Private research checkpoint; public samples and paper only. No public inference access planned in the reviewed project statement.Source for Endpoint availability (opens in a new tab)
Voice cloning
SupportedSource for Voice cloning (opens in a new tab)

Research demonstration of synthesis in a reference speaker’s voice; not a customer-accessible voice-cloning product.

Reference audio
Speaker reference recording and its transcript condition target speech synthesis.Source for Reference audio (opens in a new tab)
Research publication
2024-06-12Source for Research publication (opens in a new tab)

First arXiv disclosure of the research family. The reviewed paper may contain later revisions; this is not a commercial release date or a separate variant announcement date.

Architecture
Autoregressive and non-autoregressive Transformers, each with 12 layers, 16 heads, 1,024-dimensional embeddings and 4,096-dimensional feed-forward layers.Source for Architecture (opens in a new tab)
Training dataset
LibriSpeech: 960 hours of transcribed English speech; phoneme alignment uses Montreal Forced Aligner.Source for Training dataset (opens in a new tab)
Training hardware
8 NVIDIA V100 16GB GPUs; 400,000 training steps.Source for Training hardware (opens in a new tab)
Audio sample rates
24 kHz waveform representationSource for Audio sample rates (opens in a new tab)
Audio codec design
EnCodec with eight residual-quantization layers; shallow-code merging and Vocos reconstruction.Source for Audio codec design (opens in a new tab)
Research speech tokenizer rate
75 Hz before code merging; this is not the waveform sample rate.Source for Research speech tokenizer rate (opens in a new tab)
Research controls
Monotonic phoneme-to-acoustic alignment and merged-code decoding.Source for Research controls (opens in a new tab)

Access & pricing

Prices belong to an endpoint and billing tier. A provider listing does not guarantee access for every account or region.

Microsoft Research (prerecorded samples)

Provider source (opens in a new tab)
API model ID
Not collected

No public inference endpoint or model selector.

Access
Read the paper and listen to prerecorded research samples. This is not an interactive model service and does not accept inference requests.
Regions
Not applicable to prerecorded research samples.

Endpoint pricing has not been collected. Check the provider for applicable rates.

Data & enterprise terms

No customer inference service or data-processing policy is established by the research demo.

Caching

Caching can reuse earlier input processing. Availability, lifetime and billing depend on the endpoint. A cache hit still generates a new response.

01 / INITIAL INPUTProcess & retain

The system processes eligible input and retains reusable state.

02 / LATER REQUESTCheck available state

Reuse depends on matching input, session state and the cache policy.

03 / CACHE HITReuse & generate

Reusing state can reduce repeated work. Any charges follow the billing rules below.

Microsoft Research (prerecorded samples)

Not verified

No public endpoint cache contract for this private research model.

How it works
Not collected
Minimum reusable input
Not collected
Lifetime & refresh
Not collected
How to enable it
Not collected
Usage fields
Not collected
Billing rules
Not collected
Limits & data boundaries
Not collected

No verified cache rate for this endpoint. An empty rate is not a zero charge.

Caching reviewed 14 Oct 2026

What the measurements say

No benchmark observations have been added for this model. We do not turn a vendor description into a performance score.

Latency and throughput depend on the host, request size, reasoning settings and load. There is no measured speed or global usage figure in this record.

The record behind the model

Why it is included

The original Microsoft research project explicitly states that it has no plans to provide public access or incorporate this model into a product. The reviewed original project and paper provide no full-model weight release. Open codec/vocoder components and third-party reproductions do not establish access to these original checkpoints.

Classification evidence (opens in a new tab)

Lifecycle dates

Research family first published on arXiv12 Jun 2024Source (opens in a new tab)

Sources reviewed