Skip to content
Model infoModelsSnapshot: 15 Oct 2026

Microsoft AI / VALL-E X

VALL-E X

Original English–Chinese cross-lingual speech-synthesis model, using source speech and target text to preserve a reference speaker’s voice across languages.

Speech & voice
restrictedClosed weightsText-to-speech
Official documentation (opens in a new tab)Reviewed 14 Oct 2026
13 of 26 specification fields collected
Context windowNot collectedAwaiting source review
Maximum outputNot collectedAwaiting source review
Input billingNot collectedMicrosoft Research (prerecorded samples)
Output billingNot collectedNo inferred price

Specifications

Provider-documented facts. “Not collected” means we have not verified that field yet, not that the feature is unsupported.

Context / input limit
Not collected

No public service contract or verified value for this original research checkpoint.

Maximum input tokens
Not collected

No public service contract or verified value for this original research checkpoint.

Maximum output
Not collected

No public service contract or verified value for this original research checkpoint.

Parameters
Not collected

No public service contract or verified value for this original research checkpoint.

Reasoning
Not collected

No public service contract or verified value for this original research checkpoint.

Tool calling
Not collected

No public service contract or verified value for this original research checkpoint.

Structured output
Not collected

No public service contract or verified value for this original research checkpoint.

Streaming
Not collected

No public service contract or verified value for this original research checkpoint.

Batch processing
Not collected

No public service contract or verified value for this original research checkpoint.

Fine-tuning
Not collected

No public service contract or verified value for this original research checkpoint.

Context caching
Not collected

No public service contract or verified value for this original research checkpoint.

Knowledge cutoff
Not collected

No public service contract or verified value for this original research checkpoint.

Release date
Not collected

No public service contract or verified value for this original research checkpoint.

Input modalities
Text, AudioSource for Input modalities (opens in a new tab)
Output modalities
AudioSource for Output modalities (opens in a new tab)
Languages
English, ChineseSource for Languages (opens in a new tab)

Original paper’s bilingual experiments. Japanese support from third-party reproductions is not attributed to this checkpoint.

Research publication
2023-03-07Source for Research publication (opens in a new tab)

First research-family disclosure on arXiv; reviewed specifications may reflect a later paper revision. Not a commercial or separate variant release date.

Endpoint availability
Research paper and prerecorded samples. No public full-model download or interactive inference service found in reviewed original materials.Source for Endpoint availability (opens in a new tab)
Voice cloning
SupportedSource for Voice cloning (opens in a new tab)

Zero-shot research use of a reference voice, not an available commercial API.

Reference audio
Source-language speech, its transcript, and target-language text.Source for Reference audio (opens in a new tab)
Architecture
Multilingual AR and NAR codec language models; each is a 12-layer Transformer decoder with 1,024 attention and 4,096 feed-forward dimensions.Source for Architecture (opens in a new tab)
Training dataset
LibriLight: approximately 60,000 hours of English speech. WenetSpeech: more than 10,000 hours of Chinese speech.Source for Training dataset (opens in a new tab)
Training hardware
Each codec LM trained on 32 V100 GPUs for 800,000 steps.Source for Training hardware (opens in a new tab)
Audio codec design
EnCodec residual vector quantization, AR generation of the first codebook, then NAR prediction of seven remaining codebooks.Source for Audio codec design (opens in a new tab)
Tokenizer
Unified English/Chinese phoneme inventory from BigCiDian, based on IPA.Source for Tokenizer (opens in a new tab)
Research controls
Language-ID conditioning helps control target-language speaking style and accent.Source for Research controls (opens in a new tab)

Access & pricing

Prices belong to an endpoint and billing tier. A provider listing does not guarantee access for every account or region.

Microsoft Research (prerecorded samples)

Provider source (opens in a new tab)
API model ID
Not collected

No public API model selector.

Access
Read the paper and listen to prerecorded examples. No user-callable inference endpoint established by the reviewed project.
Regions
Not applicable to prerecorded research samples.

Endpoint pricing has not been collected. Check the provider for applicable rates.

Data & enterprise terms

No hosted customer inference or data-retention contract verified.

Caching

Caching can reuse earlier input processing. Availability, lifetime and billing depend on the endpoint. A cache hit still generates a new response.

01 / INITIAL INPUTProcess & retain

The system processes eligible input and retains reusable state.

02 / LATER REQUESTCheck available state

Reuse depends on matching input, session state and the cache policy.

03 / CACHE HITReuse & generate

Reusing state can reduce repeated work. Any charges follow the billing rules below.

Microsoft Research (prerecorded samples)

Not verified

No public service cache contract verified.

How it works
Not collected
Minimum reusable input
Not collected
Lifetime & refresh
Not collected
How to enable it
Not collected
Usage fields
Not collected
Billing rules
Not collected
Limits & data boundaries
Not collected

No verified cache rate for this endpoint. An empty rate is not a zero charge.

Caching reviewed 14 Oct 2026

What the measurements say

No benchmark observations have been added for this model. We do not turn a vendor description into a performance score.

Latency and throughput depend on the host, request size, reasoning settings and load. There is no measured speed or global usage figure in this record.

The record behind the model

Why it is included

Classification is an evidence-based inference for the original research checkpoint: the authors provide papers and prerecorded samples, but no full original model weights or callable service in the reviewed project materials. The Microsoft Hugging Face account lookup also returns no matching model. This does not classify independent implementations or separately released codec components as closed.

Classification evidence (opens in a new tab)

Lifecycle dates

Research family first published on arXiv7 Mar 2023Source (opens in a new tab)

Sources reviewed