nltk
Affected
- introduced
3.6, fixed3.10.4(ecosystem)
Fixed versions
3.10.4
Fix
- Fixed version
3.10.4pip install --upgrade nltk==3.10.4
Advisory
Also known as: CVE-2026-126301
NLTK: Quadratic CPU exhaustion in LegalitySyllableTokenizer.tokenize via unguarded onset reversal loop
Summary
LegalitySyllableTokenizer.tokenize in the NLTK tokenizer package contains an unguarded O(n^2) processing loop. When the method is called on a single token that consists of a long run of vowels (for example "a" * n), it consumes CPU time proportional to the square of the token length. An attacker who can supply an untrusted token to this public tokenizer API can force a single request to saturate one CPU core for a prolonged period, degrading availability of any service that syllabifies attacker-controlled text. No authentication, special configuration, or user interaction is required.
Root Cause
The method walks the token in reverse and, on every iteration after the first vowel is seen, evaluates the membership test char_lower + current_onset[::-1] in self.legal_onsets. The set legal_onsets is built by onset(), which returns only the characters up to the first vowel, so every member is vowel-free. For an all-vowel token the first branch can therefore never match, onset never becomes True, and the reset branch that would clear current_onset is never reached. As a result current_onset grows by one character on every iteration. Building current_onset[::-1] and hashing the resulting string costs O(k) on iteration k, and this is repeated for k from 1 to n, giving total cost O(n^2). The security invariant that is violated is bounded per-token work: there is no length cap on this code path, so untrusted token length translates directly into quadratic CPU consumption.
Affected function: LegalitySyllableTokenizer.tokenize
Source: nltk/tokenize/legality_principle.py (membership-test sink at line 133; loop over token[::-1] beginning at line 126)
Helper establishing the vowel-free onset set: LegalitySyllableTokenizer.onset (nltk/tokenize/legality_principle.py, returns prefix up to first vowel)
Impact
An attacker who controls a token passed to LegalitySyllableTokenizer.tokenize can trigger quadratic CPU work. In the reviewed release a token of roughly 64,000 vowel characters takes about 1.8 seconds on a single core, and the cost grows with the square of the length, so a token in the hundreds of kilobytes to megabyte range consumes a core for many seconds to minutes. Memory use is linear. The demonstrated capability is single-core CPU exhaustion leading to denial of service or latency degradation in any network-reachable component that syllabifies untrusted input. There is no confidentiality or integrity impact; the effect is availability degradation of the affected process. The plausible operational consequence, where multiple concurrent requests are used, is exhaustion of the available worker pool; this is inferred from the per-request cost and was not itself executed against a live deployment.
Proof of Concept
Requires only the released nltk package; no corpus download is needed because the quadratic behavior is driven entirely by the attacker token, not by the size of the legal-onset set.
tokenize with an all-vowel token of increasing length and time each call.import time
from nltk.tokenize import LegalitySyllableTokenizer
tok = LegalitySyllableTokenizer("tr c d".split()) # tiny 3-word onset source
for n in (8000, 16000, 32000):
payload = "a" * n
start = time.perf_counter()
tok.tokenize(payload)
print("vowel-run", n, round(time.perf_counter() - start, 3))
control = "ba" * 32000 # equal-length linear control
start = time.perf_counter()
tok.tokenize(control)
print("control", 64000, round(time.perf_counter() - start, 3))
vowel-run 8000 0.031
vowel-run 16000 0.120
vowel-run 32000 0.468 (about 4x per doubling => O(n^2))
control 64000 0.004 (linear, roughly 130x faster at larger size)
Attack Chain
LegalitySyllableTokenizer is exported from nltk.tokenize and tokenize is a public, documented method reachable by any service that syllabifies untrusted text.token argument, including its length and character content; a run of vowels such as "a" * n survives with no normalization or length reduction.nltk/tokenize/legality_principle.py:126 and reaches the membership-test at line 133 on every iteration past the first vowel.SyllableTokenizer received a MAX_TOKEN_LEN cap during the project hardening work, but legality_principle.py received no such guard.current_onset[::-1] inside the loop yields cumulative O(n^2) CPU work.Bypass Evidence
No guard blocks this path. Membership-set analysis shows the first branch at line 133 cannot fire for a vowel character because legal_onsets is provably vowel-free (it is derived from onset(), which stops at the first vowel), so onset never becomes True and current_onset is never reset. The strongest refutations were attempted and failed: (1) the hypothesis that the quadratic depends on a large or specific onset corpus was disproven by reproducing the same O(n^2) growth with a three-word onset source, showing the cost is driven solely by the attacker token; (2) the hypothesis that an upstream length cap neutralizes long tokens was disproven by direct source inspection, which found no MAX_TOKEN_LEN or equivalent clamp on this class and confirmed the default word-tokenization path does not call this class; (3) the hypothesis that this is covered by existing hardening was disproven, since the project quadratic-DoS test suite exercises the sibling SyllableTokenizer but contains no test for LegalitySyllableTokenizer, and no commit added a cap to this file. This is a fix-missed sibling of the accepted algorithmic-complexity class, not a previously remediated issue.
Affected Versions
Ecosystem: pipPackage: nltkConfirmed affected range: >= 3.6, <= 3.10.3Latest release checked: 3.10.3 (PyPI)Fix status: not fixedThe vulnerable loop is present and unguarded in the current released artifact 3.10.3, verified by direct source inspection and by reproducing the quadratic curve. The lower bound of 3.6 reflects when the affected module first shipped; the disclosure-relevant fact is that the latest published release is affected and no fix has been released.
Suggested Fix
Enforce a bound on per-token work in LegalitySyllableTokenizer.tokenize, consistent with the MAX_TOKEN_LEN guard already applied to the sibling SyllableTokenizer. Options include rejecting or truncating tokens above a configurable maximum length before the reverse walk, or restructuring the onset accumulation so the loop does not repeatedly build and hash a growing reversed string (for example by maintaining the onset in its final orientation and comparing without an O(k) reversal each iteration). The remediation should cover any caller that passes untrusted tokens, not just the default word-tokenization path. As an interim mitigation, deployments that expose syllabification of untrusted input can cap request and token sizes at the application boundary to bound the worst-case token length.
Medium Basis: The source's own band: MODERATE
3.6, fixed 3.10.4 (ecosystem)3.10.4
3.10.4pip install --upgrade nltk==3.10.4Fix commands are the export's own generic commands. Ojuju never runs them. Check them against your setup first.
Check your own computer: guard packages check
Source: GitHub Advisory Database (reviewed advisories) · CC BY 4.0