CVE-2024-12704 Denial of Service (DoS) in run-llama/llama_index
An attacker can cause a denial of service in the llama_index library by triggering an infinite loop through improper exception handling in streaming methods.
- Exploited in the wild
- Not known
- Login needed
- Not needed
- Attackable
- Over the internet
- Victim action needed
- Not needed
- Fix
- Available
What is CVE-2024-12704?
CVE-2024-12704 is a high-severity denial of service vulnerability in run-llama/llama_index, published on 20 Mar 2025. An attacker can exploit it over the internet without logging in, with no action from the victim.
Official description
A vulnerability in the LangChainLLM class of the run-llama/llama_index repository, version v0.12.5, allows for a Denial of Service (DoS) attack. The stream_complete method executes the llm using a thread and retrieves the result via the get_response_gen method of the StreamingGeneratorCallbackHandler class. If the thread terminates abnormally before the _llm.predict is executed, there is no exception handling for this case, leading to an infinite loop in the get_response_gen function. This can be triggered by providing an input of an incorrect type, causing the thread to terminate and the process to continue running indefinitely.
Weakness: CWE-835
Which versions are affected by CVE-2024-12704?
4 open source packages ship an affected version, including llama-index-core and llama-index. It affects 1 product.
| Package | Affected | Fixed in |
|---|---|---|
llama-index-core PyPI | All versions | 0.12.6 |
llama-index-core PyPI | All versions | 0.12.6 |
llama-index-core PyPI | All versions | 0.12.6 |
llama-index PyPI | All versions to 0.12.5 | None |
Products include Llamaindex Llamaindex.
How do I fix CVE-2024-12704?
Upgrade llama-index-core to 0.12.6 or later.
Upgrade, then put limits on request size, rate and nesting depth so one client cannot exhaust the service. More about Denial of service.
Is CVE-2024-12704 being exploited?
It is not confirmed as exploited in the wild, but public exploit code for CVE-2024-12704 exists.
Other vulnerabilities in run-llama/llama_index
Sources
Also known as GHSA-j3wr-m6xh-64hg, PYSEC-2025-244, PYSEC-2026-1563.