70% of software engineering articles on arXiv — LLM

LLM Dominance in Software Engineering Publications on arXiv: 70% of New Papers

Since 2022, around 70% of new publications in the software engineering subcategory (cs.SE) on arXiv have focused on large language models (LLM). An analysis of 15,899 articles extracted using the Python package arxivscraper via the arXiv API confirms this trend. Preprints offer timely insights into research directions, as papers appear on the platform just one day after upload, before undergoing full peer review.

arXiv remains a key repository for computer science papers, including those in software engineering. Article metadata makes it possible to track key terms in titles and abstracts case-insensitively.

Analysis of Titles: Popularity Peaks

The share of papers mentioning “LLM” or “large language model” in their titles peaked at the end of 2025. Earlier, in late 2024, the Russian term “large language model” dominated.

• Peak of “Large Language Model”: end of 2024.
• Peak of “LLM”: end of 2025.
• Current level: consistently high, with no signs of decline.

This shift reflects the global move toward English-language abbreviations in scientific publications.

Distribution in Abstracts

LLM terms appear more frequently in abstracts, providing a fuller picture. The percentage of papers featuring “LLM” or “large language model” leveled off at a plateau by the end of 2025.

The chart shows steady growth since 2022, with a peak or plateau in the current period. Assessing any decline will require monitoring through the end of 2026.

Related Terms and Overall Picture

Extended searches in titles revealed the influence of related concepts:

• “llm|large language model”.
• “ai[ ,.)]|artificial intellig” (AI, artificial intelligence).
• “agent” (agents).

Combined analysis of titles and abstracts yields 70% coverage. If the current pace holds, all cs.SE publications could relate to LLMs in 18 months. However, a slowdown to slightly above 70% is expected.

arXiv Policy Changes

In fall 2026, arXiv tightened its rules: survey articles and analytical reports in computer science are now accepted only after peer review by a journal or conference. The reason? An influx of low-quality AI-generated materials.

This could impact preprint dynamics in cs.SE by limiting the volume of LLM papers from automated sources.

Key Takeaways

• 70% of new papers in cs.SE on arXiv relate to LLMs, including AI and agent terms.
• Peak values in titles and abstracts hit in 2024–2025.
• Growth rates point to 100% dominance in 18 months, though likely with a slowdown.
• arXiv is restricting unreviewed surveys due to AI generation.
• Data based on 15,899 articles since 2022 via arxivscraper.

This analysis highlights the shift in software engineering focus toward LLMs—a key trend for mid/senior developers tracking research.

— Editorial Team