Czech Technical University in Prague
Jaroslav BeckCo-founder and CEO · BottleCap AIFounder↗
Researcher · Founder
David Herel
BottleCap AICo-founder and Technical Lead
David Herel studies how to make language models reason more efficiently and learn without losing quality. With Tomáš Mikolov, he proposed “thinking tokens” to give models extra computation before answering, and showed how repeatedly training GPT-2 on its own output can degrade its responses.[1]
Career & education
Current roleBottleCap AIMar 2025-presentCo-founder and Technical Lead
BottleCap AIMar 2025-presentPreviously
National University of Singapore2025-2025Senior Researcher
National University of Singapore2025-2025Education
Work and education history is primarily focused on AI-relevant roles and may not be comprehensive.
Citation Trend
Total citations to scholarly work, including research papers, technical reports, books and theses, as recorded by Google Scholar. Each point is a dated snapshot.
citations102As of Oct 27, '26
citations+23Since last snapshot, Jun 15, '26
References
- Collapse of Self-trained Language Modelsarxiv.org
Herel and Mikolov report GPT-2 degradation and repetitive output after extended self-training.
Based on public sources. If accuracy is important, verify details using the links or references.
For corrections, updates, or requests to remove information, contact us.
Reviewed August 9, 2026 · Checked for accuracy and new information.
