딥러닝의 과학적 이론이 도래할 것이다

--> Statistics > Machine Learning arXiv:2604.21691 (stat) [Submitted on 23 Apr 2026] Title: There Will Be a Scientific Theory of Deep Learning Authors: Jamie Simon , Daniel Kunin , Alexander Atanasov , Enric Boix-Adserà , Blake Bordelon , Jeremy Cohen , Nikhil Ghosh , Florentin Guth , Arthur Jacot , Mason Kamb , Dhruva Karkada , Eric J. Michaud , Berkan Ottlik , Joseph Turnbull View a PDF of the paper titled There Will Be a Scientific Theory of Deep Learning, by Jamie Simon and 13 other authors View PDF HTML (experimental) Abstract: In this paper, we make the case that a scientific theory of deep learning is emerging. By this we mean a theory which characterizes important properties and statistics of the training process, hidden representations, final weights, and performance of neural networks. We pull together major strands of ongoing research in deep learning theory and identify five growing bodies of work that point toward such a theory: (a) solvable idealized settings that provide intuition for learning dynamics in realistic systems; (b) tractable limits that reveal insights into fundamental learning phenomena; (c) simple mathematical laws that capture important macroscopic observables; (d) theories of hyperparameters that disentangle them from the rest of the training process, leaving simpler systems behind; and (e) universal behaviors shared across systems and settings which clarify which phenomena call for explanation. Taken together, these bodies of work share certain broad traits: they are concerned with the dynamics of the training process; they primarily seek to describe coarse aggregate statistics; and they emphasize falsifiable quantitative predictions. We argue that the emerging theory is best thought of as a mechanics of the learning process, and suggest the name learning mechanics. We discuss the relationship between this mechanics perspective and other approaches for building a theory of deep learning, including the statistical and information-theoretic perspectives. In particular, we anticipate a symbiotic relationship between learning mechanics and mechanistic interpretability. We also review and address common arguments that fundamental theory will not be possible or is not important. We conclude with a portrait of important open directions in learning mechanics and advice for beginners. We host further introductory materials, perspectives, and open questions at this http URL . Comments: 41 pages, 6 figures Subjects: Machine Learning (stat.ML) ; Machine Learning (cs.LG) Cite as: arXiv:2604.21691 [stat.ML] (or arXiv:2604.21691v1 [stat.ML] for this version) https://doi.org/10.48550/arXiv.2604.21691 Focus to learn more arXiv-issued DOI via DataCite (pending registration) Submission history From: Daniel Kunin [ view email ] [v1] Thu, 23 Apr 2026 13:58:12 UTC (3,519 KB) Full-text links: Access Paper: View a PDF of the paper titled There Will Be a Scientific Theory of Deep Learning, by Jamie Simon and 13 other authors View PDF HTML (experimental) TeX Source view license Current browse context: stat.ML < prev | next > new | recent | 2026-04 Change to browse by: cs cs.LG stat References & Citations NASA ADS Google Scholar Semantic Scholar export BibTeX citation Loading... BibTeX formatted citation &times; loading... Data provided by: Bookmark Bibliographic Tools Bibliographic and Citation Tools Bibliographic Explorer Toggle Bibliographic Explorer ( What is the Explorer? ) Connected Papers Toggle Connected Papers ( What is Connected Papers? ) Litmaps Toggle Litmaps ( What is Litmaps? ) scite.ai Toggle scite Smart Citations ( What are Smart Citations? ) Code, Data, Media Code, Data and Media Associated with this Article alphaXiv Toggle alphaXiv ( What is alphaXiv? ) Links to Code Toggle CatalyzeX Code Finder for Papers ( What is CatalyzeX? ) DagsHub Toggle DagsHub ( What is DagsHub? ) GotitPub Toggle Gotit.pub ( What is GotitPub? ) Huggingface Toggle Hugging Face ( What is Huggingface? ) ScienceCast Toggle ScienceCast ( What is ScienceCast? ) Demos Demos Replicate Toggle Replicate ( What is Replicate? ) Spaces Toggle Hugging Face Spaces ( What is Spaces? ) Spaces Toggle TXYZ.AI ( What is TXYZ.AI? ) Related Papers Recommenders and Search Tools Link to Influence Flower Influence Flower ( What are Influence Flowers? ) Core recommender toggle CORE Recommender ( What is CORE? ) Author Venue Institution Topic About arXivLabs arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs . Which authors of this paper are endorsers? | Disable MathJax ( What is MathJax? )