DuoLingo-AutoDiff : In-Database Automatic Differentiation with MLIR
Gutjahr, Kevin; Ruck, Clemens; Schüle, Maximilian E. (2025): DuoLingo-AutoDiff : In-Database Automatic Differentiation with MLIR, in: Bamberg: Otto-Friedrich-Universität, S. 1–8.
Details
- Fakultät/Lehrstuhl
- Autorin(nen)/Autor(en)
- Gutjahr, Kevin
- Verlagsangabe
- Otto-Friedrich-Universität : Bamberg
- Erscheinungsjahr
- 2025
- Quelle/Weitere Ausgabe
- DEEM ’25: Proceedings of the Workshop on Data Management for End-to-End Machine Learning, New York: ACM, 2025, S. 1–8, ISBN: 979-8-4007-1924-0
- Jahr der Erstpublikation
- 2025
- Sprache(n)
- Englisch
- Lizenz
- URN
- Abstract
Forward and reverse mode automatic differentiation evaluate the gradient of a model function efficiently by caching the results of partial derivatives. Just-in-time compilation improves the runtime of automatic differentiation by eliminating function calls and storing partial derivatives in virtual registers. This paper discusses the first open-source implementation of automatic differentiation with MLIR and LingoDB. The evaluation compares optimizations applied to forward and reverse modes. It showed that sub-expressions, that appear frequently within the calculation, will be reused after MLIR performs its optimization. Additionally, reverse mode outperforms forward mode due to less generated code.
- Freie Schlagwort(e)
- Automatic DiferentiationIn-Database Machine LearningQuery CompilationMLIR
- Dokumenttyp
- Konferenzveröffentlichung
- URI
- Datum der Freischaltung
- 26.11.2025
- Projekt(e)