TY - CPAPER TI - DuoLingo-AutoDiff : In-Database Automatic Differentiation with MLIR AU - Gutjahr, Kevin AU - Ruck, Clemens AU - Schüle, Maximilian E. PY - 2025 SP - 1-8 PB - Otto-Friedrich-Universität CY - Bamberg UR - https://fis.uni-bamberg.de/handle/uniba/111827 LA - eng AB - Forward and reverse mode automatic differentiation evaluate the gradient of a model function efficiently by caching the results of partial derivatives. Just-in-time compilation improves the runtime of automatic differentiation by eliminating function calls and storing partial derivatives in virtual registers. This paper discusses the first open-source implementation of automatic differentiation with MLIR and LingoDB. The evaluation compares optimizations applied to forward and reverse modes. It showed that sub-expressions, that appear frequently within the calculation, will be reused after MLIR performs its optimization. Additionally, reverse mode outperforms forward mode due to less generated code. KW - Automatic Diferentiation KW - In-Database Machine Learning KW - Query Compilation KW - MLIR ER - TY - CPAPER TI - DuoLingo-AutoDiff : In-Database Automatic Differentiation with MLIR AU - Gutjahr, Kevin AU - Ruck, Clemens AU - Schüle, Maximilian E. PY - 2025 T2 - DEEM '25: Proceedings of the Workshop on Data Management for End-to-End Machine Learning SP - 1-8 PB - ACM CY - New York SN - 979-8-4007-1924-0 DO - 10.1145/3735654.3735943 UR - https://fis.uni-bamberg.de/handle/uniba/111824 LA - eng AB - Forward and reverse mode automatic differentiation evaluate the gradient of a model function efficiently by caching the results of partial derivatives. Just-in-time compilation improves the runtime of automatic differentiation by eliminating function calls and storing partial derivatives in virtual registers. This paper discusses the first open-source implementation of automatic differentiation with MLIR and LingoDB. The evaluation compares optimizations applied to forward and reverse modes. It showed that sub-expressions, that appear frequently within the calculation, will be reused after MLIR performs its optimization. Additionally, reverse mode outperforms forward mode due to less generated code. KW - Automatic Diferentiation KW - In-Database Machine Learning KW - Query Compilation KW - MLIR ER - TY - CPAPER TI - Teaching Blue Elephants the Maths for Machine Learning AU - Ruck, Clemens AU - Schüle, Maximilian Emanuel PY - 2023 T2 - DEEM '23: Proceedings of the Seventh Workshop on Data Management for End-to-End Machine Learning SP - 1-4 PB - ACM SN - 979-8-4007-0204-4 DO - 10.1145/3595360.3595852 UR - https://fis.uni-bamberg.de/handle/uniba/94682 LA - eng ER -