Schedgehammer: Auto-tuning Compiler Optimizations beyond Numerical Parameters

Lenfers, Johannes; Spehr, Sven; Dieckmann, Justus; Jansen, Johannes; Lücke, Martin Paul; Gorlatch, Sergei

Abstract

This paper introduces Schedgehammer, a general-purpose auto-scheduling framework that optimizes program execution across diverse compiler infrastructures. Unlike existing auto-schedulers that are tightly coupled to specific intermediate representations or rely on template-based search, Schedgehammer provides a generic, reusable framework for optimization schedules by modeling them as graph-structured objects. This approach captures dependencies among transformations and parameters across compilers, enabling systematic mutation and validation. We demonstrate Schedgehammer’s flexibility on TVM and TACO, showing that it effectively optimizes dense and sparse computations. Across benchmarks, it achieves performance comparable to specialized auto-schedulers such as Ansor, highlighting that a unified, extensible abstraction can generalize scheduling beyond individual compiler ecosystems.