Task-Centric Job Scheduling Method and System for Heterogeneous Clusters

A computer-implemented scheduling method for accelerator hardware includes using a computational graph that splits jobs to be executed by the accelerator hardware into atomic compute tasks, using a scheduler to individually schedule and/or migrate each task for execution to different machines and/or accelerators at job runtime, and using a computer daemon to allocate memory and execute kernels for each task on the respective machines and/or accelerators.