Stochastic Sparse Backpropagation
Investigating whether training can preserve model quality while reducing backward-pass computation. The project compares dense training with stochastic gradient selection, block sparsity, pruning-based child networks, and dynamic subnetwork refresh strategies.
- Dense forward passes with selective backward updates
- MLP and CNN benchmarks
- Accuracy, time, memory, and compute analysis