Batch backprop with BSP seems to work... interestingly without globally accumulating the weights