Of course, there is a trade-off between accuracy and size. As we reduce the size, its accuracy drops (check the video).But in most cases, accuracy is not the only metric we optimize.Instead, several operational metrics like efficiency, memory, etc., are the key factors. https://t.co/zoivU2E627 ...

I removed 74% of neurons from a neural network.It dropped the accuracy by just 0.50%.Here's a breakdown (with code): ...