## Comparing Cross Entropy and KL Divergence Loss

Entropy is the number of bits required to transmit a randomly selected event from a probability distribution. A skewed distribution has a low entropy, whereas …

## Comparing Pre-trained ResNet and MobileNet

Resnet and Mobilenet are the popular pre-trained models for computer visions. Renet is more accurate, while Mobilenet is much smaller in size. In this …

## Network Compression with Depthwise Separable Convolution

One way to achieve network compression is using depthwise separable convolution. Depthwise separable convolution is used in many pre-trained neural networks such as MobileNet, …