![Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names](https://gombru.github.io/assets/cross_entropy_loss/intro.png)
Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names
![machine learning - Is this formula of cross entropy for a single example i with C classes correctly written? - Stack Overflow machine learning - Is this formula of cross entropy for a single example i with C classes correctly written? - Stack Overflow](https://i.stack.imgur.com/fH0Ns.png)
machine learning - Is this formula of cross entropy for a single example i with C classes correctly written? - Stack Overflow
![Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names](https://gombru.github.io/assets/cross_entropy_loss/softmax_CE_pipeline.png)
Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names
![Gradient Descent Update rule for Multiclass Logistic Regression | by adam dhalla | Artificial Intelligence in Plain English Gradient Descent Update rule for Multiclass Logistic Regression | by adam dhalla | Artificial Intelligence in Plain English](https://miro.medium.com/v2/resize:fit:1400/1*Mzzn_QRfy2K8MMTl0_2phw.png)
Gradient Descent Update rule for Multiclass Logistic Regression | by adam dhalla | Artificial Intelligence in Plain English
![Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names](https://gombru.github.io/assets/cross_entropy_loss/multiclass_multilabel.png)
Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names
![references - What is the history of the "cross entropy" as a loss function for neural networks? - Cross Validated references - What is the history of the "cross entropy" as a loss function for neural networks? - Cross Validated](https://i.stack.imgur.com/9gzfQ.png)
references - What is the history of the "cross entropy" as a loss function for neural networks? - Cross Validated
![Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names](https://gombru.github.io/assets/cross_entropy_loss/sigmoid_CE_pipeline.png)