0
In machine learning, entropic loss is a specific kind of loss function. A loss function measures the error between the predicted results and the desired results. Entropic loss uses the logistic function to show the error (or "loss") between the true answer and the predicted answer.
A general loss function is defined here:
Lφ= ∫ (φ(z) - y)dz, where the bounds of the integral are φ-1(y) (on the bottom) and φ-1(yhat) (on the top). yhat is the estimated (predicted) result, and y is the desired result.
The entropic loss function is defined here:
Lφ= ∫ (1/(1 + exp(-z)) - y)dz
As you can see, the entropic loss is a specific instance of a loss function. All I've done is I've chosen my loss function φ(z) to be the logistic function.
The logistic function is a common choice because it is a convex function, and therefore has only one local minimum (therefore it is also the global minimum). When we try to minimize loss, we want only one minimum so that when we set the derivative to zero, we know we've found what we want.
Wiki User
∙ 12y ago
Add your answer:
Earn +20 pts
What does attenuation mean in data communication?
it means loss of signal as distance increase July
What does loss of normal hollow curve in lower back mean?
It means that the lower back is too straight.
How do you compute ROE if there is loss and negative equity?
To compute for ROE if there is loss and negative equity, divide the company's net income by the stockholders' equity. A negative ROE does not necessarily mean bad news.
What does idemnity mean?
Indemnity is protection against a financial loss. An example would be when a person purchases an insurance policy to protect themselves from large financial losses due to sickness, accidents, or loss of material property.
What does the negative and positive signs on a compound mean?
The signs indicate the degree of ionisation resulting fro the loss or gain of an electron.
When was Jude the Entropic Man created?
Jude the Entropic Man was created in 1978.
What actors and actresses appeared in Entropic Apogee - 2013?
The cast of Entropic Apogee - 2013 includes: Juvenal Cisneros as Young Man
What kind of property or change is Decomposition?
Decomposition is an entropic change.
What is an acrostic for volunteer?
Valuing Others. Learning Useful Norms To Establish Entropic Realization.
What does Annesthesia mean?
Loss of bodily sensation with or without loss of consciousness.
What do you mean by credit balance in profit and loss Ac?
credit balance in profit and loss a/c is loss
What does loss of signal intensity and disc space height mean?
What does loss of signal intensity and disc space height mean
What does TFL in football stats mean?
TFL in football stats stands for TFL - Tackle For Loss.
What does txt ftl mean?
For The Loss
What does it mean to have a a negative profit?
A loss
What does Date of loss mean with auto insurance?
DOL, or Date of Loss, indicates the calender date of an accident or the date that the loss occurred.
What does blank spells mean?
Loss of consciousness
