Cause it is an estimate of the unobserved mean in the whole population and not the unobserved true mean of the whole population.

Key here is you know exactly the sample mean. However, the sample mean is not going to be the mean of the whole population. So you need a statement about how close you expect your sample mean to be to the unobserved whole population mean. Thats what the standard error is about.