Loss function returns x whereas tensorflow shows validation loss as (x+0.0567)

I have a custom loss function. In order to experiement how the loss is calculated during valiation, I update the loss function as follows:

def custom_loss(y_true, y_pred):
    return 0 * tf.reduce_mean(input_tensor=-tf.reduce_sum(input_tensor=y_true_1 * tf.math.log(y_pred_1), axis=-1)) + 1 

• Multiply by 0, to make the data dependent loss value as always 0.
• Add a constant value like 1 to it, so that the loss function always returns a value of 1.

Now when I run model.evaluate on my data, tensorflow shows me the loss value as 1.0567.

To further experiment, I updated the constant value being returned by loss function from 1 to other constant values. Below you can see the table:

• constant 0 => loss 0.0567
• constant 1 => loss 1.0567
• constant 2 => loss 2.0567

I was expecting the final calculated loss to be same as the constant value I passed. But that’s not the case. What is the reason for a constant difference of 0.0567?

I have verified it across three versions of tensorflow: 1.14.0, 1.15.0, and 2.1.0.