Tensorboard console-log writer only stores last message
The reason for this behavior is, that since pytorch=2.0 the add_text
method of the tensorboard writer has a global_step attribute and the default value stays at 0. Therefore all logs are written to global step 0, meaning newer logs overwrite old ones.