Persisting changes in kate

You need to make changes (like closing the Documents tab) and save session.

 

In settings under Sessions>Load last session