You might want to close your bank account while you’re still in the country.
You may also need to contact the Social Insurance Office: international.gotland@forsakringskassan.se