Load your Chapter 4 save file
Open the save point menu
Select the option to return to Castle Town
If you are in a Dark World area, use the nearest return point or exit path to get back to Castle Town
If you already progressed past the point of no return, reload an earlier save
If needed, use Chapter Select to start from a point where Castle Town is accessible