On the morrow they left the horsemen to go with him, and returned to the castle:

On the morrow they (the foot soldiers) left the horsemen to go with him, and (they themselves being no longer needed as a guard) returned to the castle ('the barracks').

Continues after advertising
Continues after advertising