In a loyal manner, faithfully.
The old dog loyally followed his master even if he didn't really want to go out.