Apparently all day Caleb's been wearing Amber's dress as a "scarf"