Philip Rivers fell just short of leading the Colts to a win in his first game back in five seasons.