According to most lore, people become ghosts when they die having some major unfinished business. That’s something that most people (and ghosts) would consider regrettable. Also, ghost are mostly depicted as not bound by gravity.

Meanwhile, bird has done or otherwise experienced regrettable things and is a bird.