“I visited the store where I used to work and went drinking with my former colleagues.”

“Former” is used with things that someone or something used to be but no longer is. For example, if you give your cat to your friend, the cat is now your former pet. If you get divorced, your ex-spouse could be called your former husband or wife.