Canaries and cages

I am the owner of a pet store. If I put in one canary per cage, I have one bird too many. If I put in two canaries per cage, I have one cage too many.

How many cages and canaries do I have?

I have 3 cages and 4 canaries.