Composting is an intricate part of the zero waste experience. In Atlanta, compost is easy and encourage by the city for residents.
If you don't have a back yard for doing the lazy man's compost, then find a community garden near you. They typically welcome all to drop of scraps, I would try to contact the garden to be sure they accept non-member's compost.
If you're not interested in getting too deep into composting on your own, get in touch with Compost Wheels. They provide a pick-up service for kitchen scraps, and in return you receive soil at your request.