I had a setup with Swift on a server, Ubuntu 11.10 and OpenStack Diablo, and I could do curls-commands to it.
However, when trying to use python-cloudfiles and swift-cli from a remote machine, it just returned Errno 111: Connection Refused all the time.
After days with googling, I finally got the nerve to visit the openstack irc channel, and after about half an hour with troubleshooting, they provided me with the answer that I need to have an url for the callback under the tempauth filter in proxy-server.conf-file.