[AsyncWebClient] Handle HTTP error 406 in the redirection workaround

The workaround in place to handle the fact that HttpWebRequest
auto-redirects don't work with some servers only handled the BadRequest
status code. Some servers return 406 NotAcceptable in that case. This
fixes the subscription to all podcasts from podbean.com (bgo#600340).