user5131: i wrote a simple function to retrieve trades from mtgox with following HTTP API call:
https://data.mtgox.com/api/1/BTCUSD/trades?since

documented here: https://en.bitcoin.it/wiki/MtGox/API/HTTP/v1#Multi_currency_trades
here's the function:
string GetTradesOnline(Int64 tid)
{
    Thread.Sleep(30000);

    // communicate
    string url = "https://data.mtgox.com/api/1/BTCUSD/trades?since=" + tid.ToString();
    HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
    HttpWebResponse response = (HttpWebResponse)request.GetResponse();
    StreamReader reader = new StreamReader(response.GetResponseStream());

    string json = reader.ReadToEnd();
    return json;
}

i'm starting at tid=0 to get the data from the very beginning. it works fine for 5 requests & responses. but then the following line throws a "System.Net.WebException", saying that "The operation has timed out":
HttpWebResponse response = (HttpWebResponse)request.GetResponse();

this exception keeps being thrown even if i catch it and retry. it's always exactly at 5 requests.
while it has been failing for a couple of minutes, i try the 6th request in the browser and it works just fine while the function continues to fail.
the strange thing is that it works for 5 requests everytime i start the application. currently, i always start at trade id 0 (tid=0).
i've increased the Sleep() inbetween requests to 2 minutes but it still behaves the same.
if i change the url to https://www.google.com, it doesn't timeout.
any ideas of what could be wrong?

user1878: MtGox uses CloudFlare for DDOS protection.  It's possible that your IP is being blocked.
Open a ticket with MtGox and tell them your IP... they may likely whitelist it.

5131: <p>i wrote a simple function to retrieve trades from mtgox with following HTTP API call:</p>

<pre><code>https://data.mtgox.com/api/1/BTCUSD/trades?since
</code></pre>

<p>documented here: <a href="https://en.bitcoin.it/wiki/MtGox/API/HTTP/v1#Multi_currency_trades" rel="nofollow">https://en.bitcoin.it/wiki/MtGox/API/HTTP/v1#Multi_currency_trades</a></p>

<p>here's the function:</p>

<pre><code>string GetTradesOnline(Int64 tid)
{
    Thread.Sleep(30000);

    // communicate
    string url = "https://data.mtgox.com/api/1/BTCUSD/trades?since=" + tid.ToString();
    HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
    HttpWebResponse response = (HttpWebResponse)request.GetResponse();
    StreamReader reader = new StreamReader(response.GetResponseStream());

    string json = reader.ReadToEnd();
    return json;
}
</code></pre>

<p>i'm starting at tid=0 to get the data from the very beginning. it works fine for 5 requests &amp; responses. but then the following line throws a "System.Net.WebException", saying that "The operation has timed out":</p>

<pre><code>HttpWebResponse response = (HttpWebResponse)request.GetResponse();
</code></pre>

<p>this exception keeps being thrown even if i catch it and retry. it's always exactly at 5 requests.</p>

<p>while it has been failing for a couple of minutes, i try the 6th request in the browser and it works just fine while the function continues to fail.</p>

<p>the strange thing is that it works for 5 requests everytime i start the application. currently, i always start at trade id 0 (tid=0).</p>

<p>i've increased the Sleep() inbetween requests to 2 minutes but it still behaves the same.</p>

<p>if i change the url to <a href="https://www.google.com" rel="nofollow">https://www.google.com</a>, it doesn't timeout.</p>

<p><strong>any ideas of what could be wrong?</strong></p>
 1878: <p>MtGox uses CloudFlare for DDOS protection.  It's possible that your IP is being blocked.</p>

<p>Open a ticket with MtGox and tell them your IP... they may likely whitelist it.</p>
