BQM Current Day XML

I'm trying to retrieve the XML from today's BQM data, but it doesn't seem to be possible. Is this expected? It would be helpful if the XML for the current day was available to download.

Get a 404 not found if try to do the current day. My guess is that overnight it creates the XML data files and that they are then stored for access - possibly does not create the XML on the fly which would be needed to get the current days data.

It's also potentially done to stop people hitting the files every 5 minutes throughout the day and building their own dashboard for the data, serving a 130k text file once every 24 hours that can be cached on a CDN is a massively different workload.

If you need to pull close to realtime BQM data then I am sure the team will be helpful.

In reply to a post by behuk:

I'm trying to retrieve the XML from today's BQM data, but it doesn't seem to be possible. Is this expected? It would be helpful if the XML for the current day was available to download.

I'm afraid this is a known limitation due to the fact the current day files aren't stored on our servers but on the device that does the pings. We copy them over each day at midnight. Hopefully this will be addressed in the next few months.

In reply to a post by jpm:

It's also potentially done to stop people hitting the files every 5 minutes throughout the day and building their own dashboard for the data, serving a 130k text file once every 24 hours that can be cached on a CDN is a massively different workload.
If you need to pull close to realtime BQM data then I am sure the team will be helpful.

To be honest we haven't thought about that issue. I don't think this would amount to a problem even if people did as I doubt that many would. We can't easily get the files ourselves either (it would take manually getting the file from the Firebrick). As I said in the other post though, we hope to fix this and go beyond XML into CSV Etc.