Re: error with high traffic site and 2.0

My company is running a high traffic web site (100.000 daily visits) and two small sites. When I checked our Piwik system today I saw that archiving the high traffic site with archive.php stopped working on 23.12.2013. The smaller web sites are still being processed.

When I manually run the script it tells me:

Error: Got invalid response from API request: http://piwik.mysite.de/piwik/index.php?module=API&method=VisitsSummary.getVisits&idSite=1&period=day&date=last52&format=php&token_auth=d5528444447gefa1388a9c0czv7c8772&trigger=archivephp. Response was 'curl_exec: Empty reply from server'
Error: Got invalid response from API request: http://piwik.mysite.de/piwik/index.php?module=API&method=CoreAdminHome.runScheduledTasks&format=csv&convertToUnicode=0&token_auth=d5528444447gefa1388a9c0czv7c8772&trigger=archivephp. Response was 'curl_exec: Empty reply from server'
2 total errors during this script execution, please investigate and try and fix these errors
ERROR: 2 total errors during this script execution, please investigate and try and fix these errors. First error was: Got invalid response from API request: http://piwik.mysite.de/piwik/index.php?module=API&method=VisitsSummary.getVisits&idSite=1&period=day&date=last52&format=php&token_auth=d5528444447gefa1388a9c0czv7c8772&trigger=archivephp. Response was 'curl_exec: Empty reply from server'


I set the timeout value from 3600 to 36000 seconds but I still get the same error message. I'm pretty sure I installed the 2.0.1 update on Friday, 20.12.2013, so it was archiving for 3 days with 2.0.1 before it stopped working. Visitors on this web site are getting more and more every day, so maybe we just broke a memory barrier on 23.12.2013.

How can I archive these 18 days? Is there a way to process the data in small chunks? What else can I check?

Cheers

Thorsten