Currently we have about 39M pageviews/ days.
Archive running one time a day with just only daily archive (no weekly, monthly), Oracle partition help much on archive (We have convert most of plugin to orcacle).
We import to mysql database table sharding by visitor id so could mysql load for visit search.
With medium website it's ok. But with the big one it's going nightmare again. We have about 4 hours delay. We've try more sharding with no help. I'm going to write another module to import logs into Mysql to replace piwik.php.
Archive running one time a day with just only daily archive (no weekly, monthly), Oracle partition help much on archive (We have convert most of plugin to orcacle).
We import to mysql database table sharding by visitor id so could mysql load for visit search.
With medium website it's ok. But with the big one it's going nightmare again. We have about 4 hours delay. We've try more sharding with no help. I'm going to write another module to import logs into Mysql to replace piwik.php.