Re: importing apache logs as long-term strategy

some months are passed but if you are still facing the problem here is my solution:

in /etc/cron.hourly (or whatever you prefer)

---------------------------------------------------------
# read number of processed records
eval $(awk '{ print "count="$1}' /var/log/httpd/count.url)

# import log files skipping processed records
python /var/www/usage/misc/log-analytics/import_logs.py --idsite=3 --recorders=2 --skip=$count --enable-http-errors --enable-http-redirects --enable-static --url=http://piwik.url /var/log/httpd/access_log >/dev/null

# save number of processed records
wc /var/log/httpd/access_log > /var/log/httpd/count.url
---------------------------------------------------------

bye,
tnapul