Quote
sfreiberg
Edit: this problems occurs in Piwik 1.11.1 import script as well as in the git version of it
I have the same problem. Output of import script:
<...>/piwik/misc/log-analytics/import_logs_git.py --idsite=4 --recorders=1 --show-progress --url=<mypiwik-url> -dddd --disable-bulk-tracking --enable-static --enable-bots --enable-http-errors --enable-http-redirects my.access.log.201302-500
2013-04-03 12:54:34,996: [DEBUG] Accepted hostnames: all
2013-04-03 12:54:34,997: [DEBUG] Piwik URL is: <mypiwik-url>
2013-04-03 12:54:34,997: [DEBUG] No token-auth specified
2013-04-03 12:54:34,997: [DEBUG] No credentials specified, reading them from "<...>/piwik/config/config.ini.php"
2013-04-03 12:54:34,998: [DEBUG] Using credentials: (login = piwikadm, password = ....)
2013-04-03 12:54:35,177: [DEBUG] Authentication token token_auth is: f73539f1f91a...........
2013-04-03 12:54:35,178: [DEBUG] Resolver: static
0 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
2013-04-03 12:54:35,345: [DEBUG] Launched recorder
Parsing log my.access.log.201302-500...
2013-04-03 12:54:35,346: [DEBUG] Detecting the log format
2013-04-03 12:54:35,346: [DEBUG] Format iis does not match
2013-04-03 12:54:35,346: [DEBUG] Format s3 does not match
2013-04-03 12:54:35,347: [DEBUG] Format common_complete does not match
2013-04-03 12:54:35,347: [DEBUG] Format common matches
2013-04-03 12:54:35,347: [DEBUG] Format common_vhost does not match
2013-04-03 12:54:35,347: [DEBUG] Format ncsa_extended matches
2013-04-03 12:54:35,348: [DEBUG] Format ncsa_extended is the best match
2013-04-03 12:54:35,565: [DEBUG] Error when connecting to Piwik: <urlopen error None>
500 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
500 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
2013-04-03 12:54:37,628: [DEBUG] Error when connecting to Piwik: <urlopen error None>
500 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
500 lines parsed, 0 lines recorded, 0 records/sec (avg), 0 records/sec (current)
2013-04-03 12:54:39,688: [DEBUG] Error when connecting to Piwik: <urlopen error None>
Fatal error: None
You can restart the import of " my.access.log.201302-500" from the point it failed by specifying --skip=0 on the command line.
BTW: How am I supposed to provide an example log file when the only valid attachments are images or pdf ? (just created a pdf of the log file)
I'm experiencing a similar issue with nsca_extended format it seems the value reported by skip is incorrect. A possible workaround is to not resume the script with what is reported by skip but use the last reported # of lines parsed. In this case, instead of --skip=0, use --skip=500. However, while it works to resume the import I do not know if valid log lines are being passed over.