Possible processing bug

Kosh · Posted: Sat Jun 27, 2009 7:01 pm Post subject: Possible processing bug

Just in the past few days I have started noticing occasional Processing Errors for my uploaded submissions. Most of my submissions are being processed successfully, and since I haven't been doing any pruning, etc., each submission will just be slightly larger / different from the previous one.

Here's a chunk of my submissions, showing a couple of errors:

Rollie · Posted: Tue Jul 14, 2009 11:32 am Post subject:

The likely culprit is that the file was just too big and timed out during processing.

Kosh · Posted: Wed Jul 15, 2009 12:02 am Post subject:

OK, that seems reasonable, except... later submissions are even larger than the errored one, and they process correctly,

Is your "stop if too large" check on clock time or processing time (it must not be file size)? I wonder if other (periodic?) processes on the server are eating a lot of the CPU occasionally.

Anyway, it isn't happening often enough for me to discern any obvious pattern, so I will just keep watching. There happened to be a couple more early on Monday, but no other errors for quite a while before that.

Rollie · Posted: Tue Jul 21, 2009 9:40 am Post subject:

Yes, that is probably the likely culprit as well. It's not that the file is so large per say, but that the process was using too much time to process that file. Depending on other factors on the server, backups, updates, etc, then smaller files might trip the timeout as well.