WarcraftReamls.com
  FAQFAQ    SearchSearch    MemberlistMemberlist    UsergroupsUsergroups   RegisterRegister 
  ProfileProfile    Log in to check your private messagesLog in to check your private messages    Log inLog in 
Possible processing bug

 
Post new topic   Reply to topic    WarcraftRealms.com Forum Index -> WarcraftRealms.com Bugs
View previous topic :: View next topic  
Author Message
Kosh



Joined: 01 Jul 2007
Posts: 84
Location: Somewhere on or near Earth
WR Updates: 1,210,548
Kosh WR Profile

PostPosted: Sat Jun 27, 2009 7:01 pm    Post subject: Possible processing bug Reply with quote

Just in the past few days I have started noticing occasional Processing Errors for my uploaded submissions. Most of my submissions are being processed successfully, and since I haven't been doing any pruning, etc., each submission will just be slightly larger / different from the previous one.

Here's a chunk of my submissions, showing a couple of errors:
Code:
Jun 27, 09 14:38:56     0     0     N
Jun 27, 09 02:04:37    0    0    E
Jun 27, 09 01:44:42    35    507    Y
Jun 26, 09 23:56:40    14    110    Y
Jun 26, 09 23:11:00    21    268    Y
Jun 26, 09 22:49:38    24    401    Y
Jun 26, 09 21:14:04    62    811    Y
Jun 26, 09 20:12:22    0    0    E


Because a later submission is processing correctly, the site is eventually going to get everything, but I will (potentially) lose out on being "first" to see some of them.

I scrolled back through my upload output, and there were no differences between successful uploads that eventually processed correctly and ones that eventually processed as "Error". Here's the output from the last two (currently) processed submissions:
Code:
[Odin:/Documents/download] kosh% ./censusup.sh
censusup.sh: Checking for updated CensusPlus.lua...
  lua file newer -- recompressing...
  Starting upload...
}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}
  % Total    % Received % Xferd  Average Speed          Time             Curr.
                                 Dload  Upload Total    Current  Left    Speed
100 1575k  100   569  100 1574k     20  57186  0:00:28  0:00:28  0:00:00 28871
Checking your file
Found: CensusPlus Database; CensusPlus Info Data; Version: 4.2.2; Locale: US
Attempting to make entry
Username : Kosh{=
Kosh will be credited with this submission!

curl: transferred 1574.68kb in 28.197 seconds (55.8458 kb/s)
{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{
  upload completed at 01:44:42

[Odin:/Documents/download] kosh% ./censusup.sh
censusup.sh: Checking for updated CensusPlus.lua...
  lua file newer -- recompressing...
  Starting upload...
}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}}
  % Total    % Received % Xferd  Average Speed          Time             Curr.
                                 Dload  Upload Total    Current  Left    Speed
100 1576k  100   569  100 1575k     22  63094  0:00:25  0:00:25  0:00:00 32843
Checking your file
Found: CensusPlus Database; CensusPlus Info Data; Version: 4.2.2; Locale: US
Attempting to make entry
Username : Kosh{=
Kosh will be credited with this submission!

curl: transferred 1575.46kb in 25.569 seconds (61.6161 kb/s)
{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{{
  upload completed at 02:04:38

Do you show any problems with my "Error" submissions on your side, or is it just an occasional hiccup?


[edit] Hmm, that's odd. For some reason the forum software is mangling any text that happens to be between a left angle bracket and a right angle bracket, even in a "code" block. Fixed by substituting braces.
Back to top
View user's profile Send private message
Rollie
Site Admin


Joined: 28 Nov 2004
Posts: 5374
Location: Austin, TX
WR Updates: 480,131
Rollie WR Profile

PostPosted: Tue Jul 14, 2009 11:32 am    Post subject: Reply with quote

The likely culprit is that the file was just too big and timed out during processing.
Back to top
View user's profile Send private message Visit poster's website
Kosh



Joined: 01 Jul 2007
Posts: 84
Location: Somewhere on or near Earth
WR Updates: 1,210,548
Kosh WR Profile

PostPosted: Wed Jul 15, 2009 12:02 am    Post subject: Reply with quote

OK, that seems reasonable, except... later submissions are even larger than the errored one, and they process correctly,

Is your "stop if too large" check on clock time or processing time (it must not be file size)? I wonder if other (periodic?) processes on the server are eating a lot of the CPU occasionally.

Anyway, it isn't happening often enough for me to discern any obvious pattern, so I will just keep watching. There happened to be a couple more early on Monday, but no other errors for quite a while before that.
Back to top
View user's profile Send private message
Rollie
Site Admin


Joined: 28 Nov 2004
Posts: 5374
Location: Austin, TX
WR Updates: 480,131
Rollie WR Profile

PostPosted: Tue Jul 21, 2009 9:40 am    Post subject: Reply with quote

Yes, that is probably the likely culprit as well. It's not that the file is so large per say, but that the process was using too much time to process that file. Depending on other factors on the server, backups, updates, etc, then smaller files might trip the timeout as well.
Back to top
View user's profile Send private message Visit poster's website
Display posts from previous:   
Post new topic   Reply to topic    WarcraftRealms.com Forum Index -> WarcraftRealms.com Bugs All times are GMT - 6 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
WarcraftRealms.com  


Powered by phpBB © 2001, 2005 phpBB Group