WarcraftReamls.com
  FAQFAQ    SearchSearch    MemberlistMemberlist    UsergroupsUsergroups   RegisterRegister 
  ProfileProfile    Log in to check your private messagesLog in to check your private messages    Log inLog in 
Site updated for MoP - Censusplus v6.0 download link
Goto page Previous  1, 2, 3 ... 5, 6, 7 ... 12, 13, 14  Next
 
Post new topic   This topic is locked: you cannot edit posts or make replies.    WarcraftRealms.com Forum Index -> News and Announcements
View previous topic :: View next topic  
Author Message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Fri Nov 30, 2012 2:18 pm    Post subject: Reply with quote

This process is out of my hands...

Nov 28, 12 00:52:54 0 0 E

also failed... Sad I am pretty sure Rollie can't babysit the queue, so I'll just have to live with whatever manages to make it through successfully. *deep sigh* All files went out successfully as far as I could tell at the time, so I have zero idea on why some of them are failing.

I'll just start feeding in the rest in a little bit.
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Fri Nov 30, 2012 4:45 pm    Post subject: Reply with quote

Strange... now that one registers as success and the next one as faulty... *scratches head* Strange beyond my limited understanding... Oh well, just to let everyone know that I have now uploaded everything I had ready. Which currently translates into about five and half pages of not yet processed files.
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Sat Dec 01, 2012 12:08 am    Post subject: Reply with quote

A few hours of sleep later...

Nov 28, 12 00:58:13 0 0 E
Nov 28, 12 00:56:32 1936 9676 Y
Nov 28, 12 00:54:30 0 0 E
Nov 28, 12 00:52:54 2067 9919 Y
Nov 28, 12 00:51:02 0 0 E
Nov 28, 12 00:49:43 884 5027 Y
Nov 28, 12 00:47:27 0 0 E
Nov 28, 12 00:45:49 1398 6696 Y

Like a Swiss cheese and no idea why... *deep sigh*
Back to top
View user's profile Send private message
Wynta



Joined: 02 Dec 2007
Posts: 23
Location: UK
WR Updates: 317,122
Wynta WR Profile

PostPosted: Sun Dec 02, 2012 3:27 am    Post subject: Reply with quote

hi,
any chance of linking to the latest addon, to run censuses with,at the top of this thread? I know Ive seen it somewhere,but am having trouble finding it (assuming 5.02 is not the current one, since dated 2010?!)
thanks Very Happy
Back to top
View user's profile Send private message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1512
Location: UK
WR Updates: 11,068,258
Balgair WR Profile

PostPosted: Sun Dec 02, 2012 6:15 am    Post subject: Reply with quote

Good idea, will do that! http://www.curse.com/addons/wow/census-plus is the latest version Smile
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Eilnich - Ruire - Dubh - Laidir - Naomh --
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Sun Dec 02, 2012 6:41 am    Post subject: Reply with quote

Many hours later... a few successes, then more Swiss cheese...

Nov 28, 12 01:26:03 0 0 E
Nov 28, 12 01:24:43 1011 5725 Y
Nov 28, 12 01:23:20 0 0 E
Nov 28, 12 01:21:52 1357 6832 Y
Nov 28, 12 01:20:28 0 0 E

*sigh*
Back to top
View user's profile Send private message
Wynta



Joined: 02 Dec 2007
Posts: 23
Location: UK
WR Updates: 317,122
Wynta WR Profile

PostPosted: Sun Dec 02, 2012 1:02 pm    Post subject: Reply with quote

Brillig, thanks Very Happy
Balgair wrote:
Good idea, will do that! http://www.curse.com/addons/wow/census-plus is the latest version Smile
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Sun Dec 02, 2012 5:26 pm    Post subject: Reply with quote

Even more hours later... the queue has slown down to a permanent crawl and the Swiss cheese just keeps piling up...

Nov 28, 12 01:32:00 0 0 E
Nov 28, 12 01:30:36 874 4834 Y
Nov 28, 12 01:28:55 0 0 E
Nov 28, 12 01:27:40 845 4661 Y
Back to top
View user's profile Send private message
esiemiat



Joined: 03 Dec 2011
Posts: 14
Location: Connecticut
WR Updates: 253,737
esiemiat WR Profile

PostPosted: Sun Dec 02, 2012 9:32 pm    Post subject: Reply with quote

Just curious, how many more from that batch of uploads are left?
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 131
Location: Shadar Logoth
WR Updates: 15,039,100
Padanfain WR Profile

PostPosted: Sun Dec 02, 2012 11:35 pm    Post subject: Reply with quote

1974ER's files to be processed.... 27 uploaded on the 28th then 2 days later
52 files, 2 files on dec 1st and 1 on the 2nd. Give it about 2 1/2 to 3 weeks
to clear up and things will be back to 'normal'. Sucks that he has so many
errors not only in server lag time but the loss of census credit to his
account.
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Mon Dec 03, 2012 12:28 am    Post subject: Reply with quote

I most seriously hope it won't take that long... Two months of enforced break was apparently too much for the queue engine, too. :/ Strange thing about the errors is that they seem to mostly alternate with successes. It's unfortunate that Rollie is so busy, it would be nice to have some sort of input from him. It has been a very hard year for him, so I hope things start going better as Christmas is approaching fast.

Also, I would be happy with much smaller figures if it meant all files process correctly. All the failures that slip through mean some data is permanently lost. And judging by the numbers in the successes, in some cases the data loss is rather significant.

Seems the queue is struggling again...

Nov 28, 12 01:59:57 0 0 E

*sigh*
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 131
Location: Shadar Logoth
WR Updates: 15,039,100
Padanfain WR Profile

PostPosted: Mon Dec 03, 2012 12:49 am    Post subject: Reply with quote

The first 43 files, taking in failure rate and time per failure, has taken about
6 days and you have over 80 queued so, if that continues, 11 or more days,
2 weeks tops plus our files Wink , is not out of range. I hope for a smaller
failure rate not only for time but your count. As for Rollie, absolutely family
comes first and I wish him well and better days to come. I'm glad he could
keep such a creation as this site running as a hobby/interest considering life
as it happens.
Back to top
View user's profile Send private message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1512
Location: UK
WR Updates: 11,068,258
Balgair WR Profile

PostPosted: Mon Dec 03, 2012 3:31 am    Post subject: Reply with quote

I've mailed Rollie to let him know about your files ER, maybe if he has a spare minute he can take a look and see what's wrong with them. Can't imagine what's wrong myself, since I'm sure you're doing nothing different to usual!
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Eilnich - Ruire - Dubh - Laidir - Naomh --
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Mon Dec 03, 2012 6:41 am    Post subject: Reply with quote

Padanfain, as far as I am aware, due to certain technical quirks most other people who stockpiled had already cleared their piles by the time I began... So what remains of November... is mostly me.

Thank you, Balgair. As I noted earlier, I have no idea why the files go awry... and the success, fail, success, fail, success, fail pattern that is evident multiple times suggests to me that the problem might actually be in the queue, not in the files themselves. It's also possible that I simply put in too many files in too short time period... but there have been other such times when it has worked... and the pattern is not fully systematic, which renders it even weirder.

I am also assuming that if there were no failures, the queue would move significantly faster, because it seems to jump forward when multiple Y statuses are achieved and then halts to more or less complete stop upon hitting E.
Back to top
View user's profile Send private message
bringoutyourdead
Forums Admin & general flunky


Joined: 07 Nov 2008
Posts: 590
Location: Silicon Valley
WR Updates: 7,092,047
bringoutyourdead WR Profile

PostPosted: Mon Dec 03, 2012 12:30 pm    Post subject: Reply with quote

I expect there isn't anything wrong with the files.. instead I expect there is a timing issue in Rollie's processing that blip in the data being read in and stored.. where either the PHP is getting or feeding faulty data or the database engine is getting confused and saying that it has seen data it hasn't really or isn't seeing the data it has been given.

When the process errors out there is time for the system to settle down.. and the next file processes fine. It is possible that rapid change of realm keys with the random cross-realm entries might be giving fits to the buffering (cache problems, memory fragmentation etc.) in the database. This is something that can be fixed by tweaking the configuration parameters but you can't do the tweaking until you see that limits you are hitting during processing.

If you remember Rollie wanted to upgrade his database hardware we don't know if he was able to do that before he opened the flood gates.

Which is another way of saying that only Rollie can know what is causing the problem.. and he won't know until he can take the time to analyze the database logs.
Back to top
View user's profile Send private message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1512
Location: UK
WR Updates: 11,068,258
Balgair WR Profile

PostPosted: Tue Dec 04, 2012 2:40 am    Post subject: Reply with quote

Rollie was looking at it earlier, don't know if he reached a final conclusion yet but he did mention that the file he was looking at had over 56k characters in it and took over an hour to process, so maybe size could be an issue there....
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Eilnich - Ruire - Dubh - Laidir - Naomh --
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Tue Dec 04, 2012 10:49 am    Post subject: Reply with quote

Admittably size could be an issue... but it's unlikely to be the only reason, as files in excess of 80000 characters were pretty much routine for me before site was updated. Also, with a quick glance... the previous time I had a file failure prior to it... was on May 15th... more looks... next failure... Sep 10th, 2011!

Overall, both the queue and my files have been pretty reliable, so I have a very hard time trying to understand why they are now encountering multiple errors in the space of just few days when preceding over a year contains only two, extremely far apart from each other, too.
Back to top
View user's profile Send private message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1512
Location: UK
WR Updates: 11,068,258
Balgair WR Profile

PostPosted: Tue Dec 04, 2012 11:00 am    Post subject: Reply with quote

Yeah, mine tend to be something similar, at least I've pruned chunks of 40k before now and never had trouble. Wondering if the database is struggling in another way, such that it can no longer handle such big files. If so, that's a headache, but maybe there's some other explanation, we'll see when Rollie investigates further I guess.
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Eilnich - Ruire - Dubh - Laidir - Naomh --
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 23,534,469
1974ER WR Profile

PostPosted: Tue Dec 04, 2012 4:02 pm    Post subject: Reply with quote

Unfortunately, it seems the situation is getting worse as I am now seeing multiple failures in row... Sad

Nov 28, 12 02:12:37 0 0 E
Nov 28, 12 02:11:14 0 0 E
Nov 28, 12 02:05:16 0 0 E
Nov 28, 12 02:03:55 2871 9726 Y
Nov 28, 12 02:02:42 0 0 E
Nov 28, 12 02:01:15 1956 8662 Y
Nov 28, 12 01:59:57 0 0 E
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 131
Location: Shadar Logoth
WR Updates: 15,039,100
Padanfain WR Profile

PostPosted: Tue Dec 04, 2012 9:36 pm    Post subject: Reply with quote

Woot! This is lookin better 1974ER Smile

Nov 28, 12 02:27:05 2631 8195 Y
Nov 28, 12 02:24:41 576 2035 Y
Nov 28, 12 02:19:45 1053 4294 Y
Nov 28, 12 02:16:40 1953 4991 Y
Nov 28, 12 02:15:41 409 2084 Y
Nov 28, 12 02:14:35 1929 6379 Y
Nov 28, 12 02:13:32 1964 6528 Y
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   This topic is locked: you cannot edit posts or make replies.    WarcraftRealms.com Forum Index -> News and Announcements All times are GMT - 6 Hours
Goto page Previous  1, 2, 3 ... 5, 6, 7 ... 12, 13, 14  Next
Page 6 of 14

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
WarcraftRealms.com  


Powered by phpBB © 2001, 2005 phpBB Group