WarcraftReamls.com
  FAQFAQ    SearchSearch    MemberlistMemberlist    UsergroupsUsergroups   RegisterRegister 
  ProfileProfile    Log in to check your private messagesLog in to check your private messages    Log inLog in 
Site updated for MoP - Censusplus v6.0 download link
Goto page Previous  1, 2, 3 ... 11, 12, 13, 14  Next
 
Post new topic   This topic is locked: you cannot edit posts or make replies.    WarcraftRealms.com Forum Index -> News and Announcements
View previous topic :: View next topic  
Author Message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1549
Location: UK
WR Updates: 11,351,655
Balgair WR Profile

PostPosted: Tue Jan 08, 2013 11:26 am    Post subject: Reply with quote

Getting worse for me too, hoping Rollie's changes help and he can get them in fairly quickly...

Dec 16, 12 20:18:44 0 0 E
Dec 15, 12 17:01:40 0 0 E
Dec 15, 12 09:46:31 434 1850 Y
Dec 14, 12 22:01:52 0 0 E
Dec 14, 12 17:04:57 343 1404 Y
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Naomh - Eilnich - Ruire - Dubh - Laidir --
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 152
Location: Shadar Logoth
WR Updates: 21,795,971
Padanfain WR Profile

PostPosted: Tue Jan 08, 2013 11:30 am    Post subject: Reply with quote

Me three. That time of day submission theory is looking pretty good Balgair.

Dec 17, 12 21:19:41 0 0 N
Dec 17, 12 01:05:56 0 0 E
Dec 17, 12 00:17:40 0 0 E
Dec 16, 12 22:40:19 0 0 E
Dec 16, 12 21:30:32 0 0 E
Dec 16, 12 20:04:04 0 0 E
Dec 16, 12 01:53:49 644 1838 Y
Dec 16, 12 01:04:36 0 0 E
Dec 15, 12 23:27:28 0 0 E
Dec 15, 12 22:13:48 0 0 E
Dec 15, 12 20:50:40 0 0 E
Dec 15, 12 01:40:50 603 1760 Y
Dec 15, 12 00:55:27 0 0 E
Dec 14, 12 23:18:46 0 0 E
Dec 14, 12 22:18:24 0 0 E
Dec 14, 12 21:02:57 0 0 E
Dec 14, 12 01:26:29 537 1583 Y
Dec 14, 12 00:42:27 0 0 E
Dec 13, 12 23:18:38 0 0 E
Dec 13, 12 22:20:11 0 0 E
Dec 13, 12 20:57:10 0 0 E
Dec 13, 12 00:23:25 0 0 E
Dec 12, 12 23:27:26 0 0 E
Dec 12, 12 21:32:09 0 0 E
Dec 12, 12 20:14:03 0 0 E
Dec 12, 12 18:56:45 553 2213 Y
Dec 12, 12 17:14:13 921 2278 Y
Back to top
View user's profile Send private message
bringoutyourdead
Forums Admin & general flunky


Joined: 07 Nov 2008
Posts: 716
Location: Silicon Valley
WR Updates: 7,243,161
bringoutyourdead WR Profile

PostPosted: Tue Jan 08, 2013 2:03 pm    Post subject: Reply with quote

Fuxie are your E submissions also of the same approximate size of characters updated?
and are you pruning your files?
I'm wondering if your files have a lot of older data vs. new update data?

If your files are purged/deleted and you have only or mostly new update data.. all I can say is "hmmn.. I haven't a clue what could be the processing issue."
And that bugs me.. I tend to spend much of my professional time, diagnosing IT problems and getting them fixed.

The one thing I do know is that so far as of the 12/15 data.. I'm batting .000% with 6 failures. Each submission I'm doing is with /census serverprune processed before I start doing my census runs on 40 to 50 factions each submission.

The fact that I'm not showing nearly 100,000 update isn't what bothers me.. as much as the fact that with all these E submissions from all of us, the most wanted and server submission pages here on the site are of no value.. no one can know which realm/factions need census runs more then others. sigh

oh well it is better then my other project (I run Wow in background, switching to it when I here the Census finished bell), that project has a program that randomly crashes on memory clean up when the program tells windows(win7 & win8) it no longer needs blocks of allocated memory... the problem seems to be a complied dll file which no one seems to have the source to any more.. it was lost during a hardware crash.. who needs backups .. sigh
So I get to try to figure out everything that dll was suppose to do and recreate it again from scratch.
Sort of like putting a picture puzzle together.. where there isn't a picture... and you haven't a clue if you have all the pieces.
Back to top
View user's profile Send private message
piratejenny



Joined: 05 Oct 2011
Posts: 3

WR Updates: 1,190,198
piratejenny WR Profile

PostPosted: Tue Jan 08, 2013 11:33 pm    Post subject: Reply with quote

Aw, me and my big mouth--now I have errors too Sad

Dec 18, 12 01:55:26 0 0 N
Dec 16, 12 20:06:15 0 0 E
Dec 16, 12 01:52:22 111 482 Y
Dec 15, 12 21:02:31 0 0 E
Dec 14, 12 02:29:36 35 207 Y

I mostly haven't been pruning my files, since I know they're not that big (though I have pruned a few times lately).
Back to top
View user's profile Send private message
FuxieDK



Joined: 22 May 2008
Posts: 477
Location: Copenhagen, DK
WR Updates: 2,722,587
FuxieDK WR Profile

PostPosted: Wed Jan 09, 2013 12:09 am    Post subject: Reply with quote

@ bring....

Honestly, I can't remember, what I did, prune-wise, 3 weeks ago, but most likely, I used standard 30 days prune.
My files are NEVER over 4MB in size.. 3,5ish is the biggest files I have uploaded in MoP.

After the first failed file, a few days ago, I have started a prune-7 routine..
_________________
Doing census on various servers Wink
Back to top
View user's profile Send private message
Djambo



Joined: 02 Aug 2005
Posts: 48
Location: Germany
WR Updates: 4,724,864
Djambo WR Profile

PostPosted: Wed Jan 09, 2013 4:34 am    Post subject: Reply with quote

FuxieDK wrote:
After the first failed file, a few days ago, I have started a prune-7 routine..

To be honest: That won't help you. I'm doing the 7 day prune for years now and two of my files error'd.
Back to top
View user's profile Send private message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1549
Location: UK
WR Updates: 11,351,655
Balgair WR Profile

PostPosted: Wed Jan 09, 2013 8:16 am    Post subject: Reply with quote

Yep, I've been doing prune 5 the last few weeks with all the problems (only even played on 2 servers so won't be that high anyway), hasn't helped me much.

I suppose on the plus side, the backlog is progressing a lot faster than it was... I just think it's doing that by not processing many of the files Razz
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Naomh - Eilnich - Ruire - Dubh - Laidir --
Back to top
View user's profile Send private message
FuxieDK



Joined: 22 May 2008
Posts: 477
Location: Copenhagen, DK
WR Updates: 2,722,587
FuxieDK WR Profile

PostPosted: Wed Jan 09, 2013 11:21 am    Post subject: Reply with quote

Djambo wrote:
FuxieDK wrote:
After the first failed file, a few days ago, I have started a prune-7 routine..

To be honest: That won't help you. I'm doing the 7 day prune for years now and two of my files error'd.
It's morelikely to be number of entries, rather than days.
However, you might do more censusing (and thus more entries) than me, and thus, it might work for me, but not you..

Strictly guessing, ofc... Shocked
_________________
Doing census on various servers Wink
Back to top
View user's profile Send private message
bringoutyourdead
Forums Admin & general flunky


Joined: 07 Nov 2008
Posts: 716
Location: Silicon Valley
WR Updates: 7,243,161
bringoutyourdead WR Profile

PostPosted: Thu Jan 10, 2013 12:39 pm    Post subject: Reply with quote

Since I'm not interested in keeping a local history on the factions I census what I'm doing is - /census serverprune - which will prune ALL data except for the current realm you are on.

One of the side effects of that is that every time I do a census run all characters are new characters.. so what I see and the end of the run doesn't come close to what warcraftrealms.com sees.

So far from what has cleanly processed.. I see about 22000 characters... and WR sees 7000 - 9000 updates and about 1/2 of that as new.
Back to top
View user's profile Send private message
1974ER
Epic Censi


Joined: 07 Nov 2008
Posts: 729

WR Updates: 24,795,456
1974ER WR Profile

PostPosted: Fri Jan 11, 2013 11:36 am    Post subject: Reply with quote

It's starting to look like that there will not be a rollback to reprocess failed files and lost data will remain that way forever. No obvious news from Rollie and DB queue remains roughly 22 days behind schedule.
Back to top
View user's profile Send private message
Fett



Joined: 01 Nov 2008
Posts: 50

WR Updates: 922,138
Fett WR Profile

PostPosted: Fri Jan 11, 2013 12:05 pm    Post subject: Reply with quote

If there's not already a song about how lost data is gone forever, there ought to be.


I had two fails in a row from late on December 19. If our observed pattern of fails coming in bunches holds true, the rest of you should be seeing fails around the same time as well. How about it? Is the pattern holding true?
Back to top
View user's profile Send private message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1549
Location: UK
WR Updates: 11,351,655
Balgair WR Profile

PostPosted: Fri Jan 11, 2013 12:28 pm    Post subject: Reply with quote

Dec 19, 12 18:41:19 0 0 E

Yep Sad
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Naomh - Eilnich - Ruire - Dubh - Laidir --
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 152
Location: Shadar Logoth
WR Updates: 21,795,971
Padanfain WR Profile

PostPosted: Fri Jan 11, 2013 7:18 pm    Post subject: Reply with quote

I think the time range is expanding.

Dec 19, 12 23:57:30 0 0 E
Dec 19, 12 22:09:15 0 0 E
Dec 19, 12 21:02:25 0 0 E
Dec 19, 12 19:49:10 0 0 E
Dec 19, 12 16:41:15 0 0 E
Dec 19, 12 15:44:57 0 0 E
Dec 19, 12 14:18:13 0 0 E
Dec 19, 12 13:37:21 0 0 E
Dec 19, 12 12:51:21 0 0 E
Dec 19, 12 00:21:13 0 0 E
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 152
Location: Shadar Logoth
WR Updates: 21,795,971
Padanfain WR Profile

PostPosted: Fri Jan 11, 2013 9:17 pm    Post subject: Reply with quote

BTW five of the failures on the 19th were taken on a second computer with a
fresh install of WoW, the only addon installed and updated is CensusPlus via
curse client and a purge after each upload on both computers. I'm getting
the feeling the database just hates me. Crying or Very sad Laughing
Back to top
View user's profile Send private message
PJEckenheim



Joined: 22 Dec 2012
Posts: 9
Location: Germany
WR Updates: 297,099
PJEckenheim WR Profile

PostPosted: Sun Jan 13, 2013 2:32 pm    Post subject: Reply with quote

Padanfain wrote:
BTW five of the failures on the 19th were taken on a second computer with a fresh install of WoW, the only addon installed and updated is CensusPlus via curse client and a purge after each upload on both computers. I'm getting the feeling the database just hates me. Crying or Very sad Laughing


Judging by the number of errors from pretty much everyone, I'm beginning to think it's not a problem with the uploads, but with the database itself.

I'm not into coding, but would it be possible that the database can't cope with the number of entries? After all, "Total character count: 98,373,879" and "Total guild count 6,580,801" does mean a really big lot of datasets...
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 152
Location: Shadar Logoth
WR Updates: 21,795,971
Padanfain WR Profile

PostPosted: Tue Jan 15, 2013 5:48 pm    Post subject: Reply with quote

Dec 25, 12 23:57:52 1787 4425 Y
Dec 25, 12 22:23:20 3519 7105 Y
Dec 25, 12 20:10:30 1281 3168 Y
Dec 25, 12 19:08:30 932 3018 Y
Dec 25, 12 18:13:16 607 2147 Y
Dec 25, 12 17:57:00 1343 4110 Y
Dec 25, 12 17:40:16 1154 2792 Y
Dec 25, 12 17:24:49 3302 6466 Y
Dec 25, 12 17:09:18 1331 3091 Y
Dec 25, 12 16:53:43 1007 3085 Y
Dec 25, 12 16:37:34 1467 3884 Y
Dec 25, 12 16:20:39 718 2353 Y
Dec 24, 12 02:02:46 1910 4276 Y
Dec 24, 12 01:18:56 1768 4446 Y

Looking promising along with the queue gaining 2 days toward being
caught up. Did Rollie make some changes or ??? Hope this trend
continues.
Back to top
View user's profile Send private message
SannaSK



Joined: 07 Sep 2005
Posts: 69

WR Updates: 418,020
SannaSK WR Profile

PostPosted: Tue Jan 15, 2013 6:15 pm    Post subject: Reply with quote

Not that I know anything for sure, and also not to be a total naysayer, but those dates were when the db was already known by the userbase to be having issues, plus it's the Christmas timeframe, so my first thought was that fewer files were getting submitted on those days, thus the DB might still be processing at its same slow speed, and only has less to chew through.

Although I'd much prefer to subscribe to the theory of 'the problems are fixed' X D.

This thread has inspired me to do a complete purge of data after every upload, because even when things are fine serverside, why make it chew through the same data twice?
_________________
Censusing: Mostly Bronzebeard, Aggramar, Elune; sometimes Alleria, Icecrown, Scilla, Kel'Thuzad, Mal'Ganis, Draka, Staghelm, Nathrezim, Stonemaul.
Back to top
View user's profile Send private message
Padanfain
Updater Extraordinaire


Joined: 18 Dec 2010
Posts: 152
Location: Shadar Logoth
WR Updates: 21,795,971
Padanfain WR Profile

PostPosted: Wed Jan 16, 2013 12:01 am    Post subject: Reply with quote

Good points SannaSK, I prefer to subscribe to the theory too.

I purged after every submission for most of December and in hindsight I
wish I hadn't. Each file that errors is just gone, poof, recycled electrons
before they were counted. Pruning to, say, two days or maybe three would
have contributed something of those soon to be recycled electrons when
that one file out of five or ten was a success.
Back to top
View user's profile Send private message
PJEckenheim



Joined: 22 Dec 2012
Posts: 9
Location: Germany
WR Updates: 297,099
PJEckenheim WR Profile

PostPosted: Fri Jan 18, 2013 12:46 pm    Post subject: Reply with quote

Jan 02, 13 20:10:19 0 0 N
Dec 27, 12 06:32:46 803 2534 Y
Dec 26, 12 13:34:41 4603 8626 Y
Dec 23, 12 20:33:10 0 0 E
Dec 23, 12 19:50:43 0 0 E
Dec 23, 12 13:24:47 0 0 E
Dec 23, 12 05:33:49 1676 3742 Y
Dec 22, 12 19:45:54 0 0 E

... we'll see if the bugs are gone. I'm afraid I don't subscribe to the "purge of data after every upload" method. I'd suggest a /prune to the date that the person uploading had the last confirmed successful upload...
Back to top
View user's profile Send private message
Balgair
Araiceil


Joined: 30 Sep 2005
Posts: 1549
Location: UK
WR Updates: 11,351,655
Balgair WR Profile

PostPosted: Tue Jan 22, 2013 2:43 pm    Post subject: Reply with quote

Dec 31, 12 10:30:49 218 1368 Y
Dec 30, 12 17:16:30 850 3416 Y
Dec 29, 12 08:23:58 524 2225 Y
Dec 28, 12 16:58:21 0 0 E
Dec 26, 12 16:53:41 3172 9275 Y
Dec 21, 12 08:08:55 4696 8451 Y
Dec 20, 12 16:50:30 1193 4743 Y

Certainly improving for me, not perfect but definitely doing better than it was. I mailed Rollie a few days back asking if he'd done anything to cause the recent improvements, but no response as yet so I guess he's not available right now, it may just be lesser load with fewer uploads over the holiday period, we'll see.
_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Balgair - Naomh - Eilnich - Ruire - Dubh - Laidir --
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   This topic is locked: you cannot edit posts or make replies.    WarcraftRealms.com Forum Index -> News and Announcements All times are GMT - 6 Hours
Goto page Previous  1, 2, 3 ... 11, 12, 13, 14  Next
Page 12 of 14

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
WarcraftRealms.com  


Powered by phpBB © 2001, 2005 phpBB Group