Site updated for MoP - Censusplus v6.0 download link

esiemiat · Posted: Mon Dec 10, 2012 10:45 pm Post subject:

I think there is something wrong with the process, now one of my files errored.

esiemiat · Posted: Mon Dec 10, 2012 11:20 pm Post subject:

Nevermind. I swear there was an E there, but now it shows a Y.

FuxieDK · Posted: Tue Dec 11, 2012 12:25 am Post subject:

While a file is being processed, it shows an E, which is then changed to Y when processed completely..
_________________
Doing census on various servers Wink

bananorama · Posted: Tue Dec 11, 2012 2:27 am Post subject:

Sorry for my question, but...
I'm not quiet familiar with the queue system.
Is the queue finally moving to december?
Is there any hope that the queue is getting better without Rollie's help?

greetings from Austria

1974ER · Posted: Tue Dec 11, 2012 2:45 am Post subject:

As I write these words, it in fact already has and a few people have made it to the December top 10 lists. Now that my massive stockpiles are gone, I hope the queue will move forward more swiftly, as it appears to be doing. Smile

Even more importantly, I hope my files don't cause any further snags in it.

My apologies to Rollie for causing a lot of extra work. Sad

Thank yous to Bringoutyourdead, Balgair, Hybuir, Fuxie and others.

Epic Censi wishes everyone a more successful December, both in game and otherwise! Smile

Hybuir · Posted: Tue Dec 11, 2012 6:39 am Post subject:

I do Censuses for selfish reasons... I want to be tracked. And I want to be #1, but I'll settle for staying in the top 10 Smile

_________________

1974ER · Posted: Wed Dec 12, 2012 1:17 am Post subject:

*very, very deep sigh*

It's my very sad duty to report that queue is still broken. Sad

Dec 01, 12 18:16:44 0 0 E
Dec 01, 12 14:57:22 1650 7562 Y
Nov 30, 12 18:43:32 1405 6498 Y

The first two post-stockpile .luas succeeded... the 3rd failed. Sad

And no, it's not being worked on as the DB stats page says:

Last processed file was uploaded on 2012-12-01 23:33:13.

As I see no reports from anyone else having massive failures, I have to conclude that the problem is somehow, unexplainably, created by me. My current, rather sad conclusion is that I may have to quit in order not to ruin the site for others... HELP!!!

Until I hear otherwise, I am going back to "stockpile mode".

This is Epic Censi, signing off... Sad

esiemiat · Posted: Wed Dec 12, 2012 9:32 am Post subject:

Epic Censi, how large are your files?

bringoutyourdead · Posted: Wed Dec 12, 2012 12:02 pm Post subject:

Size isn't the issue as such..
One of the first uploads when the DB was opened up again had over 12,000 new characters and more then 22,000 updated characters.

That was more then 3x Epic Censi's typical update size.

I think I also ran across an update of over 25,000.. but can't remember who the updater was.

1974ER · Posted: Wed Dec 12, 2012 12:04 pm Post subject:

They vary a lot... from about 1 MB to slightly below 10 MB, which is the upper limit of manual upload. But as I have stated before, the file size is not direct cause of the problem. That particular file is somewhat under 7 MB... but the point is that much smaller AND larger files have BOTH failed AND succeeded. If file size alone was indicative, I would be looking at a failure rate somewhere in the range of 80 to 95%... at the moment... out of last almost 180 files I have uploaded since I was able to resume uploading, 23 have not been gotten to yet and at a quick count, 31 have utterly failed.

As I posted earlier... I looked backward a lot... in the time preceeding the site update, I found TWO failures within a time period exceeding one year. Two failures in over a year versus over 30 failures in less than two weeks tells me something is seriously wrong... but what that something is, remains an utter mystery to me.

Just as quick example, look at this:

Nov 30, 12 15:55:37 0 0 E
Nov 30, 12 15:53:55 1089 4739 Y
Nov 30, 12 15:51:47 0 0 E
Nov 30, 12 15:49:52 2476 9240 Y
Nov 30, 12 15:47:49 0 0 E

If I am looking at this correctly, those submissions come from the same, incremental .lua. The smallest, the one in the middle and the biggest of the five failed. If there was a direct size comparison, files two and four should have automatically failed, but they didn't. Again, if it was file damage, they should have all failed, because they are all derivates of the smallest.

When I uploaded them, the system didn't report any problems. All of them gave me the usual messages of a successful upload. I am quite simply stumped and don't really have a choice in the matter before I hear something new. Sad

As I stated this morning, I have gone back to "stockpile mode" and wait. If I don't hear anything fairly soon (within the next few days), I have to conclude that I am inadvertently causing problems and need to quit uploading permanently in order to prevent constantly breaking the queue. Sad

This is a very sad Epic Censi, signing off... Sad

Padanfain · Posted: Wed Dec 12, 2012 1:54 pm Post subject:

I don't think your files are the cause of the problem 1974ER.

I just looked through my submissions and had no errors
until Dec 28th and have had 2 failures since then. Not as
many failures but not as many files either.

Padanfain · Posted: Fri Dec 14, 2012 9:18 pm Post subject:

Dec 04, 12 00:30:43 0 0 E
Dec 03, 12 01:03:33 0 0 E
Dec 01, 12 23:44:11 0 0 E

and now 3 failures in a row, doh Rolling Eyes

lol. I'll never catch ya for updates but
I can try and match you for errors 1974ER, 20 something to go.

1974ER · Posted: Sat Dec 15, 2012 3:05 am Post subject:

I am very sorry to hear that. For me, a loss a file or two (or even 30) is just a major setback. For someone who only makes submissions a few times a week, it's rather devastating. Sad

Though it doesn't help with queue backlog problem, you should probably try making at least 2 submissions on the days you do. That way, if you don't do full purges, most of data should eventually go through, as for at least as far my errors were concerned, the errors almost exclusively hit every second file at most.

Also, a few days have already passed and there is no further info... Sad

And the queue has now fallen almost 11 days behind! So, things on a very overall level have actually gotten even worse since my big stockpiles went away... which, from my point of view is pretty incredible, in the bad way. Sad

Korwynd · Posted: Sat Dec 15, 2012 6:29 pm Post subject:

I'm showing:
Dec 15, 12 18:24:47 N
Dec 15, 12 09:01:32 N
Dec 13, 12 22:33:53 N
Dec 13, 12 21:01:30 N
Dec 13, 12 18:55:40 N
Dec 11, 12 22:35:54 N
Dec 11, 12 22:16:12 N
Dec 11, 12 18:52:47 N
Dec 11, 12 18:35:17 N
Dec 04, 12 22:03:25 N
Dec 02, 12 22:37:05 Y
Dec 02, 12 00:03:08 Y
Dec 01, 12 22:59:44 Y

So nothing since Dec. 2nd.

Padanfain · Posted: Sat Dec 15, 2012 7:47 pm Post subject:

Last processed file was uploaded on 2012-12-04 20:45:12.
Current server time is 2012-12-15 19:46:37

It's getting close to your file on the 4th Korwynd.

I think I started aggressively pruning about Dec 7th so I figure I will have a
few more errors at the least. By the 11th I was purging after each
submission and submitting 5 small files a day so we'll see if that has any
effect.

Padanfain · Posted: Sun Dec 16, 2012 9:27 pm Post subject:

Dec 05, 12 16:30:10 0 0 E
Dec 05, 12 00:57:23 0 0 E
Dec 04, 12 17:22:03 0 0 E
Dec 04, 12 00:30:43 0 0 E
Dec 03, 12 01:03:33 0 0 E
Dec 01, 12 23:44:11 0 0 E
Nov 30, 12 23:54:55 4472 12847 Y
Nov 29, 12 23:36:39 4347 12797 Y
Nov 28, 12 23:50:31 0 0 E

/palm_to_forehead Doh! Hopefully the smaller files after I started
regularly purging will go better.

Balgair · Posted: Tue Dec 18, 2012 8:16 pm Post subject:

I've given Rollie another /poke, hate to bug the guy constantly so I tend to leave it a while after first contact on any issue but this clearly isn't fixing itself.

I've looked over everyone in top contributors this month and last, and it seems only ER and Padanfain have errors, both seem to be giving higher update totals than most (although nothing unusual; I've regularly had similar/larger totals per file in my more active moments with no trouble), but, there are two users who managed 20k+ submissions back in November, so clearly filesize isn't the only factor here.

Gave Rollie that info plus what I could get from the posts recently, hopefully he can come up with something, even if it's just "sorry, the database can't handle such large files any more, here's your new size limit" Confused

_________________
EU-Draenor:
-- Sagart - Tairbh - Buinne - Eilnich - Ruire - Balgair - Dubh - Laidir - Rosad - Naomh --

1974ER · Posted: Fri Dec 21, 2012 2:49 pm Post subject:

Unlike Padanfain, my files from Dec 2 to first submission of Dec 8 have been successful. Though I am currently not submitting, I am heavily pruning my stockpile files, striving hard to keep them under 6 MB. Once we reach Dec 11 and the last of my current uploads is processed, we may or may not see some change in the queue speed, which is currently slow, but from my personal view, working better than during end of November, very early December.

Korwynd · Posted: Fri Dec 21, 2012 9:50 pm Post subject:

This is what I have now
Dec 21, 12 21:47:05 0 0 N
Dec 21, 12 07:02:55 0 0 N
Dec 19, 12 22:26:11 0 0 N
Dec 19, 12 20:58:20 0 0 N
Dec 19, 12 08:02:25 0 0 N
Dec 18, 12 22:22:20 0 0 N
Dec 18, 12 21:44:53 0 0 N
Dec 18, 12 06:57:26 0 0 N
Dec 17, 12 22:54:26 0 0 N
Dec 16, 12 22:12:13 0 0 N
Dec 16, 12 11:05:25 0 0 N
Dec 15, 12 23:56:23 0 0 N
Dec 15, 12 21:22:46 0 0 N
Dec 15, 12 18:24:47 0 0 N
Dec 15, 12 09:01:32 0 0 N
Dec 13, 12 22:33:53 0 0 N
Dec 13, 12 21:01:30 0 0 N
Dec 13, 12 18:55:40 0 0 N
Dec 11, 12 22:35:54 0 0 N
Dec 11, 12 22:16:12 0 0 N
Dec 11, 12 18:52:47 0 0 N
Dec 11, 12 18:35:17 0 0 N
Dec 04, 12 22:03:25 513 1285 Y
Dec 02, 12 22:37:05 58 320 Y

Padanfain · Posted: Fri Dec 21, 2012 11:01 pm Post subject:

A couple of successful files is an encouraging sign but the queue has slipped
a bit more, 13 days behind.

Dec 08, 12 21:23:14 0 0 N
Dec 08, 12 01:12:33 4673 13404 Y
Dec 07, 12 22:24:49 0 0 E
Dec 07, 12 00:16:12 18985 43036 Y
Dec 06, 12 21:25:37 0 0 E
Dec 05, 12 21:09:20 0 0 E

Some of the times that I've seen the database stats page stuck for 2~4 hours
at a time it isn't choking on your files 1974ER or mine. If no other members
are showing errors, is Anonymous showing a ton of errors Balgair?