guildprogress.com » WoW Crawler

Patch 3.3.5

Xxav — Tue, 22 Jun 2010 22:04:12 +0000

Today was patch 3.3.5 which introduces The Ruby Sanctum:

A powerful war party of the Black Dragonflight, led by the fearsome Twilight dragon, Halion, have launched an assault upon the Ruby Sanctum beneath Wyrmrest Temple. By destroying the sanctum, the Black Dragonflight look to crush those that would stand in the way of their master’s reemergence into Azeroth and to ultimately shatter the Wyrmrest Accord – the sacred bond that unites the dragonflights.

The battle that is to come will surely deal a crippling blow to the Red Dragonflight, however, it is up to you to stop this unprecedented offensive and defend the Ruby Sanctum. First you must face the assault of Halion’s servants, Saviana Ragefire, Baltharus the Warborn, and General Zarithrian, before squaring off against Halion the Twilight Destroyer, a new and deadly force in this realm.

Unfortunately there are only 4 achievements to track. For now, these are being tracked within the Icecrown Citadel categories. I may move it later depending on feedback received.

Enjoy the new content!

Crawler Updated

Xxav — Thu, 14 Jan 2010 05:59:42 +0000

The WoW Armory received a cosmetic overhaul today which broke our crawler. This has now be corrected and the new crawler is available for download. Please let me know if you discover any problems. Thanks!

EU Armory Maintenance

Xxav — Wed, 09 Sep 2009 16:47:11 +0000

The EU Armory has been down for over 15 hours now which is preventing our crawlers from updating EU guilds. Once the EU Armory comes back online crawling will continue and any guilds that are queued should be crawled then.

UPDATE: It appears to be back online.

Crawler Delays

Xxav — Fri, 04 Sep 2009 21:34:19 +0000

I wanted to let everyone know that we’re aware of the crawler delays and are looking into the matter. Currently, this is about 1200 guilds waiting in the queue that were added by users. I just made a few changes that should prevent guilds from getting stuck in the queue for days. We’ve had some malicious activity on our server the past few days and I’m currently investigating to see if this is related. I want to thank all those who have downloaded the crawler in the past few days. We’re currently reaching over 2000 guilds crawled per hour which is pretty awesome. Once I know more about the huge queue I will post back here.

UPDATE:

A malicious user was queueing tons of guilds over and over. I have since blocked him and have added countermeasures to future attacks.

Here’s their IP address: 75.127.177.114

Sorry for the crawler delays! They should be back to normal shortly!

Crawler Fix and Instant Scoring

Xxav — Thu, 03 Sep 2009 16:43:11 +0000

A change was made last night that would cause recently started crawlers to crash upon starting. I just corrected this bug and I am also going to use this to force an update to the crawler on those who have been running older versions. You can find the new version here as well as a list of changes. Sorry for the hiccup and thank you for crawling

Also, we’re currently working on a way to enable live scoring and hope to have this completed tonight. This would allow us to provide an estimated new score for a guild whenever new data is collected so you could then see it instantly reflected on the charts. Keep an eye out for this soon!

UPDATE: Instant scoring is now live!

ToC Kill Date Inaccuracies

Xxav — Tue, 01 Sep 2009 22:21:07 +0000

I’ve been receiving a lot of emails about Trial of the Crusader boss kills being one day off and wanted to address this. The reason this happens is because our crawlers are getting information for these bosses based on the multi-part zone achievements. For example:

<achievement categoryId="168" desc="Defeat every boss in the Trial of the Crusader in 10-player mode." icon="achievement_reputation_argentchampion" id="3917" points="10" title="Call of the Crusade (10 player)">
        <criteria date="2009-08-26+02:00" id="11684" name="Defeat the Beasts of Northrend"/>
        <criteria date="2009-08-25+02:00" id="11685" name="Defeat Lord Jaraxxus"/>
        <criteria date="2009-08-25+02:00" id="11686" name="Defeat the Faction Champions"/>
        <criteria date="2009-08-26+02:00" id="11687" name="Defeat the Twin Val'kyr"/>
        <criteria id="11688" name="Complete the Trial of the Crusader"/>
      achievement>

That is what the crawler sees when it visits are player’s achievement page. The dates listed here next to are the dates that are being recorded. We have no other way of checking for a date and are at the mercy of the Armory in this regard. I just wanted to emphasis that this is on Blizzard’s end and is not guildprogress.com’s fault!

One thing I would suggest is relogging after your raid over to sync with the Armory. I am not sure how effective that is but if you are concerned about having accurate data on the Armory you can give it a shot!

Crawler Error Corrected

Xxav — Thu, 06 Aug 2009 14:02:11 +0000

If you had trouble receiving credit for a kill or achievement since 3.2 was released please queue your guild again. I just realized Blizzard went back and changed the name of all the old achievements to be the same format as the new Crusader ones (ie. Heroic: Shattered became Shattered (25 player) ). The new rules have been loaded in to the crawler and we should be good to go.

UPDATE: 10 player Coliseum bugs have been corrected. Please re-queue if you’re missing them!

Badge Bug Squashed

Xxav — Mon, 22 Jun 2009 23:40:41 +0000

If your guild badge was not displaying properly it should now be fixed. If not, please try to rebuild it and let me know if the problem persists.

Also, this bug caused a bit of chaos yesterday and this morning which resulted in the crawler not working and part of the site being down. If you notice your crawler being “stuck” please exit it and restart the program. Thanks again for those of you who run the crawler.

Sorry for the downtime!

And by the way, I’m still looking for ideas and suggestions for new features and improvements. You can comment on this entry without having to register. I am currently working on an interesting new feature that will display the data in different format. I’ll release more on this as it nears completion. But really, I want your feedback!

Crawler Server Select Option Added

Xxav — Sat, 30 May 2009 03:46:15 +0000

Due to popular demand, I updated the crawler so that you will be able to choose which server you want to spend the majority of the time crawling. Just select your server from the dropdown list and that server will be focused on. Half of your crawling time will be used to crawl the chosen server and the other half will continue to crawl guilds worldwide. This way ensures that guilds will still be crawled if no one has that server selected. I did not force this update onto current users, however, anyone interested should head to the crawler page. If you run into any problems feel free to contact me here.

EU Guilds Flagged As “Not enough members”

Xxav — Fri, 29 May 2009 21:57:57 +0000

Just a heads up that I am trying to figure out why a handful of EU guilds have been marked as not having enough members. This doesn’t affect the scoring at all so please do not panic if you see your guild being marked as such. Requeueing the guild should resolve the problem.