guildprogress.com

The site was inaccessible for a few hours today due to a widespread power failure at our web host. After moving each affected server to a new server rack, things seem to be back online. Sorry for the outage!

I wanted to let everyone know that we’re aware of the crawler delays and are looking into the matter. Currently, this is about 1200 guilds waiting in the queue that were added by users. I just made a few changes that should prevent guilds from getting stuck in the queue for days. We’ve had some malicious activity on our server the past few days and I’m currently investigating to see if this is related. I want to thank all those who have downloaded the crawler in the past few days. We’re currently reaching over 2000 guilds crawled per hour which is pretty awesome. Once I know more about the huge queue I will post back here.

UPDATE:

A malicious user was queueing tons of guilds over and over. I have since blocked him and have added countermeasures to future attacks.

Here’s their IP address: 75.127.177.114

Sorry for the crawler delays! They should be back to normal shortly!

A change was made last night that would cause recently started crawlers to crash upon starting. I just corrected this bug and I am also going to use this to force an update to the crawler on those who have been running older versions. You can find the new version here as well as a list of changes. Sorry for the hiccup and thank you for crawling

Also, we’re currently working on a way to enable live scoring and hope to have this completed tonight. This would allow us to provide an estimated new score for a guild whenever new data is collected so you could then see it instantly reflected on the charts. Keep an eye out for this soon!

UPDATE: Instant scoring is now live!

I’ve been receiving a lot of emails about Trial of the Crusader boss kills being one day off and wanted to address this. The reason this happens is because our crawlers are getting information for these bosses based on the multi-part zone achievements. For example:

<achievement categoryId="168" desc="Defeat every boss in the Trial of the Crusader in 10-player mode." icon="achievement_reputation_argentchampion" id="3917" points="10" title="Call of the Crusade (10 player)">
        <criteria date="2009-08-26+02:00" id="11684" name="Defeat the Beasts of Northrend"/>
        <criteria date="2009-08-25+02:00" id="11685" name="Defeat Lord Jaraxxus"/>
        <criteria date="2009-08-25+02:00" id="11686" name="Defeat the Faction Champions"/>
        <criteria date="2009-08-26+02:00" id="11687" name="Defeat the Twin Val'kyr"/>
        <criteria id="11688" name="Complete the Trial of the Crusader"/>
      </achievement>

That is what the crawler sees when it visits are player’s achievement page. The dates listed here next to <criteria data=” are the dates that are being recorded. We have no other way of checking for a date and are at the mercy of the Armory in this regard. I just wanted to emphasis that this is on Blizzard’s end and is not guildprogress.com’s fault!

One thing I would suggest is relogging after your raid over to sync with the Armory. I am not sure how effective that is but if you are concerned about having accurate data on the Armory you can give it a shot!

In an effort to keep the rankings as up to date as possible, we made some changes that will allow us to recalculate the rankings/scoring more frequently.

• The rankings for Ulduar/Coliseum will now be refreshed every 2 hours.
• Wrath of the Lich King rankings will be refreshed every morning at 4am est.
• The Burning Crusade will no longer be crawled or have it’s rankings updated.

We’re continuing to look at ways to make the rankings quicker to update and hope to have more improvements in the near future.