guildprogress.com

Crawler Updated

by Xxav on January 14, 2010, 1:59 am, under WoW Crawler, World of Warcraft

The WoW Armory received a cosmetic overhaul today which broke our crawler. This has now be corrected and the new crawler is available for download. Please let me know if you discover any problems. Thanks!


11 Comments for this entry

  • Elyn

    Hey there,

    Could it be possible that Putricide’s achievement (Neausea,….) isn’t crawled for? We got this achievement yesterday (10man), but the crawler didn’t pick it up?

  • Fly

    Would it be possible to add the possiblity to crawl all guilds on a given Realm with the local Crawler?

    I’d like to have the Crawler pick up the guild with the oldest update date, add it to the queue and then crawl it. Maybe add a limit to how often to crawl automatically to a configurable maximum (like once a day or so).

  • Shadow

    Doesn’t look like anything has been crawling for over a day. Is the site having problems?

  • Xxav

    @Shadow – Fixed. Thank you for bringing this up. I’m going to implement a process to better monitor this going forward.

  • Warspirit

    I’m wondering if you have thought about modifying the point structure to reflect the actual difficulty of the bosses. I understand the “wing” mentality and we all thought the same before it was released. However, we know now that BPC is absolutely NOT a 1500 point step up from Putricide.

    It’s clear now that Blizz intended the end bosses in each wing to be the gate, and not the actual wing itself.

    I feel it would make more sense to have the early bosses in each wing on par with each other and the end bosses similar.

    So instead of the points increasing like:
    Rot, Fester, Putricide, BPC, BQ, Valithria, Sindragosa, LK
    It would be more like:
    Rot, Fester, BPC, Valithria, Putricide, BQ, Sindragosa, Lich King

    Just a suggestion as this would be a more accurate picture of where a guild really ranks in power and skill.

  • Xxav

    I’ve gone ahead and updated the scoring based on what you suggested. This will be reflected Sunday morning when the scoring updates go through.

    Thanks for the suggestion!

  • Elyn

    Any news on crawling for the missing achievement by any chance? (putricide achievement)

  • Fly

    I’d like to have a commandline-option for selecting a preferred server during startup. I normally have the Crawler running in the background for both servers I am active on – if I remember starting it and then setting it to the servers.

    BTW… could you tell us more about how the crawler does automatic crawling? The following question comes to my mind:
    - how does it choose, which guild from a preferred Server to crawl? Does it look at age? Rank?
    - could you give us some information about how many crawlers would need to be running to bring all guilds up to date within a week or so? And how long it would take with the current average?

  • Suz

    Any news on the Putricide achievement?

  • Xxav

    It should be fixed. Sorry about that.

  • sphing

    i realize this is almost irrelevant, but im pretty sure the crawler is broken. for the past day or so its been telling me “New rankings are currently being calculated.” … “completes (which should only be a few minutes).”

    any news on when it might finish ;P

Leave a Reply