4.3 Dragon Soul Added
by Xxav on December 11, 2011, 3:03 pm, under WoW Crawler, World of Warcraft
Hi All,
Sorry for the delay in getting the new 4.3 raid content up. Normal and Heroic Dragon Soul should now be recording correctly. Let me know if anything is amiss.
Thanks!
Guild Alliances
by Xxav on September 16, 2011, 5:51 pm, under EverQuest 2
I am receiving a lot of mail about the guild alliances that are on the Crushbone progression. The FAQ does not say that guild alliances are not allowed. It simply says guild alliances weren’t supported because at that time I was populating guild lists automatically using EQ2Players. I am still undecided as to whether or not alliances should be in the rankings. Please post your comments/suggestions here.
Missing Progression Explanation
by Xxav on September 14, 2011, 10:45 am, under WoW Crawler, World of Warcraft
I’ve received a lot of comments lately regarding missing progression. Specifically, missing progression for normal Cataclysm bosses. This is due to Blizzard’s API missing achievement data related to those bosses’ achievements. You can find more in the thread I posted here: http://us.battle.net/wow/en/forum/topic/3082210898. I spoke to someone from their API team and they are aware of the bug but don’t have a timeline as to when it will be fixed (hopefully soon!). Some progressions sites use different data to come up with their progression. I’m using individual character achievements and that is unfortunately affected by this bug. I’ll let you know when I know more. Thanks!
Crawler Status
by Xxav on August 21, 2011, 4:23 pm, under WoW Crawler, World of Warcraft
Hi All,
I’ve been away from the computer the past week. I should point out that only Cataclysm content is being recorded in the new crawler. Are you guys seeing issues where that content isn’t being updated?
The good news is that I ran it unattended all week and nothing blew up. The bad news is, as some have pointed out, is that it is not that fast.
Ideally, I will release a public version but I need to see how that all factors into the daily limits that Blizzard imposes on the API.
Thanks for all your comments on the crawler. I will be spending some time this week digging into these issues and hopefully I’ll have an update soon. Please continue to post feedback on any issues you are having.
UPDATE 1: I identified and fixed a bug where bosses that are tracked using an achievement’s criteria were not being recorded. Also, I have just forced a recrawl of all guilds crawled this past week.
New WoW Crawler Completed!
by Xxav on August 7, 2011, 12:22 pm, under WoW Crawler, World of Warcraft
Now that Blizzard’s API is officially live, I am working on developing a new crawler program to take advantage of it. This should result in more accurate data as well as quicker updates. Stay tuned!
Update: Should be ready this weekend soon!
Update 2: The program is done but I am waiting for authenticated access from Blizzard. Hopefully I’ll get it soon!
Update 3: I have a key! I’m going to be running the new crawler locally for the time being. Once I iron out the bugs I’ll release a public version. Thanks for your patience!
Update 4: I’ve been running the new crawler this past week. It’ll definitely be a big improvement on the quality of our data. I’m going to continue to run it privately but since it is much faster than the previous methods there may not even be a need to release a public version. Thanks for hanging in there during the transition!
Update 5: We’re currently exceeding our daily request limit on Battle.net. Blizzard has tripled the amount of requests we can make but this hasn’t taken effect just yet. This is why the crawler seems to stop working in the late afternoon. Request limits are reset at 7pm EST.