(no subject)

[ursula]

Anyone know a good web spider/crawler? I want something which can start with a given URL and retrieve pages to a specified depth. Search capability with support for special characters is a bonus.

[Same game.]

Comments

[dymaxion.livejournal.com]

Fewer em dashes than I tend to use, and no non-breaking space between the sentences, but that's probably me, certainly by my more recent posts.

wget should do what you need.

[wengeue.livejournal.com]

This (http://www.xav.com/scripts/search/) is what the An Tir Heralds site uses. I don't know how it deals with special characters, but it's worth checking.