Anyone know a good web spider/crawler? I want something which can start with a given URL and retrieve pages to a specified depth. Search capability with support for special characters is a bonus.
Hrm; I may be—I've been been getting into semicolons lately, and trying to moderate my em dash use and write in sentences of less than paragraph length. While those work well enough for academic papers, they aren't as great in the real world.
![[personal profile]](https://www.dreamwidth.org/img/silk/identity/user.png){kind=small}
![[identity profile]](https://www.dreamwidth.org/img/silk/identity/openid.png){kind=small}
(no subject)
Date: 2006-04-29 01:15 am (UTC)(no subject)
Date: 2006-04-29 01:17 am (UTC)