crawler

常见例句

The basic design of this crawler is to load the first link to check onto a queue.
这个爬虫的基本设计是加载第一个链接并将其放入一个队列。
You’re better off letting your site pages be found naturally by the crawler. Good global navigation and linking will serve you much better than relying only on an XML Sitemap.
你最好打消让爬行者自动发现网站页面的念头，良好的全局导航和链接会为你服务，远胜于仅仅依靠一个XML的网站地图；
blog.sina.com.cn
Bathed in xenon spotlights, the white spaceship, attached to its twin solid rocket boosters and orange external fuel tank, crept 3.4 miles on the back of an enormous tractor called the Crawler.
沐浴着氙气聚光灯光，白色的飞船，带着一对固体火箭推进器和橙色外挂燃料箱，在称为“爬行者”的巨大拖拉机上缓慢行驶了3.4英里。

Set up a crawler that can scrape some webpages and parse some basic data.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
Set up a bigger crawler that has to fill out a form or two.
FORBES: What Are Some Useful Technical Skills I Can Learn Within A Day?
As with all dungeon-crawler, hack-and-slash action RPGs, the gameplay does get old after a while.
FORBES: The Bad