You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To reduce lookup time in the Spidr::Agent#queue, we can store the URLs in a Hash of the unique host:port pair and the URL paths. This will also facilitate events for when new hosts are seen.
To reduce lookup time in the
Spidr::Agent#queue, we can store the URLs in a Hash of the uniquehost:portpair and the URL paths. This will also facilitate events for when new hosts are seen.