Name		Name	Last commit message	Last commit date
.rustyfrog		.rustyfrog
.templates		.templates
rustyfrog		rustyfrog
rustyseo		rustyseo
src		src
templates		templates
.content		.content
.gitignore		.gitignore
.report.html		.report.html
Cargo.lock		Cargo.lock
Cargo.toml		Cargo.toml
README.md		README.md
RustySEO-Report.html		RustySEO-Report.html
links.txt		links.txt
main		main
notes.md		notes.md
response.txt		response.txt
seo_report.html		seo_report.html
sitemap.xml		sitemap.xml
tut.rs		tut.rs

Repository files navigation

🦀 Rusty Crawler

A simple crawler build in rust that crawls your website domain and outputs all URLs that exist.

TODO:

Generate sitemap programatically

About

SEO crawler in Rust 🦀

8 stars

1 watching

Report repository

Releases

Packages

Used by

Contributors

Languages