Initial commit

2023-12-22 18:04:27 +03:00
commit 3c71f14fb3
3 changed files with 183 additions and 0 deletions
@@ -0,0 +1,2 @@
+# crawler
+A robot that copies the current site and searches for all hyperlinks and follows them.