지역 사회
배우다
도구 라이브러리
AI 도구
여가
찾다
한국어
목차
머리말
손으로 작성한 벤치마크 크롤러
두 번째 크롤러고 크롤링
3 rad 크롤링
4 burpsuite v202012
五 awvs
六 比较
집 운영 및 유지보수 안전 Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법

Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법

PHPz
PHPz
May 12, 2023 am 10:49 AM
crawlergo burpsuite awvs

머리말

최근에 웹 크롤링 링크와 관련된 코드를 작성하고 있는데 Baidu: superSpider에서 이 기사를 우연히 발견했고, 갑자기 스캐너에 있는 일반적인 크롤러 도구와 크롤러 모듈의 기능이 궁금해서 여기에 왔습니다. 그것.

크롤러고, rad, burpsuite pro v202012, awvs 2019뿐만 아니라 직접 작성한 블라인드 크롤러를 주로 테스트합니다.

손으로 작성한 벤치마크 크롤러

a 태그 아래의 href와 스크립트 태그 아래의 src만 크롤링합니다.

from urllib.parse import urlparse,urljoin
from bs4 import BeautifulSoup
import requests
import validators
from queue import Queue
import threading
requests.packages.urllib3.disable_warnings()


class jsfinder():
    def __init__(self,url,cookie=""):
        self.baseUrl = self.return_entire_url(url)
        self.headers = {
            "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.108 Safari/537.36",
            "cookie": cookie}
        self.q = Queue()
        self.crawed_list = set()
        self.urlList = []
        self.q.put(url)

        self.spider_status = 1

    def return_entire_url(self,url):
        if url is not None:
            if url.startswith('http') or urlparse(url).scheme:
                return url.strip()
            else:
                if self.baseUrl == "":
                    self.baseUrl = "http://" + url
                    print(self.baseUrl)
                return urljoin(self.baseUrl,url.strip())
        else:
            pass

    def spider(self):
        while(not self.q.empty() or self.spider_status):
            url = self.q.get()
            if url in self.crawed_list :
                continue
            print("requesting:",url)
            try:
                resp = requests.get(url=url, headers=self.headers, timeout=5, verify=False)
                self.htmlParse(resp)
                self.crawed_list.add(url)
            except:
                print("requests error:",url)

            if self.spider_status == 1:
                time.sleep(5)
                self.spider_status = 0

            print(self.q.qsize())

    def htmlParse(self,response):
        tempList = []
        blacklist = ['#',None,'javascript:']

        soup = BeautifulSoup(response.text.encode('utf-8'), 'html.parser')
        for href in soup.find_all('a'):
            #print(self.urlParse(href.get('href')))
            tempList.append(href.get('href'))

        for href in soup.find_all('script'):
            #print(self.urlParse(href.get('src')))
            tempList.append(href.get('src'))

        tempList = list(set(tempList)-set(blacklist))
        for i in tempList:
            url = self.return_entire_url(i)
            if validators.url(url):
                print("get:",url)
                #print(i,self.return_entire_url(i))
                if url not in self.crawed_list :
                    self.urlList.append(url)
                    if urlparse(url).netloc in self.baseUrl:
                        self.q.put(url)

if __name__ == "__main__":
    A = jsfinder("http://testphp.vulnweb.com")
    t = threading.Thread(target=A.spider)
    t.start()
    t.join()
    for i in list(set(A.urlList)):
        print(i)
로그인 후 복사

결과:
46개의 링크, 다른 도메인 이름의 많은 링크와 매개변수가 있는 많은 링크가 혼합됨

http://testphp.vulnweb.com/product.php?pic=3
http://testphp.vulnweb.com/cart.php
https://www.acunetix.com/blog/articles/prevent-sql-injection-vulnerabilities-in-php-applications/
http://testphp.vulnweb.com/hpp/
http://testphp.vulnweb.com/product.php?pic=7
http://testphp.vulnweb.com/guestbook.php
http://testphp.vulnweb.com/listproducts.php?cat=2
http://testphp.vulnweb.com/Details/network-attached-storage-dlink/1/
http://testphp.vulnweb.com/categories.php
http://testphp.vulnweb.com/artists.php
http://www.eclectasy.com/Fractal-Explorer/index.html
http://testphp.vulnweb.com/artists.php?artist=1
http://testphp.vulnweb.com/showimage.php?file=./pictures/5.jpg
http://testphp.vulnweb.com/showimage.php?file=./pictures/4.jpg
http://testphp.vulnweb.com/listproducts.php?artist=1
http://testphp.vulnweb.com/product.php?pic=1
http://testphp.vulnweb.com/showimage.php?file=./pictures/7.jpg
http://testphp.vulnweb.com/userinfo.php
http://testphp.vulnweb.com/product.php?pic=5
http://testphp.vulnweb.com/listproducts.php?artist=3
http://www.acunetix.com
http://testphp.vulnweb.com/showimage.php?file=./pictures/2.jpg
http://testphp.vulnweb.com/Details/color-printer/3/
http://testphp.vulnweb.com/listproducts.php?artist=2
http://testphp.vulnweb.com/disclaimer.php
http://testphp.vulnweb.com/login.php
http://testphp.vulnweb.com/listproducts.php?cat=1
http://testphp.vulnweb.com/artists.php?artist=2
http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg
http://testphp.vulnweb.com/Details/web-camera-a4tech/2/
https://www.acunetix.com/vulnerability-scanner/php-security-scanner/
http://testphp.vulnweb.com/listproducts.php?cat=4
http://testphp.vulnweb.com/privacy.php
http://testphp.vulnweb.com/AJAX/index.php
http://testphp.vulnweb.com/listproducts.php?cat=3
https://www.acunetix.com/vulnerability-scanner/
http://testphp.vulnweb.com/signup.php
http://testphp.vulnweb.com/product.php?pic=2
http://testphp.vulnweb.com/showimage.php?file=./pictures/3.jpg
https://www.acunetix.com/
http://testphp.vulnweb.com/index.php
http://testphp.vulnweb.com?pp=12
http://testphp.vulnweb.com/Mod_Rewrite_Shop/
http://testphp.vulnweb.com/artists.php?artist=3
http://blog.mindedsecurity.com/2009/05/client-side-http-parameter-pollution.html
http://testphp.vulnweb.com/product.php?pic=4
로그인 후 복사

두 번째 크롤러고 크롤링

공식 샘플 코드에 몇 줄 추가

#!/usr/bin/python3
# coding: utf-8

import simplejson
import subprocess


def main():
    target = "http://testphp.vulnweb.com/"
    cmd = ["/home/loser/MySimpleScanner-master-v2/tools/crawlergo", "-c", "/usr/bin/google-chrome", "-o", "json", target]
    rsp = subprocess.Popen(cmd, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
    output, error = rsp.communicate()
	#  "--[Mission Complete]--"  是任务结束的分隔字符串
    result = simplejson.loads(output.decode().split("--[Mission Complete]--")[1])
    req_list = result["req_list"]
    for req in req_list:
        print(req)
    #print(req_list[0])


if __name__ == '__main__':
    main()
로그인 후 복사

결과:
48개 항목

{'url': 'http://testphp.vulnweb.com/', 'method': 'GET', 'headers': {'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Target'}
{'url': 'https://testphp.vulnweb.com/', 'method': 'GET', 'headers': {'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Target'}
{'url': 'http://testphp.vulnweb.com/artists.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/index.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/categories.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/disclaimer.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/guestbook.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/AJAX/index.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/cart.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/login.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/privacy.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/hpp/', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/Mod_Rewrite_Shop/', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/search.php?test=query', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'searchFor=Crawlergo', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/search.php?test=query', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'searchFor=Crawlergo&goButton=go', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/signup.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/login.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/login.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uname=crawlergo%40gmail.com&pass=Crawlergo6.', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/categories.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/artists.php?artist=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/artists.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/comment.php?aid=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/artists.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'OpenWindow'}
{'url': 'http://testphp.vulnweb.com/AJAX/artists.php', 'method': 'GET', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/AJAX/categories.php', 'method': 'GET', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/AJAX/titles.php', 'method': 'GET', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/AJAX/showxml.php', 'method': 'POST', 'headers': {'Accept': '*/*', 'Referer': 'http://testphp.vulnweb.com/AJAX/index.php', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36', 'content-type': 'text/xml'}, 'data': '<xml><node>nodetext1</node><node>nodetext2</node></xml>', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/hpp/?pp=12', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/hpp/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/search.php?test=query', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/listproducts.php?artist=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/artists.php?artist=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/secured/newuser.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/signup.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uuname=carwalwelregrogo%40gmail.com&upass=Crawlergo6.&upass2=Crawlergo6.&urname=crawlergo%40gmail.com&ucc=Crawlergo&uemail=crawlergo%40gmail.com&uphone=18812345678&uaddress=Cr', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/secured/newuser.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/signup.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uuname=carwalwelregrogo%40gmail.com&upass=Crawlergo6.&upass2=Crawlergo6.&urname=crawlergo%40gmail.com&ucc=Crawlergo&uemail=crawlergo%40gmail.com&uphone=18812345678&uaddress=Cr&signup=signup', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg&size=160', 'method': 'GET', 'headers': {'Accept': 'image/avif,image/webp,image/apng,image/*,*/*;q=0.8', 'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/product.php?pic=2', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/comment.php?pid=1', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/listproducts.php?cat=1', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'OpenWindow'}
{'url': 'http://testphp.vulnweb.com/userinfo.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/login.php', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'uname=crawlergo%40gmail.com&pass=Crawlergo6.', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&Submit=Submit&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/hpp/params.php?p=valid&pp=12', 'method': 'GET', 'headers': {'Referer': 'http://testphp.vulnweb.com/hpp/?pp=12', 'Spider-Name': 'crawlergo', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'DOM'}
{'url': 'http://testphp.vulnweb.com/hpp/params.php?', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Referer': 'http://testphp.vulnweb.com/hpp/?pp=12', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/hpp/params.php?aaaa%2F=Submit', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Referer': 'http://testphp.vulnweb.com/hpp/?pp=12', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/AJAX/showxml.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/secured/newuser.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/cart.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/product.php?pic=2', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'price=800&addcart=2', 'source': 'XHR'}
{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'POST', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Content-Type': 'application/x-www-form-urlencoded', 'Origin': 'http://testphp.vulnweb.com', 'Referer': 'http://testphp.vulnweb.com/comment.php?aid=1', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': 'name=Ccrraawwlleerrggoo%40gmail.com%3Cyour+name+here%3E&comment=&Submit=Submit&phpaction=echo+%24_POST%5Bcomment%5D%3B', 'source': 'Navigation'}
{'url': 'http://testphp.vulnweb.com/comment.php', 'method': 'GET', 'headers': {'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.9', 'Spider-Name': 'crawlergo', 'Upgrade-Insecure-Requests': '1', 'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.0 Safari/537.36'}, 'data': '', 'source': 'Navigation'}
로그인 후 복사

이후 청소: 

http://testphp.vulnweb.com/
https://testphp.vulnweb.com/
http://testphp.vulnweb.com/artists.php
http://testphp.vulnweb.com/index.php
http://testphp.vulnweb.com/categories.php
http://testphp.vulnweb.com/disclaimer.php
http://testphp.vulnweb.com/guestbook.php
http://testphp.vulnweb.com/AJAX/index.php
http://testphp.vulnweb.com/cart.php
http://testphp.vulnweb.com/login.php
http://testphp.vulnweb.com/userinfo.php
http://testphp.vulnweb.com/privacy.php
http://testphp.vulnweb.com/hpp/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/
http://testphp.vulnweb.com/search.php?test=query
http://testphp.vulnweb.com/search.php?test=query
http://testphp.vulnweb.com/signup.php
http://testphp.vulnweb.com/userinfo.php
http://testphp.vulnweb.com/listproducts.php?cat=1
http://testphp.vulnweb.com/artists.php?artist=1
http://testphp.vulnweb.com/comment.php?aid=1
http://testphp.vulnweb.com/AJAX/artists.php
http://testphp.vulnweb.com/AJAX/categories.php
http://testphp.vulnweb.com/AJAX/titles.php
http://testphp.vulnweb.com/AJAX/showxml.php
http://testphp.vulnweb.com/hpp/?pp=12
http://testphp.vulnweb.com/userinfo.php
http://testphp.vulnweb.com/search.php?test=query
http://testphp.vulnweb.com/listproducts.php?artist=1
http://testphp.vulnweb.com/secured/newuser.php
http://testphp.vulnweb.com/secured/newuser.php
http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg&size=160
http://testphp.vulnweb.com/product.php?pic=2
http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg
http://testphp.vulnweb.com/comment.php?pid=1
http://testphp.vulnweb.com/userinfo.php
http://testphp.vulnweb.com/comment.php
http://testphp.vulnweb.com/comment.php
http://testphp.vulnweb.com/hpp/params.php?p=valid&pp=12
http://testphp.vulnweb.com/hpp/params.php?
http://testphp.vulnweb.com/hpp/params.php?aaaa%2F=Submit
http://testphp.vulnweb.com/AJAX/showxml.php
http://testphp.vulnweb.com/secured/newuser.php
http://testphp.vulnweb.com/comment.php
http://testphp.vulnweb.com/comment.php
http://testphp.vulnweb.com/cart.php
http://testphp.vulnweb.com/comment.php
http://testphp.vulnweb.com/comment.php
로그인 후 복사

3 rad 크롤링

./rad_linux_amd64 --target http://testphp.vulnweb.com --text-output rad.log./rad_linux_amd64 --target http://testphp.vulnweb.com --text-output rad.log
结果：42条 ， 由于存在get和post的区别，清洗后去重为39条

GET http://testphp.vulnweb.com/
GET http://testphp.vulnweb.com/index.php
GET http://testphp.vulnweb.com/artists.php
GET http://testphp.vulnweb.com/cart.php
GET http://testphp.vulnweb.com/guestbook.php
GET http://testphp.vulnweb.com/AJAX/index.php
GET http://testphp.vulnweb.com/images/
GET http://testphp.vulnweb.com/login.php
POST http://testphp.vulnweb.com/search.php?test=query
GET http://testphp.vulnweb.com/categories.php
GET http://testphp.vulnweb.com/disclaimer.php
GET http://testphp.vulnweb.com/userinfo.php
POST http://testphp.vulnweb.com/guestbook.php
POST http://testphp.vulnweb.com/userinfo.php
GET http://testphp.vulnweb.com/Flash/
GET http://testphp.vulnweb.com/AJAX/artists.php
GET http://testphp.vulnweb.com/privacy.php
GET http://testphp.vulnweb.com/AJAX/infoartist.php?id=1
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/
GET http://testphp.vulnweb.com/hpp/
GET http://testphp.vulnweb.com/artists.php?artist=1
GET http://testphp.vulnweb.com/comment.php?aid=1
GET http://testphp.vulnweb.com/signup.php
GET http://testphp.vulnweb.com/listproducts.php?cat=1
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/images/
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/
GET http://testphp.vulnweb.com/hpp/?pp=12
POST http://testphp.vulnweb.com/comment.php
POST http://testphp.vulnweb.com/secured/newuser.php
GET http://testphp.vulnweb.com/product.php?pic=1
GET http://testphp.vulnweb.com/listproducts.php?artist=1
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/RateProduct-1.html
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/
GET http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg
GET http://testphp.vulnweb.com/showimage.php?file=./pictures/1.jpg&size=160
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-1/
POST http://testphp.vulnweb.com/cart.php
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-2/
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/RateProduct-2.html
GET http://testphp.vulnweb.com/hpp/params.php?p=valid&pp=12
GET http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/
로그인 후 복사

4 burpsuite v202012

爬取较耗费时间，截图的时候是49个，但是随着时间增加数量还在上升，在后面回看的时候数量已经一百多了

Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법

http://testphp.vulnweb.com	GET	/	burp.f5s@306052ce	200	5175	HTML	Home of Acunetix Art		1611359458449
http://testphp.vulnweb.com	GET	/AJAX/	burp.f5s@cd68998	200	4453	HTML	ajax test		1611359674072
http://testphp.vulnweb.com	GET	/AJAX/index.php	burp.f5s@126828be	200	4453	HTML	ajax test		1611359674872
http://testphp.vulnweb.com	GET	/Flash/	burp.f5s@510aed85	200	514	HTML	Index of /Flash/		1611359682400
http://testphp.vulnweb.com	GET	/Flash/add.fla	burp.f5s@63ce2348	200	154877	HTML			1611359714830
http://testphp.vulnweb.com	GET	/Flash/add.swf	burp.f5s@5becece0	200	17674	flash			1611359684049
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/	burp.f5s@81212fb	200	1191	HTML			1611359686649
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-1/	burp.f5s@ef2a0b9	200	316	HTML			1611359784523
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/	burp.f5s@1cb4164c	200	291	HTML			1611359788669
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/2.php	burp.f5s@200362d6	200	386	script			1611360605080
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/3.php	burp.f5s@389e39e7	200	386	script			1611360605176
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/BuyProduct-3/	burp.f5s@23f2b125	200	291	HTML			1611360609454
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/cart/	burp.f5s@1fc8c561	200	291	HTML			1611360609615
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/	burp.f5s@2466019c	200	291	HTML			1611360609749
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/Mod_Rewrite_Shop	burp.f5s@6d7e45f6	200	386	script			1611360666497
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/index	burp.f5s@5bb3bae5	200	386	script			1611360665770
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/categories/logo	burp.f5s@2099f3f	200	386	script			1611360665634
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-2/cgi-bin/	burp.f5s@16f71403	200	291	HTML			1611360609615
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/	burp.f5s@9b9a2de	200	308	HTML			1611359793221
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/RateProduct-1.asp	burp.f5s@4f1b459e	200	386	script			1611360727449
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/params.php	burp.f5s@1a5db25	200	386	script			1611360725439
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/privacy.aspx	burp.f5s@2fdc801e	200	386	script			1611360725841
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/BuyProduct-3/product.asp	burp.f5s@6b377869	200	386	script			1611360727028
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/color-printer/3/	burp.f5s@7e95f724	200	529	HTML			1611359733180
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/color-printer/3/1/	burp.f5s@51c66720	200	535	HTML			1611360417812
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/color-printer/3/2/	burp.f5s@1ad1d176	200	495	HTML			1611360417956
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/	burp.f5s@4af51675	200	535	HTML			1611359721331
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/Details.php	burp.f5s@1b88f4d8	200	386	script			1611360185772
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/Flash.html	burp.f5s@79957fee	200	386	script			1611360185898
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/disclaimer.html	burp.f5s@6d5b4bcb	200	386	script			1611360185841
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/favicon.html	burp.f5s@f7faeab	200	386	script			1611360185721
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/	burp.f5s@538da5a8	200	495	HTML			1611359725032
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/Mod_Rewrite_Shop/	burp.f5s@135ca38	200	386	script			1611360306031
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/	burp.f5s@3607ccc6	200	386	script			1611360304942
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/BuyProduct-1.htm	burp.f5s@447f265b	200	386	script			1611360785562
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/BuyProduct-2.htm	burp.f5s@7ae17b99	200	386	script			1611360786103
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/BuyProduct-3.htm	burp.f5s@55aa0af7	200	386	script			1611360784930
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/logo/artists.php	burp.f5s@5d438d78	200	386	script			1611360785810
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/network-attached-storage-dlink/	burp.f5s@60333575	200	386	script			1611360306304
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/RateProduct-1.html	burp.f5s@11ffb759	200	316	HTML			1611359785570
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/RateProduct-3.html	burp.f5s@1487ea23	200	308	HTML			1611359795219
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/images/	burp.f5s@55ee8d86	200	656	HTML	Index of /Mod_Rewrite_Shop/images/		1611359714160
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/index.php	burp.f5s@2c8f82d3	200	1191	HTML			1611360008044
http://testphp.vulnweb.com	GET	/admin/	burp.f5s@40a6ad64	200	405	HTML	Index of /admin/		1611359695435
http://testphp.vulnweb.com	GET	/admin/create.sql	burp.f5s@6b5b91a1	200	771	script			1611359768567
http://testphp.vulnweb.com	GET	/categories.php	burp.f5s@4af8b3f1	200	6332	HTML	picture categories		1611359533220
http://testphp.vulnweb.com	GET	/hpp/	burp.f5s@1ab12967	200	419	HTML	HTTP Parameter Pollution Example		1611359684548
http://testphp.vulnweb.com	GET	/hpp/params.php	burp.f5s@6f896ad8	200	214				1611359777049
http://testphp.vulnweb.com	GET	/images/	burp.f5s@58683811	200	520	HTML	Index of /images/		1611359667907
http://testphp.vulnweb.com	GET	/secured/	burp.f5s@57007fd6	200	214				1611359774940
http://testphp.vulnweb.com	GET	/secured/newuser.php	burp.f5s@44698e40	200	631	HTML	add new user		1611359776066
http://testphp.vulnweb.com	GET	/AJAX	burp.f5s@6012f3bf	301	371	HTML	301 Moved Permanently		1611359538410
http://testphp.vulnweb.com	GET	/Flash	burp.f5s@7923f71c	301	372	HTML	301 Moved Permanently		1611359540411
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop	burp.f5s@2d09c921	301	383	HTML	301 Moved Permanently		1611359667359
http://testphp.vulnweb.com	GET	/Mod_Rewrite_Shop/images	burp.f5s@251a494e	301	390	HTML	301 Moved Permanently		1611359707781
http://testphp.vulnweb.com	GET	/admin	burp.f5s@52e2d959	301	372	HTML	301 Moved Permanently		1611359667311
http://testphp.vulnweb.com	GET	/hpp	burp.f5s@341f4f0e	301	370	HTML	301 Moved Permanently		1611359538318
http://testphp.vulnweb.com	GET	/images	burp.f5s@57bcd86d	301	373	HTML	301 Moved Permanently		1611359667272
http://testphp.vulnweb.com	GET	/artists.php	burp.f5s@209bbbed	0	0				0
http://testphp.vulnweb.com	GET	/cart.php	burp.f5s@647786b6	0	0				0
http://testphp.vulnweb.com	GET	/disclaimer.php	burp.f5s@2a5ec209	0	0				0
http://testphp.vulnweb.com	GET	/guestbook.php	burp.f5s@1b90189f	0	0				0
http://testphp.vulnweb.com	GET	/index.php	burp.f5s@66298cd3	0	0				0
http://testphp.vulnweb.com	GET	/login.php	burp.f5s@3e33e496	0	0				0
http://testphp.vulnweb.com	GET	/privacy.php	burp.f5s@622137d3	0	0				0
http://testphp.vulnweb.com	GET	/userinfo.php	burp.f5s@79ee9fe8	0	0				0
로그인 후 복사

五 awvs

扫描相对burp很快，不知道是不是自家网站缘故，扫描结果数量405，但是很多都是Mod_Rewrite模块下的

http://testphp.vulnweb.com/
http://testphp.vulnweb.com/.idea/
http://testphp.vulnweb.com/.idea/.name
http://testphp.vulnweb.com/.idea/acuart.iml
http://testphp.vulnweb.com/.idea/encodings.xml
http://testphp.vulnweb.com/.idea/misc.xml
http://testphp.vulnweb.com/.idea/modules.xml
http://testphp.vulnweb.com/.idea/scopes/
http://testphp.vulnweb.com/.idea/scopes/scope_settings.xml
http://testphp.vulnweb.com/.idea/vcs.xml
http://testphp.vulnweb.com/.idea/workspace.xml
http://testphp.vulnweb.com/404.php
http://testphp.vulnweb.com/AJAX/
http://testphp.vulnweb.com/AJAX/artists.php
http://testphp.vulnweb.com/AJAX/categories.php
http://testphp.vulnweb.com/AJAX/htaccess.conf
http://testphp.vulnweb.com/AJAX/index.php
http://testphp.vulnweb.com/AJAX/infoartist.php
http://testphp.vulnweb.com/AJAX/infocateg.php
http://testphp.vulnweb.com/AJAX/infotitle.php
http://testphp.vulnweb.com/AJAX/showxml.php
http://testphp.vulnweb.com/AJAX/styles.css
http://testphp.vulnweb.com/AJAX/titles.php
http://testphp.vulnweb.com/CVS/
http://testphp.vulnweb.com/CVS/Entries
http://testphp.vulnweb.com/CVS/Entries.Log
http://testphp.vulnweb.com/CVS/Repository
http://testphp.vulnweb.com/CVS/Root
http://testphp.vulnweb.com/Connections/
http://testphp.vulnweb.com/Connections/DB_Connection.php
http://testphp.vulnweb.com/Flash/
http://testphp.vulnweb.com/Flash/add.fla
http://testphp.vulnweb.com/Flash/add.swf
http://testphp.vulnweb.com/Mod_Rewrite_Shop/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/details.php3/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/BuyProduct-3/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/color-printer/3/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/network-attached-storage-dlink/1/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/.htaccess
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/images/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/Details/web-camera-a4tech/2/rate.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/RateProduct-3.html
http://testphp.vulnweb.com/Mod_Rewrite_Shop/buy.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/details.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/images/
http://testphp.vulnweb.com/Mod_Rewrite_Shop/index.php
http://testphp.vulnweb.com/Mod_Rewrite_Shop/rate.php
http://testphp.vulnweb.com/Templates/
http://testphp.vulnweb.com/Templates/main_dynamic_template.dwt.php
http://testphp.vulnweb.com/_mmServerScripts/
http://testphp.vulnweb.com/_mmServerScripts/MMHTTPDB.php
http://testphp.vulnweb.com/_mmServerScripts/mysql.php
http://testphp.vulnweb.com/adm1nPan3l/
http://testphp.vulnweb.com/adm1nPan3l/index.php
http://testphp.vulnweb.com/admin/
http://testphp.vulnweb.com/admin/create.sql
http://testphp.vulnweb.com/artists.php
http://testphp.vulnweb.com/bxss/
http://testphp.vulnweb.com/bxss/adminPan3l/
http://testphp.vulnweb.com/bxss/adminPan3l/index.php
http://testphp.vulnweb.com/bxss/adminPan3l/style.css
http://testphp.vulnweb.com/bxss/cleanDatabase.php
http://testphp.vulnweb.com/bxss/database_connect.php
http://testphp.vulnweb.com/bxss/index.php
http://testphp.vulnweb.com/bxss/test.js
http://testphp.vulnweb.com/bxss/vuln.php
http://testphp.vulnweb.com/cart.php
http://testphp.vulnweb.com/categories.php
http://testphp.vulnweb.com/clearguestbook.php
http://testphp.vulnweb.com/clientaccesspolicy.xml
http://testphp.vulnweb.com/comment.php
http://testphp.vulnweb.com/crossdomain.xml
http://testphp.vulnweb.com/database_connect.php
http://testphp.vulnweb.com/disclaimer.php
http://testphp.vulnweb.com/guestbook.php
http://testphp.vulnweb.com/hpp/
http://testphp.vulnweb.com/hpp/index.php
http://testphp.vulnweb.com/hpp/params.php
http://testphp.vulnweb.com/hpp/test.php
http://testphp.vulnweb.com/images/
http://testphp.vulnweb.com/index.bak
http://testphp.vulnweb.com/index.php
http://testphp.vulnweb.com/listproducts.php
http://testphp.vulnweb.com/login.php
http://testphp.vulnweb.com/logout.php
http://testphp.vulnweb.com/medias/
http://testphp.vulnweb.com/medias/css/
http://testphp.vulnweb.com/medias/css/main.css
http://testphp.vulnweb.com/medias/img/
http://testphp.vulnweb.com/medias/js/
http://testphp.vulnweb.com/medias/js/common_functions.js
http://testphp.vulnweb.com/pictures/
http://testphp.vulnweb.com/pictures/1.jpg.tn
http://testphp.vulnweb.com/pictures/2.jpg.tn
http://testphp.vulnweb.com/pictures/3.jpg.tn
http://testphp.vulnweb.com/pictures/4.jpg.tn
http://testphp.vulnweb.com/pictures/5.jpg.tn
http://testphp.vulnweb.com/pictures/6.jpg.tn
http://testphp.vulnweb.com/pictures/7.jpg.tn
http://testphp.vulnweb.com/pictures/8.jpg.tn
http://testphp.vulnweb.com/pictures/WS_FTP.LOG
http://testphp.vulnweb.com/pictures/credentials.txt
http://testphp.vulnweb.com/pictures/ipaddresses.txt
http://testphp.vulnweb.com/pictures/path-disclosure-unix.html
http://testphp.vulnweb.com/pictures/path-disclosure-win.html
http://testphp.vulnweb.com/pictures/wp-config.bak
http://testphp.vulnweb.com/privacy.php
http://testphp.vulnweb.com/product.php
http://testphp.vulnweb.com/redir.php
http://testphp.vulnweb.com/search.php
http://testphp.vulnweb.com/secured/
http://testphp.vulnweb.com/secured/database_connect.php
http://testphp.vulnweb.com/secured/index.php
http://testphp.vulnweb.com/secured/newuser.php
http://testphp.vulnweb.com/secured/office.htm
http://testphp.vulnweb.com/secured/office_files/
http://testphp.vulnweb.com/secured/office_files/filelist.xml
http://testphp.vulnweb.com/secured/phpinfo.php
http://testphp.vulnweb.com/secured/style.css
http://testphp.vulnweb.com/sendcommand.php
http://testphp.vulnweb.com/showimage.php
http://testphp.vulnweb.com/signup.php
http://testphp.vulnweb.com/style.css
http://testphp.vulnweb.com/userinfo.php
http://testphp.vulnweb.com/wvstests/
http://testphp.vulnweb.com/wvstests/pmwiki_2_1_19/
http://testphp.vulnweb.com/wvstests/pmwiki_2_1_19/scripts/
http://testphp.vulnweb.com/wvstests/pmwiki_2_1_19/scripts/version.php
로그인 후 복사

六 比较

由上所有数据可以看出，awvs和burpsuite爬取的数据量是属于最多的一层的，crawlergo和rad和我手写的爬虫好像是一层。。仅数据量来说。。

再看下数据质量，这里我主要看手写的爬虫(下面称为基准)，和rad 、crawlergo

首先，我们先把基准数据和rad的数据比较
先取交集，
Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법

存在17个交集数据，各自减去交集后的数据，排序，对比
Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법
Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법

细心查看的话会发现中间那栏基准数据基本path基本都能在左边交集栏查看到，而右侧rad栏黄色部分基本都是左侧即基准数据里没有的。本人查看了前面的burpsuite和awvs报告，他们多出的部分基本都是http://testphp.vulnweb.com/Mod_Rewrite_Shop/결과: 42개 항목, 인해 있음 get과 post의 차이는 청소 후 중복 개수가 39개입니다.

rrreee

4 burpsuite v202012

크롤링이 더 시간이 많이 걸립니다. 스크린샷을 찍을 땐 49개였는데 시간이 지날수록 계속 늘어나고 있어요. 나중에 다시 살펴보겠습니다. 그 당시에는 이미 100개가 넘었습니다Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법
crawlergo, rad, burpsuite 및 awvs 실행 방법 크롤러 비교Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법rrreee
five awvs

트림보다 스캔 속도가 빠릅니다. 자체 웹사이트 때문인지는 모르겠습니다. 스캔 결과 수는 405개이지만 그 중 다수가 Mod_Rewrite 모듈에 속합니다
rrreeeCrawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법6개의 비교

위의 내용을 보면 모두 awvs 및 burpsuite에서 크롤링한 데이터의 양이 가장 큰 계층에 속한다는 것을 데이터에서 알 수 있습니다. . Crawlergo와 rad는 제가 직접 작성한 크롤러와 같은 레이어에 있는 것 같습니다. . 데이터 양 측면에서만 그렇습니다. .

데이터 품질을 다시 살펴보겠습니다. 여기서는 주로 필기 크롤러(이하 벤치마크)와 rad 및 크롤러고를 살펴봅니다.

먼저 벤치마크 데이터와 rad 데이터를 비교해 보겠습니다

먼저 교차점을 살펴보겠습니다.

crallergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법

17개의 교차점이 있습니다 data, 교차점을 뺀 후의 데이터, 정렬, 비교

crawlergo 수행 방법 , rad, burpsuite와 awvs 크롤러 간의 비교

크롤러 이동 방법, rad , burpsuite 및 awvs 크롤러 비교


자세히 살펴보면 중간 열의 벤치마크 데이터의 기본 경로는 기본적으로 왼쪽 교차 열에서 볼 수 있는 반면, 오른쪽의 rad 열은 기본적으로 왼쪽의 벤치마크 데이터에 없습니다. 이전 burpsuite 및 awvs 보고서를 확인했습니다. 추가 부분은 기본적으로 http://testphp.vulnweb.com/Mod_Rewrite_Shop/ 디렉토리에 있으며 벤치마크 크롤러에는 이 디렉토리가 있습니다. . Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법

벤치마크와 크롤러고의 비교를 다시 보세요🎜교차로가 18개가 있습니다🎜🎜🎜🎜🎜오른쪽에는 아직 일부가 있고 기본적으로 왼쪽에는 없지만 세부정보 디렉터리 오른쪽에는 아무것도 없습니다. 왼쪽과 오른쪽🎜🎜crawlergo와 rad를 보세요 비교🎜🎜🎜놀라운 유사성 -_-, 🎜🎜7개의 간단한 요약🎜🎜몇 가지 도구가 손으로 쓴 코드에서 쓸리지 않은 디렉터리와 경로를 스캔했으며, 능력이 꽤 강하다. 🎜🎜그 중에서 크롤러고와 rad 스캔의 양과 질이 비슷하고, burpsuite와 awvs의 스캔 결과도 비슷해서 둘 다 숫자가 가장 크지만, 개인적으로는 burpsuite의 스캔 속도가 조금 느린 느낌이 듭니다🎜🎜물론, 수량 문제는 burosuite 및 awvs의 존재로 인해 발생합니다. 일련의 보안 검색 및 기타 목적의 경우 단순히 URL을 얻기 위해crawlergo 및 rad에 의존하는 것이 더 편리합니다. 🎜🎜crawlergo와 rad의 차이점은 크롤러고가 반환한 데이터에는 자동으로 채워진 양식 데이터를 포함한 모든 헤더가 포함되어 있는 반면, rad는 Get http://xxx🎜🎜와 같은 요청 메서드 + URL만 반환한다는 것입니다. 이 표는 제 의견일 뿐 정확하지 않을 수 있습니다🎜🎜🎜

위 내용은 Crawlergo, rad, burpsuite 및 awvs 크롤러를 비교하는 방법의 상세 내용입니다. 자세한 내용은 PHP 중국어 웹사이트의 기타 관련 기사를 참조하세요!

본 웹사이트의 성명
본 글의 내용은 네티즌들의 자발적인 기여로 작성되었으며, 저작권은 원저작자에게 있습니다. 본 사이트는 이에 상응하는 법적 책임을 지지 않습니다. 표절이나 침해가 의심되는 콘텐츠를 발견한 경우 admin@php.cn으로 문의하세요.

핫 AI 도구

Undresser.AI Undress

Undresser.AI Undress

사실적인 누드 사진을 만들기 위한 AI 기반 앱

AI Clothes Remover

AI Clothes Remover

사진에서 옷을 제거하는 온라인 AI 도구입니다.

Undress AI Tool

Undress AI Tool

무료로 이미지를 벗다

Clothoff.io

Clothoff.io

AI 옷 제거제

AI Hentai Generator

AI Hentai Generator

AI Hentai를 무료로 생성하십시오.

더보기

인기 기사

R.E.P.O. 에너지 결정과 그들이하는 일 (노란색 크리스탈)
1 몇 달 전 By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. 최고의 그래픽 설정
1 몇 달 전 By 尊渡假赌尊渡假赌尊渡假赌
어 ass 신 크리드 그림자 : 조개 수수께끼 솔루션
2 몇 주 전 By DDD
R.E.P.O. 아무도들을 수없는 경우 오디오를 수정하는 방법
1 몇 달 전 By 尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. 채팅 명령 및 사용 방법
1 몇 달 전 By 尊渡假赌尊渡假赌尊渡假赌
더보기

뜨거운 도구

메모장++7.3.1

메모장++7.3.1

사용하기 쉬운 무료 코드 편집기

SublimeText3 중국어 버전

SublimeText3 중국어 버전

중국어 버전, 사용하기 매우 쉽습니다.

스튜디오 13.0.1 보내기

스튜디오 13.0.1 보내기

강력한 PHP 통합 개발 환경

드림위버 CS6

드림위버 CS6

시각적 웹 개발 도구

SublimeText3 Mac 버전

SublimeText3 Mac 버전

신 수준의 코드 편집 소프트웨어(SublimeText3)

더보기

뜨거운 주제

Gmail 이메일의 로그인 입구는 어디에 있나요?
7540
15
Cakephp 튜토리얼
1380
52
Steam의 계정 이름 형식은 무엇입니까?
83
11
Win11 활성화 키 영구
55
19
NYT 연결 힌트와 답변
21
86
더보기