简体中文(ZH-CN) English(EN) 繁体中文(ZH-TW) 日本語(JA) 한국어(KO) Melayu(MS) Français(FR) Deutsch(DE)
Home > Backend Development > PHP Tutorial > body text

获取网站所有网页访问的URL地址和页面资源加载访问地址

WBOY
Release： 2016-06-06 20:11:32
Original
1981 people have browsed it

网站上面现有来两个图片服务器的域名地址，现在我想获取当前的网站究竟有哪些页面是访问了其中某一个服务器的域名。包括隐藏在js里面生成的访问地址。只要是网站上任何一个元素能向那个域名提交请求的。都要获取到。
这个思路应该怎么写？如果是用php或者是python写这个脚本应该用哪些工具？

回复内容：

网站上面现有来两个图片服务器的域名地址，现在我想获取当前的网站究竟有哪些页面是访问了其中某一个服务器的域名。包括隐藏在js里面生成的访问地址。只要是网站上任何一个元素能向那个域名提交请求的。都要获取到。
这个思路应该怎么写？如果是用php或者是python写这个脚本应该用哪些工具？

如果自己的网站可以写一段js foreach本页面的img对象的src然后通过ajax提交后台接口；
如果是本地工具抓取的话只能用selenium这种能够解析js的工具了；

推荐分析图片服务器的访问日志
用python写，应该蛮快的

Related labels：
html php python
source：php.cn
Previous article：javascript - ajax：怎么获得onreadystatechange调用的函数的返回值？ Next article：gd库 - GD Library extension not available with this PHP installation.
Statement of this Website
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
Latest Articles by Author
Latest Issues
How to list data in a section by ID using while loop in PHP? I have a mysql table with these columns: series_id, series_color, product_name In the outp...
From 2023-11-17 20:03:03
0
1
290
Call to undefined function create_function() I get this message on the home page of the website: Fatal error: Uncaught error: calling /...
From 2023-11-16 19:00:36
0
1
277
<?php //Given a year, month and day, output the day of the year that the date is (note that leap year 4 100 400) <?php //Given a year, month and day, output the day of the year that the date is (no...
From 2023-11-14 23:55:21
0
1
79
PHP trim unicode spaces I'm trying to trim unicode spaces such as this character and I was able to do it using thi...
From 2023-11-13 08:49:45
0
2
398
TYPO3 V11: "PHP warning: undefined array key", $this->request->getArguments() is empty I'm a new user of typo3, I made a plugin to show users and use the search bar to filter th...
From 2023-11-12 21:35:09
0
1
362
Related Topics
More>
Popular Recommendations
Popular Tutorials
More>
Related Tutorials
Popular Recommendations
Latest courses
Latest Downloads
More>
Web Effects
Website Source Code
Website Materials
Front End Template
About us Disclaimer Sitemap
php.cn：Public welfare online PHP training，Help PHP learners grow quickly！