php 如何精准获取网站中的所有超链接？-PHPチュートリアル-php.cn

回复内容：

ホームページ

バックエンド開発

PHPチュートリアル

php 如何精准获取网站中的所有超链接？

Jun 06, 2016 pm 08:22 PM

php

想获取网站中的所有超链接，使用的是php snoopy类

<code>$sourceURL = $url;
$snoopy-&gt;fetchlinks($sourceURL);
$content = $snoopy-&gt;results;</code>

ログイン後にコピー

获取的结果如下：

<code>array (size=627)
  0 =&gt; string 'http://www.alibaba.com/https://login.alibaba.com/' (length=49)
  1 =&gt; string 'http://sh.vip.alibaba.com?tracelog=nav_ma' (length=41)
  2 =&gt; string 'http://message.alibaba.com/feedback/default.htm?routeto=inbox&amp;tracelog=nav_ma_mc' (length=80)
  3 =&gt; string 'http://www.alibaba.com//hz-favorite.alibaba.com/favorite/favorite_home.htm?tracelog=nav_ma_fav' (length=94)
  4 =&gt; string 'http://rfq.alibaba.com/form.htm?tracelog=header_myalibaba' (length=57)
  5 =&gt; string 'http://hz.sourcing.alibaba.com/rfq/request/rfq_manage_list.htm?tracelog=nav_ma_mana_rfq' (length=87)
  6 =&gt; string 'http://biz.alibaba.com/generalorders/list_orders.htm?tracelog=ma_mana_orders' (length=76)
  7 =&gt; string 'http://sh.vip.alibaba.com/product/post_product_interface.htm?tracelog=newschp_nav_madp' (length=86)
  8 =&gt; string 'http://sh.vip.alibaba.com/product/manage_products.htm?tracelog=newschp_nav_mamng' (length=80)
  9 =&gt; string 'http://hz.sourcing.alibaba.com/rfq/quotation/rfq_not_quoted_manage_list.htm?nav_ma_rec_rfqs' (length=91)
  10 =&gt; string 'http://www.alibaba.com/javascript:;' (length=35)
  11 =&gt; string 'http://www.alibaba.com/Products?tracelog=beacon_cate_140704' (length=59)
  12 =&gt; string 'http://rfq.alibaba.com/form.htm?tracelog=header_forbuyers' (length=57)
  13 =&gt; string 'http://globalexpo.alibaba.com?tracelog=beacon_expo_150820' (length=57)
  14 =&gt; string 'http://wholesale.alibaba.com?tracelog=nav_ws' (length=44)
  15 =&gt; string 'http://buyer.alibaba.com/bizid_buyer?tracelog=nav_bi' (length=52)
  16 =&gt; string 'http://tradeassurance.alibaba.com/bao/buyer_advertise.htm?tracelog=from_home_menu' (length=81)
  17 =&gt; string 'http://activities.alibaba.com/alibaba/secure-payment.php?tracelog=beacon_payment_150114' (length=87)
  18 =&gt; string 'http://ecredit.alibaba.com/ecl/buyer.htm?tracelog=beacon_credit_140704' (length=70)
  19 =&gt; string 'http://inspection.alibaba.com/?tracelog=beacon_is_140704' (length=56)
  20 =&gt; string 'http://buyer.alibaba.com/intelligence?tracelog=beacon_ti_140704' (length=63)
  21 =&gt; string 'http://buyer.alibaba.com/forum?tracelog=beacon_df_140704' (length=56)
  22 =&gt; string 'http://ask.alibaba.com/?tracelog=beacon_ta_140704' (length=49)
  23 =&gt; string 'http://www.alibaba.com/javascript:;' (length=35)
  24 =&gt; string 'http://seller.alibaba.com/memberships/index.html?tracelog=seller_channel_member_hp_header' (length=89)
  25 =&gt; string 'http://seller.alibaba.com/learningcenter?tracelog=seller_channel_lc_hp_header' (length=77)
  26 =&gt; string 'http://seller.alibaba.com/training.htm?tracelog=seller_channel_training_hp_header' (length=81)
  27 =&gt; string 'http://sourcing.alibaba.com/?tracelog=newschp_nav_narfq' (length=55)
  28 =&gt; string 'http://www.alibaba.com/javascript:;' (length=35)</code>

ログイン後にコピー

怎么能把“http://www.alibaba.com/javascript:;”类似的URL去掉？

回复内容：

想获取网站中的所有超链接，使用的是php snoopy类

<code>$sourceURL = $url;
$snoopy-&gt;fetchlinks($sourceURL);
$content = $snoopy-&gt;results;</code>

ログイン後にコピー

获取的结果如下：

<code>array (size=627)
  0 =&gt; string 'http://www.alibaba.com/https://login.alibaba.com/' (length=49)
  1 =&gt; string 'http://sh.vip.alibaba.com?tracelog=nav_ma' (length=41)
  2 =&gt; string 'http://message.alibaba.com/feedback/default.htm?routeto=inbox&amp;tracelog=nav_ma_mc' (length=80)
  3 =&gt; string 'http://www.alibaba.com//hz-favorite.alibaba.com/favorite/favorite_home.htm?tracelog=nav_ma_fav' (length=94)
  4 =&gt; string 'http://rfq.alibaba.com/form.htm?tracelog=header_myalibaba' (length=57)
  5 =&gt; string 'http://hz.sourcing.alibaba.com/rfq/request/rfq_manage_list.htm?tracelog=nav_ma_mana_rfq' (length=87)
  6 =&gt; string 'http://biz.alibaba.com/generalorders/list_orders.htm?tracelog=ma_mana_orders' (length=76)
  7 =&gt; string 'http://sh.vip.alibaba.com/product/post_product_interface.htm?tracelog=newschp_nav_madp' (length=86)
  8 =&gt; string 'http://sh.vip.alibaba.com/product/manage_products.htm?tracelog=newschp_nav_mamng' (length=80)
  9 =&gt; string 'http://hz.sourcing.alibaba.com/rfq/quotation/rfq_not_quoted_manage_list.htm?nav_ma_rec_rfqs' (length=91)
  10 =&gt; string 'http://www.alibaba.com/javascript:;' (length=35)
  11 =&gt; string 'http://www.alibaba.com/Products?tracelog=beacon_cate_140704' (length=59)
  12 =&gt; string 'http://rfq.alibaba.com/form.htm?tracelog=header_forbuyers' (length=57)
  13 =&gt; string 'http://globalexpo.alibaba.com?tracelog=beacon_expo_150820' (length=57)
  14 =&gt; string 'http://wholesale.alibaba.com?tracelog=nav_ws' (length=44)
  15 =&gt; string 'http://buyer.alibaba.com/bizid_buyer?tracelog=nav_bi' (length=52)
  16 =&gt; string 'http://tradeassurance.alibaba.com/bao/buyer_advertise.htm?tracelog=from_home_menu' (length=81)
  17 =&gt; string 'http://activities.alibaba.com/alibaba/secure-payment.php?tracelog=beacon_payment_150114' (length=87)
  18 =&gt; string 'http://ecredit.alibaba.com/ecl/buyer.htm?tracelog=beacon_credit_140704' (length=70)
  19 =&gt; string 'http://inspection.alibaba.com/?tracelog=beacon_is_140704' (length=56)
  20 =&gt; string 'http://buyer.alibaba.com/intelligence?tracelog=beacon_ti_140704' (length=63)
  21 =&gt; string 'http://buyer.alibaba.com/forum?tracelog=beacon_df_140704' (length=56)
  22 =&gt; string 'http://ask.alibaba.com/?tracelog=beacon_ta_140704' (length=49)
  23 =&gt; string 'http://www.alibaba.com/javascript:;' (length=35)
  24 =&gt; string 'http://seller.alibaba.com/memberships/index.html?tracelog=seller_channel_member_hp_header' (length=89)
  25 =&gt; string 'http://seller.alibaba.com/learningcenter?tracelog=seller_channel_lc_hp_header' (length=77)
  26 =&gt; string 'http://seller.alibaba.com/training.htm?tracelog=seller_channel_training_hp_header' (length=81)
  27 =&gt; string 'http://sourcing.alibaba.com/?tracelog=newschp_nav_narfq' (length=55)
  28 =&gt; string 'http://www.alibaba.com/javascript:;' (length=35)</code>

ログイン後にコピー

怎么能把“http://www.alibaba.com/javascript:;”类似的URL去掉？

QueryList

<?php
//采集某页面所有的图片
$data = QueryList::Query('http://cms.querylist.cc/bizhi/453.html',['image' => ['img','src']])->data;
//打印结果
print_r($data);
 
//采集某页面所有的超链接
$data = QueryList::Query('http://cms.querylist.cc/google/list_1.html',['link' => ['a','href']])->data;
//打印结果
print_r($data);