说起来做这个功能还真是一时好奇。前段时间在做一个淘客网站的时候,想到是否能抓取到淘宝商品的买家秀呢?经过一番折腾发现,淘宝商品用户评价信息是通过ajax来调取的,通过嗅探网址发现,评论数据的请求接口是:
https://rate.tmall.com/list_detail_rate.htm?itemid=524394294771&spuid=341564036&sellerid=100414600&order=3¤tpage=1&append=0&content=1&tagid=&posi=&picture=1&callback=jsonp2339
其实上面很多参数也很容易理解,itemid是商品的id,currentpage是当前页,picture为1时显示有图的评价,既然是抓取买家秀,那么picture参数一定要为1了。
如果你直接去访问上面的接口时,会得到如下图所示的请求结果:
看到请求结果是jsonp格式我就蛋碎了,我不知道如何去解析,但是换种思路,直接用php的正则去解析也未尝不可嘛,通过尝试,已经正确的能够解析到评论内容和买家秀的图片内容,如图:
效果不错,代码实现了评论内容的抓取、买家秀图片的抓取,代码奉上:
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
|
<?php $url = "https://rate.tmall.com/list_detail_rate.htm?itemid=524394294771&spuid=341564036&sellerid=100414600&order=3¤tpage=1&append=0&content=1&tagid=&posi=&picture=1&callback=jsonp2339" ; $ch2 = curl_init(); curl_setopt( $ch2 , curlopt_url, $url ); curl_setopt( $ch2 , curlopt_followlocation, true); curl_setopt( $ch2 , curlopt_ssl_verifyhost, false); curl_setopt( $ch2 , curlopt_ssl_verifypeer, false); curl_setopt( $ch2 , curlopt_returntransfer, true); $texts = curl_exec( $ch2 ); curl_close( $ch2 ); //echo $texts; $pattern = '/"pics"(.+?)","reply"/is' ; preg_match_all( $pattern , $texts , $match ); for ( $i =0; $i < count ( $match [0]); $i ++){ $pattern2 = '/"ratecontent":"(.+?)."reply"/is' ; preg_match( $pattern2 , $match [0][ $i ], $matchcomments_only ); echo "<p>" . str_replace ( '","ratedate":"' , ' ' , str_replace ( '","reply"' , '' , str_replace ( '"ratecontent":"' , '' , $matchcomments_only [0]))). "</p>" ; $pattern3 = '/img.alicdn(.+?).jpg/is' ; preg_match( $pattern3 , $match [0][ $i ], $matchpic_only ); echo '<img src="http://' . $matchpic_only [0]. '" width=120>' ; } /*匹配一张图片 $pattern = '/"pics"(.+?)","position"/is'; preg_match_all($pattern, $texts, $matchpic); for($i=0;$i<count($matchpic[0]);$i++){ $pattern3 = '/img.alicdn(.+?).jpg/is'; preg_match($pattern3, $matchpic[0][$i], $matchpic_only); echo "<p>".$matchpic_only[0]."</p>"; }*/ /*匹配所有图片 $pattern = '/"pics"(.+?)","position"/is'; preg_match_all($pattern, $texts, $matchpic); for($i=0;$i<count($matchpic[0]);$i++){ $pics_str=str_replace('"pics":["//','',str_replace('"],"picssmall":"","position"','',$matchpic[0][$i])); $arr = explode('","//',$pics_str); echo "<p>"; foreach($arr as $newstr){ echo '<img src=http://'.$newstr.' width=100 >'; } echo "</p>"; }*/ ?> |
下面给大家介绍php抓取淘宝搜索商品列表实例
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
|
<?php header( "content-type:text/html;charset=gbk" ); include "snoopy.class.php" ; $snoopy = new snoopy; $snoopy ->fetch( "http://s.taobao.com/search?spm=a230r.1.8.7.2nn4m7&q=%c7%ef%b6%ac%b4%f3%d2%c2&source=tbsy&refpid=420461_1006&discount_index=1&newpre=null&p4p_str=fp_midtop%3d0%26firstpage_pushleft%3d0&style=list&s=0#j_filter" ); $html = $snoopy ->results; //说明:抓取网页使用的是 snoopyphp 框架 也可以直接使用file_get_contents函数获取即可, //var_dump($html); preg_match_all( '/<h3 class="summary">.*</a>/' , $html , $result ); //preg_match_all('/<divsid="([a-z0-9_]+)">([^<>]+)</div>/',$html,$result); var_dump( $result ); echo "<br>" ; /* //循环读取数组 foreach($result as $key1){ foreach($key1 as $key => $val){ echo $key.$val; } } */ |
以上所述是小编给大家介绍的php抓取淘宝商品的用户晒单评论+图片+搜索商品列表实例,希望对大家有所帮助!