求助：想抓取这个网页的图片，有什么好办法？

xiandao7997

2014-08-01 14:04:29 +08:00

Wget

faceair

2014-08-01 14:14:42 +08:00

zzetao

2014-08-01 14:16:56 +08:00

其实一些浏览器的插件可以做到

androidBrant

2014-08-01 14:17:03 +08:00

@faceair 如何快速抓到这些地址的？

nealv2ex

2014-08-01 14:23:55 +08:00

list = $('.pic img').map(function(o,item){
var a = document.createElement('a');
a.href = $(item).attr('original');
return a.href;
})

androidBrant

2014-08-01 14:25:02 +08:00

@xiandao7997

jiaqiqunaerdeiMac:pic jiaqiqunaer$ wget -r http://www.szeros-wedding.com/UpFile/editor/

--2014-08-01 14:20:58-- http://www.szeros-wedding.com/UpFile/editor/
Resolving www.szeros-wedding.com... 211.154.142.215
Connecting to www.szeros-wedding.com|211.154.142.215|:80... connected.
HTTP request sent, awaiting response... 403 Forbidden
2014-08-01 14:20:59 ERROR 403: Forbidden.

NemoAlex

2014-08-01 14:27:23 +08:00

http://huaban.com/about/

faceair

2014-08-01 14:29:01 +08:00

https://gist.github.com/faceair/1a64217e9a28f240e68f

imn1

2014-08-01 14:29:58 +08:00

save as...
complete html

Roboo

2014-08-01 14:32:35 +08:00

idm

xiandao7997

2014-08-01 14:36:02 +08:00

Wget -r --level=2 --accept=jpg [标题里的 url]
结束后在子目录的 upfile/editor 里面找

xiandao7997

2014-08-01 14:36:51 +08:00

@imn1 感觉自己《社交网络》白看了

wesley

2014-08-01 15:24:05 +08:00

先清空浏览器缓存，再打开那个网页，再去浏览器缓存文件夹里找

androidBrant

2014-08-01 15:25:19 +08:00

@faceair 用xpath如何找到这些地址，表达式，谢谢

mengzhuo

2014-08-01 15:36:09 +08:00

再来个python版

import requests
from lxml import html
URL = 'http://www.szeros-wedding.com/html/service/804.html#1'
[x.attrib['src'] for x in html.fromstring(requests.get('http://www.szeros-wedding.com/html/service/804.html#1').text).xpath('//img')]

-------

['/skins/20140425/images/bg74.gif',
'/skins/20140425/images/t0.gif',
'/skins/20140425/images/t3.gif',
'/skins/20140425/images/t01.gif',
'/skins/20140425/images/t01.gif',
'/skins/20140425/images/bg75.gif',
'/skins/20140425/images/logo.jpg',
'/skins/20140425/images/bg6.jpg',
'/skins/20140425/images/bg7.jpg',
'/skins/20140425/images/bg8.jpg',
'/skins/20140425/images/bg9.jpg',
'/skins/20140425/images/bg10.jpg',
'/skins/20140425/images/f.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002455418.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002455652.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002456340.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002456480.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002457027.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002457496.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002457996.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002458527.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002458652.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002459152.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002460184.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002460340.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002460512.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002461262.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002461902.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002462480.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002463027.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002463746.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002464809.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002464934.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002465652.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002466230.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002466730.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002466918.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002467590.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002467746.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002468449.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002469090.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002469230.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002469902.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002470699.jpg',
'/ueditor/asp/../../UpFile/editor/2014032002470840.jpg',
'/skins/20140425/images/f.jpg',
'/skins/20140425/images/jd.jpg',
'/skins/20140425/hzjd/1.jpg',
'/skins/20140425/hzjd/2.jpg',
'/skins/20140425/hzjd/3.jpg',
'/skins/20140425/hzjd/4.jpg',
'/skins/20140425/hzjd/5.jpg',
'/skins/20140425/hzjd/6.jpg',
'/skins/20140425/hzjd/7.jpg',
'/skins/20140425/hzjd/8.jpg',
'/skins/20140425/hzjd/9.jpg',
'/skins/20140425/hzjd/10.jpg',
'/skins/20140425/images/link.jpg',
'/skins/20140425/images/logo1.jpg']

zoudm

2014-08-01 16:34:16 +08:00

@androidBrant

Xpath:

/html/body/table/tbody/tr[1]/td/table/tbody/tr[5]/td/div/p[1]/img
...
...
/html/body/table/tbody/tr[1]/td/table/tbody/tr[5]/td/div/p[5]/img

muziyue

2014-08-01 17:05:27 +08:00

如果不是特别多的页面的话，我一般都是curl+s 然后文件夹里找

decken

2014-08-01 17:54:01 +08:00

pyquery实在是太好用了
https://gist.github.com/28dea5a2553190223ca6.git

decken

2014-08-01 17:55:25 +08:00

好久没贴过代码了
https://gist.github.com/28dea5a2553190223ca6

mopvhs

2014-08-02 10:20:49 +08:00

来分享下我的常用方法：

http://gist.github.com/4b93757c88b5fe558846