Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

problem scraping index page (Scraping 0 instances) #36

Open
okliv opened this issue Apr 3, 2014 · 1 comment
Open

problem scraping index page (Scraping 0 instances) #36

okliv opened this issue Apr 3, 2014 · 1 comment

Comments

@okliv
Copy link

okliv commented Apr 3, 2014

hi!

if i try to lookup this page alma-ata.alm.slando.kz for links h3.large a.link to go next

  scraper = Upton::Scraper.new('http://alma-ata.alm.slando.kz/','h3.large a.link')

all i get with scraper.verbose = true is

Stashing disabled. Will download from the internet.
Downloading from http://alma-ata.alm.slando.kz/ 
Downloaded http://alma-ata.alm.slando.kz/
sleeping 30 secs
Scraping 0 instances

but from js console on this page i see this

> $('h3.large a.link').size()
> 30

looks like an error somewhere

@okliv okliv changed the title problem scraping website problem scraping index page (Scraping 0 instances) Apr 3, 2014
@drwl
Copy link

drwl commented Aug 19, 2014

I'm using upton (0.3.3) and running it works for me.

Stashing disabled. Will download from the internet.
Downloading from http://alma-ata.alm.slando.kz/
Downloaded http://alma-ata.alm.slando.kz/
sleeping 1 secs
Scraping 30 instances
Stashing enabled. Will try reading http://alma-ata.alm.olx.kz/obyavlenie/ogromnyy-televizor-po-skromnoy-tsene-ID4fwdh.html#4c7502b736;promoted data from cache.
Cache of http://alma-ata.alm.olx.kz/obyavlenie/ogromnyy-televizor-po-skromnoy-tsene-ID4fwdh.html#4c7502b736;promoted unavailable. Will download from the internet...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants