blogging and scraping » firebug http://www.tsnpc.com Mon, 12 Jul 2010 22:54:43 +0000 en hourly 1 http://wordpress.org/?v=3.0 firebug + hpricot http://www.tsnpc.com/firebughpricot/ http://www.tsnpc.com/firebughpricot/#comments Wed, 01 Oct 2008 12:24:29 +0000 http://www.tsnpc.com/?p=48 Following code is trying to scrape the content in a webpage, the content cannot be picked by the scraping software tool I used:
require ‘rubygems’
require ‘hpricot’
require ‘open-uri’

url = “http://homemsg.focus.cn/msgview/607/50129006.html”
doc = Hpricot(open(url))
td_contents = (doc/”/html/body/table[8]/tbody/tr/td[4]/table[2]/tbody/tr/td”).inner_html
puts td_contents

It did not work, there must be something wrong.

by firebug, I can copy the xpath(/html/body/table[8]/tbody/tr/td[4]/table[2]/tbody/tr/td), and copy its innerHTML.

]]> http://www.tsnpc.com/firebughpricot/feed/ 0