Advertisement

12.19.2007 at 12:02PM PST, ID: 23034345
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

Extract information from a webpage

Is there a way information can be extracted from a webpage?
Here is what I want to do:  I want to extract information in the table in the variety webpage for weekly boxoffice in the US.  How can this be done?  Any pointer will be greatly appreciated.  Thank you.

Here is the webpage
http://www.variety.com/index.asp?layout=b_o_weekend&dept=Film
Start your free trial to view this solution
Question Stats
Zone: Programming
Question Asked By: fcoit
Solution Provided By: aconrad
Participating Experts: 3
Solution Grade: A
Views: 0
Translate:
Loading Advertisement...
12.19.2007 at 01:34PM PST, ID: 20503145

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.19.2007 at 02:18PM PST, ID: 20503480

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
12.19.2007 at 05:24PM PST, ID: 20504395

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
01.05.2008 at 10:29AM PST, ID: 20590044

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
02.26.2008 at 05:07PM PST, ID: 20990536

All comments and solutions are available to Premium Service Members only.

Start your 7 day free trial and see for yourself why Experts Exchange is the easiest and most proven technology resource in the world. Get Started

Already a member? Login to view this solution.

 
 
Loading Advertisement...
Microsoft
  • Internet Protocols
  • Applications
  • Development
  • OS
  • Hardware
  • Windows Security
Apple
  • Operating Systems
  • Hardware
  • Programming
  • Networking
  • Software
Internet
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Spy / Ad Blockers
  • Web Browsers
  • New Net Users
  • Web Development
  • Chat / IM
  • Anti Spam
  • Web Servers
  • Anti-Virus
  • Email Clients
Gamers
  • Tips
  • Online / MMORPG
  • Puzzle
  • Emulators
  • Action / Adventure
  • Role Playing
  • Consoles
  • Game Programming
  • Strategy
  • Sports
  • Misc
  • Computer Games
Digital Living
  • Hardware
  • New Net Users
  • New Users
  • Software
  • Digital Music
  • Gaming World
  • Home Security
  • Apple
  • Networking Hardware
Virus & Spyware
  • Vulnerabilities
  • IDS
  • Encryption
  • Anti-Virus
  • Operating Systems Security
  • Software Firewalls
  • WebApplications
  • Cell Phones
  • Operating Systems
  • Internet
  • Hardware Firewalls
Hardware
  • Handhelds / PDAs
  • Displays / Monitors
  • Components
  • Networking Hardware
  • Peripherals
  • Laptops/Notebooks
  • Storage
  • Servers
  • Desktops
  • New Users
  • Misc
  • Apple
Software
  • System Utilities
  • Industry Specific
  • Network Management
  • Photos / Graphics
  • Page Layout
  • VMWare
  • Misc
  • Web Development
  • OS
  • CYGWIN
  • Voice Recognition
  • Message Queue
  • Quality Assurance
  • Security
  • Firewalls
  • MultiMedia Applications
  • Development
  • Database
  • Office / Productivity
  • Business Management
  • OS/2 Apps
  • Server Software
  • Internet / Email
ITPro
  • OS
  • Storage
  • Encryption
  • Operating Systems Security
  • Apple Hardware
  • Laptops & Notebooks
  • Servers
  • Networking Hardware
  • Peripherals
  • Devices
  • Displays / Monitors
  • WebTrends / Stats
  • Search Engines
  • Firewalls
  • WebApplications
  • IDS
  • Vulnerabilities
  • Email Clients
  • File Sharing
  • Spy / Ad Blockers
  • Web Browsers
  • Web Servers
  • Networking
  • Anti-Virus
  • Chat / IM
  • Anti Spam
Developer
  • Web Servers
  • Web Browsers
  • Game Programming
  • Dev Tools
  • Industry Specific
  • Office / Productivity
  • Database
  • CYGWIN
  • Web Development
  • Search Engines
  • File Sharing
  • WebTrends / Stats
  • Programming
  • Content Management
  • Application Servers
  • Protocols
Storage
  • Removable Backup Media
  • Storage Technology
  • Servers
  • Grid
  • Remote Access
  • Backup / Restore
  • Misc
  • Hard Drives
OS
  • Miscellaneous
  • Security
  • Development
  • Linux
  • VMWare
  • MainFrame OS
  • Unix
  • Apple
  • OS / 2
  • AS / 400
  • BeOS
  • Microsoft
  • VMS / OpenVMS
Database
  • Oracle
  • Miscellaneous
  • MySQL
  • Software
  • Sybase
  • Contact Management
  • PostgreSQL
  • Data Manipulation
  • Clarion
  • InterSystems Cache
  • Siebel
  • MUMPS
  • OLAP
  • SQLBase
  • SAS
  • GIS & GPS
  • 4GL
  • Berkeley DB
  • DB2
  • Informix
  • Interbase / Firebird
  • FoxPro
  • Reporting
  • LDAP
  • Filemaker Pro
  • MS SQL Server
  • dBase
  • MS Access
Security
  • Misc
  • Web Browsers
  • Software Firewalls
  • Operating Systems Security
  • File Sharing
  • Spy / Ad Blockers
  • Vulnerabilities
  • WebApplications
  • IDS
  • Anti-Virus
  • Encryption
  • Anti Spam
  • Email Clients
  • VPN
  • Chat / IM
Programming
  • Editors IDEs
  • Installation
  • Handhelds / PDAs
  • Multimedia Programming
  • System / Kernel
  • Algorithms
  • Game
  • Signal Processing
  • Project Management
  • Open Source
  • Database
  • Misc
  • Languages
  • Processor Platforms
  • Theory
Web Development
  • Scripting
  • Blogs
  • Web Servers
  • Software
  • Search Engines
  • Web Graphics
  • Images
  • Internet Marketing
  • Images and Photos
  • Components
  • Document Imaging
  • Web Languages/Standards
  • Illustration
  • WebApplications
  • Fonts
  • WebTrends / Stats
  • Authoring
  • Digital Camera Software
  • Miscellaneous
Networking
  • Protocols
  • Apple Networking
  • Network Management
  • Message Queue
  • Application Servers
  • Content Management
  • File Servers
  • Email Servers
  • Misc
  • Java Editors & IDEs
  • Wireless
  • Networking Hardware
  • Backup / Restore
  • System Utilities
  • ISPs & Hosting
  • Web Servers
  • Storage Technology
  • Removable Backup Media
  • Servers
  • Broadband
  • Grid
  • OS / 2
  • Novell Netware
  • Unix Networking
  • Windows Networking
  • Security
  • Telecommunications
  • Operating Systems
  • Linux Networking
Other
  • Community Advisor
  • Lounge
  • Community Support
  • New Net Users
  • Philosophy / Religion
  • Math / Science
  • Miscellaneous
  • URLs
  • Expert Lounge
  • Politics
  • Puzzles / Riddles
Community Support
  • Suggestions
  • New to EE
  • New Topics
  • Community Advisor
  • CleanUp
  • Announcements
  • General
  • Feedback
  • Input
  • EE Bugs
 
12.19.2007 at 01:34PM PST, ID: 20503145
My first question is 'Would this be copyright infringement?' Do you have permission to take the information from their site?

If so, their are a number of ways this could be done, I would imagine - I have never actually done it.

But, I would think you could use server-side scripting and some form of http_request to pull the page and extract the information.
 
12.19.2007 at 02:18PM PST, ID: 20503480
BongSoo,

I am not copyright expert but this is public information, as to how this can be accomplished I am looking for ways to do this.
 
12.19.2007 at 05:24PM PST, ID: 20504395
The first question is what resources do you have?
 
01.05.2008 at 10:29AM PST, ID: 20590044
Site is © 2008 Reed Business Information, a division of Reed Elsevier Inc. All rights reserved. Use of this website is subject to its Terms & Conditions of Use. View our Privacy Policy.

If you want web info extraction search on 'web scrapping'
 
02.26.2008 at 05:07PM PST, ID: 20990536
yup, there is a way.
what you do with that way is another story.
1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:
48:
49:
50:
51:
52:
53:
54:
55:
56:
57:
58:
59:
60:
61:
62:
63:
64:
65:
66:
67:
68:
69:
70:
71:
72:
73:
74:
75:
76:
77:
<?
error_reporting(E_ALL);
 
$fp = fopen('http://www.variety.com/index.asp?layout=b_o_weekend&dept=Film','r');
if (!$fp) die('cant');
 
 
$read = '';
while (!feof($fp)) $read .= fread($fp,10000);
fclose($fp);
 
$lines = get_items('<td width=20 class=filmOff>','<table>','start',$read);
 
 
$ret = array();
foreach ($lines as $key=>$value)
{
	$ret[] = array(
	'place'=>get_item('<b>','</b></td>','start',$value,'trim'),
	'name'=>get_item('<td class=filmOff>','</td></tr></table>','start',$value,'trim'),
	'distrib'=>str_replace('&nbsp;','',get_item('<td class=distOff>','</td>','start',$value,'trim')),
	'genre'=>str_replace('&nbsp;','',get_item('<td class=genreOff>','</td>','start',$value,'trim')),
	'wbof'=>get_item('<td align=right class=rboWeekendOn>','&nbsp;</td>','start',$value,'trim'),
	'wbof'=>get_item('<td align=right class=rboWeekendOn>','&nbsp;</td>','start',$value,'trim'),
	'cbof'=>get_item('<td align="right" class="dboCumulativeOff" bgcolor="#FFFFCC">','&nbsp;</td>','start',$value,'trim'),
	);
}
 
echo '<pre>';
print_r($ret);
echo '</pre>';
 
 
 
function get_items($start,$end,$explode_first='start',$string='',$callback='',$only='')
{
 
	if (stristr($string,$start)===false) return false;
	if (stristr($string,$end)===false) return false;
 
	$xpf = $explode_first=='start'?true:false;
 
	$tmp = explode(($xpf?$start:$end),$string);
	$tmp = $xpf?array_slice($tmp,1):array_slice($tmp,0,-1);
 
	foreach ($tmp as $value)
	{
		$tmp2 = explode(($xpf?$end:$start),$value);
		if (!$xpf)
		{
			$help = array_map('htmlentities',$tmp2);
		}
 
		$items[] = $tmp2[($xpf?0:(count($tmp2)-1))];
	}
	if (!empty($callback)){
		$items = array_map($callback,$items);
	}
		
	if (!isset($items))
	{
		echo 'ITEMS NOT DEFINED IN SEARCH : '.htmlspecialchars($start).' - '.htmlspecialchars($end)."\n";
	}
	return $items;
}
 
 
 
function get_item($start,$end,$explode_first='start',$string='',$callback='',$only='',$nr=0)
{
	$var = get_items($start,$end,$explode_first,$string,$callback,$only);
	if ($var===false) return false;
	return $var[$nr];
}
 
 
?>
Open in New Window
Accepted Solution
 
 
20080236-EE-VQP-29 / EE_QW_2_20070628