<div>
Do you have a smaller version of the RDF file?<br />
<br />
I took a quick look at the other script. &nbsp;At first, I don't see a need to have the sleep. &nbsp;That just slows it down. &nbsp;It should be fine running without the sleep.
</div>


Do you have a smaller version of the RDF file?

I took a quick look at the other script.  At first, I don't see a need to have the sleep.  That just slows it down.  It should be fine running without the sleep.

<div>
<div class="content wysiwyg-content">
Hello,<br />
<br />
I use a script, provided by za-k/ (adrpo) to populate a database with URLs from an rdf file.<br />
<a href="https://www.experts-exchange.com/questions/23120051/Placing-1-8-GB-of-data-in-database-without-hogging-resources.html" rel="ugc">https://www.experts-exchange.com/questions/23120051/Placing-1-8-GB-of-data-in-database-without-hogging-resources.html</a><br />
<br />
Here is the RDF file:<br />
<a href="http://rdf.dmoz.org/rdf/content.rdf.u8.gz" rel="ugc">http://rdf.dmoz.org/rdf/content.rdf.u8.gz</a><br />
<br />
It populates my database with over 400,000 URLs and many are sub-pages of the same domain.<br />
<br />
Now I only want domain names in my database.<br />
<br />
<a href="http://www.example.com" rel="ugc">http://www.example.com</a>&nbsp;<br />
<br />
&nbsp; &nbsp; &nbsp;should be included as is but<br />
&nbsp; &nbsp; &nbsp;<br />
http://www.domain.com/subdirectory/&nbsp; <br />
<br />
&nbsp; &nbsp; &nbsp; &nbsp; &nbsp;should be placed into the database as <br />
<br />
http://www.domain.com/<br />
<br />
because I only want the domain names and not the full URL.<br />
<br />
Thanks for the help!
</div>
</div>


Hello,

I use a script, provided by za-k/ (adrpo) to populate a database with URLs from an rdf file.
http://www.experts-exchange.com/Web_Development/Web_Languages-Standards/PHP/Q_23120051.html

Here is the RDF file:
http://rdf.dmoz.org/rdf/content.rdf.u8.gz

It populates my database with over 400,000 URLs and many are sub-pages of the same domain.

Now I only want domain names in my database.

http://www.example.com 

     should be included as is but
     
http://www.domain.com/subdirectory/  

         should be placed into the database as 

http://www.domain.com/

because I only want the domain names and not the full URL.

Thanks for the help!

Populate a database with domain names from an rdf file

Perl is a high-level, general-purpose, interpreted, dynamic programming languages with over 25 years of development. Perl 5 runs on over 100 platforms from portables to mainframes and is suitable for both rapid prototyping and large-scale development projects.  Perl gained widespread popularity as a Common Gateway Interface (CGI) scripting language, in part due to its regular expression and string parsing abilities. In addition to CGI, Perl is used for graphics programming, system administration, network programming, finance, bioinformatics, and other applications.

Perl

MySQL is an open source, relational database management system that runs as a server providing multi-user access to a number of databases. Acquired by Oracle in 2009, it is frequently used in combination with PHP installations, powering most of the WordPress installations.