Can I download a whole dictionary website with online GNU-dictionary (open-source), and then extract the whole dictionary to my harddisk?

Posted on 2011-10-25
Last Modified: 2013-11-13
Can I download a whole dictionary website with online GNU-dictionary (open-source), and then extract the whole dictionary to my harddisk? And also extract the example sentences (German-English)? I then need it converted to Word-format or Excel-format.

I already know what type of software I need to download whole websites, and there is also the software Concordance (or WordSmith) that I can use to extract. But would this be practically possible? Or will the some parts of the website be copyprotected (even though it's open-source)? Or can I do it with the right software/extraction tools (text/data mining)? I guess the dictionary itself and the example sentences must be stored in some type of database, MySQL or something. Can I download that and extract everything from the database? What tools would I need?
Question by:hermesalpha
    LVL 47

    Expert Comment

    Probably not.

    If there is a database attached to it then I assume it works by accepting some type of input and then outputting a query to the screen.  Site downloading software doesn't work on these types of sites.

    But if it is an online GNU dictionary you should be able to obtain the whole package from somewhere else.  Which site is this?

    Author Comment

    It's this site:

    There should be more than one million words in it. I downloaded a .txt file that was attached to this site, but it only contained about 100,000 words (German-English).
    LVL 47

    Accepted Solution

    Have had a look.  There is a database attached to it so you are not going to get that with site downloading software.

    However the site lists its resources here and you can access those.

    For example obtainable from the link above gives you access to databases and software.

    And see from browsing their FAQ.

    The word list is Open Source and they give you access to that.  The rest of the information isn't.

    Featured Post

    Do You Know the 4 Main Threat Actor Types?

    Do you know the main threat actor types? Most attackers fall into one of four categories, each with their own favored tactics, techniques, and procedures.

    Join & Write a Comment

    Whether you've completed a degree in computer sciences or you're a self-taught programmer, writing your first lines of code in the real world is always a challenge. Here are some of the most common pitfalls for new programmers.
    If your app took Google’s lash recently, here are the 5 most likely reasons.
    The viewer will learn how to successfully download and install the SARDU utility on Windows 8, without downloading adware.
    An overview on how to enroll an hourly employee into the employee database and how to give them access into the clock in terminal.

    745 members asked questions and received personalized solutions in the past 7 days.

    Join the community of 500,000 technology professionals and ask your questions.

    Join & Ask a Question

    Need Help in Real-Time?

    Connect with top rated Experts

    15 Experts available now in Live!

    Get 1:1 Help Now