Solved

Get the database of institutions(schools, and universities with faculties ) of azerbaijan cities from vk.com

Posted on 2015-02-21
5
136 Views
Last Modified: 2015-03-03
Hello, there is a site vk.com which is actually social network, (but that's not very important in current context).

There is a people search link https://vk.com/search
where you may select(at the right side)
1. region
2. city
3.1 school
3.2 class
...
4.1 university and
4.2 faculty
4.3 department
4.4 attending year
....

The task: get the list of schools and universities with faculties and department (in proper hierrachical tree view which must be remapped into MySQL database.

How can we automatically grab that data and put that into mysql corresponding tables? Do we need to write some web-utility which will automatically get those data fields?
The structure of mysql tables are following (without country and city) attached
0
Comment
Question by:Nusrat Nuriyev
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
  • 2
5 Comments
 
LVL 43

Assisted Solution

by:Chris Stanyon
Chris Stanyon earned 20 total points
ID: 40624202
This would be a whole lot easier if the site offers an API to access their data. Have you checked with them to see if this is possible.

Couple of questions through - Is this a homework assignment and do you have permission to be scraping their data?
0
 
LVL 62

Accepted Solution

by:
gheist earned 480 total points
ID: 40624289
Google told me: https://vk.com/dev/openapi
Isnt it easier to seek some central authority that licences them and has the list without mass data mining?
0
 

Author Comment

by:Nusrat Nuriyev
ID: 40624588
Yeah, I have  already found the way to get some info, unfortunately to exactly how I wanted, but still it's acceptable.
0
 
LVL 62

Expert Comment

by:gheist
ID: 40624657
0
 

Author Closing Comment

by:Nusrat Nuriyev
ID: 40642919
Yes, this is my homework, which I'm going to assign to my students.
0

Featured Post

NFR key for Veeam Backup for Microsoft Office 365

Veeam is happy to provide a free NFR license (for 1 year, up to 10 users). This license allows for the non‑production use of Veeam Backup for Microsoft Office 365 in your home lab without any feature limitations.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

When crafting your “Why Us” page, there are a plethora of pitfalls to avoid. Follow these five tips, and you’ll be well on your way to creating an effective page.
Dramatic changes are revolutionizing how we build and use technology. Every company is automating, digitizing, and modernizing operations. We need a better, more connected way to work together as teams so we can harness the insights from our system…
This video teaches users how to migrate an existing Wordpress website to a new domain.
The viewer will learn how to look for a specific file type in a local or remote server directory using PHP.

734 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question