Solved

Get the database of institutions(schools, and universities with faculties ) of azerbaijan cities from vk.com

Posted on 2015-02-21
5
138 Views
Last Modified: 2015-03-03
Hello, there is a site vk.com which is actually social network, (but that's not very important in current context).

There is a people search link https://vk.com/search
where you may select(at the right side)
1. region
2. city
3.1 school
3.2 class
...
4.1 university and
4.2 faculty
4.3 department
4.4 attending year
....

The task: get the list of schools and universities with faculties and department (in proper hierrachical tree view which must be remapped into MySQL database.

How can we automatically grab that data and put that into mysql corresponding tables? Do we need to write some web-utility which will automatically get those data fields?
The structure of mysql tables are following (without country and city) attached
0
Comment
Question by:Nusrat Nuriyev
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
  • 2
  • 2
5 Comments
 
LVL 43

Assisted Solution

by:Chris Stanyon
Chris Stanyon earned 20 total points
ID: 40624202
This would be a whole lot easier if the site offers an API to access their data. Have you checked with them to see if this is possible.

Couple of questions through - Is this a homework assignment and do you have permission to be scraping their data?
0
 
LVL 62

Accepted Solution

by:
gheist earned 480 total points
ID: 40624289
Google told me: https://vk.com/dev/openapi
Isnt it easier to seek some central authority that licences them and has the list without mass data mining?
0
 

Author Comment

by:Nusrat Nuriyev
ID: 40624588
Yeah, I have  already found the way to get some info, unfortunately to exactly how I wanted, but still it's acceptable.
0
 
LVL 62

Expert Comment

by:gheist
ID: 40624657
0
 

Author Closing Comment

by:Nusrat Nuriyev
ID: 40642919
Yes, this is my homework, which I'm going to assign to my students.
0

Featured Post

Simplifying Server Workload Migrations

This use case outlines the migration challenges that organizations face and how the Acronis AnyData Engine supports physical-to-physical (P2P), physical-to-virtual (P2V), virtual to physical (V2P), and cross-virtual (V2V) migration scenarios to address these challenges.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Does your audience prefer people in photos or no people? How can you best highlight what you’re selling? What are your competitors doing, and what can you do that is different and unique from them?  Continue reading to learn how to make your images …
Australian government abolished Visa 457 earlier this April and this article describes how this decision might affect Australian IT scene and IT experts.
This tutorial walks through the best practices in adding a local business to Google Maps including how to properly search for duplicates, marker placement, and inputing business details. Login to your Google Account, then search for "Google Mapmaker…
Video by: Mark
This lesson goes over how to construct ordered and unordered lists and how to create hyperlinks.

690 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question