Solved

Get the database of institutions(schools, and universities with faculties ) of azerbaijan cities from vk.com

Posted on 2015-02-21
5
133 Views
Last Modified: 2015-03-03
Hello, there is a site vk.com which is actually social network, (but that's not very important in current context).

There is a people search link https://vk.com/search
where you may select(at the right side)
1. region
2. city
3.1 school
3.2 class
...
4.1 university and
4.2 faculty
4.3 department
4.4 attending year
....

The task: get the list of schools and universities with faculties and department (in proper hierrachical tree view which must be remapped into MySQL database.

How can we automatically grab that data and put that into mysql corresponding tables? Do we need to write some web-utility which will automatically get those data fields?
The structure of mysql tables are following (without country and city) attached
0
Comment
Question by:Nusrat Nuriyev
  • 2
  • 2
5 Comments
 
LVL 43

Assisted Solution

by:Chris Stanyon
Chris Stanyon earned 20 total points
ID: 40624202
This would be a whole lot easier if the site offers an API to access their data. Have you checked with them to see if this is possible.

Couple of questions through - Is this a homework assignment and do you have permission to be scraping their data?
0
 
LVL 62

Accepted Solution

by:
gheist earned 480 total points
ID: 40624289
Google told me: https://vk.com/dev/openapi
Isnt it easier to seek some central authority that licences them and has the list without mass data mining?
0
 

Author Comment

by:Nusrat Nuriyev
ID: 40624588
Yeah, I have  already found the way to get some info, unfortunately to exactly how I wanted, but still it's acceptable.
0
 
LVL 62

Expert Comment

by:gheist
ID: 40624657
0
 

Author Closing Comment

by:Nusrat Nuriyev
ID: 40642919
Yes, this is my homework, which I'm going to assign to my students.
0

Featured Post

3 Use Cases for Connected Systems

Our Dev teams are like yours. They’re continually cranking out code for new features/bugs fixes, testing, deploying, testing some more, responding to production monitoring events and more. It’s complex. So, we thought you’d like to see what’s working for us.

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Title # Comments Views Activity
Edit a page at wix.com 8 51
how to see all occupied ports on windows 10 laptop 15 65
mysql between clause 2 24
Excel - SQL export question 3 42
I've been asked to discuss some of the UX activities that I'm using with my team. Here I will share some details about how we approach UX projects.
This article will inform Clients about common and important expectations from the freelancers (Experts) who are looking at your Gig.
Explain concepts important to validation of email addresses with regular expressions. Applies to most languages/tools that uses regular expressions. Consider email address RFCs: Look at HTML5 form input element (with type=email) regex pattern: T…
The viewer will get a basic understanding of what section 508 compliance can entail, learn about skip navigation links, alt text, transcripts, and font size controls.

777 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question