[x]
Posted via EE Mobile

Search, ask, and monitor your questions on the go with EE Mobile. Visit Experts Exchange from your mobile device and never be out of touch again.

Question
[x]
Attachment Details
[x]
The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

  • The Grade of the Solution
  • The Zone Rank of the Expert Providing the Solution
  • The Number of Author and Expert Comments
  • The Number of Experts Contributing
  • The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

7.5

Read from File or Database

Asked by ldbkutty in PHP Scripting Language, MySQL Server, Design & Methodology

We have formulated couple of design specifications for a project and would like to have your opinion on them.

The project typically takes CSV files as input and applies "operations" to it. The CSV file would have tens of thousands of records with 50 to 100 columns. One of the objective of the project is to to extract one/few of the columns from it, apply an equation and create a new column/variable.

Let us assume a CSV file named student.csv with columns: Name, Gender, Age, Dept, etc. has 80,000 records/students. Now we want to make a new column/variable named 'Experience' and the equation to apply is: (Age/2 - 10).

We see two possibilities:

1) Use file read option and store the entire content in a PHP variable, fetch the 'Age' column value and populate 'Experience' for each student.

Cons: If I want to fetch only certain records (Ex: Students aged between 20 and 25) or if I want to fetch only particular columns (Ex: Name and Age), the system will need to fetch the complete file, parse it and generate such a report (this might be practically impossible in case of large datasets)

Doubt: Is there some existing API that would fetch particular set of columns from a file?! (Ex: http://code.google.com/p/php-csv-parser/)

2) When the CSV file is imported, this shall be created as a DB Table (CSV first line is the DB Table Columns). And, newly created variable (Ex: Experience) shall be new column.

I feel that the second option is practically possible, but worried about the number of tables that will be generated! If I upload 200 CSV files, it would generate 200 DB Tables, and each table will have tens of thousands of records!

Please advise with your thoughts.

Thanks!
[+][-]08/13/09 03:11 AM, ID: 25086730Accepted Solution

View this solution now by starting your 30-day free trial. Setting up your free trial is quick, easy, and secure. We will return you to this solution, unlocked, when you're done.

About this solution

Zones: PHP Scripting Language, MySQL Server, Design & Methodology
Sign Up Now!
Solution Provided By: flob9
Participating Experts: 1
Solution Grade: B
 
[+][-]08/13/09 02:50 AM, ID: 25086618Expert Comment

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 30-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]08/13/09 02:52 AM, ID: 25086631Expert Comment

At Experts Exchange, members can ask their questions to thousands of technology professionals, also known as Experts. Experts compete and collaborate to answer those questions by leaving comments like this one.

Start your 30-day free trial to view this Expert Comment or ask the Experts your question.

 
[+][-]08/13/09 02:58 AM, ID: 25086659Author Comment

Often, when Experts are collaborating with members who have asked questions, they will request additional information about the problem. Askers respond with an author comment like this one.

Start your 30-day free trial to view this Author Comment or ask the Experts your question.

 
 
Loading Advertisement...
20091111-EE-VQP-92 - Hierarchy / EE_QW_3_20080625