July 9, 2008 08:12am pdt

1. SidFishes 144,720
2. Zvonko 91,000
3. gdemaria 77,770
4. _agx_ 73,657
5. SBennett 53,100
6. Plucka 52,300
7. hielo 34,250
8. Mr_Nil 24,500
9. zadoc 23,750
10. dgrafx 23,500
11. srikanth... 19,310
12. pmascari 18,750
13. erikTsomik 16,200
14. Kerrdo 15,300
15. meverest 13,950

1. mrichmon 1,346,158
2. trailbla... 688,918
3. pinaldave 661,396
4. anandkp 591,655
5. dgrafx 535,438
6. SidFishes 520,670
7. gdemaria 519,691
8. _agx_ 422,122
9. Plucka 393,668
10. Tacobell777 390,907
11. Jester_48 383,245
12. danrosen... 348,915
13. mkishline 295,040
14. mmc98dl1 271,238
15. entrance... 248,605

02.11.2008 at 12:12AM PST, ID: 23152400

	[x] Attachment Details

[x]

The Solution Rating System

With so many solutions, how can you tell which solutions are most likely to help you and which ones are not? To provide you with a tool to use, we rate our solutions based on various elements that most accurately determine if a solution is a quality solution. To explain what factors affect the solution rating, here are the elements we take into consideration when formulating our solution rating.

The Grade of the Solution
The Zone Rank of the Expert Providing the Solution
The Number of Author and Expert Comments
The Number of Experts Contributing
The Feedback of the Community

Your Input Matters
Because of the way the system is set up, the most important variable in this equation is you. As a member of Experts Exchange, you are able to cast your vote on the quality of the solutions in regard to how complete, accurate, helpful and easy to understand each solution is. When you provide your feedback, each rating is adjusted accordingly. So, if you see a solution that has a poor rating that you think is a good solution, let us know by rating it. As you do, the rating will be adjusted and will become more accurate for other members of our site.

If you have any suggestions that you would like to make for our rating system, please ask a question in the Suggestions Zone of Community Support.

Thank you!

9.2

Reading and comparing CSV and database table data

Zones: ColdFusion Application Server, MySQL, Cold Fusion Markup Language

Tags: Coldfusion, IE6, www.tio.co.za, Comparing data in table with data in CSV file

hi

I am trying to compare the data in a datebase table with the data in a CSV file. Only the first column is being used/compared in the CSV file to/with a column in the DB table. Whatever is listed in the CSV file column and is not equal to that which is in the database table must be displayed to the browser. Here is some code:

<cfset DepartmentCodes = QueryNew('DepartmentCode')>
<cfset strFilePath = (CFFILE.ServerDirectory & "\" & CFFILE.ServerFile) />


<cffile action="read" file="#strFilePath#" variable="csvfile">


<cfloop index="index" list="#csvfile#" delimiters="#chr(10)##chr(13)#">
<cfset CSVcolumn = '#listgetAt('#index#',1)#'>

<cfquery name="GetCodes" datasource="#serverDNS#">
SELECT DepartmentID
FROM Departments
WHERE Deleted = 0
AND Code <> '#CSVcolumn#'
</cfquery>
<cfif GetCodes.Recordcount GT 0>
<cfset NewRow = queryAddRow(DepartmentCodes)>
<cfset tempCodes = querySetCell(DepartmentCodes, 'DepartmentCode', #CSVcolumn#)>
</cfif>
</cfloop>
<cfoutput query="DepartmentCodes">
#DepartmentCode#<br />
</cfoutput>

Problem:
This is returning all the Data in the CSV column, all i need is the data not in the database table which are listed in the CSV file.

Anyone?

Thank you.
Garth.
Direct email gclaasen@tio.co.za

Start your free trial to view this solution

Question Stats

Zone: Software

Question Asked By: TIO-Solutions

Solution Provided By: _agx_

Participating Experts: 2

Solution Grade: B

Translate:

Loading Advertisement...

Microsoft

Internet Protocols
Applications

Development
OS

Hardware
Windows Security

Apple

Operating Systems
Hardware

Programming
Networking

Software

Internet

Search Engines
File Sharing
WebTrends / Stats
Spy / Ad Blockers

Web Browsers
New Net Users
Web Development
Chat / IM

Anti Spam
Web Servers
Anti-Virus
Email Clients

Gamers

Tips
Online / MMORPG
Puzzle
Emulators

Action / Adventure
Role Playing
Consoles
Game Programming

Strategy
Sports
Misc
Computer Games

Digital Living

Hardware
New Net Users
New Users

Software
Digital Music
Gaming World

Home Security
Apple
Networking Hardware

Virus & Spyware

Vulnerabilities
IDS
Encryption
Anti-Virus

Operating Systems Security
Software Firewalls
WebApplications
Cell Phones

Operating Systems
Internet
Hardware Firewalls

Hardware

Handhelds / PDAs
Displays / Monitors
Components
Networking Hardware

Peripherals
Laptops/Notebooks
Storage
Servers

Desktops
New Users
Misc
Apple

Software

System Utilities
Industry Specific
Network Management
Photos / Graphics
Page Layout
VMWare
Misc
Web Development

OS
CYGWIN
Voice Recognition
Message Queue
Quality Assurance
Security
Firewalls
MultiMedia Applications

Development
Database
Office / Productivity
Business Management
OS/2 Apps
Server Software
Internet / Email

ITPro

OS
Storage
Encryption
Operating Systems Security
Apple Hardware
Laptops & Notebooks
Servers
Networking Hardware
Peripherals

Devices
Displays / Monitors
WebTrends / Stats
Search Engines
Firewalls
WebApplications
IDS
Vulnerabilities
Email Clients

File Sharing
Spy / Ad Blockers
Web Browsers
Web Servers
Networking
Anti-Virus
Chat / IM
Anti Spam

Developer

Web Servers
Web Browsers
Game Programming
Dev Tools
Industry Specific
Office / Productivity

Database
CYGWIN
Web Development
Search Engines
File Sharing
WebTrends / Stats

Programming
Content Management
Application Servers
Protocols

Storage

Removable Backup Media
Storage Technology
Servers

Grid
Remote Access
Backup / Restore

Misc
Hard Drives

Miscellaneous
Security
Development
Linux
VMWare

MainFrame OS
Unix
Apple
OS / 2
AS / 400

BeOS
Microsoft
VMS / OpenVMS

Database

Oracle
Miscellaneous
MySQL
Software
Sybase
Contact Management
PostgreSQL
Data Manipulation
Clarion
InterSystems Cache

Siebel
MUMPS
OLAP
SQLBase
SAS
GIS & GPS
4GL
Berkeley DB
DB2
Informix

Interbase / Firebird
FoxPro
Reporting
LDAP
Filemaker Pro
MS SQL Server
dBase
MS Access

Security

Misc
Web Browsers
Software Firewalls
Operating Systems Security
File Sharing

Spy / Ad Blockers
Vulnerabilities
WebApplications
IDS
Anti-Virus

Encryption
Anti Spam
Email Clients
VPN
Chat / IM

Programming

Editors IDEs
Installation
Handhelds / PDAs
Multimedia Programming
System / Kernel

Algorithms
Game
Signal Processing
Project Management
Open Source

Database
Misc
Languages
Processor Platforms
Theory

Web Development

Scripting
Blogs
Web Servers
Software
Search Engines
Web Graphics
Images

Internet Marketing
Images and Photos
Components
Document Imaging
Web Languages/Standards
Illustration
WebApplications

Fonts
WebTrends / Stats
Authoring
Digital Camera Software
Miscellaneous

Networking

Protocols
Apple Networking
Network Management
Message Queue
Application Servers
Content Management
File Servers
Email Servers
Misc
Java Editors & IDEs

Wireless
Networking Hardware
Backup / Restore
System Utilities
ISPs & Hosting
Web Servers
Storage Technology
Removable Backup Media
Servers
Broadband

Grid
OS / 2
Novell Netware
Unix Networking
Windows Networking
Security
Telecommunications
Operating Systems
Linux Networking

Other

Community Advisor
Lounge
Community Support
New Net Users

Philosophy / Religion
Math / Science
Miscellaneous
URLs

Expert Lounge
Politics
Puzzles / Riddles

Community Support

Suggestions
New to EE
New Topics
Community Advisor

CleanUp
Announcements
General

Feedback
Input
EE Bugs

02.11.2008 at 12:35AM PST, ID: 20864726

Rank: Guru

hielo:

Hello TIO-Solutions,
Try changing this:
<cfset CSVcolumn = '#listgetAt('#index#',1)#'>

to this:
<cfset CSVcolumn = '#listgetAt('#index#',1,',')#'>

Regards,

hielo

Assisted Solution

02.11.2008 at 02:05AM PST, ID: 20865077

TIO-Solutions:

Thanks for the reply Hielo.
This is what i get back from the query;
BDCTBAwweett

It should look like this;
ww
ee
tt

Reason is that BD, CT, BA are already in the table and do not need to be displayed. the other three are in the code column of the csv file, but not in the table. the last three need to be displayed.

02.11.2008 at 07:51AM PST, ID: 20867277

Rank: Wizard

_agx_:

I think your query logic is wrong. I think you should be matching _on_ the code and adding the value to the query if the record count _does_ equal 0.

...
WHERE Deleted = 0
AND Code = '#CSVcolumn#'
</cfquery>
<cfif GetCodes.Recordcount EQ 0>
<cfset NewRow = queryAddRow(DepartmentCodes)>
...
</.cfif>

As an aside, maybe you have a reason for doing the comparison in CF, but it seems like it would be easier if you imported the CSV data into a table, then used a single LEFT JOIN to get the differences

-- find codes that exist in table 1 that do not exist in table 2
SELECT t1.Code
FROM TableOne AS t1 LEFT JOIN TableTwo AS t2
ON t1.Code = t2.Code AND t2.Deleted = 0
WHERE t2.Code IS NULL

Accepted Solution

02.11.2008 at 10:25PM PST, ID: 20872831

TIO-Solutions:

Everything is working properly now.
Thanks to Ben Nadel, the following code did the job.
thanks for your efforts.

                       
         
           
             1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:

           
           
             <cfset DepartmentCodes = QueryNew('DepartmentCode')>
		
		<cfset strFilePath = (CFFILE.ServerDirectory & "\" & CFFILE.ServerFile) />
		
		<!--- get and read the CSV-TXT file --->
		<cffile action="read" file="#strFilePath#" variable="csvfile">
		
		<cfquery name="GetCodes" datasource="tio">
				SELECT TourplanDepartmentCode
				FROM Departments
				WHERE Deleted = 0
		</cfquery>
		
		<!---loop through the CSV-TXT file on line breaks and insert into database --->
		<cfloop index="index" list="#csvfile#" delimiters="#chr(10)##chr(13)#">
		
				<!--- Get the current department. --->
				<cfset strDepartment = ListGetAt( index, 1 ) />
				
				<!--- Check to see if it exists in the query. --->
				<cfquery name="qDepartment" dbtype="query">
						SELECT
								*
						FROM
								GetCodes
						WHERE
								TourplanDepartmentCode = <cfqueryparam value="#strDepartment#" cfsqltype="cf_sql_varchar" />
				</cfquery>
				
				
				<!--- Check to see if department was found. --->
				<cfif NOT qDepartment.RecordCount>
								<cfset NewRow = queryAddRow(DepartmentCodes)>
								<cfset tempCodes = querySetCell(DepartmentCodes, 'DepartmentCode', strDepartment)>
				</cfif>
		
		</cfloop>
		
		<cfoutput query="DepartmentCodes">
		
								#DepartmentCode#<br />
		
		</cfoutput>

           
         

Open in New Window

_agx_

02.12.2008 at 06:54AM PST, ID: 20875224

TIO-Solutions,

Really? That looks like exactly what I suggested.

TIO-Solutions

02.14.2008 at 10:18PM PST, ID: 20899747

Yeah. The problem was that i did yours and it still returned all the codes.

What you forgot or maybe did not notice is that the query:
<cfquery name="GetCodes" datasource="tio">
                        SELECT TourplanDepartmentCode
                        FROM Departments
                        WHERE Deleted = 0
            </cfquery>
should have been outside the loop. With the query outside the loop it gave me all the codes not listed/found.

_agx_

02.14.2008 at 11:51PM PST, ID: 20900036

No, it works perfectly fine even inside the loop. I suspect you may have implemented the code wrong. Perhaps you missed it but there were two code changes.

1) to change the <> to equals
...
WHERE Deleted = 0
AND Code = '#CSVcolumn#'
</cfquery>

2) Add the row if the the recordcount _equals_ zero

<cfif GetCodes.Recordcount EQ 0>
<cfset NewRow = queryAddRow(DepartmentCodes)>
...
</.cfif>

So if the table contains the codes: BD, CT, BA
And the file contains the codes: ww, ee, tt

The output of the query is: ww, ee, tt (not everything).

20080236-EE-VQP-29 / EE_QW_2_20070628