Solved

Rounding problem in SQL 2005

Posted on 2008-06-18
4
222 Views
Last Modified: 2010-03-19
I have data for a particular row. the value as shown when i open the table is 0.02222499999999999998 and when i execute a query in the SQL management studio, the value returned is 0.022225. how can i make the query return the exact data in the table and not the rounded value.
0
Comment
Question by:jealanish
[X]
Welcome to Experts Exchange

Add your voice to the tech community where 5M+ people just like you are talking about what matters.

  • Help others & share knowledge
  • Earn cash & points
  • Learn & ask questions
4 Comments
 
LVL 13

Expert Comment

by:rickchild
ID: 21814410
I am sure someone will come in with a better solution, but see this:

http://www.codeproject.com/KB/database/Formatting_in_SQL.aspx
0
 

Author Comment

by:jealanish
ID: 21814561
It does not really help me as the value that is retrieved is 0.022225 and so whatever operation you do is based on this. i see the value as 0.02222499999999999998 in the table.  lets say i have a table expt in which i have two columns one is name of type varchar2 and the other is floatvalue of type float. insert into expt values('jealani' , 0.02222499999999999998). now when i execute the query 'Select * from expt". i need to see "Jealani   0.02222499999999999998 " as the output. i need the exact value what i see in the table in the table view mode.
0
 
LVL 51

Expert Comment

by:Mark Wills
ID: 21815774
Sounds like you are using a float. which is an approximation to the real value. Make sure your datatype is either REAL or FLOAT when retrieving, or if decimal, has sufficent scale to accommodate such as decimal(24,18). When using float, some of the views like tableview will attempt to round back. Better if possible to use a high scaled number rather than the numerical approximation of a float column...
0
 
LVL 143

Accepted Solution

by:
Guy Hengel [angelIII / a3] earned 250 total points
ID: 21816012
just to show the "behaviour":
set nocount on
declare @i1 float
declare @i2 float
declare @f float
 
set @i1 = 1
set @i2 = 3
set @f = @i1/@i2
 
select @f f 
select cast(@f as varchar(1000)) v
select cast(@f as decimal(20,18)) d
 
returns:
 
                     f
----------------------
     0,333333333333333
 
v
----------------------------------------------
0.333333
 
                                      d
---------------------------------------
                   0.333333333333333310

Open in new window

0

Featured Post

Industry Leaders: We Want Your Opinion!

We value your feedback.

Take our survey and automatically be enter to win anyone of the following:
Yeti Cooler, Amazon eGift Card, and Movie eGift Card!

Question has a verified solution.

If you are experiencing a similar issue, please ask a related question

Suggested Solutions

Introduction This article will provide a solution for an error that might occur installing a new SQL 2005 64-bit cluster. This article will assume that you are fully prepared to complete the installation and describes the error as it occurred durin…
I've encountered valid database schemas that do not have a primary key.  For example, I use LogParser from Microsoft to push IIS logs into a SQL database table for processing and analysis.  However, occasionally due to user error or a scheduled task…
Finds all prime numbers in a range requested and places them in a public primes() array. I've demostrated a template size of 30 (2 * 3 * 5) but larger templates can be built such 210  (2 * 3 * 5 * 7) or 2310  (2 * 3 * 5 * 7 * 11). The larger templa…

737 members asked questions and received personalized solutions in the past 7 days.

Join the community of 500,000 technology professionals and ask your questions.

Join & Ask a Question