Excel 2003 Bug #2

if you copy a number like '51234123412349999' into excel, excel treats it as 
a number but cannot handle the length and thus stores it in scientific 
notation which loses the precision of the original number (it is now 
51234123412349900)

this is no bloody use

why does it automatically remove precision just because it thinks you want a 
freaking number 


0
noone1 (387)
6/15/2005 4:49:24 AM
excel 39879 articles. 2 followers. Follow

5 Replies
298 Views

Similar Articles

[PageSpeed] 24

Hi

Read about this in Excel Help: Getting Started > Microsoft Excel 
Specifications > Calculation Specifications > Number precision

-- 
Arvi Laanemets
( My real mail address: arvil<at>tarkon.ee )


"Mark" <noone@nowhere.com> wrote in message 
news:eCSlqTWcFHA.3808@TK2MSFTNGP14.phx.gbl...
> if you copy a number like '51234123412349999' into excel, excel treats it 
> as a number but cannot handle the length and thus stores it in scientific 
> notation which loses the precision of the original number (it is now 
> 51234123412349900)
>
> this is no bloody use
>
> why does it automatically remove precision just because it thinks you want 
> a freaking number
> 


0
garbage (650)
6/15/2005 5:11:27 AM
On Wed, 15 Jun 2005 16:49:24 +1200, "Mark" <noone@nowhere.com> wrote:

>why does it automatically remove precision just because it thinks you want a 
>freaking number 

Because it is acting in accord with its specifications, which you can find if
you check HELP for specifications.


--ron
0
ronrosenfeld (3122)
6/15/2005 11:01:21 AM
51234123412349999 cannot be represented in Excel's numeric storage 
format.  If you don't need to do math with it (e.g. it is an ID #), then 
prefix with a single quote to store it exactly as text.

Almost all software (including Excel) follows the IEEE standard for 
double precision storage of numbers.  The binary representation defined 
there can distinguish every 15 decimal digit number (hence Excel's 
documented limit of 15 digits.

Excel does do things a bit oddly when you enter more than 15 digits; it 
truncates to 15 digits before conversion to binary, whereas most other 
packages would use the trailing digits to fine tune the binary 
approximation so that they would display 51234123412350000 (also 
different from your input, but slightly closer).

The difference between 51234123412349900 and 51234123412350000 is 
0.0000000000002%.  If you are doing calculations where you care about 
differences that small, then no double precision package would be 
adequate.  In that case you might look at arbitrary precision packages 
such as Maple and Mathematica.

Jerry

Mark wrote:

> if you copy a number like '51234123412349999' into excel, excel treats it as 
> a number but cannot handle the length and thus stores it in scientific 
> notation which loses the precision of the original number (it is now 
> 51234123412349900)
> 
> this is no bloody use
> 
> why does it automatically remove precision just because it thinks you want a 
> freaking number

0
post_a_reply (1395)
6/15/2005 11:46:36 AM
thanks...

the source data is from a query in sql server 2000...loaded via csv into 
excel

i should have thought to add the single quote myself...its not too much 
hassle to do (in the query) and works...

"Jerry W. Lewis" <post_a_reply@no_e-mail.com> wrote in message 
news:42B0151C.4090006@no_e-mail.com...
> 51234123412349999 cannot be represented in Excel's numeric storage format. 
> If you don't need to do math with it (e.g. it is an ID #), then prefix 
> with a single quote to store it exactly as text.
>
> Almost all software (including Excel) follows the IEEE standard for double 
> precision storage of numbers.  The binary representation defined there can 
> distinguish every 15 decimal digit number (hence Excel's documented limit 
> of 15 digits.
>
> Excel does do things a bit oddly when you enter more than 15 digits; it 
> truncates to 15 digits before conversion to binary, whereas most other 
> packages would use the trailing digits to fine tune the binary 
> approximation so that they would display 51234123412350000 (also different 
> from your input, but slightly closer).
>
> The difference between 51234123412349900 and 51234123412350000 is 
> 0.0000000000002%.  If you are doing calculations where you care about 
> differences that small, then no double precision package would be 
> adequate.  In that case you might look at arbitrary precision packages 
> such as Maple and Mathematica.
>
> Jerry
>
> Mark wrote:
>
>> if you copy a number like '51234123412349999' into excel, excel treats it 
>> as a number but cannot handle the length and thus stores it in scientific 
>> notation which loses the precision of the original number (it is now 
>> 51234123412349900)
>>
>> this is no bloody use
>>
>> why does it automatically remove precision just because it thinks you 
>> want a freaking number
> 


0
noone1 (387)
6/16/2005 4:42:14 AM
You're welcome, glad it helped.

Jerry

Mark wrote:

> thanks...
> 
> the source data is from a query in sql server 2000...loaded via csv into 
> excel
> 
> i should have thought to add the single quote myself...its not too much 
> hassle to do (in the query) and works...

0
post_a_reply (1395)
6/16/2005 11:49:34 AM
Reply:

Similar Artilces:

How do I create project schedule using excel
I need to create a project schedule using excel. Please help. Hi lack of details :-) Maybe give some more information what you're trying to do? -- Regards Frank Kabel Frankfurt, Germany raeisza wrote: > I need to create a project schedule using excel. Please help. ...

CRM 1.2 Too Slow to be usuable
This application is just to slow to be usable in a production environment. If a user has not done a query recently, it takes 2-3 minutes to bring up data. This makes it useless, for all intents and purposes, live while on the phone. Do you have any third party tools added to CRM? "John" wrote: > This application is just to slow to be usable in a production environment. > > If a user has not done a query recently, it takes 2-3 minutes to bring up > data. > This makes it useless, for all intents and purposes, live while on the phone. > Nope. This is an out-o...

Sumif() help #2
Gurus, I'm stuck with this formula. I have a spreadsheet with two tabs. On one is a list of Standard Window Types in different houses and the quantity of that type of window for that house. The Window type can be repeated many times with different quantities. On my second tab I have a list of all the unique windows listed only once. I want to know the frequency that a window is used in all these projects. I'm using =SUMIF(Quantity!$A$2:$A$1567,Usage!A2,Quantity!$B$2:$B$1567). The funny thing is I've got a total of 3,213 windows in these projects but the sum if returns a ...

Printing an Excel doucument
In this example, I have a document of 100 pages, when I print the document, the column headers only print on the first page and not the subsequent pages. also I would like all the pages to be numbered. is therea fix for this? Hi Richard, For your first question goto File>Page Setup>Sheet tab and look for the option 'Rows to repeat at top' For your second question goto View>Header and Footer and look at the &[page] and &[pages] options in your footer. HTH Martin ...

Acrobat Reader #2
When opening acrobat reader, it asks for the microsoft publisher 2003 cd. When you insert the cd the file it is looking for cannot be found. I think the file name is sku019.cab or something very similar. This is getting to be very annoying. Any ideas? Thanks in advance. The exact error would be preferable to an almost. Reinstall the Reader. -- Mary Sauer MS MVP http://office.microsoft.com/ http://www.mvps.org/msauer/ news://msnews.microsoft.com "Charles" <chubbard@mh2.com> wrote in message news:1a03a01c44d94$34e46b60$a001280a@phx.gbl... > When opening acrobat read...

my printer ejects a blank sheet prior to printing with EXCEL
...

Error in formula displayed for linear and 2nd order curve fits in Excel 2003
I have created trendlines for some pretty simple data using both 2nd order polynomial and linear fits. In both cases, the displayed formulas have their 1st and 2nd order coefficients wrong by a factor of 10!! (I have read lots of posts about increasing precision but this is not what I am up against). Has anyone seen this? What version of Excel? Could you include the data in a follow up post (not as an attachment), along with the coefficients you've computed? - Jon ------- Jon Peltier, Microsoft Excel MVP Tutorials and Custom Solutions Peltier Technical Services, Inc. - http://PeltierT...

Excel: extract and sum numerals from mixed text/numeral cell range
I have a large (30x20) grid of cells with data, and I want to extract and then sum up certain numerals from this entire range. The catch is that the data is mixed numerals and text, as you'll see below. Here's an abbreviated 3x3 example, with a value in each of the nine cells: V7.1 T H P1 A T B V3 P4.5 If I just wanted to sum up the instances of "T" appearing, I could use COUNTIF() for the entire range to come up with answer ("T" appears 2 times). Easy enough. But, what I'm trying to accomplish is to sum up the numerals associated w...

Can�t open some mail in Exchange 2003
Hi! I�m using exchange 2003 and Outlook 2000 and 2003 I have some mail that I can�t open, I get the error "Can�t open this item, The operation failed." I can view, delete or take backup on the mails. I have tried to resote an old backup, the I get two mails with the exact same name, I can open the restored mail, but still not the orginal. How can I delete the bad mails? Is their a tool to check all the mailboxes for errors in Exchange 2003. Best regards Joakim Sweden ISINTEG will help you. Make sure that you have usable backup before you start. Jocke wrote: > Hi! > &g...

how do i form 2 lines in 1 row?
I'm guessing you're looking to force text in a cell to wrap into the next line of the same cell. If that's true...... Edit the text and move the insertion point to where you want to wrap the text. Hold down the [Alt] key and press [Enter] Does that help? ---------------------------------- Regards, Ron Microsoft MVP (Excel) "MSEXCELROOKIE" <MSEXCELROOKIE@discussions.microsoft.com> wrote in message news:951AA059-1613-4A62-AAA6-7890AF6F84A6@microsoft.com... > In one cell type this is line one then Alt + ENTER then type this is line two. The Alt ...

Windows Update
My problem is similar to someone else's below(about Excel 2003 not being able to update), the only difference is that I don't want Excel to update at all. I don't even use it. But the yellow shield kept telling me that it had 1 update available, which was Excel 2003, so, out of annoyance, I installed it. After failing to install several times, I decided to uninstall Excel from Microsoft Office(Pro Edition 2003). Even after uninstalling Excel, I still got the windows update alert. How do I stop it? Extra info: When windows update first appeared, I did a custom instal...

excel axes
how do I create a secondary horizontal axis on an xy scatter plot? forgot to mention 2008 excel using Leopard (10.5.2) ...

unable to open outlook 2003
This is a multi-part message in MIME format. ------=_NextPart_000_0006_01C5B4B8.538D04A0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi , i'm unable to open my Outlook 2003 , it gives error = message as "cannot start microsoft office outlook 2003,unable to open = the outlook window. the set of folders could not be opened . the server = is not available " plz help me to fix this issue With Regards, Ramesh.C ------=_NextPart_000_0006_01C5B4B8.538D04A0 Content-Type: text/html; charset="iso-8859-1"...

Excel program
I have a simple program in excel for data entry. When I protect the sheet, and use tab to move about within the spreadsheet, sometimes the tab button will not move the cursor to the next cell. It will pick a random cell to go to next. Is there a way that I can designate what cell it will go to next. Thanks for your help, jb On a protected sheet, it is going to the next unprotected cell. So, if you don't want it to go to a cell, protect it. "JB" <jgblanton@hotmail.com> wrote in message news:093a01c391d0$ae57f190$a301280a@phx.gbl... > I have a simple program in exce...

Do I need Windows 2003 Enterprise for Exchange 2003 Enterprise?
Hi I am upgrading our server to Windows 2003 either Standard or Enterprise. I know that I want Exchange 2003 Enterprise because we have the Standard version at the moment and are about to hit the 16GB limit. Do I need Windows 2003 Enterprise for Exchange 2003 Enterprise? What will Windows 2003 Enterprise give me that Standard does not? Any help is appreciated. Thanks. No you don't. You would only need Windows 2003 Enterprise if you are planning on doing clustering. I'm sure there are some other things it will get you, but clustering capability is one of the big additions. -...

2003 Excel and 2007 Trial Version Excel
I downloaded the 2007 trial version of Microsoft Office. Now my trial is over and I reloaded my 2003 version. But it will not let me remove the 2007 trial version. Also when I go into my 2003 Excel a Window Installer box comes up that says Preparing to install and this stays on for about 5 minutes before it goes away. I know that I should not have downloaded the trial version but I did. Can someone please help me. I have Windows XP and it is my office computer. Please help! ...

MFC: Excel Automation Can't Quit from Excel. Please help...
Hi I use MFC Visual C++ 4.2. I am automating Excel from my application. My problem is I cannot quit the Excel after the automation process finished! I checked it still exists on the Process lists and the most DANGEROUS is everytime the automation function run, it create other Excel and so on. So it must be out of memory soon. I have used the app.Quit() method like all the people used but it DOES NOT work. What should I do? Thank you. I happened to answer this on the office.developer.vba newsgroup. You most likely have neglected to Release() the automation object. joe On Wed, 3 Sep...

Offline Defrag of Exchange 2003 not representing database size cor
I have Exchange 2003 Sp2 installed. I need to do an offline defrag due to database size. My database should be 15Gb smaller than the actual database size. When I run eseutil the defrag completes successfully but doesnt change the file size. The online defrag run correctly but only free up 10-15Mb. Any suggestions? What makes you think it should be 15GB smaller than it is? Nue "Lynn" <Lynn@discussions.microsoft.com> wrote in message news:C8047F0C-D1DE-49B4-96AD-4F8B572CF381@microsoft.com... >I have Exchange 2003 Sp2 installed. I need to do an offline defrag due to >...

Error Message When opening Excel
I am using Windows VISTA 64 bit O/S with Office Professional 2003 All of a sudden I started to get the following error message: 'One of your object libraries (Stdole32.tlb) is missing or damaged. Please run setup to install it' I am at a loss as how to correct this. I checked online and found some instructions that were for Windows 2000 Those did not work for VISTA at all. Thank you in advance for your support and suggestions, HankL It is telling you to do a "setup to install" on the Office product, did you try that? Did you try doing a repair on ...

Excel charts should allow "switching" series on or off
A plot (chart) of time series data may be used for many purposes. From my use two reasons I use such plots are: Studying individual time series trends; and Overall impression of all results. But when studying multiple time series data a chart can become cluttered. It would be useful if individual series could be seleceted as visible or invisible so that they could be evaluated without losing the total plot. At the moment the only way to "unclutter" the plot is to remove the temporaily-unwanted series but it can be time consuming to reconstruct the plot. ---------------- Thi...

Excel number / date conversion
I've just pulled some data out of an ODBC connection into Access an then exported it to Excel. The dates are currently in the format 20031109. But the built in dat convertor (from Format Cells) doesn't do anything, even if I convert i to a 'proper' number first. How can I convert this to 09/11/2003 so that I can do some date - base arithmetic and work out difference in days -- markperr ----------------------------------------------------------------------- markperry's Profile: http://www.excelforum.com/member.php?action=getinfo&userid=2759 View this thread: http://w...

Budget Totaling Bug???
Any reason why my "enter your income" page on my budget says my income is $8,500 per month and then, when I finish the budget and go to the summary screen, it says my income is $7800 per month. Nothing is hidden, is this a bug? If my enter your income page says one thing and the summary another, whats up with that? Is one your gross amount and the other your net? "Christopher Glenn" wrote: > Any reason why my "enter your income" page on my budget says my income is > $8,500 per month and then, when I finish the budget and go to the summary > scr...

Email from Excel #3
Is it possible to have Excel send an email if the value of a certain cell is changed? Hi see your post in public.excel -- Regards Frank Kabel Frankfurt, Germany "berj" <berj@adelphia.net> schrieb im Newsbeitrag news:CcSdndsVDJy4jcjcRVn-pQ@adelphia.com... > Is it possible to have Excel send an email if the value of a certain cell is > changed? > > ...

Outlook 2003 #28
Will Outlook 2003 allow install on one owner, two machines (desktop and Laptop), or do you have to purchase 2 copies? Dick ...

version excel
bonjour a tous, & a tous les pro bien sur es qu'il est possible ,que des l'instant on modifie le code VBA EXCEL on incremente un compteur pour les mise a jour cela me semble plus simple merci pour vos reponse patrick.villa@laposte.net +++++ http://www.mcgimpsey.com/excel/udfs/sequentialnums.html -- --- HTH Bob (change the xxxx to gmail if mailing direct) "pounet" <patrick.villa@laposte.net> wrote in message news:1165418782.552172.169740@j44g2000cwa.googlegroups.com... > bonjour a tous, & a tous les pro bien sur > > es qu'il est possible ,qu...