Forums > Help! > Read Numeric value From Excel
Login/Join to Participatenewbie
1 post
1 post
Posted:
Hi,
I was trying to read numeric value from an excel file.I used the function "cell.getNumericCellValue()" to read the column. Some times the value is fetched correctly and some times it returns a high precision value( ie, some times the value 118.474 is fetched as 118.4739999999), while I require the exact value.
The format type of the column in the excel is "custom".
Can any one please help me on this?
Sreeram
Hi,
I was trying to read numeric value from an excel file.I used the function "cell.getNumericCellValue()" to read the column. Some times the value is fetched correctly and some times it returns a high precision value( ie, some times the value 118.474 is fetched as 118.4739999999), while I require the exact value.
The format type of the column in the excel is "custom".
Can any one please help me on this?
Sreeram
BRONZE Member
Lambretta Fanatic
4,998 posts
Location: United Kingdom
Lambretta Fanatic
4,998 posts
Location: United Kingdom
Posted:
118.4739999999 ...considering excel uses better calculations than myself I'd say that figure was most likely to be correct when 118.474 may look logically correct.
I'm no mathematician nor excel user.
Good luck.
118.4739999999 ...considering excel uses better calculations than myself I'd say that figure was most likely to be correct when 118.474 may look logically correct.
I'm no mathematician nor excel user.
Good luck.
BRONZE Member
member
78 posts
Location: Melbourne, Australia
member
78 posts
Location: Melbourne, Australia
Posted:
I can show mathematically that 118.4739999999 is actually equal to 118.474, but I don't think that will be particularly useful, sorry
I can show mathematically that 118.4739999999 is actually equal to 118.474, but I don't think that will be particularly useful, sorry
---
No statements are true unless they can be proven scientifically.
---
SILVER Member
veteran
1,237 posts
Location: Oxfordshire, United Kingdom
veteran
1,237 posts
Location: Oxfordshire, United Kingdom
Posted:
are you always reading cell.getNumericCellValue into a variable with a datatype that can hold the full value? and are all the fields your reading from definitely formatted correctly?
same problem is discussed here though you havn't actually said what language you're programming/scripting in...
are you always reading cell.getNumericCellValue into a variable with a datatype that can hold the full value? and are all the fields your reading from definitely formatted correctly?
same problem is discussed here though you havn't actually said what language you're programming/scripting in...
Blinded by Hyperlights, please donate generously 
SILVER Member
Tosser
1,712 posts
Location: Bristol,UK
Tosser
1,712 posts
Location: Bristol,UK
Posted:
Nor indeed why you are posting this on a poi forum?!
Nor indeed why you are posting this on a poi forum?!
Similar Topics
Using the keywords [read numeric value excel] we found the following existing topics.
- Forums > Read Numeric value From Excel [4 replies]
Show more..
© 1998 - 2025 Home of Poi
All prices converted to United States dollars using XE.com