Loading wonderful precision ascii files

Moderators: davetaflin, salter, steve, jprenaud, straton, Chris Idso

Svetlana
Expert
Posts: 93
Joined: Sun Dec 22, 2013 3:08 pm
Location: Australia
Contact:

Loading wonderful precision ascii files

Postby Svetlana » Tue Sep 16, 2014 7:44 pm

I have a file with some wonderful precision and Tecplot apparently reads it wrong without any error; the plot is a lot of triangles and the spreadsheet has incorrect values of the "x" variable, suggesting that Tecplot chops it off at an arbitrary point...

Code: Select all

variables="x" "y"
zone t="my zone" datapacking="point"
   150.0000000000000000000000000000000000000000000     0.9097114452810799445359180026571266353130340
   175.0000000000000000000000000000000000000000000     0.9388906863143251513292852905578911304473880

JerimiahLee
Tecplot Employee
Posts: 81
Joined: Mon Oct 08, 2012 11:20 am
Location: Bellevue, WA

Re: Loading wonderful precision ascii files

Postby JerimiahLee » Wed Sep 17, 2014 12:33 pm

Hey Svetlana,

It turns out that there is a hard coded limit in Tecplot to take the first 39 characters. The 40th character is considered to be the start of a new value. This effectively turned your four values into eight, and two points into four.

When originally coded, we did not see a need for more than 39 decimal places, do you believe it would be wise to allow this large of a precision?
Technical Support Specialist
Email: support@tecplot.com

Tecplot, Inc. | Master the View
3535 Factoria Blvd. S.E., Ste. 550
Bellevue, Washington USA 98006
Main: 425.653.1200
Fax: 425.653.9200
Web: www.tecplot.com

Svetlana
Expert
Posts: 93
Joined: Sun Dec 22, 2013 3:08 pm
Location: Australia
Contact:

Re: Loading wonderful precision ascii files

Postby Svetlana » Wed Sep 17, 2014 3:31 pm

It's ok to keep as is, if it's documented. Is it?

Also it would be perhaps nice to give a warning where Tecplot reads data which it finds are not separated by spaces. I.e. I have 0.234345345435645674574574567 and it reads it as 0.234345345435645674574574567, but it does notice that a space is missing. (I didn't put the effort to count the digits and the number is off, but you get the idea.)


Return to “Loading Data”

Who is online

Users browsing this forum: No registered users and 1 guest

cron