You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Nov 22, 2022. It is now read-only.
Currently we get 16 decimal places output, we must consider if we want this many sigfigs in the output as despite our precision being accurate to 12 decimal places, it may not return the exact expected value for common operations because of all of those sigfigs. Design decision involves determining if we want to give user the ability to adjust how many sigfigs are displayed.
For large numbers we automatically show in scientific notation form although we intend on having a special output mode with this form, if giving users this control of determining number of sigfigs displayed and output type, we would need to be consistent with this use case.
Currently we get 16 decimal places output, we must consider if we want this many sigfigs in the output as despite our precision being accurate to 12 decimal places, it may not return the exact expected value for common operations because of all of those sigfigs. Design decision involves determining if we want to give user the ability to adjust how many sigfigs are displayed.
For large numbers we automatically show in scientific notation form although we intend on having a special output mode with this form, if giving users this control of determining number of sigfigs displayed and output type, we would need to be consistent with this use case.
Related issues: Fix precision issues #32