Method lim
lim(UInt32, Int32)
Limitates the binary digits of the value at the top of the stack to the specified count c.
If the number of digits in numerator or denominator exceeds this count the bits will shifted right by the difference.
Declaration
public void lim(uint c, int i = 0)
Parameters
| Type | Name | Description |
|---|---|---|
| System.UInt32 | c | A positive number as bit count. |
| System.Int32 | i | A relative index of a stack entry. |
Remarks
This is a fast binary rounding operation that limits precision to increase the performance.
Mainly intended for iterations where the successive numeric operations internally produce much more precision than is finally needed.
Example: lim(msb(1E+24)) to limit the precision to about 24 decimal digits.