Method lim
lim(UInt32, Int32)
Limitates the binary digits of the value at the top of the stack to the specified count c
.
If the number of digits in numerator or denominator exceeds this count the bits will shifted right by the difference.
Declaration
public void lim(uint c, int i = 0)
Parameters
Type | Name | Description |
---|---|---|
System.UInt32 | c | A positive number as bit count. |
System.Int32 | i | A relative index of a stack entry. |
Remarks
This is a fast binary rounding operation that limits precision to increase the performance.
Mainly intended for iterations where the successive numeric operations internally produce much more precision than is finally needed.
Example: lim(msb(1E+24))
to limit the precision to about 24 decimal digits.