Seite 1 von 1

Solver doesn‘t handle certain divisions?

Verfasst: 28. Oktober 2020, 01:49
von Harry
If the coordinates contain a division calculation, it appears that the solver can‘t handle it if the result admits a non-terminating decimal expansion. Example: N53 1B works if B = formula(1000/1250); the result is N53 10.800. However, B = formula(1000/1300) gives no result... shouldn’t it be B = 0.769 (rounded), or even more decimal place were calculated, together with a rounding function (to n =3 decimal places).