Lib/tests-14

Tue Jul 26 01:30:25 MST 2005

compared 1994 and 1991 executables, 
working on same data - from 1994 or 1991
	same parameter estimates and sd (from quadratic approx)
	rms weighted error diffs in 7-9th decimal place = 9-10th sig digit

reason for difference convoluted:
	1991 and 1994 have same fitting algorithms, both simfit and simpdev;
	the output differs - more sparse from 1994 and less operator control;
		rms_data is variable printed in lines that differ
		also mse, variable from which it derives;
  **heart of diff**	simpfit1991 - rms_data set at value for lowest vertex
			simpfit1994 - rms_data set at value for centroid

			simpdev199[14] - centroid replaced by lowest vertex
			if latter is lower; 
			rms_data set at (reset) centroid value;
			ie, same as simpfit for 1991, different for 1994;

			simpmain199[14] - on exit two prints:
				ffitprint()
					rms_data = lowest vertex = 1991
					rms_data = centroid = 1994
				fquadprint()
					rms_data printed for 1991
						(same value as ffitprint)
					no rms_data output for 1994
			
so - only difference in output **values** between 1991 and 1994 progs
is ok.... (at least it is explained and is not indicative of fit diffs)


----------------------------------------------------------------------
test script - comparing 1991 and 1994 executables fitting same data

#!/bin/sh

D1994="/Users/jar/Sites/Rupley/web-content/Code/src/simplex/Simplex-1994/Lib"
D1991="/Users/jar/Sites/Rupley/web-content/Code/src/simplex/Simplex-1991/Ldh"

#run 1991 test data with ldhfit from 1991 and 1994
${D1994}/ldhfit < ${D1994}/tests-14/ldhfit.dat1991-mod > ${D1994}/ldhfit1994.test1991
${D1991}/ldhfit -sn -dl ${D1991}/ldhfit.dat ${D1994}/ldhfit1991.test1991

#run 1994 test data with ldhfit from 1991 and 1994
${D1994}/ldhfit < ${D1994}/ldhfit.dat > ${D1994}/ldhfit1994.test1994
${D1991}/ldhfit -sn -dl ${D1994}/ldhfit.dat ${D1994}/ldhfit1991.test1994

exit

----------------------------------------------------------------------

diff ldhfit1994.test1991 ldhfit1991.test1991  >diff-14-11
diff ldhfit1994.test1994 ldhfit1991.test1994  >diff-14-44
	structure of output different, values same except as noted below
		this difference is in 9th or 10th digit of rms weighted error

checks 

vi *[14].*1-* 

difference is in 10th sig. digit of rms weighted error
otherwise:`
	same parameter estimates and standard deviations
	same simplex at exit after same number of iterations
following cut from vi of *1.*1-*, with difference line shown

----------------------------------------

mean=1.41445214054527e-04 rms=1.35633287687465e-12 test=9.58910406365384e-09
												difference
mse    = 6.42932781063765e-06   rms weighted error = 2.53561192035328e-03			1.*1-
[mse    = 6.42932782123362e-06   rms weighted error = 2.53561192244271e-03] 			4.*1- 

yzero  = 1.41445211834028e-04
ymin   = 1.41445211834025e-04
y-pmin = 1.41445211834023e-04

parm free    q                 centroid          pmin              std_dev
  0   0  3.8128088756e-06  2.0724805650e-01  2.0724803302e-01  3.6488010542e-02
  1   1  1.0771690086e-06  2.9590086971e-02  2.9590081027e-02  9.2520116942e-03
  2   2  1.0504630272e-05  3.8789460147e-01  3.8789451885e-01  1.3364938203e-01
  3   3  4.2029693189e-08  2.8239192596e-03  2.8239198440e-03  1.3493734510e-03
  4   4  1.6229159923e-07  7.4933493004e-03  7.4933481485e-03  3.0057272866e-03
  5   5  1.5953589291e-07  1.8932042264e-03  1.8932053428e-03  3.6011209350e-03

----------------------------------------
----------------------------------------

vi *[14].*4-* 

difference is in 9th sig. digit of rms weighted error
otherwise:`
	same parameter estimates and standard deviations
	same simplex at exit after same number of iterations
following cut from vi of *1.*1-*, with difference line shown

----------------------------------------

mean=5.22353813497473e-05 rms=5.16787864926236e-13 test=9.89344485619871e-09
												difference
mse    = 2.61176902226162e-06   rms weighted error = 1.61609684804520e-03			1.*1-
[mse    = 2.61176903291136e-06   rms weighted error = 1.61609685134009e-03]			4.*4-

yzero  = 5.22353804452325e-05
ymin   = 5.22353804452269e-05
y-pmin = 5.22353804452284e-05

parm free    q                 centroid          pmin              std_dev
  0   0  4.1079869053e-06  2.5416358679e-01  2.5416359510e-01  2.0979764734e-02
  1   1  9.2097238759e-07  3.2511006626e-02  3.2511008640e-02  4.5557350566e-03
  2   2  1.1057083987e-05  3.0561568755e-01  3.0561572120e-01  5.1902927181e-02
  3   3  8.9630272015e-08  2.3433658071e-03  2.3433653120e-03  5.2905247294e-04
  4   4  8.5119824668e-08  3.9517271983e-03  3.9517265845e-03  1.0720995684e-03
  5   5  3.5806020485e-07  6.7555012796e-03  6.7555023793e-03  2.6581163065e-03
