Re: ssconvert: long running time (hours) - is there a diagnostic signal?

[Peter Brooks <peter h m brooks gmail com>]

I'm replying to my own post, in case anybody else has this problem in
future. I've resolved it the resolution was:

1. To remove the calculation from every row. I've just put the
calculation in the first row, and I'll copy and paste it in the
spreadsheet program (MacOS Numbers, or OpenOffice).
2. To use .ods instead of the old-fashioned .xlxs. I have a feeling
that there are some limitations, perhaps not documented, to what the
old, proprietary format can do.

In future, I'll always use .ods.

I'll also remember that, for some reason, ssconvert seems to calculate
the formulae for all cells. I had thought that it would just copy it
in.

I hope this helps others..

[for Prakhar - you have subscribed to this list, if you want to
unsubscribe, you have to read the lines at the bottom of each message,
and follow the instructions]

On 19 January 2017 at 04:44, Peter Brooks <peter h m brooks gmail com> wrote:
> I'm running ssconvert, and it's been running for 15 hours. It's
> clearly got into some sort of trouble.
>
> This is the run string:
>
>       ssconvert --merge-to=view_all_records.xlsx
> view_AT_No_cancer_L.csv view_AT_No_cancer_R.csv view_CC_cancer_L.csv
> view_CC_cancer_R.csv view_CCID_cancer_R.csv view_CCID_No_cancer_L.csv
> view_CCID_No_cancer_R.csv view_CC_No_cancer_L.csv
> view_CC_No_cancer_R.csv view_CV_No_cancer_L.csv
> view_CV_No_cancer_R.csv view_LM_No_cancer_L.csv
> view_LM_No_cancer_R.csv view_LMO_No_cancer_L.csv
> view_LMO_No_cancer_R.csv view_ML_No_cancer_L.csv
> view_ML_No_cancer_R.csv view_MLO_cancer_L.csv view_MLO_cancer_R.csv
> view_MLOID_cancer_R.csv view_MLOID_No_cancer_L.csv
> view_MLOID_No_cancer_R.csv view_MLO_No_cancer_L.csv
> view_MLO_No_cancer_R.csv view_XCCL_cancer_L.csv view_XCCL_cancer_R.csv
> view_XCCL_No_cancer_L.csv view_XCCL_No_cancer_R.csv
> view_XCCM_No_cancer_L.csv view_XCCM_No_cancer_R.csv
>
> Can ssconvert catch any signals and give diagnostic information?
>
> I'd like to send it a signal to either get it to dump what it has so
> far, or give an indication of where it is. Can this be done?
>
> It's running on:
>
>       Linux 4.4.0-59-generic #80-Ubuntu SMP Fri Jan 6 17:47:47 UTC
> 2017 x86_64 x86_64 x86_64 GNU/Linux
>
> The version is:
>
>       ssconvert version '1.12.28'
>
> I don't know if it helps, but the only .csv file it has open at the
> moment ( from lsof -p {pid} ) is:
>
>       ssconvert 24522 peterbrooks  mem       REG   0,45 11660818
> 1263 /media/sf_mammogram/isolate_extremes/view_CC_No_cancer_R.csv
>
> As you can see, that's the 9th file in the list. All the files have
> been generated by awk, so it's the same format as the others, which
> is:
>
> "
> Field_1,Field_2,Field_3,Field_4,Field_5,Field_6,Field_7,Field_8,Field_9,Field_10,Field_11,Field_12,Field_13,Field_14,Field_15,Field_16,Field_17,Field_18,Field_19,Field_20,Field_21,Field_22,Field_23,Field_24,Field_25,Field_26,Field_27,Field_28,Field_29,Field_30,Field_31,Field_32,Field_33,Field_34,Field_35,Field_36,Field_37,Field_38,Field_39,Field_40,Field_41,Field_42,Field_43,Field_44,Field_45,Field_46,Field_47,Field_48,Field_49,Field_50,Field_51,Field_52,Field_53,Field_54,Field_55,Field_56,Field_57,Field_58,
> Image,Patient,View,Laterality,Cancer,
> Stats,,,,Min,=min(f10:f50613),
> Stats,,Cancer:,,Max,=max(f10:f50613),
> Stats,,View:,,Mean,=average(f10:g50613),
> Stats,,Laterality:,,Median,=median(f10:g50613),
> Stats,,,,STD,=stdev(f10:f50613),
> Stats,,,,Median - 2.5 *STD,=f6-2.5*f7,
> Stats,,,,Median + 2.5 * STD,=f6+2.5*f7,
> 000127,19,CC,R,0,0.00157771707226,6.46075141091,1.71799998937,1.0,0.0,1.5131442631,0.869322106816,0.869322106816,2.36342017425,1.62347086736,,1.721785563616257,145.2976810847176,8.78271637341,13.0534197754,0.425333149379,1.50443704098,8.78271637341,0.425333149379,1.50443704098,1.09450649523,6.23365530718,6.23365530718,,232.83740111899138,5.963275296580617,7.480778387254143,-2.673423701633893,,79561907344.7,5.7372355245694,,-3.4156414976895983,55.691497132046386,8.93892840263,2.73881470782,0.968385123524,13.2078152934,8.93892840263,0.968385123524,13.2078152934,1.99828819462,5.78550138489,5.78550138489,,55.885750775325334,5.636237254410181,1.3493215236951794,-2.5241607854411345,359587665206.0,18.53947763416856,
> ,"=AVERAGE(F9:BF9)","=STDEV(F10:bf10)","=SUMPRODUCT(--(F9:BF9<F:BF))","=SUMPRODUCT(--(F9:BF9<F:BF))"
> "
>
> Any ideas or suggestions?
>
> --
> Peter Brooks
>
>
> Mobile: +27 82 717 6404
> Direct:  +27 21 447 9752
> Skype:  Fustbariclation
> Twitter: Fustbariclation
> Google+: Fustbariclation
> Author Page: amazon.com/author/peter_brooks



-- 
Peter Brooks


Mobile: +27 82 717 6404
Direct:  +27 21 447 9752
Skype:  Fustbariclation
Twitter: Fustbariclation
Google+: Fustbariclation
Author Page: amazon.com/author/peter_brooks