Trace number 4079203

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 1071.46 1071.63

General information on the benchmark

Name/OPT-BIGINT-LIN/
heinz/normalized-ds-big.opb
MD5SUM0f8cbacf22bcac8867146871fbd72f4e
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark4645117612430000
Best CPU time to get the best result obtained on this benchmark1800.43
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables174997
Total number of constraints1042
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)1042
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint259
Maximum length of a constraint11821
Number of terms in the objective function 174997
Biggest coefficient in the objective function 60000000000000
Number of bits for the biggest coefficient in the objective function 46
Sum of the numbers in the objective function 602632800292929998
Number of bits of the sum of numbers in the objective function 60
Biggest number in a constraint 60000000000000
Number of bits of the biggest number in a constraint 46
Biggest sum of numbers in a constraint 602632800292929998
Number of bits of the biggest sum of numbers60
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-07T07:57:30+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4079203-1465279048.opb"]
0.00/0.01	c use --random-gen="2861721237 54671407 3987092650 3477488850 3588866834 4167051930 3574043511 2583391772 3831973944 1901335882 3360313575 2135162089 1091886175 352687172 210211311 1773564558 1741706128 2123659999 857986147 2087676938 2126523315 1472765322 1198615116 986245264 682444812 1867008709 1187871364 2192979620 3442554634 880872337 3654544327 264307978 2461453715 2801843243 3553499365 3260561162 3526553389 654525457 3653834879 2519965694 4280188552 624439513 1004806717 507206148 2881149749 2822179671 1099974958 115277039 3382870294 2361462286 11998228 884876997 2774994264 1298786879 3170953085 336705139 1683788213 2112305892 1598893838 1718784027 3994436157 3694144214 822783040 3531205191 2808673565 3263188020 1366352889 3288934069 1068649079 1873236650 1979730301 466345243 4078749547 3120292886 704171696 369527153 91620576 1160776049 497535375 1475842899 2872158514 2528417821 2113742431 784176116 123197112 912156895 3108010788 2175747721 2342814103 68230624 643226016 2737292428 2191256969 1579590099 1408984995 3326946384 2377868356 3042791377 3090989578 321202067 2825766150 648424479 2807534156 2576416203 638374190 3514645153 2038510278 398694698 1090478281 2619382714 205012292 490862125 341048821 4033304819 3156069057 972856677 2163846814 2500641189 1002763606 3509725750 141493376 603202298 2157046611 1205726163 3496631845 3152246174 3051802058 2787005142 2815788943 3578036320 3271854989 1739933735 2491519265 844355738 718798114 3747998869 1877842869 2995390909 1401598313 785370736 1345288612 344522169 3624426830 1544454763 3580955070 868659689 251175781 1126819449 4079025239 2960606946 4071988143 138908283 2426430755 3403700029 1763949064 4246411214 2552501547 685480872 3827496740 239905807 3730476280 2264868126 2773428511 2187672362 419805989 3854783156 4215312963 2427070300 3725532056 2602940389 319020730 4052223763 2576575220 1971931755 2119342225 1668933535 601693113 4018535639 2157623140 1958964665 1856698854 2164117646 3717130071 4174839625 2854226640 1496716090 2543571967 673744658 3880344255 1529738109 2925858269 639232044 971628719 4047681234 1700990239 559066732 2529630798 2113510035 437206984 2606214694 1822685960 1071686016 3931178159 2073856077 1212604425 757290301 427606674 3038753979 1927219241 3169928737 2997444619 434118620 2815253821 4279663298 2376574482 3634851992 3639857331 3224991686 3465674041 2021444505 3980010894 205662788 1816734799 625177836 3826741851 2244629334 901524936 2836793194 1139222991 3413183981 236940987 1491466350 665174054 3818808311 3114438435 1368544449 2275048560 3940271537 2293795601 1110266021 568218091 518033305 2255545915 725194310 4207115784 1982059909 955945269 3902337471 2159521114 1987672075 3116991042 1506689570 1627813131 861372099 377184935 3383146999 255 362436" option to reproduce the execution
8.19/8.20	c #vars 174997
8.19/8.20	c #constraints 1042
50.28/50.37	c BCD2: Hardening is enabled.
50.28/50.37	c BCD2: BiasedSearch is enabled.
50.28/50.37	c Solving starts ...
50.28/50.37	c ============================[ Search Statistics ]============================
50.28/50.37	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
50.28/50.37	c       |         |          |          |    Limit     GC | Var      | Constra 
50.28/50.37	c =============================================================================
50.28/50.37	c  0.0s |       0 |        0 |        0 |    59027      0 |        0 |        0
52.58/52.62	c  2.3s |       0 |      470 |        0 |    59027      0 |        0 |        0
52.58/52.62	c #cpu_time = 2.155s
52.58/52.62	c #wall_clock_time = 2.160s
52.58/52.62	c #decision = 470
52.58/52.62	c #random_decision = 0
52.58/52.62	c #conflict = 0
52.58/52.62	c #restart = 0
52.58/52.62	o 61981325000050000

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4079203-1465279048/watcher-4079203-1465279048 -o /tmp/evaluation-result-4079203-1465279048/solver-4079203-1465279048 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1465262703-3573 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079203-1465279048.opb 

pid=6109
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.35 2.30 2.22 4/179 6112
/proc/meminfo: memFree=28974984/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=690620 CPUtime=0 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 2566 0 0 0 0 0 0 0 20 0 4 0 109838127 707194880 3439 33554432000 4194304 16246674 140734965329264 140734965328688 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 173167 3449 441 2943 0 170061 0
[pid=6112/tid=6113] ppid=6109 vsize=709052 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 726069248 3511 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=713148 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 730263552 3528 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=717244 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109838127 734457856 3545 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100184 s]
/proc/loadavg: 2.35 2.30 2.22 4/179 6112
/proc/meminfo: memFree=28974984/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1304132 CPUtime=0.09 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 32202 0 0 0 5 4 0 0 20 0 4 0 109838127 1335431168 33013 33554432000 4194304 16246674 140734965329264 140734965328576 7374276 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 326033 33031 799 2943 0 322927 0
[pid=6112/tid=6113] ppid=6109 vsize=1304132 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1335431168 33039 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1304132 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 1335431168 33045 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1304132 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1335431168 33057 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1304132

[startup+0.200548 s]
/proc/loadavg: 2.35 2.30 2.22 4/179 6112
/proc/meminfo: memFree=28974984/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1311300 CPUtime=0.19 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 39178 0 0 0 14 5 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140734965328576 8058528 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 327825 40499 799 2943 0 324719 0
[pid=6112/tid=6113] ppid=6109 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300518 s]
/proc/loadavg: 2.35 2.30 2.22 4/179 6112
/proc/meminfo: memFree=28974984/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1311300 CPUtime=0.29 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 39178 0 0 0 24 5 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140734965328576 14073329 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 327825 40499 799 2943 0 324719 0
[pid=6112/tid=6113] ppid=6109 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1342771200 40499 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1311300

[startup+0.700422 s]
/proc/loadavg: 2.35 2.30 2.22 4/179 6112
/proc/meminfo: memFree=28974984/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1312324 CPUtime=0.68 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 75277 0 0 0 59 9 0 0 20 0 4 0 109838127 1343819776 76598 33554432000 4194304 16246674 140734965329264 140734965311168 4221031 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 328081 76598 802 2943 0 324975 0
[pid=6112/tid=6113] ppid=6109 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1343819776 76598 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 1343819776 76598 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1343819776 76598 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 1312324

[startup+1.50042 s]
/proc/loadavg: 2.35 2.30 2.22 3/183 6116
/proc/meminfo: memFree=28660304/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1324612 CPUtime=1.48 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 86560 0 0 0 137 11 0 0 20 0 4 0 109838127 1356402688 90436 33554432000 4194304 16246674 140734965329264 140734965312256 4220489 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 331153 90436 802 2943 0 328047 0
[pid=6112/tid=6113] ppid=6109 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1356402688 90436 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 1356402688 90436 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1324612 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1356402688 90436 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1324612

[startup+3.10044 s]
/proc/loadavg: 2.35 2.30 2.22 3/183 6116
/proc/meminfo: memFree=28456348/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1349188 CPUtime=3.09 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 122374 0 0 0 292 17 0 0 20 0 4 0 109838127 1381568512 131360 33554432000 4194304 16246674 140734965329264 140734965312256 7364055 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 337297 131360 802 2943 0 334191 0
[pid=6112/tid=6113] ppid=6109 vsize=1349188 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1381568512 131360 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1349188 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 1381568512 131360 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1349188 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1381568512 131360 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1349188

[startup+6.30044 s]
/proc/loadavg: 2.32 2.29 2.21 3/183 6116
/proc/meminfo: memFree=28141664/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1398340 CPUtime=6.29 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 190362 0 0 0 602 27 0 0 20 0 4 0 109838127 1431900160 210079 33554432000 4194304 16246674 140734965329264 140734965312256 7364055 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 349585 210079 802 2943 0 346479 0
[pid=6112/tid=6113] ppid=6109 vsize=1398340 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1431900160 210079 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1398340 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 4 0 109838127 1431900160 210079 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1398340 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1431900160 210079 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1398340

[startup+12.7004 s]
/proc/loadavg: 2.29 2.29 2.21 3/183 6116
/proc/meminfo: memFree=27759148/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=1496644 CPUtime=12.68 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 270375 0 0 0 1229 39 0 0 20 0 4 0 109838127 1532563456 304400 33554432000 4194304 16246674 140734965329264 140734965328440 5876336 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 374161 304400 839 2943 0 371055 0
[pid=6112/tid=6113] ppid=6109 vsize=1496644 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1532563456 304400 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=1496644 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 1532563456 304400 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=1496644 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 1532563456 304400 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 1496644

[startup+25.5005 s]
/proc/loadavg: 2.30 2.29 2.21 3/183 6116
/proc/meminfo: memFree=26613912/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=2593348 CPUtime=25.48 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 544340 0 0 0 2473 75 0 0 20 0 4 0 109838127 2655588352 590118 33554432000 4194304 16246674 140734965329264 140734965327040 4221023 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 648337 590118 840 2943 0 645231 0
[pid=6112/tid=6113] ppid=6109 vsize=2593348 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 2655588352 590118 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=2593348 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 2655588352 590118 33554432000 4194304 16246674 140734965329264 140228333382672 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=2593348 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 2655588352 590118 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 2593348

[startup+51.1005 s]
/proc/loadavg: 2.20 2.27 2.21 3/183 6116
/proc/meminfo: memFree=25134220/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=4070980 CPUtime=51.08 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 913569 0 0 0 4980 128 0 0 20 0 4 0 109838127 4168683520 959347 33554432000 4194304 16246674 140734965329264 140734965328440 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 1017745 959347 876 2943 0 1014639 0
[pid=6112/tid=6113] ppid=6109 vsize=4070980 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 4168683520 959347 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=4070980 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 4168683520 959347 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=4070980 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 4168683520 959347 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 4070980

[startup+102.3 s]
/proc/loadavg: 2.20 2.25 2.20 3/183 6117
/proc/meminfo: memFree=23297012/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=5903940 CPUtime=102.28 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 1372038 0 0 0 10034 194 0 0 20 0 4 0 109838127 6045634560 1417816 33554432000 4194304 16246674 140734965329264 140734965328360 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 1475985 1417816 890 2943 0 1472879 0
[pid=6112/tid=6113] ppid=6109 vsize=5903940 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 6045634560 1417816 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=5903940 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 6045634560 1417816 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=5903940 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 6045634560 1417816 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 5903940


################
# More data... #
################

[pid=6112] ppid=6109 vsize=14018116 CPUtime=642.19 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 3955598 0 0 0 63625 594 0 0 20 0 4 0 109838127 14354550784 3446368 33554432000 4194304 16246674 140734965329264 140734965328360 4220491 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3504529 3446368 894 2943 0 3501423 0
[pid=6112/tid=6113] ppid=6109 vsize=14018116 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14354550784 3446368 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=14018116 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14354550784 3446368 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=14018116 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 14354550784 3446368 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 642.19
Current children cumulated vsize (KiB) 14018116

[startup+702.3 s]
/proc/loadavg: 2.22 2.27 2.24 3/183 6155
/proc/meminfo: memFree=14747384/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=14456388 CPUtime=702.19 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4065166 0 0 0 69607 612 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140734965327232 14013533 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3614097 3555936 894 2943 0 3610991 0
[pid=6112/tid=6113] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228333382672 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 702.19
Current children cumulated vsize (KiB) 14456388

[startup+762.3 s]
/proc/loadavg: 2.28 2.28 2.24 3/184 6160
/proc/meminfo: memFree=14745940/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=14456388 CPUtime=762.18 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4065166 0 0 0 75602 616 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140734965327168 13899629 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3614097 3555936 894 2943 0 3610991 0
[pid=6112/tid=6113] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228333382672 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 762.18
Current children cumulated vsize (KiB) 14456388

[startup+822.3 s]
/proc/loadavg: 2.30 2.29 2.24 3/183 6161
/proc/meminfo: memFree=14747504/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=14456388 CPUtime=822.16 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4065166 0 0 0 81598 618 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140734965327232 4226064 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3614097 3555936 894 2943 0 3610991 0
[pid=6112/tid=6113] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228333382672 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 822.16
Current children cumulated vsize (KiB) 14456388

[startup+882.307 s]
/proc/loadavg: 2.31 2.29 2.25 3/183 6162
/proc/meminfo: memFree=14747712/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=14456388 CPUtime=882.16 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4065166 0 0 0 87594 622 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140734965327232 13899629 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3614097 3555936 894 2943 0 3610991 0
[pid=6112/tid=6113] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228333382672 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=14456388 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 14803341312 3555936 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 882.16
Current children cumulated vsize (KiB) 14456388

[startup+942.3 s]
/proc/loadavg: 2.31 2.30 2.25 3/183 6163
/proc/meminfo: memFree=13997080/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=15198788 CPUtime=942.15 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4194423 0 0 0 93569 646 0 0 20 0 4 0 109838127 15563558912 3741403 33554432000 4194304 16246674 140734965329264 140734965327168 4220480 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3799697 3741403 894 2943 0 3796591 0
[pid=6112/tid=6113] ppid=6109 vsize=15198788 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 15563558912 3741403 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=15198788 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 15563558912 3741403 33554432000 4194304 16246674 140734965329264 140228333382672 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=15198788 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 15563558912 3741403 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 942.15
Current children cumulated vsize (KiB) 15198788

[startup+1002.3 s]
/proc/loadavg: 2.25 2.28 2.25 3/183 6164
/proc/meminfo: memFree=13993904/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=15199812 CPUtime=1002.14 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4194812 0 0 0 99565 649 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140734965328360 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3799953 3741792 894 2943 0 3796847 0
[pid=6112/tid=6113] ppid=6109 vsize=15199812 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=15199812 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=15199812 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1002.14
Current children cumulated vsize (KiB) 15199812

[startup+1062.3 s]
/proc/loadavg: 2.25 2.28 2.25 4/182 6165
/proc/meminfo: memFree=13993844/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=15199812 CPUtime=1062.13 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4194812 0 0 0 105562 651 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140734965328360 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3799953 3741792 894 2943 0 3796847 0
[pid=6112/tid=6113] ppid=6109 vsize=15199812 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=15199812 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=15199812 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 15564607488 3741792 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1062.13
Current children cumulated vsize (KiB) 15199812



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1070.8 s]
/proc/loadavg: 2.29 2.28 2.25 3/183 6166
/proc/meminfo: memFree=13517264/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=15912516 CPUtime=1070.62 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) R 6109 6112 3556 0 -1 4202496 4372891 0 0 0 106386 676 0 0 20 0 4 0 109838127 16294416384 3919871 33554432000 4194304 16246674 140734965329264 140734965328440 4221016 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 3978129 3919877 894 2943 0 3975023 0
[pid=6112/tid=6113] ppid=6109 vsize=15912516 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6113/stat : 6113 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 16294416384 3919877 33554432000 4194304 16246674 140734965329264 140228419366128 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=15912516 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) S 6109 6112 3556 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109838127 16294416384 3919877 33554432000 4194304 16246674 140734965329264 140228333382896 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=6112/tid=6115] ppid=6109 vsize=15912516 CPUtime=0 cores=1,3,5,7
/proc/6112/task/6115/stat : 6115 (toysat) S 6109 6112 3556 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 109838127 16294416384 3919877 33554432000 4194304 16246674 140734965329264 140228322909360 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1070.62
Current children cumulated vsize (KiB) 15912516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6112 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1071.2 s]
/proc/loadavg: 2.29 2.28 2.25 3/183 6166
/proc/meminfo: memFree=13517264/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=0 CPUtime=1071.03 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) Z 6109 6112 3556 0 -1 4203532 4373465 0 0 0 106387 716 0 0 20 0 2 0 109838127 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 0 0 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=0 CPUtime=0.38 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) R 6109 6112 3556 0 -1 4203588 8 0 0 0 0 38 0 0 20 0 2 0 109838127 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1071.03
Current children cumulated vsize (KiB) 0

[startup+1071.6 s]
/proc/loadavg: 2.29 2.28 2.25 3/181 6166
/proc/meminfo: memFree=24495952/32872528 swapFree=17892/1720544
[pid=6112] ppid=6109 vsize=0 CPUtime=1071.43 cores=1,3,5,7
/proc/6112/stat : 6112 (toysat) Z 6109 6112 3556 0 -1 4203532 4373465 0 0 0 106387 756 0 0 20 0 2 0 109838127 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/6112/statm: 0 0 0 0 0 0 0
[pid=6112/tid=6114] ppid=6109 vsize=0 CPUtime=0.78 cores=1,3,5,7
/proc/6112/task/6114/stat : 6114 (toysat) R 6109 6112 3556 0 -1 4203588 8 0 0 0 0 78 0 0 20 0 2 0 109838127 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1071.43
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1071.63
CPU time (s): 1071.46
CPU user time (s): 1063.87
CPU system time (s): 7.58485
CPU usage (%): 99.9838
Max. virtual memory (cumulated for all children) (KiB): 15912516

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1063.87
system time used= 7.58485
maximum resident set size= 15681780
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4373465
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 199
involuntary context switches= 1108

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 3.87741 second user time and 5.48317 second system time

The end

Launcher Data 

Begin job on node117 at 2016-06-07 07:57:30
IDJOB=4079203
IDBENCH=89879
IDSOLVER=2542
FILE ID=node117/4079203-1465279048
RUNJOBID= node117-1465262703-3573
PBS_JOBID= 19843298
Free space on /tmp= 71660 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB11/normalized-PB11/OPT-BIGINT-LIN/heinz/normalized-ds-big.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4079203-1465279048/watcher-4079203-1465279048 -o /tmp/evaluation-result-4079203-1465279048/solver-4079203-1465279048 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1465262703-3573 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079203-1465279048.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0f8cbacf22bcac8867146871fbd72f4e
RANDOM SEED=1904379167

node117.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.088
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28975776 kB
Buffers:           92004 kB
Cached:           189684 kB
SwapCached:        55388 kB
Active:          1245664 kB
Inactive:         193036 kB
Active(anon):    1104376 kB
Inactive(anon):    54760 kB
Active(file):     141288 kB
Inactive(file):   138276 kB
Unevictable:     1720544 kB
Mlocked:           17892 kB
SwapTotal:      67108856 kB
SwapFree:       67045084 kB
Dirty:             66576 kB
Writeback:             0 kB
AnonPages:       2825136 kB
Mapped:            10720 kB
Shmem:                 0 kB
Slab:             601988 kB
SReclaimable:      45480 kB
SUnreclaim:       556508 kB
KernelStack:        1464 kB
PageTables:         9536 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2969244 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1732608 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71644 MiB
End job on node117 at 2016-06-07 08:15:21