Trace number 4093133

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.02 1800.31

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/celar/
normalized-celar6-sub2_wcsp.wbo
MD5SUM4fd86302e553a3e850920dece7efe22c
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmark
Best cost obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables688
Total number of constraints280826
Number of soft constraints280810
Number of constraints which are clauses280810
Number of constraints which are cardinality constraints (but not clauses)16
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint44
Top cost 52140
Min constraint cost 1
Max constraint cost 1000
Sum of constraints costs 37167130
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 45
Number of bits of the biggest sum of numbers6
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-16T21:51:14+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--wbo","--search=bcd2","HOME/instance-4093133-1466106674.wbo"]
0.00/0.01	c use --random-gen="1348274737 2262555837 4288492574 969471765 3458863074 2136023064 3576214822 976015140 1952685542 845044403 2948688918 2058602205 109282213 1978265309 3601661617 840156437 797917008 3732326069 800168737 486635415 446144276 1202631962 1334228309 3488663586 1349376082 142000414 3543575539 128038710 1783319300 3993743953 2496893465 1150207531 3435498908 52097147 3942869471 1403529663 2866738008 885021534 962164376 2779417568 2879786680 2775609695 548587346 1735910943 1366343133 1239880619 3943197756 2389217484 461806692 576615064 2720888547 3049693424 103853431 637106493 1471671572 1654316735 1102293881 848635772 3753069376 595211412 2538589285 758711822 1993740668 3969236574 440960033 2279622757 1052833058 1625719831 2202965174 3618200441 3080226765 3652489174 267045811 1836331228 1777366591 1178632059 1541849285 440354062 295452023 685623828 179784852 2160056 2172177129 732337923 2656975332 1286786050 2854464859 3638360815 663550056 1090035482 4162029517 2911861756 3098789701 4028187894 4135511549 3053771161 1315310566 1854758991 31065008 1481836492 2269168388 1552628791 1908935496 2626976512 2861059678 302368683 1913248801 2004119534 1468817693 3010997635 4278402059 3796527891 2686251258 1821591777 1231169423 455923844 4201780968 3232177410 2527488514 1570641763 3997931717 468595541 1703398094 4115559560 106356059 1744094284 2753799116 765776032 2605704854 2487118205 888830898 3289870949 2739424920 2228922584 3489175342 134491932 2237780296 2601909311 3142240457 2662914049 1255612123 3534635226 4245147017 4255489783 2793673048 4176514563 498031241 3673673894 3045961545 2089694006 724837524 2176871358 620127822 2716243851 1369922259 3817315977 1429842472 2035965998 2229944712 3649464160 1195107084 3533337695 3174190992 199605811 3740765244 2268615178 2834137071 3628199695 3400801608 98718439 145931159 2123848567 2740165578 943461889 3219788393 535348476 2048091571 515995851 1597540431 1899451313 6456086 3644215083 3167616086 2454563211 3916403865 1865539137 3520951179 2483421769 3132410578 1413654326 1446414892 99024602 3469791932 2952518315 1833828443 2260567063 3381443026 432986057 1581937174 1886077695 2301628597 3076160565 890703682 955174940 610664460 3985161349 3399359653 2372857691 3513231670 2711074637 1551860956 816541255 42510178 3171723417 2170337953 3919595897 401720524 2224636384 2870591771 1351439262 849889652 951710808 230992586 453686345 3924493461 1003281550 4267623016 2331855808 1826443663 457572614 2452123783 615237448 1924517613 1659645554 3116264691 415515093 3116256640 3848007339 3147666671 1604964682 4013096880 1291069465 3917830501 1982558095 765692736 3472689583 2796701201 586762087 152893880 1746693223 1424646011 1722338398 3605379561 1414305943 1833673212 1971061273 255 362436" option to reproduce the execution

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4093133-1466106674/watcher-4093133-1466106674 -o /tmp/evaluation-result-4093133-1466106674/solver-4093133-1466106674 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node107-1466104872-14917 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093133-1466106674.wbo 

pid=15088
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.12 2.07 1.95 3/179 15091
/proc/meminfo: memFree=31636932/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=809404 CPUtime=0 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 3035 0 0 0 0 0 0 0 20 0 4 0 12717402 828829696 2885 33554432000 4194304 16246674 140733340296608 140733340296032 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 202863 2894 441 2943 0 199757 0
[pid=15091/tid=15092] ppid=15088 vsize=826812 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 846655488 2953 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=831932 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 851898368 2972 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=835004 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 12717402 855044096 2988 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100175 s]
/proc/loadavg: 2.12 2.07 1.95 3/179 15091
/proc/meminfo: memFree=31636932/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1301060 CPUtime=0.09 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 24853 0 0 0 6 3 0 0 20 0 4 0 12717402 1332285440 24643 33554432000 4194304 16246674 140733340296608 140733340295920 7853005 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 325265 24658 801 2943 0 322159 0
[pid=15091/tid=15092] ppid=15088 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1332285440 24668 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1332285440 24680 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1301060 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1332285440 24691 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1301060

[startup+0.20053 s]
/proc/loadavg: 2.12 2.07 1.95 3/179 15091
/proc/meminfo: memFree=31636932/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1309252 CPUtime=0.19 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 48700 0 0 0 14 5 0 0 20 0 4 0 12717402 1340674048 49001 33554432000 4194304 16246674 140733340296608 140733340295920 4221105 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 327313 49009 802 2943 0 324207 0
[pid=15091/tid=15092] ppid=15088 vsize=1309252 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1340674048 49014 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1309252 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1340674048 49019 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1310276 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1341722624 49026 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1309252

[startup+0.300496 s]
/proc/loadavg: 2.12 2.07 1.95 3/179 15091
/proc/meminfo: memFree=31636932/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1314372 CPUtime=0.29 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 65616 0 0 0 20 9 0 0 20 0 4 0 12717402 1345916928 65916 33554432000 4194304 16246674 140733340296608 140733340295920 4222992 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 328593 65916 802 2943 0 325487 0
[pid=15091/tid=15092] ppid=15088 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1345916928 65916 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1345916928 65916 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1345916928 65916 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.700428 s]
/proc/loadavg: 2.12 2.07 1.95 3/179 15091
/proc/meminfo: memFree=31636932/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1314372 CPUtime=0.69 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 72821 0 0 0 59 10 0 0 20 0 4 0 12717402 1345916928 73121 33554432000 4194304 16246674 140733340296608 140733340295704 4206964 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 328593 73121 802 2943 0 325487 0
[pid=15091/tid=15092] ppid=15088 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1345916928 73121 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1345916928 73121 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1314372 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1345916928 73121 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.50042 s]
/proc/loadavg: 2.12 2.07 1.95 3/183 15095
/proc/meminfo: memFree=30969512/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1326660 CPUtime=1.49 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 110005 0 0 0 134 15 0 0 20 0 4 0 12717402 1358499840 112349 33554432000 4194304 16246674 140733340296608 140733340295704 4206653 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 331665 112349 803 2943 0 328559 0
[pid=15091/tid=15092] ppid=15088 vsize=1326660 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1358499840 112349 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1326660 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1358499840 112349 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1326660 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1358499840 112349 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1326660

[startup+3.10043 s]
/proc/loadavg: 2.11 2.07 1.95 3/183 15095
/proc/meminfo: memFree=30756588/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1326660 CPUtime=3.09 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 114087 0 0 0 293 16 0 0 20 0 4 0 12717402 1358499840 117453 33554432000 4194304 16246674 140733340296608 140733340295920 13899096 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 331665 117453 836 2943 0 328559 0
[pid=15091/tid=15092] ppid=15088 vsize=1326660 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1358499840 117453 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1326660 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1358499840 117453 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1326660 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1358499840 117453 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1326660

[startup+6.30043 s]
/proc/loadavg: 2.11 2.07 1.95 3/183 15095
/proc/meminfo: memFree=29329892/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1399364 CPUtime=6.29 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 287400 0 0 0 590 39 0 0 20 0 4 0 12717402 1432948736 290766 33554432000 4194304 16246674 140733340296608 140733340278528 4221140 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 349841 290766 838 2943 0 346735 0
[pid=15091/tid=15092] ppid=15088 vsize=1399364 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1432948736 290766 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1399364 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1432948736 290766 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1399364 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1432948736 290766 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1399364

[startup+12.7004 s]
/proc/loadavg: 2.09 2.07 1.95 3/183 15095
/proc/meminfo: memFree=29153712/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1487428 CPUtime=12.69 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 309422 0 0 0 1226 43 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140733340278528 13807754 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 371857 312788 844 2943 0 368751 0
[pid=15091/tid=15092] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1487428

[startup+25.5004 s]
/proc/loadavg: 2.08 2.07 1.95 3/183 15095
/proc/meminfo: memFree=29155084/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1487428 CPUtime=25.49 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 309422 0 0 0 2506 43 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140733340278528 13817064 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 371857 312788 844 2943 0 368751 0
[pid=15091/tid=15092] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1487428

[startup+51.1005 s]
/proc/loadavg: 2.12 2.08 1.96 3/183 15095
/proc/meminfo: memFree=29154440/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1487428 CPUtime=51.08 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 309422 0 0 0 5065 43 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140733340278528 13943664 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 371857 312788 844 2943 0 368751 0
[pid=15091/tid=15092] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1487428

[startup+102.3 s]
/proc/loadavg: 2.10 2.08 1.96 3/183 15096
/proc/meminfo: memFree=29154684/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1487428 CPUtime=102.28 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 309422 0 0 0 10185 43 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140733340278528 13943664 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 371857 312788 844 2943 0 368751 0
[pid=15091/tid=15092] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 312788 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1487428


################
# More data... #
################

/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 1487428

[startup+1362.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/183 15151
/proc/meminfo: memFree=29152564/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1487428 CPUtime=1362.07 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 309440 0 0 0 136164 43 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140733340278528 6132605 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 371857 313044 844 2943 0 368751 0
[pid=15091/tid=15092] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 1487428

[startup+1422.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/183 15152
/proc/meminfo: memFree=29152588/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1487428 CPUtime=1422.07 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 309440 0 0 0 142164 43 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140733340278528 13807548 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 371857 313044 844 2943 0 368751 0
[pid=15091/tid=15092] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 1487428

[startup+1482.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/183 15153
/proc/meminfo: memFree=29152320/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1487428 CPUtime=1482.06 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 309442 0 0 0 148162 44 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140733340278528 6132605 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 371857 313044 844 2943 0 368751 0
[pid=15091/tid=15092] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1487428 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1523126272 313044 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.06
Current children cumulated vsize (KiB) 1487428

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 15155
/proc/meminfo: memFree=28549700/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1788484 CPUtime=1542.05 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 384694 0 0 0 154151 54 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140733340278528 13809305 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 447121 388295 844 2943 0 444015 0
[pid=15091/tid=15092] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 1788484

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 15156
/proc/meminfo: memFree=28549860/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1788484 CPUtime=1602.04 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 384694 0 0 0 160150 54 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140733340278528 6132663 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 447121 388295 844 2943 0 444015 0
[pid=15091/tid=15092] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.04
Current children cumulated vsize (KiB) 1788484

[startup+1662.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/183 15157
/proc/meminfo: memFree=28549752/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1788484 CPUtime=1662.03 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 384698 0 0 0 166149 54 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140733340278528 13774216 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 447121 388295 844 2943 0 444015 0
[pid=15091/tid=15092] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662.03
Current children cumulated vsize (KiB) 1788484

[startup+1722.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/183 15158
/proc/meminfo: memFree=28550028/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1788484 CPUtime=1722.02 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 384698 0 0 0 172148 54 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140733340278528 6132584 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 447121 388295 844 2943 0 444015 0
[pid=15091/tid=15092] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 1788484

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/184 15162
/proc/meminfo: memFree=28548860/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1788484 CPUtime=1782.01 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 384700 0 0 0 178147 54 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140733340278528 13774024 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 447121 388295 844 2943 0 444015 0
[pid=15091/tid=15092] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 1788484



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/182 15162
/proc/meminfo: memFree=28549252/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1788484 CPUtime=1800.01 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 384700 0 0 0 179947 54 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140733340278528 13807582 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 447121 388295 844 2943 0 444015 0
[pid=15091/tid=15092] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1788484

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15091 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/182 15162
/proc/meminfo: memFree=28549252/32872528 swapFree=240572/273276
[pid=15091] ppid=15088 vsize=1788484 CPUtime=1800.01 cores=1,3,5,7
/proc/15091/stat : 15091 (toysat) R 15088 15091 14160 0 -1 4202496 384700 0 0 0 179947 54 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140733340278528 13807582 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15091/statm: 447121 388295 844 2943 0 444015 0
[pid=15091/tid=15092] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15092/stat : 15092 (toysat) S 15088 15091 14160 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546904403184 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15091/tid=15093] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15093/stat : 15093 (toysat) S 15088 15091 14160 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546893913328 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15091/tid=15094] ppid=15088 vsize=1788484 CPUtime=0 cores=1,3,5,7
/proc/15091/task/15094/stat : 15094 (toysat) S 15088 15091 14160 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 12717402 1831407616 388295 33554432000 4194304 16246674 140733340296608 140546883439792 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1788484

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.31
CPU time (s): 1800.02
CPU user time (s): 1799.48
CPU system time (s): 0.542917
CPU usage (%): 99.9838
Max. virtual memory (cumulated for all children) (KiB): 1788484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.48
system time used= 0.542917
maximum resident set size= 1553180
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 384700
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 54
involuntary context switches= 1875

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.20521 second user time and 6.87495 second system time

The end

Launcher Data 

Begin job on node107 at 2016-06-16 21:51:14
IDJOB=4093133
IDBENCH=79556
IDSOLVER=2553
FILE ID=node107/4093133-1466106674
RUNJOBID= node107-1466104872-14917
PBS_JOBID= 19904056
Free space on /tmp= 71660 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/celar/normalized-celar6-sub2_wcsp.wbo
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --wbo --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4093133-1466106674/watcher-4093133-1466106674 -o /tmp/evaluation-result-4093133-1466106674/solver-4093133-1466106674 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node107-1466104872-14917 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093133-1466106674.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4fd86302e553a3e850920dece7efe22c
RANDOM SEED=1871656373

node107.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        31658660 kB
Buffers:           59704 kB
Cached:           174368 kB
SwapCached:         2504 kB
Active:           135756 kB
Inactive:         102376 kB
Active(anon):       3976 kB
Inactive(anon):     2156 kB
Active(file):     131780 kB
Inactive(file):   100220 kB
Unevictable:      273276 kB
Mlocked:          240572 kB
SwapTotal:      67108856 kB
SwapFree:       67099248 kB
Dirty:             48164 kB
Writeback:            12 kB
AnonPages:        275904 kB
Mapped:             6992 kB
Shmem:                 0 kB
Slab:             571096 kB
SReclaimable:      14604 kB
SUnreclaim:       556492 kB
KernelStack:        1448 kB
PageTables:         4188 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:     370764 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:     32768 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71632 MiB
End job on node107 at 2016-06-16 22:21:14