Trace number 4103293

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.55 1800.85

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/milp/normalized-mps-v2-20-10-mkc1.opb
MD5SUMc469eec4209d8404cb0293cb27bb013d
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 0
Optimality of the best value was proved NO
Number of variables27743
Total number of constraints5584
Number of constraints which are clauses712
Number of constraints which are cardinality constraints (but not clauses)24
Number of constraints which are nor clauses,nor cardinality constraints4848
Minimum length of a constraint2
Maximum length of a constraint25072
Number of terms in the objective function 25306
Biggest coefficient in the objective function 20480000
Number of bits for the biggest coefficient in the objective function 25
Sum of the numbers in the objective function 56454927307
Number of bits of the sum of numbers in the objective function 36
Biggest number in a constraint 536870912000
Number of bits of the biggest number in a constraint 39
Biggest sum of numbers in a constraint 1129539816832
Number of bits of the biggest sum of numbers41
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T09:32:17+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103293-1466235137.opb"]
0.00/0.01	c use --random-gen="2087747303 2659677702 1644890915 2956534046 2017724330 1194259335 868820363 2468204499 3553020555 1339329608 1637599986 930363516 603627802 1615971420 3956518119 2590176060 984612718 3272730031 2205426546 3063044872 3177590190 2985748302 1310497168 1498299339 314338217 2851057501 1848864437 2440361579 773191157 4172369411 971789859 746699538 458203413 2081713359 2633345013 3241617328 2723402287 3450598436 407687715 1247534009 3734955039 3878367326 431410835 2289188079 1530821101 1252762580 4261827897 176235836 3252276428 279625858 1536340482 204476595 2256631261 3905507152 2811408407 3718051668 1714835839 1355863969 483961553 2083472902 229640418 1394677675 3184227297 3232626161 2038437606 4239083454 431533567 3248591114 1050774603 3264413913 833972106 2188474078 2962005154 1105529308 1618190733 3499247511 178280008 757565243 1316529245 2311010982 4263545064 1324829632 466034622 1374452883 128783757 3293958988 1296752181 935673902 1436255620 701601855 367018863 3853412014 2672779285 1370177443 3700682305 285901525 2276607132 3835445805 4093120291 496309123 3419549829 4249595425 2126593862 2913958285 4278639409 1009967214 2545127857 2014355736 2624830051 248721424 2798851825 3589944469 4092189442 2667985265 1658050756 3176440624 444961912 705422788 1677216879 4100373415 2213673260 2643638909 167830955 1379312866 2859588867 1084606651 841607110 2650714377 3024441791 2730133123 2704792430 947041171 1521041825 2809381218 1803459983 3089471955 326673223 422162326 589862455 2226513136 544283372 3772395569 3744730319 3622865704 815853148 2708049464 56948939 4014581178 529534682 1397638818 3433116251 482016094 844696942 97956147 587781545 1744571899 2433090799 3293288196 4077709533 3994571528 3184820545 74016925 4272030610 1314081475 296840780 1462174227 4049386994 1032604320 204953187 958522101 1867891324 4166056080 682048448 3240950388 2934076295 1936049684 1996918875 3573493031 1539067912 879258935 1829353338 3279129539 1720594734 3838289095 3045279860 1079232463 2642089044 3708669059 85761778 67942116 3745206829 2306643546 1759745421 2529006545 683368054 2657401787 3453135591 3754298890 2601946538 2999299385 2931810946 3318055279 373476199 1693182545 2897713420 275708808 39051336 2623700066 3460293357 2447351248 2308590870 2071331775 299107837 2483078420 514392053 893356652 535947569 3835017543 3009920863 3308990863 3311548858 856494086 2766440407 2815512827 94456923 3018676615 1513947013 3191884902 2650004606 3094537395 1111785885 3478629614 1634182650 3973422207 1900895081 2275186295 2196062764 1445264134 3716345612 2373190379 1506637123 934099686 2800618834 4162917388 4091187669 1807981349 3256123000 3558047564 2234743594 1123469210 2587865892 3939582751 2072052733 2915427330 2517623167 2964545410 255 362436" option to reproduce the execution
0.28/0.33	c #vars 27743
0.28/0.33	c #constraints 5584

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103293-1466235137/watcher-4103293-1466235137 -o /tmp/evaluation-result-4103293-1466235137/solver-4103293-1466235137 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node131-1466206062-31241 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103293-1466235137.opb 

pid=2957
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.18 2.22 2.18 3/179 2960
/proc/meminfo: memFree=28768020/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=691780 CPUtime=0 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 2576 0 0 0 0 0 0 0 20 0 4 0 25560242 708382720 2936 33554432000 4194304 16246674 140735010381280 140735010380704 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2960/statm: 173457 2944 442 2943 0 170351 0
[pid=2960/tid=2961] ppid=2957 vsize=735812 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 753471488 3110 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=740932 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 758714368 3127 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=745028 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25560242 762908672 3144 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100168 s]
/proc/loadavg: 2.18 2.22 2.18 3/179 2960
/proc/meminfo: memFree=28768020/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=1302084 CPUtime=0.09 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 30068 0 0 0 5 4 0 0 20 0 4 0 25560242 1333334016 30367 33554432000 4194304 16246674 140735010381280 140735010380592 12752373 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2960/statm: 325521 30383 800 2943 0 322415 0
[pid=2960/tid=2961] ppid=2957 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 1333334016 30395 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 1333334016 30406 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 1333334016 30417 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1302084

[startup+0.200545 s]
/proc/loadavg: 2.18 2.22 2.18 3/179 2960
/proc/meminfo: memFree=28768020/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=1311300 CPUtime=0.18 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 44073 0 0 0 13 5 0 0 20 0 4 0 25560242 1342771200 44883 33554432000 4194304 16246674 140735010381280 140735010380592 7371468 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2960/statm: 327825 44902 802 2943 0 324719 0
[pid=2960/tid=2961] ppid=2957 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 1342771200 44913 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 1342771200 44923 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 1342771200 44935 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 1311300

[startup+0.300502 s]
/proc/loadavg: 2.18 2.22 2.18 3/179 2960
/proc/meminfo: memFree=28768020/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=1312324 CPUtime=0.28 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 44482 0 0 0 23 5 0 0 20 0 4 0 25560242 1343819776 45292 33554432000 4194304 16246674 140735010381280 140735010364272 8055525 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/2960/statm: 328081 45312 802 2943 0 324975 0
[pid=2960/tid=2961] ppid=2957 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 1343819776 45323 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 1343819776 45335 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 1343819776 45346 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 1312324

[startup+0.700437 s]
/proc/loadavg: 2.18 2.22 2.18 3/179 2960
/proc/meminfo: memFree=28768020/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=1319492 CPUtime=0.69 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 64711 0 0 0 61 8 0 0 20 0 4 0 25560242 1351159808 65520 33554432000 4194304 16246674 140735010381280 140735010380496 12429797 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 329873 65527 836 2943 0 326767 0
[pid=2960/tid=2961] ppid=2957 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 1351159808 65530 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 1351159808 65534 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 1351159808 65537 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1319492

[startup+1.50037 s]
/proc/loadavg: 2.18 2.22 2.18 3/183 2964
/proc/meminfo: memFree=28134692/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=1319492 CPUtime=1.49 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 235185 0 0 0 120 29 0 0 20 0 4 0 25560242 1351159808 235995 33554432000 4194304 16246674 140735010381280 140735010363200 12449130 0 0 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 329873 236011 836 2943 0 326767 0
[pid=2960/tid=2961] ppid=2957 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 1351159808 236020 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 1351159808 236029 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=1319492 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 1351159808 236038 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1319492

[startup+3.10043 s]
/proc/loadavg: 2.18 2.22 2.18 3/183 2964
/proc/meminfo: memFree=27522256/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=1481284 CPUtime=3.09 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 310945 0 0 0 272 37 0 0 20 0 4 0 25560242 1516834816 311754 33554432000 4194304 16246674 140735010381280 140735010363200 4206864 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 370321 311754 836 2943 0 367215 0
[pid=2960/tid=2961] ppid=2957 vsize=1481284 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 1516834816 311754 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=1481284 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 1516834816 311754 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=1481284 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 1516834816 311754 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1481284

[startup+6.30041 s]
/proc/loadavg: 2.24 2.23 2.18 3/183 2964
/proc/meminfo: memFree=27520808/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=1658436 CPUtime=6.29 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 355162 0 0 0 587 42 0 0 20 0 4 0 25560242 1698238464 355971 33554432000 4194304 16246674 140735010381280 140735010379944 4225154 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 414609 355982 836 2943 0 411503 0
[pid=2960/tid=2961] ppid=2957 vsize=1658436 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 1698238464 355988 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=1658436 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 1698238464 355993 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=1658436 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 1698238464 355998 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1658436

[startup+12.7004 s]
/proc/loadavg: 2.22 2.23 2.18 3/183 2964
/proc/meminfo: memFree=26437836/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=2562628 CPUtime=12.68 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 581282 0 0 0 1197 71 0 0 20 0 4 0 25560242 2624131072 582091 33554432000 4194304 16246674 140735010381280 140735010380376 4220520 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 640657 582091 836 2943 0 637551 0
[pid=2960/tid=2961] ppid=2957 vsize=2562628 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 2624131072 582091 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=2562628 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 2624131072 582091 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=2562628 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 2624131072 582091 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 2562628

[startup+25.5005 s]
/proc/loadavg: 2.25 2.24 2.18 3/183 2964
/proc/meminfo: memFree=24233604/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=4761156 CPUtime=25.48 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 1130916 0 0 0 2401 147 0 0 20 0 4 0 25560242 4875423744 1131725 33554432000 4194304 16246674 140735010381280 140735010379072 4220894 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 1190289 1131725 836 2943 0 1187183 0
[pid=2960/tid=2961] ppid=2957 vsize=4761156 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 4875423744 1131725 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=4761156 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 4875423744 1131725 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=4761156 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 4875423744 1131725 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 4761156

[startup+51.1005 s]
/proc/loadavg: 2.31 2.25 2.19 3/183 2964
/proc/meminfo: memFree=19825844/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=9160260 CPUtime=51.08 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 2230693 0 0 0 4812 296 0 0 20 0 4 0 25560242 9380106240 2231502 33554432000 4194304 16246674 140735010381280 140735010380456 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 2290065 2231502 836 2943 0 2286959 0
[pid=2960/tid=2961] ppid=2957 vsize=9160260 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 9380106240 2231502 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=9160260 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 9380106240 2231502 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=9160260 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 9380106240 2231502 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9160260

[startup+102.3 s]
/proc/loadavg: 2.43 2.29 2.20 3/183 2965
/proc/meminfo: memFree=16225404/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=102.28 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128746 0 0 0 9814 414 0 0 20 0 4 0 25560242 13058510848 3129555 33554432000 4194304 16246674 140735010381280 140735010380456 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129555 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129555 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129555 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129555 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 12752452


################
# More data... #
################

[pid=2960] ppid=2957 vsize=12752452 CPUtime=1362.07 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128749 0 0 0 135698 509 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010379200 14016657 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 12752452

[startup+1422.3 s]
/proc/loadavg: 2.24 2.19 2.18 3/183 3095
/proc/meminfo: memFree=17229488/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1422.07 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128749 0 0 0 141692 515 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010380376 4221138 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 12752452

[startup+1482.3 s]
/proc/loadavg: 2.18 2.18 2.18 4/183 3096
/proc/meminfo: memFree=17204864/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1482.05 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128749 0 0 0 147686 519 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010380376 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 12752452

[startup+1542.31 s]
/proc/loadavg: 2.31 2.21 2.19 3/183 3097
/proc/meminfo: memFree=17191104/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1542.05 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128752 0 0 0 153682 523 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010379200 4226254 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.05
Current children cumulated vsize (KiB) 12752452

[startup+1602.3 s]
/proc/loadavg: 2.16 2.18 2.18 3/183 3098
/proc/meminfo: memFree=17176484/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1602.03 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128752 0 0 0 159675 528 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010379200 14006562 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 12752452

[startup+1662.3 s]
/proc/loadavg: 2.17 2.18 2.18 4/182 3099
/proc/meminfo: memFree=17128408/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1662.02 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128752 0 0 0 165669 533 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010379200 14003024 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 12752452

[startup+1722.3 s]
/proc/loadavg: 2.21 2.19 2.18 3/184 3104
/proc/meminfo: memFree=17120680/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1722.02 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128752 0 0 0 171665 537 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010379200 14013629 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1722.02
Current children cumulated vsize (KiB) 12752452

[startup+1782.3 s]
/proc/loadavg: 2.16 2.18 2.18 3/184 3128
/proc/meminfo: memFree=17093676/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1782.01 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128752 0 0 0 177660 541 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010380456 15015658 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479984 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1782.01
Current children cumulated vsize (KiB) 12752452



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.20 2.18 2.18 4/183 3129
/proc/meminfo: memFree=17092940/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=12752452 CPUtime=1800 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) R 2957 2960 31224 0 -1 4202496 3128752 0 0 0 179457 543 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 140735010379200 14013830 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 3188113 3129558 841 2943 0 3185007 0
[pid=2960/tid=2961] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2961/stat : 2961 (toysat) S 2957 2960 31224 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938290969840 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=2960/tid=2962] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2962/stat : 2962 (toysat) S 2957 2960 31224 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938280479760 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=12752452 CPUtime=0 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) S 2957 2960 31224 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 25560242 13058510848 3129558 33554432000 4194304 16246674 140735010381280 139938270006448 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 12752452

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 2960 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.20 2.18 2.18 4/183 3129
/proc/meminfo: memFree=17092940/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=0 CPUtime=1800.1 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) Z 2957 2960 31224 0 -1 4203532 3128752 0 0 0 179457 553 0 0 20 0 2 0 25560242 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 0 0 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=0 CPUtime=0.08 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) R 2957 2960 31224 0 -1 4203588 2 0 0 0 0 8 0 0 20 0 2 0 25560242 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 0

[startup+1800.81 s]
/proc/loadavg: 2.20 2.18 2.18 4/181 3129
/proc/meminfo: memFree=26811552/32872528 swapFree=1200228/1314692
[pid=2960] ppid=2957 vsize=0 CPUtime=1800.5 cores=1,3,5,7
/proc/2960/stat : 2960 (toysat) Z 2957 2960 31224 0 -1 4203532 3128752 0 0 0 179457 593 0 0 20 0 2 0 25560242 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/2960/statm: 0 0 0 0 0 0 0
[pid=2960/tid=2963] ppid=2957 vsize=0 CPUtime=0.49 cores=1,3,5,7
/proc/2960/task/2963/stat : 2963 (toysat) R 2957 2960 31224 0 -1 4203588 2 0 0 0 0 49 0 0 20 0 2 0 25560242 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.85
CPU time (s): 1800.55
CPU user time (s): 1794.58
CPU system time (s): 5.97509
CPU usage (%): 99.9836
Max. virtual memory (cumulated for all children) (KiB): 12752452

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.58
system time used= 5.97509
maximum resident set size= 12518232
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3128752
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 254
involuntary context switches= 1994

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.77527 second user time and 6.97794 second system time

The end

Launcher Data 

Begin job on node131 at 2016-06-18 09:32:17
IDJOB=4103293
IDBENCH=2320
IDSOLVER=2542
FILE ID=node131/4103293-1466235137
RUNJOBID= node131-1466206062-31241
PBS_JOBID= 19918146
Free space on /tmp= 71688 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/milp/normalized-mps-v2-20-10-mkc1.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103293-1466235137/watcher-4103293-1466235137 -o /tmp/evaluation-result-4103293-1466235137/solver-4103293-1466235137 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node131-1466206062-31241 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103293-1466235137.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c469eec4209d8404cb0293cb27bb013d
RANDOM SEED=1789469516

node131.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.752
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28768548 kB
Buffers:          129996 kB
Cached:           161340 kB
SwapCached:         1508 kB
Active:          1860004 kB
Inactive:         192136 kB
Active(anon):    1761000 kB
Inactive(anon):     2684 kB
Active(file):      99004 kB
Inactive(file):   189452 kB
Unevictable:     1314692 kB
Mlocked:         1200228 kB
SwapTotal:      67108856 kB
SwapFree:       67099856 kB
Dirty:             18280 kB
Writeback:             0 kB
AnonPages:       3022424 kB
Mapped:            10592 kB
Shmem:                 0 kB
Slab:             602336 kB
SReclaimable:      46396 kB
SUnreclaim:       555940 kB
KernelStack:        1520 kB
PageTables:         9844 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3220172 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:     61440 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71668 MiB
End job on node131 at 2016-06-18 10:02:18