Trace number 4110518

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.67 1801.01

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/warehouse/
normalized-cap133_wcsp.wbo
MD5SUMea836e0f976b6c1eccda327c2ccf56b9
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmarkMSAT
Best cost obtained on this benchmark11826857
Best CPU time to get the best result obtained on this benchmark1800.1
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables2600
Total number of constraints5148
Number of soft constraints5048
Number of constraints which are clauses5048
Number of constraints which are cardinality constraints (but not clauses)100
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint50
Top cost 66206436
Min constraint cost 1
Max constraint cost 66206436
Sum of constraints costs 166802246300
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 51
Number of bits of the biggest sum of numbers6
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-19T16:07:35+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--wbo","--search=bcd2","HOME/instance-4110518-1466345254.wbo"]
0.00/0.01	c use --random-gen="3585063038 3570827983 448211705 3258015915 110553219 547105799 3074142397 18043535 3868877099 798631916 1503498152 3482749665 488016615 950692661 2654901827 3152664758 2740744448 2783461715 2079012614 4033502138 3222643434 1120764123 4266004363 1306532535 1857241242 2238600443 3606280854 2589502008 3499475119 3725982485 2579577921 935910795 2317049224 3910961728 290921400 1249593325 480268392 492259759 3966041751 3460397021 2193461945 699044136 1438566036 208700992 2792897303 2130079348 3961790150 2408399311 3564665749 3848619635 1685850078 4147535396 319207143 1612497487 1705581308 2046057254 201401158 801996213 214369079 810701196 2306112101 3803312444 2041827873 994460876 2871713482 1440653826 4177527374 889877844 2909563106 1270515672 2415643252 1875637647 3423006189 1477094115 510608594 564133605 559349341 4139698342 999154525 2861079155 2754581501 733994657 4288584490 259867569 2155263258 3820257990 1901052203 1972247099 1430136174 1404690942 2002287817 3306770969 3478934997 3461681079 2521806513 3941779807 3000103644 2679029315 4081239459 2356254483 1369385145 2549746686 3230570678 2941852489 373417316 286558879 5366612 2280384455 1250381711 20977872 3394421459 4249925088 2163531929 809331777 1807475050 2738973289 3722169228 1354711468 2822483986 1221542366 2655070287 2086181786 3975134256 3468362336 1417301820 1752318461 3524033854 867773961 4177859424 3621330728 4159414125 1653841200 317254689 1155552960 3214555863 1113102828 1199440242 204447521 1944259580 2584182467 695756407 2514892188 1733729592 3492277653 1639288591 896387136 3952690618 376969184 1231836675 3650881845 3094070883 2387026169 2590101828 4061743851 473580582 297035182 3947083057 1057618665 1875508078 1527312738 3774964305 583458122 4144673614 1805744493 1240011432 2518218130 4256462279 2416856311 1342302065 2148200424 1732537996 3713972234 3709747706 779023205 3349774131 3657486750 363584335 3804826953 259932631 3134429270 1871145019 1739903727 1336718482 858522478 2472045962 4145713241 2034646938 1989074323 1553807344 2008372677 1691282773 431308918 2486726826 2542375630 2352736487 1077535007 4079452590 3548052086 1510737805 853643620 3551680215 1686042711 1516279415 985289533 1972934944 1086638768 2828638359 106204836 3155906277 2210884796 1947179676 3220741880 2371214576 3378690525 3879596352 693344624 3171593877 1675435476 4106090758 1351650983 1148527221 1187892207 99978652 599342370 2945830169 691293334 2991870302 752525646 2885519036 1993202941 3328456979 4209494670 2414689506 2969857258 1826892821 798882908 1468566294 34200450 2452754048 3853161847 1427009680 3338420304 1561990921 3460410416 3634076442 3995234380 139215068 3346807176 4293820888 479058065 3170237990 3430575859 4179566706 1083136407 2782668057 2002060641 255 362436" option to reproduce the execution

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4110518-1466345254/watcher-4110518-1466345254 -o /tmp/evaluation-result-4110518-1466345254/solver-4110518-1466345254 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node121-1466341819-1235 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4110518-1466345254.wbo 

pid=3515
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.14 2.21 2.17 3/177 3518
/proc/meminfo: memFree=29003704/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=677444 CPUtime=0 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 2517 0 0 0 0 0 0 0 20 0 4 0 36572374 693702656 2877 33554432000 4194304 16246674 140733999242960 140733999242384 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 169873 2889 442 2943 0 166767 0
[pid=3518/tid=3519] ppid=3515 vsize=693828 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 710479872 2946 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=698948 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 715722752 2965 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=704068 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 36572374 720965632 2982 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100164 s]
/proc/loadavg: 2.14 2.21 2.17 3/177 3518
/proc/meminfo: memFree=29003704/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1220164 CPUtime=0.08 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 22143 0 0 0 5 3 0 0 20 0 4 0 36572374 1249447936 22443 33554432000 4194304 16246674 140733999242960 140733999242272 12459121 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 305041 22449 830 2943 0 301935 0
[pid=3518/tid=3519] ppid=3515 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1249447936 22456 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1249447936 22460 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1220164 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36572374 1249447936 22465 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 1220164

[startup+0.200481 s]
/proc/loadavg: 2.14 2.21 2.17 3/177 3518
/proc/meminfo: memFree=29003704/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1221188 CPUtime=0.19 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 42146 0 0 0 13 6 0 0 20 0 4 0 36572374 1250496512 42446 33554432000 4194304 16246674 140733999242960 140733999242272 4225154 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 305297 42450 835 2943 0 302191 0
[pid=3518/tid=3519] ppid=3515 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1250496512 42453 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1250496512 42456 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1221188 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 4 0 36572374 1250496512 42459 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1221188

[startup+0.300437 s]
/proc/loadavg: 2.14 2.21 2.17 3/177 3518
/proc/meminfo: memFree=29003704/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1307204 CPUtime=0.28 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 51543 0 0 0 22 6 0 0 20 0 4 0 36572374 1338576896 51843 33554432000 4194304 16246674 140733999242960 140733999242272 13955806 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 326801 51843 841 2943 0 323695 0
[pid=3518/tid=3519] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 51843 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 51843 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 51843 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 1307204

[startup+0.700391 s]
/proc/loadavg: 2.14 2.21 2.17 3/177 3518
/proc/meminfo: memFree=29003704/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1307204 CPUtime=0.69 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 55503 0 0 0 62 7 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140733999242272 13807598 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 326801 55803 841 2943 0 323695 0
[pid=3518/tid=3519] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1307204

[startup+1.50037 s]
/proc/loadavg: 2.14 2.21 2.17 3/181 3522
/proc/meminfo: memFree=28780996/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1307204 CPUtime=1.49 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 55503 0 0 0 142 7 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140733999224832 6132584 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 326801 55803 841 2943 0 323695 0
[pid=3518/tid=3519] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1307204

[startup+3.10038 s]
/proc/loadavg: 2.14 2.21 2.17 3/181 3522
/proc/meminfo: memFree=28780500/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1307204 CPUtime=3.09 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 55503 0 0 0 302 7 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140733999224832 13807488 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 326801 55803 841 2943 0 323695 0
[pid=3518/tid=3519] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 55803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1307204

[startup+6.30037 s]
/proc/loadavg: 2.13 2.21 2.17 4/181 3522
/proc/meminfo: memFree=28743200/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1307204 CPUtime=6.28 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 61733 0 0 0 621 7 0 0 20 0 4 0 36572374 1338576896 62033 33554432000 4194304 16246674 140733999242960 140733999224832 6132648 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 326801 62033 841 2943 0 323695 0
[pid=3518/tid=3519] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 62033 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 62033 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1307204 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1338576896 62033 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 1307204

[startup+12.7004 s]
/proc/loadavg: 2.20 2.22 2.18 4/181 3522
/proc/meminfo: memFree=28729592/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1309252 CPUtime=12.69 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 64110 0 0 0 1261 8 0 0 20 0 4 0 36572374 1340674048 64410 33554432000 4194304 16246674 140733999242960 140733999224832 13809305 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 327313 64410 841 2943 0 324207 0
[pid=3518/tid=3519] ppid=3515 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1340674048 64410 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1340674048 64410 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1309252 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1340674048 64410 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1309252

[startup+25.5005 s]
/proc/loadavg: 2.24 2.22 2.18 3/181 3522
/proc/meminfo: memFree=28695360/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1311300 CPUtime=25.48 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 71380 0 0 0 2539 9 0 0 20 0 4 0 36572374 1342771200 71680 33554432000 4194304 16246674 140733999242960 140733999224832 13807598 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 327825 71680 841 2943 0 324719 0
[pid=3518/tid=3519] ppid=3515 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1342771200 71680 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1342771200 71680 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1342771200 71680 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1311300

[startup+51.1004 s]
/proc/loadavg: 2.23 2.22 2.18 4/181 3522
/proc/meminfo: memFree=28475732/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1311300 CPUtime=51.08 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 111481 0 0 0 5093 15 0 0 20 0 4 0 36572374 1342771200 111781 33554432000 4194304 16246674 140733999242960 140733999224832 13055848 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 327825 111781 843 2943 0 324719 0
[pid=3518/tid=3519] ppid=3515 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1342771200 111781 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 36572374 1342771200 111781 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1311300 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1342771200 111781 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1311300

[startup+102.3 s]
/proc/loadavg: 2.29 2.23 2.18 3/181 3523
/proc/meminfo: memFree=28042652/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=1312324 CPUtime=102.28 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 206972 0 0 0 10202 26 0 0 20 0 4 0 36572374 1343819776 207272 33554432000 4194304 16246674 140733999242960 140733999224832 13774000 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 328081 207272 843 2943 0 324975 0
[pid=3518/tid=3519] ppid=3515 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 1343819776 207272 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 36572374 1343819776 207272 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=1312324 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 1343819776 207272 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1312324


################
# More data... #
################

[pid=3518] ppid=3515 vsize=10443332 CPUtime=1362.04 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 2552014 0 0 0 135824 380 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140733999242136 13774024 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 2610833 2552277 843 2943 0 2607727 0
[pid=3518/tid=3519] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1362.04
Current children cumulated vsize (KiB) 10443332

[startup+1422.3 s]
/proc/loadavg: 2.23 2.21 2.18 3/181 3608
/proc/meminfo: memFree=18519128/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=10443332 CPUtime=1422.03 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 2552020 0 0 0 141820 383 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140733999242056 13774220 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 2610833 2552277 843 2943 0 2607727 0
[pid=3518/tid=3519] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1422.03
Current children cumulated vsize (KiB) 10443332

[startup+1482.3 s]
/proc/loadavg: 2.13 2.18 2.18 3/181 3609
/proc/meminfo: memFree=18519036/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=10443332 CPUtime=1482.02 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 2552021 0 0 0 147815 387 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140733999242136 13809392 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 2610833 2552277 843 2943 0 2607727 0
[pid=3518/tid=3519] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=10443332 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 10693971968 2552277 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1482.02
Current children cumulated vsize (KiB) 10443332

[startup+1542.31 s]
/proc/loadavg: 2.16 2.18 2.17 3/181 3610
/proc/meminfo: memFree=15629012/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=13477444 CPUtime=1542.02 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 3310548 0 0 0 153707 495 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140733999242136 6132712 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 3369361 3310803 844 2943 0 3366255 0
[pid=3518/tid=3519] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 13477444

[startup+1602.3 s]
/proc/loadavg: 2.12 2.16 2.17 4/181 3611
/proc/meminfo: memFree=15629168/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=13477444 CPUtime=1602 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 3310548 0 0 0 159701 499 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140733999242136 13923665 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 3369361 3310803 844 2943 0 3366255 0
[pid=3518/tid=3519] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1602
Current children cumulated vsize (KiB) 13477444

[startup+1662.3 s]
/proc/loadavg: 2.09 2.14 2.16 3/181 3612
/proc/meminfo: memFree=15629452/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=13477444 CPUtime=1661.99 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 3310548 0 0 0 165696 503 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140733999242136 13774223 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 3369361 3310803 844 2943 0 3366255 0
[pid=3518/tid=3519] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1661.99
Current children cumulated vsize (KiB) 13477444

[startup+1722.3 s]
/proc/loadavg: 2.19 2.16 2.17 4/181 3614
/proc/meminfo: memFree=15629600/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=13477444 CPUtime=1721.98 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 3310548 0 0 0 171694 504 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140733999242136 14628944 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 3369361 3310803 844 2943 0 3366255 0
[pid=3518/tid=3519] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1721.98
Current children cumulated vsize (KiB) 13477444

[startup+1782.3 s]
/proc/loadavg: 2.13 2.14 2.16 3/181 3615
/proc/meminfo: memFree=15629380/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=13477444 CPUtime=1781.97 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 3310553 0 0 0 177691 506 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140733999224832 13807601 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 3369361 3310803 844 2943 0 3366255 0
[pid=3518/tid=3519] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1781.97
Current children cumulated vsize (KiB) 13477444



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.10 2.14 2.16 3/181 3615
/proc/meminfo: memFree=15629104/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=13477444 CPUtime=1800.07 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) R 3515 3518 1219 0 -1 4202496 3310553 0 0 0 179501 506 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140733999242136 13807598 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 3369361 3310803 844 2943 0 3366255 0
[pid=3518/tid=3519] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3519/stat : 3519 (toysat) S 3515 3518 1219 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350790282480 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) S 3515 3518 1219 0 -1 4202560 11 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350779792624 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=3518/tid=3521] ppid=3515 vsize=13477444 CPUtime=0 cores=0,2,4,6
/proc/3518/task/3521/stat : 3521 (toysat) S 3515 3518 1219 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 4 0 36572374 13800902656 3310803 33554432000 4194304 16246674 140733999242960 140350769319088 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 13477444

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 3518 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.81 s]
/proc/loadavg: 2.09 2.13 2.16 3/179 3615
/proc/meminfo: memFree=23279108/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=0 CPUtime=1800.47 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) Z 3515 3518 1219 0 -1 4203532 3310553 0 0 0 179501 546 0 0 20 0 2 0 36572374 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 0 0 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=0 CPUtime=0.39 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) R 3515 3518 1219 0 -1 4203588 11 0 0 0 0 39 0 0 20 0 2 0 36572374 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.47
Current children cumulated vsize (KiB) 0

[startup+1801 s]
/proc/loadavg: 2.09 2.13 2.16 3/179 3615
/proc/meminfo: memFree=23279108/32872528 swapFree=1316768/1463936
[pid=3518] ppid=3515 vsize=0 CPUtime=1800.66 cores=0,2,4,6
/proc/3518/stat : 3518 (toysat) Z 3515 3518 1219 0 -1 4203532 3310553 0 0 0 179501 565 0 0 20 0 2 0 36572374 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/3518/statm: 0 0 0 0 0 0 0
[pid=3518/tid=3520] ppid=3515 vsize=0 CPUtime=0.58 cores=0,2,4,6
/proc/3518/task/3520/stat : 3520 (toysat) R 3515 3518 1219 0 -1 4203588 11 0 0 0 0 58 0 0 20 0 2 0 36572374 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.66
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1801.01
CPU time (s): 1800.67
CPU user time (s): 1795.02
CPU system time (s): 5.65414
CPU usage (%): 99.9814
Max. virtual memory (cumulated for all children) (KiB): 13477444

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1795.02
system time used= 5.65414
maximum resident set size= 13243212
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3310553
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 131
involuntary context switches= 1843

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.34719 second user time and 6.38203 second system time

The end

Launcher Data 

Begin job on node121 at 2016-06-19 16:07:34
IDJOB=4110518
IDBENCH=79503
IDSOLVER=2553
FILE ID=node121/4110518-1466345254
RUNJOBID= node121-1466341819-1235
PBS_JOBID= 19922032
Free space on /tmp= 71704 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/warehouse/normalized-cap133_wcsp.wbo
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --wbo --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4110518-1466345254/watcher-4110518-1466345254 -o /tmp/evaluation-result-4110518-1466345254/solver-4110518-1466345254 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node121-1466341819-1235 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4110518-1466345254.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ea836e0f976b6c1eccda327c2ccf56b9
RANDOM SEED=1206938769

node121.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29003596 kB
Buffers:          204832 kB
Cached:           484432 kB
SwapCached:         1944 kB
Active:          1155484 kB
Inactive:         486136 kB
Active(anon):     951796 kB
Inactive(anon):     2900 kB
Active(file):     203688 kB
Inactive(file):   483236 kB
Unevictable:     1463936 kB
Mlocked:         1316768 kB
SwapTotal:      67108856 kB
SwapFree:       67101196 kB
Dirty:             16600 kB
Writeback:            28 kB
AnonPages:       2414724 kB
Mapped:            12260 kB
Shmem:                 0 kB
Slab:             629500 kB
SReclaimable:      73416 kB
SUnreclaim:       556084 kB
KernelStack:        1440 kB
PageTables:         9048 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2679912 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    612352 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71684 MiB
End job on node121 at 2016-06-19 16:37:36