Trace number 4093291

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.05 1800.33

General information on the benchmark

Name/PARTIAL-BIGINT-LIN/wcsp/warehouse/
normalized-capmq1_wcsp.wbo
MD5SUMe8bcb76dae4005526534cba50c92556d
Bench CategoryPARTIAL-BIGINT-LIN (both soft and hard constraints, big integers, linear constraints)
Best result obtained on this benchmark
Best cost obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables90600
Total number of constraints180900
Number of soft constraints180300
Number of constraints which are clauses180300
Number of constraints which are cardinality constraints (but not clauses)600
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint300
Top cost 167360670
Min constraint cost 1
Max constraint cost 167360670
Sum of constraints costs 15063769612171
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 301
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-30T02:31:04+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--wbo","--search=bcd2","HOME/instance-4093291-1467246664.wbo"]
0.00/0.01	c use --random-gen="4196196645 1605661165 862759004 2734955504 3641864505 3857460381 1175638359 3117005293 2307444703 1140017442 2772130539 1444174167 11424957 3297779029 3164447920 2670821938 772638072 4247677872 4031729670 1388339917 3357044913 315453425 3143284397 3344123878 2199397961 714932314 4098669914 992919825 1053940120 609037288 1002499081 168847351 2666381990 1674059231 1324987079 4077995056 3123462823 1425958872 3441647898 2916400569 4022836474 1378978656 1786895676 867990721 97976335 1354250350 2503858405 3307963186 1960173973 3471475467 941935463 702951176 150789612 4111448046 4171793643 2517201355 2595464221 1643371522 930579270 2130240725 1105596619 3590039087 875226040 2008717023 2353920415 2749144655 1539050400 1142306769 3382831311 2223778302 2610841968 1407502178 2296109082 716910897 509916967 4202032346 1163133839 589292552 2711160937 861015230 2779881956 2512737908 3327903083 628093268 957517520 1895561664 2352180797 3579973249 835546913 2241135002 81937260 818388556 364104377 1820590294 1076121089 2142089632 3019418069 78367103 1987115343 135476805 3289395950 2446012588 62254896 4228985849 2048131667 4138887680 1522537438 1584295992 3278688061 3075062459 879997005 2285994816 1062967839 103161055 896389947 3845968180 3624219842 2340548511 1114036285 3356715540 1822719516 3352524813 1908382113 1572607861 2732285884 2377719797 2385199586 3514135004 1213350167 3367130255 2443369217 1257596608 191140418 3626446977 675791054 3124636452 3950705086 2980505244 1161668310 1772116091 2797035815 292963480 1404197214 1560113096 2630286811 256869469 3520536704 345328972 2539565210 3500771888 262188748 4234856512 3158689182 4157631112 1496089391 3358866457 3470835967 3436619136 1371931768 3407973330 3683605226 4254150311 1568355483 3869967575 3397049977 1408136947 3784966595 994784190 582935632 3773691785 3230218097 1387395654 3736529381 1905674594 3126406224 4288517076 1555808975 2783762337 2480793864 1880087217 3775031502 4180787492 1335785489 1482203004 1679059961 3816882523 151173021 1546563122 3723704591 1286458579 3682593341 3078304250 2428804085 2872521858 4157314024 1885223681 1517308969 1305731401 3473869695 2689991395 3977678349 4212045107 2024968981 3001681560 1918134072 1948262630 1911318047 4287934460 301989266 1313341861 558366876 3696029673 999564051 3163754419 2321625001 3910292778 1589199009 3542184596 998105290 1680814152 3721302027 2339725654 1706580428 3961627597 134287236 3739468877 2373562243 2505193588 1154308766 277898258 1556517923 1874346933 470322859 2157343353 300039073 3606901521 2295320456 2875891250 3794380399 1329874187 501135157 2159341221 3614066262 2380565734 1566271770 1410975595 550055576 1805612259 585992009 1550141448 927518680 1785799008 2834189089 2984886552 1673343472 2530642959 255 362436" option to reproduce the execution

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4093291-1467246664/watcher-4093291-1467246664 -o /tmp/evaluation-result-4093291-1467246664/solver-4093291-1467246664 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1467246664-5965 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093291-1467246664.wbo 

pid=5986
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.31 0.49 0.77 3/172 5990
/proc/meminfo: memFree=28550552/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=542140 CPUtime=0 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 1991 0 0 0 0 0 0 0 20 0 4 0 3694036 555151360 2353 33554432000 4194304 16246674 140736212273232 140736212272656 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 136303 2362 441 2943 0 133197 0
[pid=5990/tid=5997] ppid=5986 vsize=559548 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 572977152 2420 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=564668 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 578220032 2439 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=568764 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 582414336 2456 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100176 s]
/proc/loadavg: 0.31 0.49 0.77 3/172 5990
/proc/meminfo: memFree=28550552/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1302084 CPUtime=0.08 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 28575 0 0 0 5 3 0 0 20 0 4 0 3694036 1333334016 28877 33554432000 4194304 16246674 140736212273232 140736212272544 7889646 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 325521 28893 801 2943 0 322415 0
[pid=5990/tid=5997] ppid=5986 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1333334016 28905 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1333334016 28916 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1302084 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1333334016 28927 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 1302084

[startup+0.200484 s]
/proc/loadavg: 0.31 0.49 0.77 3/172 5990
/proc/meminfo: memFree=28550552/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1312324 CPUtime=0.19 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 48363 0 0 0 13 6 0 0 20 0 4 0 3694036 1343819776 49175 33554432000 4194304 16246674 140736212273232 140736212272544 13923665 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 328081 49175 802 2943 0 324975 0
[pid=5990/tid=5997] ppid=5986 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1343819776 49175 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1343819776 49175 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1343819776 49175 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1312324

[startup+0.300514 s]
/proc/loadavg: 0.31 0.49 0.77 3/172 5990
/proc/meminfo: memFree=28550552/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1312324 CPUtime=0.29 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 54002 0 0 0 23 6 0 0 20 0 4 0 3694036 1343819776 54814 33554432000 4194304 16246674 140736212273232 140736212272544 4206877 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 328081 54814 802 2943 0 324975 0
[pid=5990/tid=5997] ppid=5986 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1343819776 54814 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1343819776 54814 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1343819776 54814 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1312324

[startup+0.700385 s]
/proc/loadavg: 0.31 0.49 0.77 3/172 5990
/proc/meminfo: memFree=28550552/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1313348 CPUtime=0.69 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 65238 0 0 0 61 8 0 0 20 0 4 0 3694036 1344868352 66050 33554432000 4194304 16246674 140736212273232 140736212256224 4220897 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 328337 66050 803 2943 0 325231 0
[pid=5990/tid=5997] ppid=5986 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1344868352 66050 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1344868352 66050 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1344868352 66050 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1313348

[startup+1.50035 s]
/proc/loadavg: 0.31 0.49 0.77 3/183 6001
/proc/meminfo: memFree=27869044/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1313348 CPUtime=1.48 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 116753 0 0 0 132 16 0 0 20 0 4 0 3694036 1344868352 117566 33554432000 4194304 16246674 140736212273232 140736212255104 12500869 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 328337 117573 830 2943 0 325231 0
[pid=5990/tid=5997] ppid=5986 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1344868352 117579 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1344868352 117582 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1313348 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1344868352 117587 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 1313348

[startup+3.10036 s]
/proc/loadavg: 0.44 0.51 0.78 3/183 6001
/proc/meminfo: memFree=27342780/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1321540 CPUtime=3.08 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 234004 0 0 0 276 32 0 0 20 0 4 0 3694036 1353256960 234816 33554432000 4194304 16246674 140736212273232 140736212255104 6132531 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 330385 234816 833 2943 0 327279 0
[pid=5990/tid=5997] ppid=5986 vsize=1321540 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1353256960 234816 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1321540 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1353256960 234816 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1321540 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1353256960 234816 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 1321540

[startup+6.30038 s]
/proc/loadavg: 0.44 0.51 0.78 3/183 6001
/proc/meminfo: memFree=26410384/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1321540 CPUtime=6.29 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 271001 0 0 0 590 39 0 0 20 0 4 0 3694036 1353256960 271813 33554432000 4194304 16246674 140736212273232 140736212255104 4220543 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 330385 271813 835 2943 0 327279 0
[pid=5990/tid=5997] ppid=5986 vsize=1321540 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1353256960 271813 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1321540 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1353256960 271813 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1321540 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1353256960 271813 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1321540

[startup+12.7003 s]
/proc/loadavg: 0.76 0.58 0.80 4/183 6001
/proc/meminfo: memFree=26194504/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=12.69 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293797 0 0 0 1227 42 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 140736212255104 6132712 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294609 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1412676

[startup+25.5003 s]
/proc/loadavg: 0.95 0.62 0.81 3/183 6001
/proc/meminfo: memFree=26196060/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=25.49 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293797 0 0 0 2507 42 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 140736212255104 13774056 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294609 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 1412676

[startup+51.1003 s]
/proc/loadavg: 1.44 0.76 0.85 3/183 6001
/proc/meminfo: memFree=26196252/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=51.08 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293797 0 0 0 5066 42 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 140736212255104 13774087 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294609 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1412676

[startup+102.3 s]
/proc/loadavg: 2.26 1.11 0.96 3/183 6002
/proc/meminfo: memFree=26196008/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=102.28 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293797 0 0 0 10186 42 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 140736212255104 6132671 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294609 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1412676


################
# More data... #
################

/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294609 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1302.09
Current children cumulated vsize (KiB) 1412676

[startup+1362.3 s]
/proc/loadavg: 2.33 2.28 1.91 3/183 6033
/proc/meminfo: memFree=26192688/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1362.08 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293797 0 0 0 136165 43 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 13807608 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1362.08
Current children cumulated vsize (KiB) 1412676

[startup+1422.3 s]
/proc/loadavg: 2.43 2.33 1.95 3/183 6034
/proc/meminfo: memFree=26192796/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1422.08 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293797 0 0 0 142164 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 6132488 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1422.08
Current children cumulated vsize (KiB) 1412676

[startup+1482.3 s]
/proc/loadavg: 2.48 2.36 1.98 4/183 6035
/proc/meminfo: memFree=26192532/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1482.07 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293802 0 0 0 148163 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 6132712 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1482.07
Current children cumulated vsize (KiB) 1412676

[startup+1542.31 s]
/proc/loadavg: 2.65 2.42 2.02 3/183 6036
/proc/meminfo: memFree=26192320/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1542.06 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293802 0 0 0 154162 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 13807696 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1542.06
Current children cumulated vsize (KiB) 1412676

[startup+1602.3 s]
/proc/loadavg: 2.32 2.37 2.03 3/183 6036
/proc/meminfo: memFree=26192724/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1602.05 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293802 0 0 0 160161 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 6132704 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1602.05
Current children cumulated vsize (KiB) 1412676

[startup+1662.3 s]
/proc/loadavg: 2.37 2.39 2.05 4/183 6037
/proc/meminfo: memFree=26193016/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1662.04 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293802 0 0 0 166160 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 13774216 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1662.04
Current children cumulated vsize (KiB) 1412676

[startup+1722.3 s]
/proc/loadavg: 2.39 2.40 2.08 4/183 6039
/proc/meminfo: memFree=26193044/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1722.03 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293804 0 0 0 172159 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 13774216 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1722.03
Current children cumulated vsize (KiB) 1412676

[startup+1782.3 s]
/proc/loadavg: 2.42 2.40 2.10 3/184 6043
/proc/meminfo: memFree=26192724/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1782.02 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293807 0 0 0 178158 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 13807544 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1782.02
Current children cumulated vsize (KiB) 1412676



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.38 2.39 2.10 4/185 6066
/proc/meminfo: memFree=26191052/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1800.01 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293807 0 0 0 179957 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 13807582 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1412676

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 5990 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.3 s]
/proc/loadavg: 2.38 2.39 2.10 4/185 6066
/proc/meminfo: memFree=26191052/32872528 swapFree=1555460/1718980
[pid=5990] ppid=5986 vsize=1412676 CPUtime=1800.01 cores=1,3,5,7
/proc/5990/stat : 5990 (toysat) R 5986 5990 5948 0 -1 4202496 293807 0 0 0 179957 44 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 140736212255104 13807582 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/5990/statm: 353169 294865 844 2943 0 350063 0
[pid=5990/tid=5997] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5997/stat : 5997 (toysat) S 5986 5990 5948 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656053107952 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=5990/tid=5998] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5998/stat : 5998 (toysat) S 5986 5990 5948 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139656042618096 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=5990/tid=5999] ppid=5986 vsize=1412676 CPUtime=0 cores=1,3,5,7
/proc/5990/task/5999/stat : 5999 (toysat) S 5986 5990 5948 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 3694036 1446580224 294865 33554432000 4194304 16246674 140736212273232 139655961898160 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1412676

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.33
CPU time (s): 1800.05
CPU user time (s): 1799.58
CPU system time (s): 0.464929
CPU usage (%): 99.9844
Max. virtual memory (cumulated for all children) (KiB): 1412676

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.58
system time used= 0.464929
maximum resident set size= 1179460
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 293807
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33
involuntary context switches= 2024

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.94025 second user time and 7.56085 second system time

The end

Launcher Data 

Begin job on node117 at 2016-06-30 02:31:04
IDJOB=4093291
IDBENCH=79527
IDSOLVER=2553
FILE ID=node117/4093291-1467246664
RUNJOBID= node117-1467246664-5965
PBS_JOBID= 20004471
Free space on /tmp= 71612 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/PARTIAL-BIGINT-LIN/wcsp/warehouse/normalized-capmq1_wcsp.wbo
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --wbo --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4093291-1467246664/watcher-4093291-1467246664 -o /tmp/evaluation-result-4093291-1467246664/solver-4093291-1467246664 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node117-1467246664-5965 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --wbo --search=bcd2 HOME/instance-4093291-1467246664.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e8bcb76dae4005526534cba50c92556d
RANDOM SEED=465655412

node117.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.42
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.714
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28551452 kB
Buffers:           77908 kB
Cached:          1792636 kB
SwapCached:            0 kB
Active:           181244 kB
Inactive:        1702300 kB
Active(anon):      15888 kB
Inactive(anon):        0 kB
Active(file):     165356 kB
Inactive(file):  1702300 kB
Unevictable:     1718980 kB
Mlocked:         1555460 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             45028 kB
Writeback:             0 kB
AnonPages:       1732552 kB
Mapped:            13636 kB
Shmem:               204 kB
Slab:             583360 kB
SReclaimable:      28220 kB
SUnreclaim:       555140 kB
KernelStack:        1360 kB
PageTables:         7224 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1817840 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    165888 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71580 MiB
End job on node117 at 2016-06-30 03:01:05