Trace number 4079172

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (TO) 1800.09 1800.44

General information on the benchmark

Name/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/
datasets/10orplus/normalized-mercurial-common.cudf.trendy.opb
MD5SUM6bb48d2b0ff46f6e7b073e580100f5b4
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2626215701393
Best CPU time to get the best result obtained on this benchmark377.682
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables21105
Total number of constraints100043
Number of constraints which are clauses98478
Number of constraints which are cardinality constraints (but not clauses)1565
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint2962
Number of terms in the objective function 8588
Biggest coefficient in the objective function 79285326336
Number of bits for the biggest coefficient in the objective function 37
Sum of the numbers in the objective function 234763814370998
Number of bits of the sum of numbers in the objective function 48
Biggest number in a constraint 79285326336
Number of bits of the biggest number in a constraint 37
Biggest sum of numbers in a constraint 234763814370998
Number of bits of the biggest sum of numbers48
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c 2016-06-07T05:53:21+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4079172-1465271601.opb"]
0.00/0.01	c use --random-gen="4013425397 739126090 4273493716 3272779505 3418424261 2692818655 3950925057 79074736 3389915687 4133460903 1494968157 2549566976 4030170546 2663440639 3390105706 3552233896 1006319074 2760698358 4009166558 4079389492 3336283331 970280054 747543645 464816804 923683372 2655100399 1155016730 994322522 128759899 2369075521 1725773869 2876521622 2262850896 3140417965 3790843689 451379882 2244303383 1899920434 214970907 1732573350 1948779489 1688068527 2549829115 2140128839 1455310941 3132148158 180406771 4118353874 845178690 2335980553 20737318 3616768904 2538146007 570797696 2732173738 3298503102 727351928 1191976286 833924820 4289425344 3634453230 3933489580 1755618424 3333259844 2967593113 759616444 1305131882 3353187864 2598475455 1843757163 2419275069 1032737447 3209492226 4098952860 4187299200 2628420494 1843520421 1786128160 3266068574 3161887188 1887187176 965844684 2009937703 2181379625 1559946656 3787543014 72313308 4253237449 2811239349 2990168622 102398036 578231724 2759952464 3195071254 2595576237 1731638695 2719061523 749319358 3597094027 580564122 2054307116 2901849933 1534132868 3869720011 965403027 2724572364 2787683445 30997008 2007726180 3044681236 4239194913 2519931665 2403124520 4132051515 3643702818 3813278211 3765873980 1190483742 2441670489 1175377981 295524285 3727950432 4192704870 1418727397 1836276300 1412254794 3422444773 818219556 1386158608 355226418 4279269723 1627599630 2164453394 3983518822 1841774094 440531306 517199727 4225535825 351042836 1068882178 1770907505 1049724404 3631515995 3852843356 4233721786 5480047 1625235505 3136675280 127846568 3389350669 740300978 2517597256 1114387012 1202606479 2648188881 1994730936 1529015382 86423319 2225810725 1044766470 2305716733 2945573381 4072266167 1286420553 1547944566 2325056542 3259481104 3921595444 3697764825 968913115 1217876818 3648909753 3877618266 1709103485 1733549009 1669351204 4159646600 785093994 1910053558 4005452076 653029010 2323984201 3851854084 799402520 114955825 4135609968 4047597351 2263520011 1983429639 949215283 1893463424 801691947 2983364814 1369406151 593050949 827085880 803156653 2974969790 1812636216 2902102013 1770723289 1593403261 3347018363 1724266854 639208994 1540266223 3463694425 288886994 2500831446 2162814235 97318803 608569788 82903044 3952536386 2487826778 310036559 1940801502 1108322631 277877507 915233305 870958074 1355849352 1859067008 1110588063 2086966032 1581176863 379208851 1715030068 56399600 175000795 2876807685 2810714462 2042586039 3832231035 638280001 2464705645 2752172510 533940130 3505882699 3858250630 1605036773 4024200319 2914222181 515339765 2699913167 4169343088 3349120340 52312564 3758655614 508645027 985496651 1012464299 1473235335 1493401341 2605351440 3986317573 255 362436" option to reproduce the execution
0.69/0.72	c #vars 21105
0.69/0.72	c #constraints 100043
2.19/2.29	c BCD2: Hardening is enabled.
2.19/2.29	c BCD2: BiasedSearch is enabled.
2.19/2.29	c Solving starts ...
2.19/2.29	c ============================[ Search Statistics ]============================
2.19/2.29	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
2.19/2.29	c       |         |          |          |    Limit     GC | Var      | Constra 
2.19/2.29	c =============================================================================
2.19/2.29	c  0.0s |       0 |        0 |        0 |    39940      0 |     1202 |        0
2.99/3.07	c  0.8s |       1 |    88476 |      100 |    39940      0 |     1202 |     1291
4.99/5.02	c  2.7s |       2 |   295441 |      250 |    43934      0 |     1202 |     1291
5.89/5.98	c  3.7s |       2 |   421615 |      355 |    48328      0 |     1202 |     1291
5.89/5.98	c #cpu_time = 3.682s
5.89/5.98	c #wall_clock_time = 3.682s
5.89/5.98	c #decision = 421615
5.89/5.98	c #random_decision = 1150
5.89/5.98	c #conflict = 355
5.89/5.98	c #restart = 2
5.89/5.98	o 49119954186261

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4079172-1465271601/watcher-4079172-1465271601 -o /tmp/evaluation-result-4079172-1465271601/solver-4079172-1465271601 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node119-1465252213-5799 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079172-1465271601.opb 

pid=8879
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.13 2.19 2.18 3/179 8882
/proc/meminfo: memFree=29339912/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=765372 CPUtime=0 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 2863 0 0 0 0 0 0 0 20 0 4 0 109093279 783740928 3223 33554432000 4194304 16246674 140736956041952 140736956041376 13880264 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 192111 3232 441 2943 0 189005 0
[pid=8882/tid=8883] ppid=8879 vsize=782780 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 801566720 3292 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=787900 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 806809600 3309 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=791996 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 811003904 3327 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0

[startup+0.100128 s]
/proc/loadavg: 2.13 2.19 2.18 3/179 8882
/proc/meminfo: memFree=29339912/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1303108 CPUtime=0.09 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 31795 0 0 0 5 4 0 0 20 0 4 0 109093279 1334382592 32093 33554432000 4194304 16246674 140736956041952 140736956041264 12752373 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 325777 32107 799 2943 0 322671 0
[pid=8882/tid=8883] ppid=8879 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1334382592 32118 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1334382592 32129 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1303108 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1334382592 32140 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.20049 s]
/proc/loadavg: 2.13 2.19 2.18 3/179 8882
/proc/meminfo: memFree=29339912/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1314372 CPUtime=0.19 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 50584 0 0 0 13 6 0 0 20 0 4 0 109093279 1345916928 51393 33554432000 4194304 16246674 140736956041952 140736956041264 13923640 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 328593 51393 799 2943 0 325487 0
[pid=8882/tid=8883] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 51393 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 51393 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 51393 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1314372

[startup+0.30053 s]
/proc/loadavg: 2.13 2.19 2.18 3/179 8882
/proc/meminfo: memFree=29339912/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1314372 CPUtime=0.29 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 60967 0 0 0 22 7 0 0 20 0 4 0 109093279 1345916928 61776 33554432000 4194304 16246674 140736956041952 140736956041264 7373347 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 328593 61776 800 2943 0 325487 0
[pid=8882/tid=8883] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 61776 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 61776 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 61776 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1314372

[startup+0.700417 s]
/proc/loadavg: 2.13 2.19 2.18 3/179 8882
/proc/meminfo: memFree=29339912/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1314372 CPUtime=0.69 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 75045 0 0 0 61 8 0 0 20 0 4 0 109093279 1345916928 75854 33554432000 4194304 16246674 140736956041952 140736956041264 4221129 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 328593 75854 801 2943 0 325487 0
[pid=8882/tid=8883] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 75854 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 75854 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1314372 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1345916928 75854 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1314372

[startup+1.50039 s]
/proc/loadavg: 2.12 2.19 2.17 3/183 8886
/proc/meminfo: memFree=28876124/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1319492 CPUtime=1.49 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 195679 0 0 0 123 26 0 0 20 0 4 0 109093279 1351159808 196488 33554432000 4194304 16246674 140736956041952 140736956023872 6756128 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 329873 196496 840 2943 0 326767 0
[pid=8882/tid=8883] ppid=8879 vsize=1319492 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1351159808 196502 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1319492 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1351159808 196508 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1319492 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1351159808 196513 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1319492

[startup+3.1004 s]
/proc/loadavg: 2.12 2.19 2.17 3/183 8886
/proc/meminfo: memFree=28237028/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1337924 CPUtime=3.09 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 275093 0 0 0 269 40 0 0 20 0 4 0 109093279 1370034176 275902 33554432000 4194304 16246674 140736956041952 140736956023872 5531312 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 334481 275902 889 2943 0 331375 0
[pid=8882/tid=8883] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275902 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275902 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275902 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1337924

[startup+6.30041 s]
/proc/loadavg: 2.19 2.20 2.18 3/183 8886
/proc/meminfo: memFree=28236452/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1337924 CPUtime=6.29 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 275170 0 0 0 589 40 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140736956023872 12654434 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 334481 275979 903 2943 0 331375 0
[pid=8882/tid=8883] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1337924

[startup+12.7004 s]
/proc/loadavg: 2.18 2.20 2.18 3/183 8886
/proc/meminfo: memFree=28236492/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1337924 CPUtime=12.69 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 275170 0 0 0 1229 40 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140736956023872 12654399 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 334481 275979 903 2943 0 331375 0
[pid=8882/tid=8883] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1337924

[startup+25.5005 s]
/proc/loadavg: 2.22 2.20 2.18 3/183 8886
/proc/meminfo: memFree=28236776/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1337924 CPUtime=25.48 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 275170 0 0 0 2508 40 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140736956039744 12429820 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 334481 275979 903 2943 0 331375 0
[pid=8882/tid=8883] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1337924

[startup+51.1005 s]
/proc/loadavg: 2.20 2.20 2.18 3/183 8887
/proc/meminfo: memFree=28236784/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1337924 CPUtime=51.08 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 275170 0 0 0 5068 40 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140736956023872 12429788 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 334481 275979 903 2943 0 331375 0
[pid=8882/tid=8883] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1337924 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1370034176 275979 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1337924

[startup+102.301 s]
/proc/loadavg: 2.21 2.21 2.18 3/183 8888
/proc/meminfo: memFree=28236188/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1338948 CPUtime=102.28 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 275189 0 0 0 10188 40 0 0 20 0 4 0 109093279 1371082752 275998 33554432000 4194304 16246674 140736956041952 140736956023872 12413960 0 0 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 334737 275998 903 2943 0 331631 0
[pid=8882/tid=8883] ppid=8879 vsize=1338948 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1371082752 275998 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1338948 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1371082752 275998 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 0 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1338948 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1371082752 275998 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1338948


################
# More data... #
################

/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1474891776 301580 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1242.1
Current children cumulated vsize (KiB) 1440324

[startup+1302.3 s]
/proc/loadavg: 2.13 2.16 2.16 3/183 8942
/proc/meminfo: memFree=27944796/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1518148 CPUtime=1302.08 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 320230 0 0 0 130160 48 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140736956039808 4225157 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 379537 321292 903 2943 0 376431 0
[pid=8882/tid=8883] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520740330512 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 1518148

[startup+1362.3 s]
/proc/loadavg: 2.14 2.16 2.16 3/183 8943
/proc/meminfo: memFree=27859888/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1518148 CPUtime=1362.06 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 320233 0 0 0 136158 48 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140736956039808 4220897 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 379537 321292 903 2943 0 376431 0
[pid=8882/tid=8883] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1362.06
Current children cumulated vsize (KiB) 1518148

[startup+1422.3 s]
/proc/loadavg: 2.27 2.19 2.17 3/183 8944
/proc/meminfo: memFree=27851960/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1518148 CPUtime=1422.07 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 320236 0 0 0 142158 49 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140736956041264 4221122 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 379537 321292 903 2943 0 376431 0
[pid=8882/tid=8883] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1518148 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1554583552 321292 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1422.07
Current children cumulated vsize (KiB) 1518148

[startup+1482.3 s]
/proc/loadavg: 2.12 2.15 2.16 3/183 8945
/proc/meminfo: memFree=27829140/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1540676 CPUtime=1482.04 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 325869 0 0 0 148155 49 0 0 20 0 4 0 109093279 1577652224 326924 33554432000 4194304 16246674 140736956041952 140736956041128 4220543 0 2 0 34082818 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/8882/statm: 385169 326924 903 2943 0 382063 0
[pid=8882/tid=8883] ppid=8879 vsize=1540676 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1577652224 326924 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1540676 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1577652224 326924 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1540676 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1577652224 326924 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 1540676

[startup+1542.31 s]
/proc/loadavg: 2.20 2.17 2.17 3/183 8946
/proc/meminfo: memFree=27817016/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1547844 CPUtime=1542.02 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 327662 0 0 0 154152 50 0 0 20 0 4 0 109093279 1584992256 328716 33554432000 4194304 16246674 140736956041952 140736956023872 4220507 0 2 0 34082818 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8882/statm: 386961 328716 903 2943 0 383855 0
[pid=8882/tid=8883] ppid=8879 vsize=1547844 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1584992256 328716 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1547844 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1584992256 328716 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1547844 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1584992256 328716 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1542.02
Current children cumulated vsize (KiB) 1547844

[startup+1602.3 s]
/proc/loadavg: 2.23 2.18 2.17 4/184 8951
/proc/meminfo: memFree=27781432/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1563204 CPUtime=1601.99 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 331502 0 0 0 160148 51 0 0 20 0 4 0 109093279 1600720896 332556 33554432000 4194304 16246674 140736956041952 140736956023872 13965680 0 0 0 34082818 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/8882/statm: 390801 332556 903 2943 0 387695 0
[pid=8882/tid=8883] ppid=8879 vsize=1563204 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1600720896 332556 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1563204 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 109093279 1600720896 332556 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1563204 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1600720896 332556 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1601.99
Current children cumulated vsize (KiB) 1563204

[startup+1662.3 s]
/proc/loadavg: 2.30 2.20 2.18 3/183 8952
/proc/meminfo: memFree=27768844/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1571396 CPUtime=1661.96 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 333553 0 0 0 166145 51 0 0 20 0 4 0 109093279 1609109504 334604 33554432000 4194304 16246674 140736956041952 140736956023872 13885029 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8882/statm: 392849 334604 903 2943 0 389743 0
[pid=8882/tid=8883] ppid=8879 vsize=1571396 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1609109504 334604 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1571396 CPUtime=0.01 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 109093279 1609109504 334604 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1571396 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1609109504 334604 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1661.96
Current children cumulated vsize (KiB) 1571396

[startup+1722.3 s]
/proc/loadavg: 2.21 2.20 2.18 3/183 8953
/proc/meminfo: memFree=27753388/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1576516 CPUtime=1721.95 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 334835 0 0 0 172144 51 0 0 20 0 4 0 109093279 1614352384 335884 33554432000 4194304 16246674 140736956041952 140736956023872 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8882/statm: 394129 335884 903 2943 0 391023 0
[pid=8882/tid=8883] ppid=8879 vsize=1576516 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1614352384 335884 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1576516 CPUtime=0.01 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 109093279 1614352384 335884 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1576516 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1614352384 335884 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1721.95
Current children cumulated vsize (KiB) 1576516

[startup+1782.3 s]
/proc/loadavg: 2.28 2.22 2.18 3/183 9003
/proc/meminfo: memFree=28226972/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1579588 CPUtime=1781.94 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 335608 0 0 0 178143 51 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140736956039744 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8882/statm: 394897 336652 903 2943 0 391791 0
[pid=8882/tid=8883] ppid=8879 vsize=1579588 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1579588 CPUtime=0.01 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1579588 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1781.94
Current children cumulated vsize (KiB) 1579588



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.22 2.21 2.18 3/183 9003
/proc/meminfo: memFree=28008336/32872528 swapFree=16252/1391864
[pid=8882] ppid=8879 vsize=1579588 CPUtime=1800.03 cores=0,2,4,6
/proc/8882/stat : 8882 (toysat) R 8879 8882 5783 0 -1 4202496 335609 0 0 0 179952 51 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140736956023872 4220897 0 2 0 34082818 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8882/statm: 394897 336652 903 2943 0 391791 0
[pid=8882/tid=8883] ppid=8879 vsize=1579588 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8883/stat : 8883 (toysat) S 8879 8882 5783 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140520750820592 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8884] ppid=8879 vsize=1579588 CPUtime=0.01 cores=0,2,4,6
/proc/8882/task/8884/stat : 8884 (toysat) S 8879 8882 5783 0 -1 4202560 8 0 0 0 0 1 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140520740330736 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 4 0 0 0 0 0
[pid=8882/tid=8885] ppid=8879 vsize=1579588 CPUtime=0 cores=0,2,4,6
/proc/8882/task/8885/stat : 8885 (toysat) S 8879 8882 5783 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 109093279 1617498112 336652 33554432000 4194304 16246674 140736956041952 140520659610800 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 1579588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 8882 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1800.44
CPU time (s): 1800.09
CPU user time (s): 1799.53
CPU system time (s): 0.556915
CPU usage (%): 99.9806
Max. virtual memory (cumulated for all children) (KiB): 1579588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.53
system time used= 0.556915
maximum resident set size= 1346608
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 335609
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1829
involuntary context switches= 2581

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.4461 second user time and 16.5135 second system time

The end

Launcher Data

Begin job on node119 at 2016-06-07 05:53:21
IDJOB=4079172
IDBENCH=72395
IDSOLVER=2542
FILE ID=node119/4079172-1465271601
RUNJOBID= node119-1465252213-5799
PBS_JOBID= 19843259
Free space on /tmp= 71716 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB10/normalized-PB10/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/datasets/10orplus/normalized-mercurial-common.cudf.trendy.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4079172-1465271601/watcher-4079172-1465271601 -o /tmp/evaluation-result-4079172-1465271601/solver-4079172-1465271601 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node119-1465252213-5799 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4079172-1465271601.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6bb48d2b0ff46f6e7b073e580100f5b4
RANDOM SEED=907179116

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.410
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29340192 kB
Buffers:          121664 kB
Cached:           177448 kB
SwapCached:          888 kB
Active:          1241876 kB
Inactive:         164624 kB
Active(anon):    1107948 kB
Inactive(anon):     1712 kB
Active(file):     133928 kB
Inactive(file):   162912 kB
Unevictable:     1391864 kB
Mlocked:           16252 kB
SwapTotal:      67108856 kB
SwapFree:       67100176 kB
Dirty:             40036 kB
Writeback:            40 kB
AnonPages:       2623608 kB
Mapped:            10996 kB
Shmem:                 0 kB
Slab:             600416 kB
SReclaimable:      44156 kB
SUnreclaim:       556260 kB
KernelStack:        1472 kB
PageTables:         9008 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2639824 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1509376 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71700 MiB
End job on node119 at 2016-06-07 06:23:22