Trace number 3385888

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3883.25 1300.14

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x39.cnf
MD5SUMe7679ca49bb432c9b90305d907365c4e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3276
Number of clauses628173
Sum of the clauses size2502864
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24914
Number of clauses of size 30
Number of clauses of size 4623259
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385888-1305581347/watcher-3385888-1305581347 -o /tmp/evaluation-result-3385888-1305581347/solver-3385888-1305581347 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385888-1305581347.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.67 6.38 7.92 6/398 26727
/proc/meminfo: memFree=22753932/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=35064 CPUtime=0.01 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 1176 0 0 0 1 0 0 0 25 0 1 0 669732911 35905536 908 33554432000 4194304 4625164 140733482801600 18446744073709551615 232335892224 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26727/statm: 8766 908 296 106 0 4269 0

[startup+0.035919 s]
/proc/loadavg: 4.67 6.38 7.92 6/398 26727
/proc/meminfo: memFree=22753932/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=38212 CPUtime=0.02 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 3092 0 0 0 2 0 0 0 25 0 1 0 669732911 39129088 1802 33554432000 4194304 4625164 140733482801600 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26727/statm: 9553 1805 296 106 0 5056 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 38212

[startup+0.100919 s]
/proc/loadavg: 4.67 6.38 7.92 6/398 26727
/proc/meminfo: memFree=22753932/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=47340 CPUtime=0.08 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 8373 0 0 0 8 0 0 0 25 0 1 0 669732911 48476160 4440 33554432000 4194304 4625164 140733482801600 18446744073709551615 232335935578 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26727/statm: 13058 4467 296 106 0 8561 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 47340

[startup+0.300851 s]
/proc/loadavg: 4.67 6.38 7.92 6/398 26727
/proc/meminfo: memFree=22753932/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=88200 CPUtime=0.29 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 25035 0 0 0 26 3 0 0 25 0 1 0 669732911 90316800 14137 33554432000 4194304 4625164 140733482801600 18446744073709551615 232335589845 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/26727/statm: 22050 14157 296 106 0 17553 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 88200

[startup+0.700747 s]
/proc/loadavg: 4.67 6.38 7.92 6/398 26727
/proc/meminfo: memFree=22753932/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=398544 CPUtime=1.18 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 58875 0 0 0 111 7 0 0 25 0 4 0 669732911 408109056 42423 33554432000 4194304 4625164 140733482801600 18446744073709551615 4329101 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26727/statm: 99636 42423 339 106 0 95139 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 398544

[startup+1.5006 s]
/proc/loadavg: 4.67 6.38 7.92 10/402 26731
/proc/meminfo: memFree=22558112/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=398544 CPUtime=3.56 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 80456 0 0 0 345 11 0 0 25 0 4 0 669732911 408109056 50156 33554432000 4194304 4625164 140733482801600 18446744073709551615 4392987 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26727/statm: 99636 50156 339 106 0 95139 0
[pid=26727/tid=26729] ppid=26725 vsize=398544 CPUtime=0.97 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 4088 0 0 0 97 0 0 0 19 0 4 0 669732956 408109056 50156 33554432000 4194304 4625164 140733482801600 18446744073709551615 4467222 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=398544 CPUtime=0.2 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 3044 0 0 0 20 0 0 0 25 0 4 0 669732956 408109056 50156 33554432000 4194304 4625164 140733482801600 18446744073709551615 4462619 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=398544 CPUtime=0.9 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 21776 0 0 0 87 3 0 0 25 0 4 0 669732956 408109056 50156 33554432000 4194304 4625164 140733482801600 18446744073709551615 4552363 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.56
Current children cumulated vsize (KiB) 398544

[startup+3.10032 s]
/proc/loadavg: 4.67 6.38 7.92 10/402 26731
/proc/meminfo: memFree=22514104/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=406976 CPUtime=8.35 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 111048 0 0 0 819 16 0 0 25 0 4 0 669732911 416743424 53430 33554432000 4194304 4625164 140733482801600 18446744073709551615 4329142 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26727/statm: 101744 53430 339 106 0 97247 0
[pid=26727/tid=26729] ppid=26725 vsize=406976 CPUtime=2.38 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 8823 0 0 0 237 1 0 0 21 0 4 0 669732956 416743424 53430 33554432000 4194304 4625164 140733482801600 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=406976 CPUtime=1.41 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 3668 0 0 0 141 0 0 0 25 0 4 0 669732956 416743424 53430 33554432000 4194304 4625164 140733482801600 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=406976 CPUtime=1.66 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 46772 0 0 0 159 7 0 0 25 0 4 0 669732956 416743424 53430 33554432000 4194304 4625164 140733482801600 18446744073709551615 4334488 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 8.35
Current children cumulated vsize (KiB) 406976

[startup+6.30075 s]
/proc/loadavg: 5.10 6.44 7.93 10/402 26731
/proc/meminfo: memFree=22430404/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=423740 CPUtime=17.9 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 172850 0 0 0 1767 23 0 0 25 0 4 0 669732911 433909760 57929 33554432000 4194304 4625164 140733482801600 18446744073709551615 232335997422 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26727/statm: 105935 57929 339 106 0 101438 0
[pid=26727/tid=26729] ppid=26725 vsize=423740 CPUtime=5.58 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 10038 0 0 0 557 1 0 0 25 0 4 0 669732956 433909760 57929 33554432000 4194304 4625164 140733482801600 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=423740 CPUtime=3.09 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 9039 0 0 0 308 1 0 0 25 0 4 0 669732956 433909760 57929 33554432000 4194304 4625164 140733482801600 18446744073709551615 4352831 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=423740 CPUtime=3.61 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 97506 0 0 0 349 12 0 0 25 0 4 0 669732956 433909760 57929 33554432000 4194304 4625164 140733482801600 18446744073709551615 232335589753 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 17.9
Current children cumulated vsize (KiB) 423740

[startup+12.7006 s]
/proc/loadavg: 5.41 6.48 7.94 10/402 26731
/proc/meminfo: memFree=22297984/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=436340 CPUtime=37.02 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 394673 0 0 0 3652 50 0 0 25 0 4 0 669732911 446812160 68341 33554432000 4194304 4625164 140733482801600 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26727/statm: 109085 68341 339 106 0 104588 0
[pid=26727/tid=26729] ppid=26725 vsize=436340 CPUtime=11.98 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 18289 0 0 0 1196 2 0 0 25 0 4 0 669732956 446812160 68341 33554432000 4194304 4625164 140733482801600 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=436340 CPUtime=6.3 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 10623 0 0 0 629 1 0 0 25 0 4 0 669732956 446812160 68341 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=436340 CPUtime=9.33 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 309233 0 0 0 896 37 0 0 25 0 4 0 669732956 446812160 68341 33554432000 4194304 4625164 140733482801600 18446744073709551615 232335559642 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37.02
Current children cumulated vsize (KiB) 436340

[startup+25.5003 s]
/proc/loadavg: 6.20 6.61 7.95 10/402 26731
/proc/meminfo: memFree=22095872/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=505704 CPUtime=75.24 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 623383 0 0 0 7443 81 0 0 25 0 4 0 669732911 517840896 82639 33554432000 4194304 4625164 140733482801600 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26727/statm: 126426 82639 339 106 0 121929 0
[pid=26727/tid=26729] ppid=26725 vsize=505704 CPUtime=24.77 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 21362 0 0 0 2474 3 0 0 25 0 4 0 669732956 517840896 82639 33554432000 4194304 4625164 140733482801600 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=505704 CPUtime=12.71 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 14225 0 0 0 1268 3 0 0 25 0 4 0 669732956 517840896 82639 33554432000 4194304 4625164 140733482801600 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=505704 CPUtime=15.57 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 530715 0 0 0 1490 67 0 0 25 0 4 0 669732956 517840896 82639 33554432000 4194304 4625164 140733482801600 18446744073709551615 4579428 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 75.24
Current children cumulated vsize (KiB) 505704

[startup+51.1008 s]
/proc/loadavg: 7.22 6.81 7.98 10/402 26732
/proc/meminfo: memFree=21774884/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=655972 CPUtime=151.62 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 1068772 0 0 0 15007 155 0 0 25 0 4 0 669732911 671715328 114136 33554432000 4194304 4625164 140733482801600 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 163993 114136 342 106 0 159496 0
[pid=26727/tid=26729] ppid=26725 vsize=655972 CPUtime=50.3 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 38250 0 0 0 5024 6 0 0 25 0 4 0 669732956 671715328 114136 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=655972 CPUtime=26.21 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 32071 0 0 0 2606 15 0 0 25 0 4 0 669732956 671715328 114136 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=655972 CPUtime=27.69 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 931862 0 0 0 2646 123 0 0 25 0 4 0 669732956 671715328 114136 33554432000 4194304 4625164 140733482801600 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 151.62
Current children cumulated vsize (KiB) 655972

[startup+102.316 s]
/proc/loadavg: 8.40 7.20 8.05 10/402 26733
/proc/meminfo: memFree=21172236/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=894184 CPUtime=304.5 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 1862856 0 0 0 30171 279 0 0 25 0 4 0 669732911 915644416 171189 33554432000 4194304 4625164 140733482801600 18446744073709551615 4329142 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26727/statm: 223546 171189 550 106 0 219049 0
[pid=26727/tid=26729] ppid=26725 vsize=894184 CPUtime=97.15 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 65184 0 0 0 9704 11 0 0 25 0 4 0 669732956 915644416 171189 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=894184 CPUtime=53.6 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 57577 0 0 0 5329 31 0 0 25 0 4 0 669732956 915644416 171189 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=894184 CPUtime=55.85 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 1663460 0 0 0 5359 226 0 0 25 0 4 0 669732956 915644416 171189 33554432000 4194304 4625164 140733482801600 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 304.5
Current children cumulated vsize (KiB) 894184

[startup+162.301 s]
/proc/loadavg: 8.96 7.58 8.13 10/402 26735
/proc/meminfo: memFree=20670260/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=1118172 CPUtime=483.69 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 2983610 0 0 0 47926 443 0 0 25 0 4 0 669732911 1145008128 224041 33554432000 4194304 4625164 140733482801600 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26727/statm: 279543 224041 342 106 0 275046 0
[pid=26727/tid=26729] ppid=26725 vsize=1118172 CPUtime=143.04 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 97020 0 0 0 14288 16 0 0 25 0 4 0 669732956 1145008128 224041 33554432000 4194304 4625164 140733482801600 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=1118172 CPUtime=87.03 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 68919 0 0 0 8668 35 0 0 25 0 4 0 669732956 1145008128 224041 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=1118172 CPUtime=99.18 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 2730678 0 0 0 9539 379 0 0 25 0 4 0 669732956 1145008128 224041 33554432000 4194304 4625164 140733482801600 18446744073709551615 4334708 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 483.69
Current children cumulated vsize (KiB) 1118172

[startup+222.3 s]
/proc/loadavg: 9.22 7.90 8.20 10/402 26737
/proc/meminfo: memFree=20233512/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=1419736 CPUtime=664.32 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 3514123 0 0 0 65909 523 0 0 25 0 4 0 669732911 1453809664 269687 33554432000 4194304 4625164 140733482801600 18446744073709551615 4393068 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26727/statm: 354934 269687 342 106 0 350437 0
[pid=26727/tid=26729] ppid=26725 vsize=1419736 CPUtime=188.38 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 107923 0 0 0 18817 21 0 0 25 0 4 0 669732956 1453809664 269687 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=1419736 CPUtime=134.12 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 99120 0 0 0 13370 42 0 0 25 0 4 0 669732956 1453809664 269687 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=1419736 CPUtime=136.78 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 3207256 0 0 0 13232 446 0 0 25 0 4 0 669732956 1453809664 269687 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 664.32
Current children cumulated vsize (KiB) 1419736

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2097.63
Current children cumulated vsize (KiB) 2300696

[startup+762.315 s]
/proc/loadavg: 9.29 9.01 8.64 10/402 26751
/proc/meminfo: memFree=18160040/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2419924 CPUtime=2276.9 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 7680565 0 0 0 226511 1179 0 0 25 0 4 0 669732911 2478002176 517377 33554432000 4194304 4625164 140733482801600 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 604981 517377 342 106 0 600484 0
[pid=26727/tid=26729] ppid=26725 vsize=2419924 CPUtime=597.77 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 246280 0 0 0 59725 52 0 0 25 0 4 0 669732956 2478002176 517377 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2419924 CPUtime=549.81 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 128591 0 0 0 54912 69 0 0 25 0 4 0 669732956 2478002176 517377 33554432000 4194304 4625164 140733482801600 18446744073709551615 4330879 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2419924 CPUtime=442.33 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 6979017 0 0 0 43234 999 0 0 25 0 4 0 669732956 2478002176 517377 33554432000 4194304 4625164 140733482801600 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2276.9
Current children cumulated vsize (KiB) 2419924

[startup+822.301 s]
/proc/loadavg: 9.22 9.03 8.66 10/402 26752
/proc/meminfo: memFree=18003780/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2465596 CPUtime=2456.1 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 7867368 0 0 0 244398 1212 0 0 25 0 4 0 669732911 2524770304 530778 33554432000 4194304 4625164 140733482801600 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 616399 530778 342 106 0 611902 0
[pid=26727/tid=26729] ppid=26725 vsize=2465596 CPUtime=627.77 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 246919 0 0 0 62724 53 0 0 25 0 4 0 669732956 2524770304 530778 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2465596 CPUtime=609.79 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 128648 0 0 0 60910 69 0 0 25 0 4 0 669732956 2524770304 530778 33554432000 4194304 4625164 140733482801600 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2465596 CPUtime=472.33 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 7138665 0 0 0 46208 1025 0 0 25 0 4 0 669732956 2524770304 530778 33554432000 4194304 4625164 140733482801600 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2456.1
Current children cumulated vsize (KiB) 2465596

[startup+882.3 s]
/proc/loadavg: 9.26 9.08 8.70 10/402 26754
/proc/meminfo: memFree=17845788/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2486156 CPUtime=2635.31 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 8154596 0 0 0 262275 1256 0 0 25 0 4 0 669732911 2545823744 543031 33554432000 4194304 4625164 140733482801600 18446744073709551615 4396715 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 621539 543032 342 106 0 617042 0
[pid=26727/tid=26729] ppid=26725 vsize=2486156 CPUtime=664.12 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 247097 0 0 0 66359 53 0 0 25 0 4 0 669732956 2545823744 543033 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2486156 CPUtime=669.79 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 128726 0 0 0 66910 69 0 0 25 0 4 0 669732956 2545823744 543034 33554432000 4194304 4625164 140733482801600 18446744073709551615 4331081 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2486156 CPUtime=502.24 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 7403632 0 0 0 49160 1064 0 0 25 0 4 0 669732956 2545823744 543035 33554432000 4194304 4625164 140733482801600 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2635.31
Current children cumulated vsize (KiB) 2486156

[startup+942.301 s]
/proc/loadavg: 9.16 9.08 8.73 10/402 26756
/proc/meminfo: memFree=17690032/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2551692 CPUtime=2814.56 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 8671582 0 0 0 280126 1330 0 0 25 0 4 0 669732911 2612932608 555421 33554432000 4194304 4625164 140733482801600 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 637923 555421 342 106 0 633426 0
[pid=26727/tid=26729] ppid=26725 vsize=2551692 CPUtime=694.15 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 248569 0 0 0 69361 54 0 0 25 0 4 0 669732956 2612932608 555421 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2551692 CPUtime=729.8 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 128813 0 0 0 72911 69 0 0 25 0 4 0 669732956 2612932608 555421 33554432000 4194304 4625164 140733482801600 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2551692 CPUtime=532.22 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 7896056 0 0 0 52090 1132 0 0 25 0 4 0 669732956 2612932608 555421 33554432000 4194304 4625164 140733482801600 18446744073709551615 4579601 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2814.56
Current children cumulated vsize (KiB) 2551692

[startup+1002.3 s]
/proc/loadavg: 9.18 9.11 8.75 10/402 26757
/proc/meminfo: memFree=17546036/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2682764 CPUtime=2993.79 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 9230153 0 0 0 297965 1414 0 0 25 0 4 0 669732911 2747150336 570419 33554432000 4194304 4625164 140733482801600 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 670691 570419 342 106 0 666194 0
[pid=26727/tid=26729] ppid=26725 vsize=2682764 CPUtime=724.25 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 251216 0 0 0 72370 55 0 0 25 0 4 0 669732956 2747150336 570419 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2682764 CPUtime=789.8 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 128865 0 0 0 78911 69 0 0 25 0 4 0 669732956 2747150336 570419 33554432000 4194304 4625164 140733482801600 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2682764 CPUtime=562.11 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 8433131 0 0 0 55000 1211 0 0 25 0 4 0 669732956 2747150336 570419 33554432000 4194304 4625164 140733482801600 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2993.79
Current children cumulated vsize (KiB) 2682764

[startup+1062.3 s]
/proc/loadavg: 9.06 9.09 8.77 10/402 26759
/proc/meminfo: memFree=17403920/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2682764 CPUtime=3173.02 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 9637552 0 0 0 315824 1478 0 0 25 0 4 0 669732911 2747150336 584688 33554432000 4194304 4625164 140733482801600 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 670691 584688 342 106 0 666194 0
[pid=26727/tid=26729] ppid=26725 vsize=2682764 CPUtime=754.4 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 254274 0 0 0 75382 58 0 0 25 0 4 0 669732956 2747150336 584688 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2682764 CPUtime=849.8 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 128916 0 0 0 84911 69 0 0 25 0 4 0 669732956 2747150336 584688 33554432000 4194304 4625164 140733482801600 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2682764 CPUtime=595.36 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 8795249 0 0 0 58275 1261 0 0 25 0 4 0 669732956 2747150336 584688 33554432000 4194304 4625164 140733482801600 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3173.02
Current children cumulated vsize (KiB) 2682764

[startup+1122.3 s]
/proc/loadavg: 9.11 9.10 8.79 10/402 26761
/proc/meminfo: memFree=17259420/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2682764 CPUtime=3352.25 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 10123819 0 0 0 333675 1550 0 0 25 0 4 0 669732911 2747150336 593259 33554432000 4194304 4625164 140733482801600 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 670691 593259 342 106 0 666194 0
[pid=26727/tid=26729] ppid=26725 vsize=2682764 CPUtime=784.47 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 254779 0 0 0 78388 59 0 0 25 0 4 0 669732956 2747150336 593259 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2682764 CPUtime=909.8 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 128958 0 0 0 90911 69 0 0 25 0 4 0 669732956 2747150336 593259 33554432000 4194304 4625164 140733482801600 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2682764 CPUtime=625.3 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 9242289 0 0 0 61204 1326 0 0 25 0 4 0 669732956 2747150336 593259 33554432000 4194304 4625164 140733482801600 18446744073709551615 4547277 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3352.25
Current children cumulated vsize (KiB) 2682764

[startup+1182.3 s]
/proc/loadavg: 9.11 9.09 8.81 10/402 26762
/proc/meminfo: memFree=17098456/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2748960 CPUtime=3531.49 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 10683455 0 0 0 351512 1637 0 0 25 0 4 0 669732911 2814935040 606194 33554432000 4194304 4625164 140733482801600 18446744073709551615 4280391 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 687240 606194 342 106 0 682743 0
[pid=26727/tid=26729] ppid=26725 vsize=2748960 CPUtime=814.3 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 255364 0 0 0 81371 59 0 0 25 0 4 0 669732956 2814935040 606194 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2748960 CPUtime=969.8 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 129004 0 0 0 96911 69 0 0 25 0 4 0 669732956 2814935040 606194 33554432000 4194304 4625164 140733482801600 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2748960 CPUtime=655.47 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 9732582 0 0 0 64148 1399 0 0 25 0 4 0 669732956 2814935040 606194 33554432000 4194304 4625164 140733482801600 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3531.49
Current children cumulated vsize (KiB) 2748960

[startup+1242.3 s]
/proc/loadavg: 8.99 9.06 8.81 10/402 26795
/proc/meminfo: memFree=20142292/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2799112 CPUtime=3710.71 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 11130595 0 0 0 369364 1707 0 0 25 0 4 0 669732911 2866290688 620219 33554432000 4194304 4625164 140733482801600 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 699778 620219 342 106 0 695281 0
[pid=26727/tid=26729] ppid=26725 vsize=2799112 CPUtime=844.38 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 259299 0 0 0 84377 61 0 0 25 0 4 0 669732956 2866290688 620219 33554432000 4194304 4625164 140733482801600 18446744073709551615 4352089 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2799112 CPUtime=1029.8 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 129063 0 0 0 102911 69 0 0 25 0 4 0 669732956 2866290688 620219 33554432000 4194304 4625164 140733482801600 18446744073709551615 4331184 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2799112 CPUtime=685.4 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 10105109 0 0 0 67086 1454 0 0 25 0 4 0 669732956 2866290688 620219 33554432000 4194304 4625164 140733482801600 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3710.71
Current children cumulated vsize (KiB) 2799112



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.08 9.07 8.83 11/402 26796
/proc/meminfo: memFree=19859196/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=2867880 CPUtime=3883.11 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) R 26725 26727 25968 0 -1 4202496 11569518 0 0 0 386536 1775 0 0 25 0 4 0 669732911 2936709120 629771 33554432000 4194304 4625164 140733482801600 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26727/statm: 716970 629771 342 106 0 712473 0
[pid=26727/tid=26729] ppid=26725 vsize=2867880 CPUtime=885.68 cores=0,2,4,6
/proc/26727/task/26729/stat : 26729 (SArTagnan) R 26725 26727 25968 0 -1 4202560 262144 0 0 0 88506 62 0 0 25 0 4 0 669732956 2936709120 629771 33554432000 4194304 4625164 140733482801600 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=26727/tid=26730] ppid=26725 vsize=2867880 CPUtime=1087.52 cores=0,2,4,6
/proc/26727/task/26730/stat : 26730 (SArTagnan) R 26725 26727 25968 0 -1 4202560 129118 0 0 0 108682 70 0 0 25 0 4 0 669732956 2936709120 629771 33554432000 4194304 4625164 140733482801600 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26727/tid=26731] ppid=26725 vsize=2867880 CPUtime=714.15 cores=0,2,4,6
/proc/26727/task/26731/stat : 26731 (SArTagnan) R 26725 26727 25968 0 -1 4202560 10524558 0 0 0 69900 1515 0 0 25 0 4 0 669732956 2936709120 629771 33554432000 4194304 4625164 140733482801600 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3883.11
Current children cumulated vsize (KiB) 2867880

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.12 s]
/proc/loadavg: 9.08 9.07 8.83 7/400 26797
/proc/meminfo: memFree=22177640/32951124 swapFree=65173164/67111528
[pid=26727] ppid=26725 vsize=0 CPUtime=3883.24 cores=0,2,4,6
/proc/26727/stat : 26727 (SArTagnan) Z 26725 26727 25968 0 -1 4203548 11570152 0 0 0 386538 1786 0 0 25 0 1 0 669732911 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26727/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 3883.24
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.14
CPU time (s): 3883.25
CPU user time (s): 3865.39
CPU system time (s): 17.8603
CPU usage (%): 298.68
Max. virtual memory (cumulated for all children) (KiB): 2876772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3865.39
system time used= 17.8603
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11570152
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11984
involuntary context switches= 30909

runsolver used 4.6003 second user time and 12.0612 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-16 23:29:08
IDJOB=3385888
IDBENCH=83184
IDSOLVER=1871
FILE ID=node132/3385888-1305581347
RUNJOBID= node132-1305581346-26644
PBS_JOBID= 13350206
Free space on /tmp= 73272 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x39.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385888-1305581347/watcher-3385888-1305581347 -o /tmp/evaluation-result-3385888-1305581347/solver-3385888-1305581347 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385888-1305581347.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e7679ca49bb432c9b90305d907365c4e
RANDOM SEED=1640673922

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22753972 kB
Buffers:        317176 kB
Cached:        3568440 kB
SwapCached:       9908 kB
Active:        3818396 kB
Inactive:      6051260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22753972 kB
SwapTotal:    67111528 kB
SwapFree:     65173164 kB
Dirty:           20928 kB
Writeback:           0 kB
AnonPages:     5980600 kB
Mapped:          25208 kB
Slab:           221976 kB
PageTables:      40540 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 78325800 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73272 MiB
End job on node132 at 2011-05-16 23:50:50