Trace number 3385887

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3820.23 1300.12

General information on the benchmark

Namecrafted/mosoi/289/
289-unsat-21x33.cnf
MD5SUMf7c29bbc3bef00d1e7cc799553ba4813
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2772
Number of clauses448371
Sum of the clauses size1785168
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 24158
Number of clauses of size 30
Number of clauses of size 4444213
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385887-1305581153/watcher-3385887-1305581153 -o /tmp/evaluation-result-3385887-1305581153/solver-3385887-1305581153 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385887-1305581153.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.15 10.15 10.15 8/373 28425
/proc/meminfo: memFree=13451184/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=30548 CPUtime=0 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 1078 0 0 0 0 0 0 0 25 0 1 0 669714936 31281152 808 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664808192 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/28425/statm: 7637 809 296 106 0 3140 0

[startup+0.0157301 s]
/proc/loadavg: 10.15 10.15 10.15 8/373 28425
/proc/meminfo: memFree=13451184/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=31676 CPUtime=0 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 1392 0 0 0 0 0 0 0 25 0 1 0 669714936 32436224 1013 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664505813 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/28425/statm: 7811 911 296 106 0 3314 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 31676

[startup+0.100753 s]
/proc/loadavg: 10.15 10.15 10.15 8/373 28425
/proc/meminfo: memFree=13451184/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=44884 CPUtime=0.09 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 9366 0 0 0 8 1 0 0 25 0 1 0 669714936 45961216 4596 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664469189 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/28425/statm: 11221 4599 296 106 0 6724 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 44884

[startup+0.30072 s]
/proc/loadavg: 10.15 10.15 10.15 8/373 28425
/proc/meminfo: memFree=13451184/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=115384 CPUtime=0.29 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 32360 0 0 0 25 4 0 0 25 0 1 0 669714936 118153216 21418 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664505813 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/28425/statm: 28846 21440 301 106 0 24349 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 115384

[startup+0.85385 s]
/proc/loadavg: 10.15 10.15 10.15 8/373 28425
/proc/meminfo: memFree=13451184/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=361752 CPUtime=1.75 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 61120 0 0 0 167 8 0 0 25 0 4 0 669714936 370434048 35133 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664505813 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28425/statm: 90438 35133 338 106 0 85941 0
Current children cumulated CPU time (s) 1.75
Current children cumulated vsize (KiB) 361752

[startup+1.50051 s]
/proc/loadavg: 10.15 10.15 10.15 11/377 28429
/proc/meminfo: memFree=13301120/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=367348 CPUtime=3.22 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 85238 0 0 0 311 11 0 0 25 0 4 0 669714936 376164352 39502 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664505813 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 91837 39502 339 106 0 87340 0
[pid=28425/tid=28427] ppid=28423 vsize=367348 CPUtime=0.73 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 5047 0 0 0 73 0 0 0 25 0 4 0 669714967 376164352 39502 33554432000 4194304 4625164 140735471817360 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=367348 CPUtime=0.66 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) D 28423 28425 27834 0 -1 4202560 6575 0 0 0 65 1 0 0 18 0 4 0 669714967 376164352 39502 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664851639 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=367348 CPUtime=1.11 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) D 28423 28425 27834 0 -1 4202560 35778 0 0 0 107 4 0 0 18 0 4 0 669714967 376164352 39502 33554432000 4194304 4625164 140735471817360 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.22
Current children cumulated vsize (KiB) 367348

[startup+3.1012 s]
/proc/loadavg: 10.15 10.15 10.15 11/377 28429
/proc/meminfo: memFree=13284284/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=356160 CPUtime=7.32 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 132201 0 0 0 713 19 0 0 25 0 4 0 669714936 364707840 41648 33554432000 4194304 4625164 140735471817360 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28425/statm: 89040 41648 339 106 0 84543 0
[pid=28425/tid=28427] ppid=28423 vsize=356160 CPUtime=2.28 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 5567 0 0 0 228 0 0 0 18 0 4 0 669714967 364707840 41648 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=356160 CPUtime=1.66 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 8737 0 0 0 163 3 0 0 18 0 4 0 669714967 364707840 41648 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=356160 CPUtime=2.53 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 78240 0 0 0 244 9 0 0 19 0 4 0 669714967 364707840 41648 33554432000 4194304 4625164 140735471817360 18446744073709551615 4547606 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 7.32
Current children cumulated vsize (KiB) 356160

[startup+6.30065 s]
/proc/loadavg: 10.14 10.15 10.15 14/377 28430
/proc/meminfo: memFree=13253808/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=353544 CPUtime=15.52 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 178186 0 0 0 1527 25 0 0 25 0 4 0 669714936 362029056 48945 33554432000 4194304 4625164 140735471817360 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28425/statm: 88386 48945 339 106 0 83889 0
[pid=28425/tid=28427] ppid=28423 vsize=353544 CPUtime=5.44 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 12663 0 0 0 543 1 0 0 25 0 4 0 669714967 362029056 48945 33554432000 4194304 4625164 140735471817360 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=353544 CPUtime=3.51 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 9337 0 0 0 348 3 0 0 21 0 4 0 669714967 362029056 48945 33554432000 4194304 4625164 140735471817360 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=353544 CPUtime=4.2 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 113502 0 0 0 407 13 0 0 22 0 4 0 669714967 362029056 48945 33554432000 4194304 4625164 140735471817360 18446744073709551615 4579465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 15.52
Current children cumulated vsize (KiB) 353544

[startup+12.7005 s]
/proc/loadavg: 10.13 10.15 10.15 11/377 28430
/proc/meminfo: memFree=13222644/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=431588 CPUtime=30.66 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 262716 0 0 0 3026 40 0 0 25 0 4 0 669714936 441946112 56545 33554432000 4194304 4625164 140735471817360 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/28425/statm: 107897 56545 339 106 0 103400 0
[pid=28425/tid=28427] ppid=28423 vsize=431588 CPUtime=8.75 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 14836 0 0 0 870 5 0 0 25 0 4 0 669714967 441946112 56545 33554432000 4194304 4625164 140735471817360 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=431588 CPUtime=6.52 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 15532 0 0 0 647 5 0 0 25 0 4 0 669714967 441946112 56545 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664469189 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=431588 CPUtime=7.05 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 189288 0 0 0 682 23 0 0 25 0 4 0 669714967 441946112 56545 33554432000 4194304 4625164 140735471817360 18446744073709551615 4562164 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 30.66
Current children cumulated vsize (KiB) 431588

[startup+25.5143 s]
/proc/loadavg: 10.10 10.14 10.15 11/377 28430
/proc/meminfo: memFree=13136380/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=523308 CPUtime=58.38 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 450121 0 0 0 5764 74 0 0 25 0 4 0 669714936 535867392 73908 33554432000 4194304 4625164 140735471817360 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 130827 73908 342 106 0 126330 0
[pid=28425/tid=28427] ppid=28423 vsize=523308 CPUtime=15.15 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 24692 0 0 0 1505 10 0 0 19 0 4 0 669714967 535867392 73908 33554432000 4194304 4625164 140735471817360 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=523308 CPUtime=12.72 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 22282 0 0 0 1265 7 0 0 25 0 4 0 669714967 535867392 73908 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=523308 CPUtime=13.03 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 356554 0 0 0 1253 50 0 0 21 0 4 0 669714967 535867392 73908 33554432000 4194304 4625164 140735471817360 18446744073709551615 4334461 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 58.38
Current children cumulated vsize (KiB) 523308

[startup+51.1009 s]
/proc/loadavg: 10.13 10.14 10.15 12/377 28431
/proc/meminfo: memFree=12977812/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=645540 CPUtime=109.11 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 764325 0 0 0 10787 124 0 0 25 0 4 0 669714936 661032960 104048 33554432000 4194304 4625164 140735471817360 18446744073709551615 4338046 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/28425/statm: 161385 104048 342 106 0 156888 0
[pid=28425/tid=28427] ppid=28423 vsize=645540 CPUtime=26.86 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 29078 0 0 0 2672 14 0 0 25 0 4 0 669714967 661032960 104048 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=645540 CPUtime=25.91 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 41297 0 0 0 2581 10 0 0 25 0 4 0 669714967 661032960 104048 33554432000 4194304 4625164 140735471817360 18446744073709551615 4352843 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=645540 CPUtime=25.3 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 646076 0 0 0 2440 90 0 0 25 0 4 0 669714967 661032960 104048 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664505678 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 109.11
Current children cumulated vsize (KiB) 645540

[startup+102.301 s]
/proc/loadavg: 10.13 10.14 10.15 12/377 28432
/proc/meminfo: memFree=12691312/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=892996 CPUtime=241.49 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 1234830 0 0 0 23947 202 0 0 25 0 4 0 669714936 914427904 165131 33554432000 4194304 4625164 140735471817360 18446744073709551615 4512142 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28425/statm: 223249 165131 396 106 0 218752 0
[pid=28425/tid=28427] ppid=28423 vsize=892996 CPUtime=53.34 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 46369 0 0 0 5312 22 0 0 25 0 4 0 669714967 914427904 165131 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=892996 CPUtime=60.57 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 75109 0 0 0 6036 21 0 0 25 0 4 0 669714967 914427904 165131 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=892996 CPUtime=52.18 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 1054009 0 0 0 5071 147 0 0 25 0 4 0 669714967 914427904 165131 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 241.49
Current children cumulated vsize (KiB) 892996

[startup+162.301 s]
/proc/loadavg: 10.25 10.16 10.15 11/377 28434
/proc/meminfo: memFree=12380684/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=1182256 CPUtime=420.72 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 1603028 0 0 0 41801 271 0 0 25 0 4 0 669714936 1210630144 226873 33554432000 4194304 4625164 140735471817360 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/28425/statm: 295564 226873 342 106 0 291067 0
[pid=28425/tid=28427] ppid=28423 vsize=1182256 CPUtime=97.33 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 78100 0 0 0 9702 31 0 0 25 0 4 0 669714967 1210630144 226873 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=1182256 CPUtime=107.26 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 98866 0 0 0 10688 38 0 0 25 0 4 0 669714967 1210630144 226873 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=1182256 CPUtime=85.09 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 1357160 0 0 0 8321 188 0 0 25 0 4 0 669714967 1210630144 226873 33554432000 4194304 4625164 140735471817360 18446744073709551615 4288293 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 420.72
Current children cumulated vsize (KiB) 1182256

[startup+222.3 s]
/proc/loadavg: 10.22 10.16 10.15 11/377 28435
/proc/meminfo: memFree=12090148/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=1441896 CPUtime=599.78 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 1740062 0 0 0 59661 317 0 0 25 0 4 0 669714936 1476501504 287344 33554432000 4194304 4625164 140735471817360 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/28425/statm: 360474 287344 342 106 0 355977 0
[pid=28425/tid=28427] ppid=28423 vsize=1441896 CPUtime=139.88 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 111854 0 0 0 13949 39 0 0 25 0 4 0 669714967 1476501504 287344 33554432000 4194304 4625164 140735471817360 18446744073709551615 4352776 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=1441896 CPUtime=142.9 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 130556 0 0 0 14229 61 0 0 20 0 4 0 669714967 1476501504 287344 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=1441896 CPUtime=126.97 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 1415546 0 0 0 12496 201 0 0 20 0 4 0 669714967 1476501504 287344 33554432000 4194304 4625164 140735471817360 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 599.78
Current children cumulated vsize (KiB) 1441896

[startup+282.301 s]

################
# More data... #
################

[pid=28425] ppid=28423 vsize=2229672 CPUtime=2034.02 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 4414092 0 0 0 202622 780 0 0 25 0 4 0 669714936 2283184128 474978 33554432000 4194304 4625164 140735471817360 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 557418 474978 342 106 0 552921 0
[pid=28425/tid=28427] ppid=28423 vsize=2229672 CPUtime=402.99 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 147189 0 0 0 40204 95 0 0 25 0 4 0 669714967 2283184128 474978 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2229672 CPUtime=602.27 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148202 0 0 0 60154 73 0 0 25 0 4 0 669714967 2283184128 474978 33554432000 4194304 4625164 140735471817360 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2229672 CPUtime=367.89 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 3992973 0 0 0 36203 586 0 0 25 0 4 0 669714967 2283184128 474978 33554432000 4194304 4625164 140735471817360 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2034.02
Current children cumulated vsize (KiB) 2229672

[startup+762.301 s]
/proc/loadavg: 6.08 7.27 8.81 7/368 28468
/proc/meminfo: memFree=12879532/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2229672 CPUtime=2213.31 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 4641725 0 0 0 220507 824 0 0 25 0 4 0 669714936 2283184128 489796 33554432000 4194304 4625164 140735471817360 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 557418 489796 342 106 0 552921 0
[pid=28425/tid=28427] ppid=28423 vsize=2229672 CPUtime=433.04 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 150416 0 0 0 43203 101 0 0 25 0 4 0 669714967 2283184128 489796 33554432000 4194304 4625164 140735471817360 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2229672 CPUtime=662.27 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148238 0 0 0 66154 73 0 0 25 0 4 0 669714967 2283184128 489796 33554432000 4194304 4625164 140735471817360 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2229672 CPUtime=397.84 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 4216441 0 0 0 39160 624 0 0 25 0 4 0 669714967 2283184128 489796 33554432000 4194304 4625164 140735471817360 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2213.31
Current children cumulated vsize (KiB) 2229672

[startup+822.3 s]
/proc/loadavg: 6.06 7.05 8.63 7/368 28469
/proc/meminfo: memFree=12815172/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2296340 CPUtime=2392.61 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 4957949 0 0 0 238381 880 0 0 25 0 4 0 669714936 2351452160 504924 33554432000 4194304 4625164 140735471817360 18446744073709551615 4512193 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 574085 504924 342 106 0 569588 0
[pid=28425/tid=28427] ppid=28423 vsize=2296340 CPUtime=463.14 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 153231 0 0 0 46210 104 0 0 25 0 4 0 669714967 2351452160 504924 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2296340 CPUtime=722.27 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148281 0 0 0 72154 73 0 0 25 0 4 0 669714967 2351452160 504924 33554432000 4194304 4625164 140735471817360 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2296340 CPUtime=427.73 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 4528604 0 0 0 42098 675 0 0 25 0 4 0 669714967 2351452160 504924 33554432000 4194304 4625164 140735471817360 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2392.61
Current children cumulated vsize (KiB) 2296340

[startup+882.301 s]
/proc/loadavg: 6.02 6.86 8.46 7/368 28471
/proc/meminfo: memFree=12753792/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2361876 CPUtime=2571.93 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 5260506 0 0 0 256263 930 0 0 25 0 4 0 669714936 2418561024 518749 33554432000 4194304 4625164 140735471817360 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 590469 518749 342 106 0 585972 0
[pid=28425/tid=28427] ppid=28423 vsize=2361876 CPUtime=493.27 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 155790 0 0 0 49217 110 0 0 25 0 4 0 669714967 2418561024 518749 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2361876 CPUtime=782.29 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148320 0 0 0 78156 73 0 0 25 0 4 0 669714967 2418561024 518749 33554432000 4194304 4625164 140735471817360 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2361876 CPUtime=457.62 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 4827390 0 0 0 45043 719 0 0 25 0 4 0 669714967 2418561024 518749 33554432000 4194304 4625164 140735471817360 18446744073709551615 4547354 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2571.93
Current children cumulated vsize (KiB) 2361876

[startup+942.301 s]
/proc/loadavg: 6.04 6.71 8.31 7/368 28473
/proc/meminfo: memFree=12695756/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2389640 CPUtime=2751.19 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 5487790 0 0 0 274144 975 0 0 25 0 4 0 669714936 2446991360 533349 33554432000 4194304 4625164 140735471817360 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 597410 533349 342 106 0 592913 0
[pid=28425/tid=28427] ppid=28423 vsize=2389640 CPUtime=523.47 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 165808 0 0 0 52229 118 0 0 25 0 4 0 669714967 2446991360 533349 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2389640 CPUtime=842.27 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148357 0 0 0 84154 73 0 0 25 0 4 0 669714967 2446991360 533349 33554432000 4194304 4625164 140735471817360 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2389640 CPUtime=487.43 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 5043427 0 0 0 47988 755 0 0 25 0 4 0 669714967 2446991360 533349 33554432000 4194304 4625164 140735471817360 18446744073709551615 274664505440 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2751.19
Current children cumulated vsize (KiB) 2389640

[startup+1002.31 s]
/proc/loadavg: 6.09 6.60 8.17 7/368 28474
/proc/meminfo: memFree=12640076/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2455176 CPUtime=2930.51 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 5770254 0 0 0 292031 1020 0 0 25 0 4 0 669714936 2514100224 547389 33554432000 4194304 4625164 140735471817360 18446744073709551615 4396545 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 613794 547391 342 106 0 609297 0
[pid=28425/tid=28427] ppid=28423 vsize=2455176 CPUtime=553.47 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 168861 0 0 0 55224 123 0 0 25 0 4 0 669714967 2514100224 547391 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2455176 CPUtime=902.29 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148400 0 0 0 90156 73 0 0 25 0 4 0 669714967 2514100224 547392 33554432000 4194304 4625164 140735471817360 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2455176 CPUtime=517.46 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 5321647 0 0 0 50951 795 0 0 25 0 4 0 669714967 2514100224 547393 33554432000 4194304 4625164 140735471817360 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2930.51
Current children cumulated vsize (KiB) 2455176

[startup+1062.3 s]
/proc/loadavg: 6.10 6.50 8.04 7/368 28476
/proc/meminfo: memFree=12593200/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2520712 CPUtime=3109.77 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 6058795 0 0 0 309906 1071 0 0 25 0 4 0 669714936 2581209088 560291 33554432000 4194304 4625164 140735471817360 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 630178 560291 342 106 0 625681 0
[pid=28425/tid=28427] ppid=28423 vsize=2520712 CPUtime=583.57 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 171314 0 0 0 58230 127 0 0 25 0 4 0 669714967 2581209088 560291 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2520712 CPUtime=962.27 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148440 0 0 0 96154 73 0 0 25 0 4 0 669714967 2581209088 560291 33554432000 4194304 4625164 140735471817360 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2520712 CPUtime=547.35 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 5606507 0 0 0 53894 841 0 0 25 0 4 0 669714967 2581209088 560291 33554432000 4194304 4625164 140735471817360 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3109.77
Current children cumulated vsize (KiB) 2520712

[startup+1122.3 s]
/proc/loadavg: 6.10 6.42 7.91 7/368 28477
/proc/meminfo: memFree=12533804/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2586248 CPUtime=3289.06 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 6367435 0 0 0 327780 1126 0 0 25 0 4 0 669714936 2648317952 575084 33554432000 4194304 4625164 140735471817360 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 646562 575084 342 106 0 642065 0
[pid=28425/tid=28427] ppid=28423 vsize=2586248 CPUtime=613.6 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 174090 0 0 0 61229 131 0 0 25 0 4 0 669714967 2648317952 575084 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2586248 CPUtime=1022.28 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148493 0 0 0 102155 73 0 0 25 0 4 0 669714967 2648317952 575084 33554432000 4194304 4625164 140735471817360 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2586248 CPUtime=577.31 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 5911320 0 0 0 56840 891 0 0 25 0 4 0 669714967 2648317952 575084 33554432000 4194304 4625164 140735471817360 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3289.06
Current children cumulated vsize (KiB) 2586248

[startup+1182.3 s]
/proc/loadavg: 6.09 6.36 7.79 7/368 28479
/proc/meminfo: memFree=12477012/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2651784 CPUtime=3468.37 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 6646428 0 0 0 345661 1176 0 0 25 0 4 0 669714936 2715426816 589413 33554432000 4194304 4625164 140735471817360 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 662946 589413 342 106 0 658449 0
[pid=28425/tid=28427] ppid=28423 vsize=2651784 CPUtime=643.76 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 177613 0 0 0 64241 135 0 0 25 0 4 0 669714967 2715426816 589413 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2651784 CPUtime=1082.28 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148526 0 0 0 108155 73 0 0 25 0 4 0 669714967 2715426816 589413 33554432000 4194304 4625164 140735471817360 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2651784 CPUtime=607.16 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 6185793 0 0 0 59780 936 0 0 25 0 4 0 669714967 2715426816 589413 33554432000 4194304 4625164 140735471817360 18446744073709551615 4552336 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3468.37
Current children cumulated vsize (KiB) 2651784

[startup+1242.3 s]
/proc/loadavg: 6.08 6.31 7.68 7/368 28481
/proc/meminfo: memFree=12415748/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2693872 CPUtime=3647.65 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 6873676 0 0 0 363548 1217 0 0 25 0 4 0 669714936 2758524928 604637 33554432000 4194304 4625164 140735471817360 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 673468 604637 342 106 0 668971 0
[pid=28425/tid=28427] ppid=28423 vsize=2693872 CPUtime=673.75 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 180406 0 0 0 67236 139 0 0 25 0 4 0 669714967 2758524928 604637 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2693872 CPUtime=1142.29 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148564 0 0 0 114155 74 0 0 25 0 4 0 669714967 2758524928 604637 33554432000 4194304 4625164 140735471817360 18446744073709551615 4330825 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2693872 CPUtime=637.16 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 6385985 0 0 0 62747 969 0 0 25 0 4 0 669714967 2758524928 604637 33554432000 4194304 4625164 140735471817360 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3647.65
Current children cumulated vsize (KiB) 2693872



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 6.08 6.26 7.58 7/368 28482
/proc/meminfo: memFree=12368752/32951132 swapFree=67093824/67111528
[pid=28425] ppid=28423 vsize=2759408 CPUtime=3820.11 cores=1,3,5,7
/proc/28425/stat : 28425 (SArTagnan) R 28423 28425 27834 0 -1 4202496 7090448 0 0 0 380757 1254 0 0 25 0 4 0 669714936 2825633792 616166 33554432000 4194304 4625164 140735471817360 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/28425/statm: 689852 616166 342 106 0 685355 0
[pid=28425/tid=28427] ppid=28423 vsize=2759408 CPUtime=702.55 cores=1,3,5,7
/proc/28425/task/28427/stat : 28427 (SArTagnan) R 28423 28425 27834 0 -1 4202560 182635 0 0 0 70112 143 0 0 25 0 4 0 669714967 2825633792 616166 33554432000 4194304 4625164 140735471817360 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=28425/tid=28428] ppid=28423 vsize=2759408 CPUtime=1200 cores=1,3,5,7
/proc/28425/task/28428/stat : 28428 (SArTagnan) R 28423 28425 27834 0 -1 4202560 148593 0 0 0 119926 74 0 0 25 0 4 0 669714967 2825633792 616166 33554432000 4194304 4625164 140735471817360 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=28425/tid=28429] ppid=28423 vsize=2759408 CPUtime=666.08 cores=1,3,5,7
/proc/28425/task/28429/stat : 28429 (SArTagnan) R 28423 28425 27834 0 -1 4202560 6599610 0 0 0 65606 1002 0 0 25 0 4 0 669714967 2825633792 616166 33554432000 4194304 4625164 140735471817360 18446744073709551615 4552388 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3820.11
Current children cumulated vsize (KiB) 2759408

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.12
CPU time (s): 3820.23
CPU user time (s): 3807.59
CPU system time (s): 12.6401
CPU usage (%): 293.837
Max. virtual memory (cumulated for all children) (KiB): 2777880

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3807.59
system time used= 12.6401
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7090450
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14942
involuntary context switches= 43783

runsolver used 4.50232 second user time and 10.8993 second system time

The end

Launcher Data 

Begin job on node131 at 2011-05-16 23:25:53
IDJOB=3385887
IDBENCH=83165
IDSOLVER=1871
FILE ID=node131/3385887-1305581153
RUNJOBID= node131-1305576906-27853
PBS_JOBID= 13350211
Free space on /tmp= 73564 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/mosoi/289/289-unsat-21x33.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385887-1305581153/watcher-3385887-1305581153 -o /tmp/evaluation-result-3385887-1305581153/solver-3385887-1305581153 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385887-1305581153.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f7c29bbc3bef00d1e7cc799553ba4813
RANDOM SEED=441413431

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      13451464 kB
Buffers:        309784 kB
Cached:        4757132 kB
SwapCached:       1504 kB
Active:       15535748 kB
Inactive:      3680144 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      13451464 kB
SwapTotal:    67111528 kB
SwapFree:     67093824 kB
Dirty:           11444 kB
Writeback:          44 kB
AnonPages:    14147432 kB
Mapped:          33224 kB
Slab:           171352 kB
PageTables:      48348 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 67281368 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73564 MiB
End job on node131 at 2011-05-16 23:47:35