Trace number 3386075

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3889.6 1300.06

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_21_60_7-log.shuffled-as.sat03-151.cnf
MD5SUM5cab37809f478f7db7fa096e9a155cfe
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables105
Number of clauses40110
Sum of the clauses size400890
Maximum clause length10
Minimum clause length5
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 542
Number of clauses of size over 540068

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386075-1305582249/watcher-3386075-1305582249 -o /tmp/evaluation-result-3386075-1305582249/solver-3386075-1305582249 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386075-1305582249.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.78 4.52 2.94 8/278 29190
/proc/meminfo: memFree=20368648/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=20216 CPUtime=0 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 717 0 0 0 0 0 0 0 20 0 1 0 669825699 20701184 569 33554432000 4194304 4625164 140735961141968 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/29190/statm: 5054 569 296 106 0 557 0

[startup+0.0438611 s]
/proc/loadavg: 8.78 4.52 2.94 8/278 29190
/proc/meminfo: memFree=20368648/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=26024 CPUtime=0.03 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 3294 0 0 0 3 0 0 0 20 0 1 0 669825699 26648576 2062 33554432000 4194304 4625164 140735961141968 18446744073709551615 222921776896 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/29190/statm: 6506 2063 302 106 0 2009 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 26024

[startup+0.110799 s]
/proc/loadavg: 8.78 4.52 2.94 8/278 29190
/proc/meminfo: memFree=20368648/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=132800 CPUtime=0.16 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) D 29188 29190 29085 0 -1 4202496 6901 0 0 0 15 1 0 0 21 0 4 0 669825699 135987200 4812 33554432000 4194304 4625164 140735961141968 18446744073709551615 222921820250 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/29190/statm: 33200 4812 360 106 0 28703 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 132800

[startup+0.300783 s]
/proc/loadavg: 8.78 4.52 2.94 8/278 29190
/proc/meminfo: memFree=20368648/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=139780 CPUtime=0.53 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 10019 0 0 0 52 1 0 0 21 0 4 0 669825699 143134720 6436 33554432000 4194304 4625164 140735961141968 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/29190/statm: 34945 6436 363 106 0 30448 0
Current children cumulated CPU time (s) 0.53
Current children cumulated vsize (KiB) 139780

[startup+0.70071 s]
/proc/loadavg: 8.78 4.52 2.94 8/278 29190
/proc/meminfo: memFree=20368648/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=148280 CPUtime=1.33 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 14574 0 0 0 132 1 0 0 21 0 4 0 669825699 151838720 8318 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/29190/statm: 37070 8319 358 106 0 32573 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 148280

[startup+1.50056 s]
/proc/loadavg: 8.96 4.62 2.98 11/282 29194
/proc/meminfo: memFree=20334136/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=149736 CPUtime=2.92 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 20851 0 0 0 290 2 0 0 22 0 4 0 669825699 153329664 9093 33554432000 4194304 4625164 140735961141968 18446744073709551615 4392937 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/29190/statm: 37434 9093 345 106 0 32937 0
[pid=29190/tid=29192] ppid=29188 vsize=149736 CPUtime=0.72 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 1627 0 0 0 72 0 0 0 25 0 4 0 669825704 153329664 9093 33554432000 4194304 4625164 140735961141968 18446744073709551615 4464208 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=149736 CPUtime=0.7 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 1944 0 0 0 70 0 0 0 24 0 4 0 669825704 153329664 9093 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=149736 CPUtime=0.69 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 9421 0 0 0 69 0 0 0 25 0 4 0 669825704 153329664 9093 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.92
Current children cumulated vsize (KiB) 149736

[startup+3.10027 s]
/proc/loadavg: 8.96 4.62 2.98 11/282 29194
/proc/meminfo: memFree=20338340/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=156216 CPUtime=6.12 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 36844 0 0 0 608 4 0 0 25 0 4 0 669825699 159965184 10379 33554432000 4194304 4625164 140735961141968 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/29190/statm: 39054 10379 345 106 0 34557 0
[pid=29190/tid=29192] ppid=29188 vsize=156216 CPUtime=1.52 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2986 0 0 0 152 0 0 0 25 0 4 0 669825704 159965184 10379 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=156216 CPUtime=1.5 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 3327 0 0 0 150 0 0 0 25 0 4 0 669825704 159965184 10379 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352069 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=156216 CPUtime=1.49 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 21346 0 0 0 148 1 0 0 25 0 4 0 669825704 159965184 10379 33554432000 4194304 4625164 140735961141968 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.12
Current children cumulated vsize (KiB) 156216

[startup+6.30068 s]
/proc/loadavg: 8.96 4.62 2.98 11/282 29194
/proc/meminfo: memFree=20306968/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=289684 CPUtime=12.66 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 58773 0 0 0 1258 8 0 0 25 0 4 0 669825699 296636416 13224 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 72421 13224 343 106 0 67924 0
[pid=29190/tid=29192] ppid=29188 vsize=289684 CPUtime=3.04 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 3696 0 0 0 304 0 0 0 25 0 4 0 669825704 296636416 13224 33554432000 4194304 4625164 140735961141968 18446744073709551615 222921438241 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=289684 CPUtime=3 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) D 29188 29190 29085 0 -1 4202560 6472 0 0 0 299 1 0 0 25 0 4 0 669825704 296636416 13224 33554432000 4194304 4625164 140735961141968 18446744073709551615 222921820343 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=289684 CPUtime=2.79 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 39142 0 0 0 275 4 0 0 25 0 4 0 669825704 296636416 13224 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 289684

[startup+12.7005 s]
/proc/loadavg: 9.12 4.80 3.06 11/282 29194
/proc/meminfo: memFree=20271160/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=300072 CPUtime=26.21 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 116868 0 0 0 2604 17 0 0 25 0 4 0 669825699 307273728 17638 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 75018 17638 343 106 0 70521 0
[pid=29190/tid=29192] ppid=29188 vsize=300072 CPUtime=5.71 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 6875 0 0 0 570 1 0 0 25 0 4 0 669825704 307273728 17638 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=300072 CPUtime=5.63 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 10507 0 0 0 561 2 0 0 25 0 4 0 669825704 307273728 17638 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=300072 CPUtime=6.49 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 88714 0 0 0 638 11 0 0 25 0 4 0 669825704 307273728 17638 33554432000 4194304 4625164 140735961141968 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 26.21
Current children cumulated vsize (KiB) 300072

[startup+25.5012 s]
/proc/loadavg: 9.25 4.97 3.13 11/282 29194
/proc/meminfo: memFree=20181392/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=315904 CPUtime=58.56 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 200094 0 0 0 5821 35 0 0 25 0 4 0 669825699 323485696 27706 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/29190/statm: 78976 27706 416 106 0 74479 0
[pid=29190/tid=29192] ppid=29188 vsize=315904 CPUtime=13.56 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 12753 0 0 0 1352 4 0 0 25 0 4 0 669825704 323485696 27706 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=315904 CPUtime=11.84 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 17791 0 0 0 1179 5 0 0 25 0 4 0 669825704 323485696 27706 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=315904 CPUtime=13.19 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 157012 0 0 0 1296 23 0 0 25 0 4 0 669825704 323485696 27706 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351958 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 58.56
Current children cumulated vsize (KiB) 315904

[startup+51.1005 s]
/proc/loadavg: 9.51 5.37 3.31 11/282 29195
/proc/meminfo: memFree=20113668/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=334712 CPUtime=135.24 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 334190 0 0 0 13466 58 0 0 25 0 4 0 669825699 342745088 38858 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512180 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/29190/statm: 83678 38858 342 106 0 79181 0
[pid=29190/tid=29192] ppid=29188 vsize=334712 CPUtime=32.51 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 27624 0 0 0 3244 7 0 0 25 0 4 0 669825704 342745088 38858 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=334712 CPUtime=32.58 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 22039 0 0 0 3250 8 0 0 25 0 4 0 669825704 342745088 38858 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=334712 CPUtime=25.2 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 271735 0 0 0 2481 39 0 0 25 0 4 0 669825704 342745088 38858 33554432000 4194304 4625164 140735961141968 18446744073709551615 4339848 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 135.24
Current children cumulated vsize (KiB) 334712

[startup+102.31 s]
/proc/loadavg: 9.86 6.16 3.70 11/282 29196
/proc/meminfo: memFree=19933844/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=401244 CPUtime=288.86 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 475946 0 0 0 28801 85 0 0 25 0 4 0 669825699 410873856 63377 33554432000 4194304 4625164 140735961141968 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/29190/statm: 100311 63380 688 106 0 95814 0
[pid=29190/tid=29192] ppid=29188 vsize=401244 CPUtime=58.01 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 41940 0 0 0 5788 13 0 0 25 0 4 0 669825704 410873856 63380 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=401244 CPUtime=58.97 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 32558 0 0 0 5885 12 0 0 25 0 4 0 669825704 410873856 63380 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=401244 CPUtime=75.73 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 380220 0 0 0 7517 56 0 0 25 0 4 0 669825704 410873856 63380 33554432000 4194304 4625164 140735961141968 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 288.86
Current children cumulated vsize (KiB) 401244

[startup+162.301 s]
/proc/loadavg: 10.18 6.92 4.11 11/282 29198
/proc/meminfo: memFree=19793460/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=526716 CPUtime=468.84 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 882048 0 0 0 46730 154 0 0 25 0 4 0 669825699 539357184 85405 33554432000 4194304 4625164 140735961141968 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 131679 85427 829 106 0 127182 0
[pid=29190/tid=29192] ppid=29188 vsize=526716 CPUtime=88.11 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 48612 0 0 0 8792 19 0 0 25 0 4 0 669825704 539357184 85437 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=526716 CPUtime=111.25 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 48156 0 0 0 11111 14 0 0 25 0 4 0 669825704 539357184 85450 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=526716 CPUtime=114.85 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 739044 0 0 0 11374 111 0 0 25 0 4 0 669825704 539357184 85464 33554432000 4194304 4625164 140735961141968 18446744073709551615 222921474517 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 468.84
Current children cumulated vsize (KiB) 526716

[startup+222.301 s]
/proc/loadavg: 10.10 7.49 4.48 11/282 29199
/proc/meminfo: memFree=19636208/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=581716 CPUtime=648.85 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 1110005 0 0 0 64692 193 0 0 25 0 4 0 669825699 595677184 101101 33554432000 4194304 4625164 140735961141968 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 145429 101101 816 106 0 140932 0
[pid=29190/tid=29192] ppid=29188 vsize=581716 CPUtime=118.18 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 66082 0 0 0 11796 22 0 0 25 0 4 0 669825704 595677184 101101 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=581716 CPUtime=171.24 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 66759 0 0 0 17107 17 0 0 25 0 4 0 669825704 595677184 101101 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=581716 CPUtime=144.77 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 930385 0 0 0 14334 143 0 0 25 0 4 0 669825704 595677184 101101 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 648.85
Current children cumulated vsize (KiB) 581716

[startup+282.301 s]

################
# More data... #
################

[pid=29190] ppid=29188 vsize=1023312 CPUtime=2088.88 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 2502724 0 0 0 208456 432 0 0 25 0 4 0 669825699 1047871488 184252 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 255828 184252 418 106 0 251331 0
[pid=29190/tid=29192] ppid=29188 vsize=1023312 CPUtime=522.12 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 112311 0 0 0 52175 37 0 0 25 0 4 0 669825704 1047871488 184252 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1023312 CPUtime=433.33 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 111861 0 0 0 43291 42 0 0 25 0 4 0 669825704 1047871488 184252 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1023312 CPUtime=485.14 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2159511 0 0 0 48187 327 0 0 25 0 4 0 669825704 1047871488 184252 33554432000 4194304 4625164 140735961141968 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2088.88
Current children cumulated vsize (KiB) 1023312

[startup+762.31 s]
/proc/loadavg: 10.09 9.69 6.96 12/282 29214
/proc/meminfo: memFree=18824608/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1029224 CPUtime=2268.91 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 2507739 0 0 0 226456 435 0 0 25 0 4 0 669825699 1053925376 189160 33554432000 4194304 4625164 140735961141968 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 257306 189160 418 106 0 252809 0
[pid=29190/tid=29192] ppid=29188 vsize=1029224 CPUtime=552.13 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 112786 0 0 0 55176 37 0 0 25 0 4 0 669825704 1053925376 189160 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1029224 CPUtime=463.34 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 113147 0 0 0 46289 45 0 0 25 0 4 0 669825704 1053925376 189160 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1029224 CPUtime=545.16 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2161337 0 0 0 54188 328 0 0 25 0 4 0 669825704 1053925376 189160 33554432000 4194304 4625164 140735961141968 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2268.91
Current children cumulated vsize (KiB) 1029224

[startup+822.3 s]
/proc/loadavg: 10.12 9.77 7.16 11/282 29215
/proc/meminfo: memFree=18757512/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1035932 CPUtime=2448.89 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 2512775 0 0 0 244451 438 0 0 25 0 4 0 669825699 1060794368 194060 33554432000 4194304 4625164 140735961141968 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 258983 194060 418 106 0 254486 0
[pid=29190/tid=29192] ppid=29188 vsize=1035932 CPUtime=582.13 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 112983 0 0 0 58175 38 0 0 25 0 4 0 669825704 1060794368 194060 33554432000 4194304 4625164 140735961141968 18446744073709551615 4339628 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1035932 CPUtime=493.33 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 114443 0 0 0 49287 46 0 0 25 0 4 0 669825704 1060794368 194060 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1035932 CPUtime=605.15 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2163032 0 0 0 60187 328 0 0 25 0 4 0 669825704 1060794368 194060 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351860 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2448.89
Current children cumulated vsize (KiB) 1035932

[startup+882.3 s]
/proc/loadavg: 10.13 9.84 7.34 11/282 29217
/proc/meminfo: memFree=18686056/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1147656 CPUtime=2628.89 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 2575125 0 0 0 262439 450 0 0 25 0 4 0 669825699 1175199744 204340 33554432000 4194304 4625164 140735961141968 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 286914 204340 418 106 0 282417 0
[pid=29190/tid=29192] ppid=29188 vsize=1147656 CPUtime=624.14 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 146516 0 0 0 62371 43 0 0 25 0 4 0 669825704 1175199744 204340 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1147656 CPUtime=523.35 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 115780 0 0 0 52286 49 0 0 25 0 4 0 669825704 1175199744 204340 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1147656 CPUtime=665.15 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2164427 0 0 0 66187 328 0 0 25 0 4 0 669825704 1175199744 204340 33554432000 4194304 4625164 140735961141968 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2628.89
Current children cumulated vsize (KiB) 1147656

[startup+942.3 s]
/proc/loadavg: 10.12 9.89 7.51 11/282 29219
/proc/meminfo: memFree=18646100/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1154100 CPUtime=2808.89 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 2584030 0 0 0 280432 457 0 0 25 0 4 0 669825699 1181798400 213105 33554432000 4194304 4625164 140735961141968 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 288525 213105 340 106 0 284028 0
[pid=29190/tid=29192] ppid=29188 vsize=1154100 CPUtime=684.15 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 150095 0 0 0 68368 47 0 0 25 0 4 0 669825704 1181798400 213105 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1154100 CPUtime=553.42 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 117597 0 0 0 55290 52 0 0 25 0 4 0 669825704 1181798400 213105 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1154100 CPUtime=718.1 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2165966 0 0 0 71481 329 0 0 25 0 4 0 669825704 1181798400 213105 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352053 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2808.89
Current children cumulated vsize (KiB) 1154100

[startup+1002.3 s]
/proc/loadavg: 10.08 9.92 7.67 11/282 29220
/proc/meminfo: memFree=18625872/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1154100 CPUtime=2988.9 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 2817670 0 0 0 298391 499 0 0 25 0 4 0 669825699 1181798400 217801 33554432000 4194304 4625164 140735961141968 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 288525 217801 340 106 0 284028 0
[pid=29190/tid=29192] ppid=29188 vsize=1154100 CPUtime=716.41 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 151582 0 0 0 71592 49 0 0 25 0 4 0 669825704 1181798400 217801 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1154100 CPUtime=603.87 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 118629 0 0 0 60335 52 0 0 25 0 4 0 669825704 1181798400 217801 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1154100 CPUtime=755.38 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2396040 0 0 0 75172 366 0 0 25 0 4 0 669825704 1181798400 217801 33554432000 4194304 4625164 140735961141968 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2988.9
Current children cumulated vsize (KiB) 1154100

[startup+1062.3 s]
/proc/loadavg: 10.21 9.99 7.84 11/282 29231
/proc/meminfo: memFree=18590708/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1154100 CPUtime=3168.88 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 3067079 0 0 0 316345 543 0 0 25 0 4 0 669825699 1181798400 227117 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 288525 227117 370 106 0 284028 0
[pid=29190/tid=29192] ppid=29188 vsize=1154100 CPUtime=753.05 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 153126 0 0 0 75252 53 0 0 25 0 4 0 669825704 1181798400 227117 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1154100 CPUtime=656.92 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 124419 0 0 0 65638 54 0 0 25 0 4 0 669825704 1181798400 227117 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1154100 CPUtime=785.68 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2637701 0 0 0 78163 405 0 0 25 0 4 0 669825704 1181798400 227117 33554432000 4194304 4625164 140735961141968 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3168.88
Current children cumulated vsize (KiB) 1154100

[startup+1122.3 s]
/proc/loadavg: 10.15 10.01 7.97 11/282 29232
/proc/meminfo: memFree=18551144/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1154100 CPUtime=3348.77 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 3292633 0 0 0 334288 589 0 0 25 0 4 0 669825699 1181798400 232415 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 288525 232415 351 106 0 284028 0
[pid=29190/tid=29192] ppid=29188 vsize=1154100 CPUtime=790.71 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 154973 0 0 0 79014 57 0 0 25 0 4 0 669825704 1181798400 232415 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1154100 CPUtime=712.11 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 126455 0 0 0 71153 58 0 0 25 0 4 0 669825704 1181798400 232415 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1154100 CPUtime=815.67 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 2858074 0 0 0 81125 442 0 0 25 0 4 0 669825704 1181798400 232415 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3348.77
Current children cumulated vsize (KiB) 1154100

[startup+1182.3 s]
/proc/loadavg: 10.12 10.02 8.10 11/282 29236
/proc/meminfo: memFree=18543300/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1219636 CPUtime=3528.69 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 3521373 0 0 0 352242 627 0 0 25 0 4 0 669825699 1248907264 237576 33554432000 4194304 4625164 140735961141968 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 304909 237576 365 106 0 300412 0
[pid=29190/tid=29192] ppid=29188 vsize=1219636 CPUtime=829 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 156634 0 0 0 82842 58 0 0 25 0 4 0 669825704 1248907264 237576 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1219636 CPUtime=764.35 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 128219 0 0 0 76373 62 0 0 25 0 4 0 669825704 1248907264 237576 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1219636 CPUtime=845.07 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 3082561 0 0 0 84032 475 0 0 25 0 4 0 669825704 1248907264 237576 33554432000 4194304 4625164 140735961141968 18446744073709551615 4552283 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3528.69
Current children cumulated vsize (KiB) 1219636

[startup+1242.3 s]
/proc/loadavg: 10.16 10.04 8.23 11/282 29270
/proc/meminfo: memFree=20570328/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1219636 CPUtime=3716.95 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 3799962 0 0 0 371024 671 0 0 25 0 4 0 669825699 1248907264 242861 33554432000 4194304 4625164 140735961141968 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 304909 242861 341 106 0 300412 0
[pid=29190/tid=29192] ppid=29188 vsize=1219636 CPUtime=869.39 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 159214 0 0 0 86878 61 0 0 25 0 4 0 669825704 1248907264 242861 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1219636 CPUtime=816.06 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 129810 0 0 0 81542 64 0 0 25 0 4 0 669825704 1248907264 242861 33554432000 4194304 4625164 140735961141968 18446744073709551615 4352776 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1219636 CPUtime=881.22 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 3355832 0 0 0 87607 515 0 0 25 0 4 0 669825704 1248907264 242861 33554432000 4194304 4625164 140735961141968 18446744073709551615 4579330 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3716.95
Current children cumulated vsize (KiB) 1219636



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.13 10.05 8.33 11/282 29271
/proc/meminfo: memFree=20529000/32951124 swapFree=61559568/67111528
[pid=29190] ppid=29188 vsize=1219636 CPUtime=3889.53 cores=1,3,5,7
/proc/29190/stat : 29190 (SArTagnan) R 29188 29190 29085 0 -1 4202496 4051475 0 0 0 388240 713 0 0 25 0 4 0 669825699 1248907264 248634 33554432000 4194304 4625164 140735961141968 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/29190/statm: 304909 248634 350 106 0 300412 0
[pid=29190/tid=29192] ppid=29188 vsize=1219636 CPUtime=911.48 cores=1,3,5,7
/proc/29190/task/29192/stat : 29192 (SArTagnan) R 29188 29190 29085 0 -1 4202560 161223 0 0 0 91085 63 0 0 25 0 4 0 669825704 1248907264 248634 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=29190/tid=29193] ppid=29188 vsize=1219636 CPUtime=855.71 cores=1,3,5,7
/proc/29190/task/29193/stat : 29193 (SArTagnan) R 29188 29190 29085 0 -1 4202560 131549 0 0 0 85506 65 0 0 25 0 4 0 669825704 1248907264 248634 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=29190/tid=29194] ppid=29188 vsize=1219636 CPUtime=914.36 cores=1,3,5,7
/proc/29190/task/29194/stat : 29194 (SArTagnan) R 29188 29190 29085 0 -1 4202560 3603032 0 0 0 90883 553 0 0 25 0 4 0 669825704 1248907264 248634 33554432000 4194304 4625164 140735961141968 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3889.53
Current children cumulated vsize (KiB) 1219636

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.06
CPU time (s): 3889.6
CPU user time (s): 3882.43
CPU system time (s): 7.17691
CPU usage (%): 299.187
Max. virtual memory (cumulated for all children) (KiB): 1219636

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3882.43
system time used= 7.17691
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4051476
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4129
involuntary context switches= 18618

runsolver used 3.15952 second user time and 8.58769 second system time

The end

Launcher Data 

Begin job on node109 at 2011-05-16 23:44:10
IDJOB=3386075
IDBENCH=83967
IDSOLVER=1871
FILE ID=node109/3386075-1305582249
RUNJOBID= node109-1305582132-29104
PBS_JOBID= 13350307
Free space on /tmp= 73060 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_21_60_7-log.shuffled-as.sat03-151.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386075-1305582249/watcher-3386075-1305582249 -o /tmp/evaluation-result-3386075-1305582249/solver-3386075-1305582249 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386075-1305582249.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5cab37809f478f7db7fa096e9a155cfe
RANDOM SEED=1293309560

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      20368928 kB
Buffers:        295052 kB
Cached:        3043348 kB
SwapCached:      28404 kB
Active:        3620560 kB
Inactive:      8723632 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      20368928 kB
SwapTotal:    67111528 kB
SwapFree:     61559568 kB
Dirty:           82988 kB
Writeback:           0 kB
AnonPages:     8983480 kB
Mapped:          21636 kB
Slab:           134368 kB
PageTables:      40668 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 33532660 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73168 MiB
End job on node109 at 2011-05-17 00:05:52