Trace number 3250958

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.35 1201.78

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf
MD5SUM1002234f62b5dfa01a75197c65e66327
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.921859
Satisfiable
(Un)Satisfiability was proved
Number of variables1285
Number of clauses166723
Sum of the clauses size334661
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2166688
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250958-1304119506/watcher-3250958-1304119506 -o /tmp/evaluation-result-3250958-1304119506/solver-3250958-1304119506 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3250958-1304119506.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.68 3.98 5.51 2/174 22316
/proc/meminfo: memFree=30590712/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=22880 CPUtime=0 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 672 0 0 0 0 0 0 0 24 0 1 0 523552961 23429120 484 33554432000 4194304 4623224 140737401334992 18446744073709551615 212436016896 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/22316/statm: 5720 485 297 105 0 1224 0

[startup+0.0159071 s]
/proc/loadavg: 1.68 3.98 5.51 2/174 22316
/proc/meminfo: memFree=30590712/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=24476 CPUtime=0.01 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 1081 0 0 0 1 0 0 0 24 0 1 0 523552961 25063424 676 33554432000 4194304 4623224 140737401334992 18446744073709551615 212435714256 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/22316/statm: 6119 695 297 105 0 1623 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 24476

[startup+0.240754 s]
/proc/loadavg: 1.68 3.98 5.51 2/174 22316
/proc/meminfo: memFree=30590712/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=273936 CPUtime=3.41 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 11598 0 0 0 339 2 0 0 25 0 4 0 523552961 280510464 9677 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510604 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 68484 9677 343 105 0 63988 0
Current children cumulated CPU time (s) 3.41
Current children cumulated vsize (KiB) 273936

[startup+0.986687 s]
/proc/loadavg: 1.68 3.98 5.51 2/174 22316
/proc/meminfo: memFree=30590712/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=282036 CPUtime=3.8 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 14074 0 0 0 378 2 0 0 25 0 4 0 523552961 288804864 11024 33554432000 4194304 4623224 140737401334992 18446744073709551615 4517833 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 70509 11037 346 105 0 66013 0
Current children cumulated CPU time (s) 3.8
Current children cumulated vsize (KiB) 282036

[startup+1.08667 s]
/proc/loadavg: 1.68 3.98 5.51 2/174 22316
/proc/meminfo: memFree=30590712/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=282036 CPUtime=4.2 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 15092 0 0 0 418 2 0 0 25 0 4 0 523552961 288804864 11797 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510030 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 70509 11797 347 105 0 66013 0
Current children cumulated CPU time (s) 4.2
Current children cumulated vsize (KiB) 282036

[startup+1.50059 s]
/proc/loadavg: 1.68 3.98 5.51 2/174 22316
/proc/meminfo: memFree=30590712/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=283356 CPUtime=5.86 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 16289 0 0 0 583 3 0 0 25 0 4 0 523552961 290156544 12987 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 70839 12987 344 105 0 66343 0
Current children cumulated CPU time (s) 5.86
Current children cumulated vsize (KiB) 283356

[startup+3.10029 s]
/proc/loadavg: 2.18 4.04 5.52 9/184 22329
/proc/meminfo: memFree=30385648/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=300576 CPUtime=12.24 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 26562 0 0 0 1220 4 0 0 25 0 4 0 523552961 307789824 19458 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 75144 19458 344 105 0 70648 0
[pid=22316/tid=22318] ppid=22314 vsize=300576 CPUtime=3.04 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 6058 0 0 0 303 1 0 0 25 0 4 0 523552965 307789824 19458 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=300576 CPUtime=3.05 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 5872 0 0 0 304 1 0 0 25 0 4 0 523552965 307789824 19458 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=300576 CPUtime=3.05 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 3917 0 0 0 305 0 0 0 25 0 4 0 523552965 307789824 19458 33554432000 4194304 4623224 140737401334992 18446744073709551615 4363945 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.24
Current children cumulated vsize (KiB) 300576

[startup+6.30068 s]
/proc/loadavg: 2.18 4.04 5.52 9/184 22329
/proc/meminfo: memFree=30320304/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=319792 CPUtime=25.03 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 48499 0 0 0 2495 8 0 0 25 0 4 0 523552961 327467008 26750 33554432000 4194304 4623224 140737401334992 18446744073709551615 4519750 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 79948 26750 345 105 0 75452 0
[pid=22316/tid=22318] ppid=22314 vsize=319792 CPUtime=6.22 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 9681 0 0 0 620 2 0 0 25 0 4 0 523552965 327467008 26750 33554432000 4194304 4623224 140737401334992 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=319792 CPUtime=6.24 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 10431 0 0 0 623 1 0 0 25 0 4 0 523552965 327467008 26750 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376862 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=319792 CPUtime=6.24 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 14242 0 0 0 623 1 0 0 25 0 4 0 523552965 327467008 26750 33554432000 4194304 4623224 140737401334992 18446744073709551615 4363746 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.03
Current children cumulated vsize (KiB) 319792

[startup+12.7005 s]
/proc/loadavg: 3.08 4.17 5.55 9/184 22329
/proc/meminfo: memFree=30218992/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=336280 CPUtime=50.62 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 84096 0 0 0 5045 17 0 0 25 0 4 0 523552961 344350720 37557 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 84070 37557 345 105 0 79574 0
[pid=22316/tid=22318] ppid=22314 vsize=336280 CPUtime=12.58 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 15683 0 0 0 1254 4 0 0 25 0 4 0 523552965 344350720 37557 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=336280 CPUtime=12.65 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 15806 0 0 0 1263 2 0 0 25 0 4 0 523552965 344350720 37557 33554432000 4194304 4623224 140737401334992 18446744073709551615 4366369 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=336280 CPUtime=12.66 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 36954 0 0 0 1260 6 0 0 25 0 4 0 523552965 344350720 37557 33554432000 4194304 4623224 140737401334992 18446744073709551615 4545312 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.62
Current children cumulated vsize (KiB) 336280

[startup+25.501 s]
/proc/loadavg: 3.91 4.31 5.58 9/184 22330
/proc/meminfo: memFree=30070832/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=374752 CPUtime=101.73 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 127897 0 0 0 10143 30 0 0 25 0 4 0 523552961 383746048 51585 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 93688 51585 344 105 0 89192 0
[pid=22316/tid=22318] ppid=22314 vsize=374752 CPUtime=25.32 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 23882 0 0 0 2523 9 0 0 25 0 4 0 523552965 383746048 51585 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=374752 CPUtime=25.44 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 24734 0 0 0 2538 6 0 0 25 0 4 0 523552965 383746048 51585 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=374752 CPUtime=25.45 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 60040 0 0 0 2535 10 0 0 25 0 4 0 523552965 383746048 51585 33554432000 4194304 4623224 140737401334992 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.73
Current children cumulated vsize (KiB) 374752

[startup+51.1012 s]
/proc/loadavg: 5.31 4.61 5.64 9/184 22330
/proc/meminfo: memFree=29841808/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=471540 CPUtime=203.99 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 348070 0 0 0 20330 69 0 0 25 0 4 0 523552961 482856960 71701 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 117885 71701 363 105 0 113389 0
[pid=22316/tid=22318] ppid=22314 vsize=471540 CPUtime=50.78 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 34052 0 0 0 5065 13 0 0 25 0 4 0 523552965 482856960 71701 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=471540 CPUtime=51.05 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 37691 0 0 0 5094 11 0 0 25 0 4 0 523552965 482856960 71701 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=471540 CPUtime=51.05 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 256256 0 0 0 5065 40 0 0 25 0 4 0 523552965 482856960 71701 33554432000 4194304 4623224 140737401334992 18446744073709551615 4366381 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.99
Current children cumulated vsize (KiB) 471540

[startup+102.3 s]
/proc/loadavg: 6.98 5.19 5.78 9/184 22332
/proc/meminfo: memFree=29293088/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=719756 CPUtime=408.51 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 922270 0 0 0 40689 162 0 0 25 0 4 0 523552961 737030144 118855 33554432000 4194304 4623224 140737401334992 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 179939 118855 415 105 0 175443 0
[pid=22316/tid=22318] ppid=22314 vsize=719756 CPUtime=101.7 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 49822 0 0 0 10151 19 0 0 25 0 4 0 523552965 737030144 118855 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=719756 CPUtime=102.25 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 56099 0 0 0 10206 19 0 0 25 0 4 0 523552965 737030144 118855 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=719756 CPUtime=102.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 742065 0 0 0 10113 112 0 0 25 0 4 0 523552965 737030144 118855 33554432000 4194304 4623224 140737401334992 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.51
Current children cumulated vsize (KiB) 719756

[startup+162.301 s]
/proc/loadavg: 7.71 5.73 5.93 9/184 22333
/proc/meminfo: memFree=28820468/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=905212 CPUtime=648.21 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 1088115 0 0 0 64625 196 0 0 25 0 4 0 523552961 926937088 168518 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510214 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 226303 168518 555 105 0 221807 0
[pid=22316/tid=22318] ppid=22314 vsize=905212 CPUtime=161.38 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 72019 0 0 0 16109 29 0 0 25 0 4 0 523552965 926937088 168518 33554432000 4194304 4623224 140737401334992 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=905212 CPUtime=162.25 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 78366 0 0 0 16199 26 0 0 25 0 4 0 523552965 926937088 168518 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=905212 CPUtime=162.26 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 819873 0 0 0 16104 122 0 0 25 0 4 0 523552965 926937088 168518 33554432000 4194304 4623224 140737401334992 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 648.21
Current children cumulated vsize (KiB) 905212

[startup+222.301 s]
/proc/loadavg: 7.98 6.17 6.06 9/184 22335
/proc/meminfo: memFree=28483408/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=1036424 CPUtime=887.88 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 1152359 0 0 0 88569 219 0 0 25 0 4 0 523552961 1061298176 197840 33554432000 4194304 4623224 140737401334992 18446744073709551615 4414978 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 259106 197840 530 105 0 254610 0
[pid=22316/tid=22318] ppid=22314 vsize=1036424 CPUtime=221.04 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 79887 0 0 0 22067 37 0 0 25 0 4 0 523552965 1061298176 197840 33554432000 4194304 4623224 140737401334992 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=1036424 CPUtime=222.25 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 86226 0 0 0 22193 32 0 0 25 0 4 0 523552965 1061298176 197840 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=1036424 CPUtime=222.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 821070 0 0 0 22102 123 0 0 25 0 4 0 523552965 1061298176 197840 33554432000 4194304 4623224 140737401334992 18446744073709551615 4355088 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.88
Current children cumulated vsize (KiB) 1036424

[startup+282.306 s]
/proc/loadavg: 8.07 6.53 6.19 9/184 22336
/proc/meminfo: memFree=28259536/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=1271720 CPUtime=1127.57 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 1399764 0 0 0 112490 267 0 0 25 0 4 0 523552961 1302241280 235636 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 317930 235636 619 105 0 313434 0
[pid=22316/tid=22318] ppid=22314 vsize=1271720 CPUtime=280.72 cores=1,3,5,7

################
# More data... #
################

[pid=22316] ppid=22314 vsize=1836720 CPUtime=2565.61 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 4630936 0 0 0 255755 806 0 0 25 0 4 0 523552961 1880801280 376017 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 459180 376017 631 105 0 454684 0
[pid=22316/tid=22318] ppid=22314 vsize=1836720 CPUtime=638.76 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 129751 0 0 0 63802 74 0 0 25 0 4 0 523552965 1880801280 376017 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=1836720 CPUtime=642.26 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 181001 0 0 0 64150 76 0 0 25 0 4 0 523552965 1880801280 376017 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=1836720 CPUtime=642.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 3934838 0 0 0 63628 597 0 0 25 0 4 0 523552965 1880801280 376017 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376649 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2565.61
Current children cumulated vsize (KiB) 1836720

[startup+702.3 s]
/proc/loadavg: 8.07 7.66 6.85 9/184 22348
/proc/meminfo: memFree=26754832/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=1902256 CPUtime=2805.29 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 5149741 0 0 0 279643 886 0 0 25 0 4 0 523552961 1947910144 390820 33554432000 4194304 4623224 140737401334992 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 475564 390820 629 105 0 471068 0
[pid=22316/tid=22318] ppid=22314 vsize=1902256 CPUtime=698.44 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 130136 0 0 0 69770 74 0 0 25 0 4 0 523552965 1947910144 390820 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=1902256 CPUtime=702.26 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 186749 0 0 0 70146 80 0 0 25 0 4 0 523552965 1947910144 390820 33554432000 4194304 4623224 140737401334992 18446744073709551615 4486260 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=1902256 CPUtime=702.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 4441522 0 0 0 69553 672 0 0 25 0 4 0 523552965 1947910144 390820 33554432000 4194304 4623224 140737401334992 18446744073709551615 4366381 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2805.29
Current children cumulated vsize (KiB) 1902256

[startup+762.301 s]
/proc/loadavg: 8.08 7.74 6.93 9/184 22349
/proc/meminfo: memFree=26330692/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2124116 CPUtime=3044.96 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 5781880 0 0 0 303507 989 0 0 25 0 4 0 523552961 2175094784 415665 33554432000 4194304 4623224 140737401334992 18446744073709551615 4415038 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 531029 415665 630 105 0 526533 0
[pid=22316/tid=22318] ppid=22314 vsize=2124116 CPUtime=758.11 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 130248 0 0 0 75737 74 0 0 25 0 4 0 523552965 2175094784 415665 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2124116 CPUtime=762.26 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 190669 0 0 0 76141 85 0 0 25 0 4 0 523552965 2175094784 415665 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2124116 CPUtime=762.24 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 4941867 0 0 0 75471 753 0 0 25 0 4 0 523552965 2175094784 415665 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3044.96
Current children cumulated vsize (KiB) 2124116

[startup+822.301 s]
/proc/loadavg: 8.03 7.78 6.99 9/184 22351
/proc/meminfo: memFree=26115152/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2189652 CPUtime=3284.66 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 6190401 0 0 0 327411 1055 0 0 25 0 4 0 523552961 2242203648 425191 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 547413 425191 629 105 0 542917 0
[pid=22316/tid=22318] ppid=22314 vsize=2189652 CPUtime=817.79 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 130810 0 0 0 81705 74 0 0 25 0 4 0 523552965 2242203648 425191 33554432000 4194304 4623224 140737401334992 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2189652 CPUtime=822.27 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 193340 0 0 0 82139 88 0 0 25 0 4 0 523552965 2242203648 425191 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376835 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2189652 CPUtime=822.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 5343567 0 0 0 81409 816 0 0 25 0 4 0 523552965 2242203648 425191 33554432000 4194304 4623224 140737401334992 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3284.66
Current children cumulated vsize (KiB) 2189652

[startup+882.301 s]
/proc/loadavg: 8.06 7.83 7.06 9/184 22352
/proc/meminfo: memFree=25997924/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2189652 CPUtime=3524.33 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 6637459 0 0 0 351302 1131 0 0 25 0 4 0 523552961 2242203648 431899 33554432000 4194304 4623224 140737401334992 18446744073709551615 4517563 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 547413 431899 629 105 0 542917 0
[pid=22316/tid=22318] ppid=22314 vsize=2189652 CPUtime=877.46 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 131232 0 0 0 87672 74 0 0 25 0 4 0 523552965 2242203648 431899 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2189652 CPUtime=882.27 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 194404 0 0 0 88138 89 0 0 25 0 4 0 523552965 2242203648 431899 33554432000 4194304 4623224 140737401334992 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2189652 CPUtime=882.24 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 5787055 0 0 0 87334 890 0 0 25 0 4 0 523552965 2242203648 431899 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3524.33
Current children cumulated vsize (KiB) 2189652

[startup+942.307 s]
/proc/loadavg: 8.07 7.88 7.12 9/184 22354
/proc/meminfo: memFree=25898444/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2189652 CPUtime=3764.02 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 7075845 0 0 0 375199 1203 0 0 25 0 4 0 523552961 2242203648 437945 33554432000 4194304 4623224 140737401334992 18446744073709551615 4508306 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 547413 437945 631 105 0 542917 0
[pid=22316/tid=22318] ppid=22314 vsize=2189652 CPUtime=937.14 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 131298 0 0 0 93640 74 0 0 25 0 4 0 523552965 2242203648 437945 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357653 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2189652 CPUtime=942.27 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 194596 0 0 0 94138 89 0 0 25 0 4 0 523552965 2242203648 437945 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2189652 CPUtime=942.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 6223268 0 0 0 93263 962 0 0 25 0 4 0 523552965 2242203648 437945 33554432000 4194304 4623224 140737401334992 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3764.02
Current children cumulated vsize (KiB) 2189652

[startup+1002.3 s]
/proc/loadavg: 8.07 7.91 7.18 9/184 22356
/proc/meminfo: memFree=25780604/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2189652 CPUtime=4003.68 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 7550057 0 0 0 399087 1281 0 0 25 0 4 0 523552961 2242203648 441192 33554432000 4194304 4623224 140737401334992 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 547413 441192 629 105 0 542917 0
[pid=22316/tid=22318] ppid=22314 vsize=2189652 CPUtime=996.81 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 131468 0 0 0 99607 74 0 0 25 0 4 0 523552965 2242203648 441192 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2189652 CPUtime=1002.27 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 194796 0 0 0 100137 90 0 0 25 0 4 0 523552965 2242203648 441192 33554432000 4194304 4623224 140737401334992 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2189652 CPUtime=1002.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 6694737 0 0 0 99186 1039 0 0 25 0 4 0 523552965 2242203648 441192 33554432000 4194304 4623224 140737401334992 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4003.68
Current children cumulated vsize (KiB) 2189652

[startup+1062.3 s]
/proc/loadavg: 8.07 7.94 7.23 9/184 22357
/proc/meminfo: memFree=25455560/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2241592 CPUtime=4243.37 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 8054348 0 0 0 422967 1370 0 0 25 0 4 0 523552961 2295390208 449739 33554432000 4194304 4623224 140737401334992 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 560398 449739 631 105 0 555902 0
[pid=22316/tid=22318] ppid=22314 vsize=2241592 CPUtime=1056.48 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 159678 0 0 0 105570 78 0 0 25 0 4 0 523552965 2295390208 449739 33554432000 4194304 4623224 140737401334992 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2241592 CPUtime=1062.27 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 195020 0 0 0 106137 90 0 0 25 0 4 0 523552965 2295390208 449739 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2241592 CPUtime=1062.25 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 7168802 0 0 0 105102 1123 0 0 25 0 4 0 523552965 2295390208 449739 33554432000 4194304 4623224 140737401334992 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4243.37
Current children cumulated vsize (KiB) 2241592

[startup+1122.3 s]
/proc/loadavg: 8.06 7.96 7.28 9/184 22359
/proc/meminfo: memFree=25324080/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2241592 CPUtime=4483.05 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 8462447 0 0 0 446866 1439 0 0 25 0 4 0 523552961 2295390208 453773 33554432000 4194304 4623224 140737401334992 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 560398 453773 629 105 0 555902 0
[pid=22316/tid=22318] ppid=22314 vsize=2241592 CPUtime=1116.16 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 159774 0 0 0 111538 78 0 0 25 0 4 0 523552965 2295390208 453773 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357772 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2241592 CPUtime=1122.28 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 195155 0 0 0 112137 91 0 0 25 0 4 0 523552965 2295390208 453773 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2241592 CPUtime=1122.26 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 7575067 0 0 0 111034 1192 0 0 25 0 4 0 523552965 2295390208 453773 33554432000 4194304 4623224 140737401334992 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4483.05
Current children cumulated vsize (KiB) 2241592

[startup+1182.3 s]
/proc/loadavg: 8.10 8.00 7.33 9/184 22360
/proc/meminfo: memFree=25199056/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2275840 CPUtime=4722.73 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 8918347 0 0 0 470753 1520 0 0 25 0 4 0 523552961 2330460160 459667 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 568960 459667 623 105 0 564464 0
[pid=22316/tid=22318] ppid=22314 vsize=2275840 CPUtime=1175.83 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 159858 0 0 0 117505 78 0 0 25 0 4 0 523552965 2330460160 459667 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357641 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2275840 CPUtime=1182.28 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 195349 0 0 0 118137 91 0 0 25 0 4 0 523552965 2330460160 459667 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2275840 CPUtime=1182.26 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 8027941 0 0 0 116954 1272 0 0 25 0 4 0 523552965 2330460160 459667 33554432000 4194304 4623224 140737401334992 18446744073709551615 4550495 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4722.73
Current children cumulated vsize (KiB) 2275840



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.21 8.03 7.36 9/184 22361
/proc/meminfo: memFree=25142116/32951124 swapFree=67111416/67111528
[pid=22316] ppid=22314 vsize=2341376 CPUtime=4800.25 cores=1,3,5,7
/proc/22316/stat : 22316 (SArTagnan) R 22314 22316 22284 0 -1 4202496 9045321 0 0 0 478480 1545 0 0 25 0 4 0 523552961 2397569024 462452 33554432000 4194304 4623224 140737401334992 18446744073709551615 4510189 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22316/statm: 585344 462452 623 105 0 580848 0
[pid=22316/tid=22318] ppid=22314 vsize=2341376 CPUtime=1195.13 cores=1,3,5,7
/proc/22316/task/22318/stat : 22318 (SArTagnan) R 22314 22316 22284 0 -1 4202560 159942 0 0 0 119435 78 0 0 25 0 4 0 523552965 2397569024 462452 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22316/tid=22319] ppid=22314 vsize=2341376 CPUtime=1201.68 cores=1,3,5,7
/proc/22316/task/22319/stat : 22319 (SArTagnan) R 22314 22316 22284 0 -1 4202560 195397 0 0 0 120077 91 0 0 25 0 4 0 523552965 2397569024 462452 33554432000 4194304 4623224 140737401334992 18446744073709551615 4357576 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=22316/tid=22320] ppid=22314 vsize=2341376 CPUtime=1201.66 cores=1,3,5,7
/proc/22316/task/22320/stat : 22320 (SArTagnan) R 22314 22316 22284 0 -1 4202560 8153794 0 0 0 118870 1296 0 0 25 0 4 0 523552965 2397569024 462452 33554432000 4194304 4623224 140737401334992 18446744073709551615 4544945 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 2341376

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.78
CPU time (s): 4800.35
CPU user time (s): 4784.82
CPU system time (s): 15.5226
CPU usage (%): 399.435
Max. virtual memory (cumulated for all children) (KiB): 2565592

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4784.82
system time used= 15.5226
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9045323
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2475
involuntary context switches= 17536

runsolver used 1.85172 second user time and 4.71228 second system time

The end

Launcher Data 

Begin job on node102 at 2011-04-30 01:25:06
IDJOB=3250958
IDBENCH=88205
IDSOLVER=1656
FILE ID=node102/3250958-1304119506
RUNJOBID= node102-1304119506-22303
PBS_JOBID= 13170726
Free space on /tmp= 71556 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q446.25-n35-p30-s33692332.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250958-1304119506/watcher-3250958-1304119506 -o /tmp/evaluation-result-3250958-1304119506/solver-3250958-1304119506 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3250958-1304119506.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1002234f62b5dfa01a75197c65e66327
RANDOM SEED=819906632

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30590992 kB
Buffers:        604372 kB
Cached:        1270152 kB
SwapCached:          0 kB
Active:         142060 kB
Inactive:      1800284 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30590992 kB
SwapTotal:    67111528 kB
SwapFree:     67111416 kB
Dirty:            5188 kB
Writeback:           0 kB
AnonPages:       68100 kB
Mapped:          14372 kB
Slab:           351768 kB
PageTables:       4648 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   192032 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71552 MiB
End job on node102 at 2011-04-30 01:45:10