Trace number 3385839

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.51 1204.1

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf
MD5SUMc86ce640ddb0138bf41ccc37bc6fcf28
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.84587
Satisfiable
(Un)Satisfiability was proved
Number of variables1295
Number of clauses148400
Sum of the clauses size298025
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2148365
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385839-1305583688/watcher-3385839-1305583688 -o /tmp/evaluation-result-3385839-1305583688/solver-3385839-1305583688 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385839-1305583688.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.89 7.90 7.93 2/378 5588
/proc/meminfo: memFree=22112404/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=22452 CPUtime=0 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 687 0 0 0 0 0 0 0 22 0 1 0 669967544 22990848 499 33554432000 4194304 4625164 140733531821056 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/5588/statm: 5613 499 296 106 0 1116 0

[startup+0.158238 s]
/proc/loadavg: 6.89 7.90 7.93 2/378 5588
/proc/meminfo: memFree=22112404/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=198640 CPUtime=0.49 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 6126 0 0 0 48 1 0 0 18 0 4 0 669967544 203407360 4370 33554432000 4194304 4625164 140733531821056 18446744073709551615 235594971679 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 52781 10454 345 106 0 48284 0
Current children cumulated CPU time (s) 0.49
Current children cumulated vsize (KiB) 198640

[startup+0.958101 s]
/proc/loadavg: 6.89 7.90 7.93 2/378 5588
/proc/meminfo: memFree=22112404/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=211124 CPUtime=3.7 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 14012 0 0 0 368 2 0 0 19 0 4 0 669967544 216190976 10667 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393089 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 52781 10667 345 106 0 48284 0
Current children cumulated CPU time (s) 3.7
Current children cumulated vsize (KiB) 211124

[startup+1.05808 s]
/proc/loadavg: 6.89 7.90 7.93 2/378 5588
/proc/meminfo: memFree=22112404/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=211496 CPUtime=4.09 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 14400 0 0 0 407 2 0 0 19 0 4 0 669967544 216571904 10937 33554432000 4194304 4625164 140733531821056 18446744073709551615 4512029 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 52874 10937 345 106 0 48377 0
Current children cumulated CPU time (s) 4.09
Current children cumulated vsize (KiB) 211496

[startup+1.15806 s]
/proc/loadavg: 6.89 7.90 7.93 2/378 5588
/proc/meminfo: memFree=22112404/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=211496 CPUtime=4.5 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 15455 0 0 0 447 3 0 0 19 0 4 0 669967544 216571904 11789 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 52874 11789 362 106 0 48377 0
Current children cumulated CPU time (s) 4.5
Current children cumulated vsize (KiB) 211496

[startup+1.50101 s]
/proc/loadavg: 6.89 7.90 7.93 2/378 5588
/proc/meminfo: memFree=22112404/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=213880 CPUtime=5.87 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 17605 0 0 0 584 3 0 0 19 0 4 0 669967544 219013120 12849 33554432000 4194304 4625164 140733531821056 18446744073709551615 4512475 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 53470 12849 345 106 0 48973 0
Current children cumulated CPU time (s) 5.87
Current children cumulated vsize (KiB) 213880

[startup+3.10073 s]
/proc/loadavg: 6.89 7.90 7.93 9/388 5601
/proc/meminfo: memFree=21857648/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=225904 CPUtime=12.23 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 28292 0 0 0 1219 4 0 0 25 0 4 0 669967544 231325696 18823 33554432000 4194304 4625164 140733531821056 18446744073709551615 4512078 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 56476 18823 346 106 0 51979 0
[pid=5588/tid=5590] ppid=5586 vsize=225904 CPUtime=3.05 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 3394 0 0 0 305 0 0 0 25 0 4 0 669967547 231325696 18823 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=225904 CPUtime=3.02 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 5117 0 0 0 301 1 0 0 25 0 4 0 669967547 231325696 18823 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=225904 CPUtime=3.05 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 11141 0 0 0 304 1 0 0 25 0 4 0 669967547 231325696 18823 33554432000 4194304 4625164 140733531821056 18446744073709551615 4560539 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.23
Current children cumulated vsize (KiB) 225904

[startup+6.31516 s]
/proc/loadavg: 6.97 7.90 7.93 9/388 5601
/proc/meminfo: memFree=21738988/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=308604 CPUtime=25.05 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 58929 0 0 0 2496 9 0 0 25 0 4 0 669967544 316010496 27910 33554432000 4194304 4625164 140733531821056 18446744073709551615 4511811 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 77151 27910 346 106 0 72654 0
[pid=5588/tid=5590] ppid=5586 vsize=308604 CPUtime=6.26 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 7899 0 0 0 625 1 0 0 25 0 4 0 669967547 316010496 27910 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=308604 CPUtime=6.2 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 8621 0 0 0 618 2 0 0 25 0 4 0 669967547 316010496 27910 33554432000 4194304 4625164 140733531821056 18446744073709551615 4317312 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=308604 CPUtime=6.27 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 31331 0 0 0 623 4 0 0 25 0 4 0 669967547 316010496 27910 33554432000 4194304 4625164 140733531821056 18446744073709551615 4552307 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.05
Current children cumulated vsize (KiB) 308604

[startup+12.701 s]
/proc/loadavg: 7.06 7.90 7.93 9/388 5601
/proc/meminfo: memFree=21597904/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=331412 CPUtime=50.52 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 85247 0 0 0 5038 14 0 0 25 0 4 0 669967544 339365888 39398 33554432000 4194304 4625164 140733531821056 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 82853 39398 348 106 0 78356 0
[pid=5588/tid=5590] ppid=5586 vsize=331412 CPUtime=12.64 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 13347 0 0 0 1263 1 0 0 25 0 4 0 669967547 339365888 39398 33554432000 4194304 4625164 140733531821056 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=331412 CPUtime=12.51 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 14636 0 0 0 1247 4 0 0 25 0 4 0 669967547 339365888 39398 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=331412 CPUtime=12.65 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 42909 0 0 0 1261 4 0 0 25 0 4 0 669967547 339365888 39398 33554432000 4194304 4625164 140733531821056 18446744073709551615 4334197 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.52
Current children cumulated vsize (KiB) 331412

[startup+25.5008 s]
/proc/loadavg: 7.27 7.91 7.93 9/388 5601
/proc/meminfo: memFree=21294188/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=369464 CPUtime=101.55 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 170311 0 0 0 10126 29 0 0 25 0 4 0 669967544 378331136 57142 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393089 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 92366 57142 346 106 0 87869 0
[pid=5588/tid=5590] ppid=5586 vsize=369464 CPUtime=25.44 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 21151 0 0 0 2540 4 0 0 25 0 4 0 669967547 378331136 57142 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=369464 CPUtime=25.14 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 23069 0 0 0 2508 6 0 0 25 0 4 0 669967547 378331136 57142 33554432000 4194304 4625164 140733531821056 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=369464 CPUtime=25.45 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 106657 0 0 0 2531 14 0 0 25 0 4 0 669967547 378331136 57142 33554432000 4194304 4625164 140733531821056 18446744073709551615 4547270 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.55
Current children cumulated vsize (KiB) 369464

[startup+51.1003 s]
/proc/loadavg: 7.64 7.94 7.94 9/388 5602
/proc/meminfo: memFree=20758320/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=572960 CPUtime=203.62 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 269477 0 0 0 20310 52 0 0 25 0 4 0 669967544 586711040 89509 33554432000 4194304 4625164 140733531821056 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 143240 89509 354 106 0 138743 0
[pid=5588/tid=5590] ppid=5586 vsize=572960 CPUtime=51.04 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 34236 0 0 0 5096 8 0 0 25 0 4 0 669967547 586711040 89509 33554432000 4194304 4625164 140733531821056 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=572960 CPUtime=50.42 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 37986 0 0 0 5028 14 0 0 25 0 4 0 669967547 586711040 89509 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=572960 CPUtime=51.05 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 160546 0 0 0 5084 21 0 0 25 0 4 0 669967547 586711040 89509 33554432000 4194304 4625164 140733531821056 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 203.62
Current children cumulated vsize (KiB) 572960

[startup+102.3 s]
/proc/loadavg: 7.91 7.97 7.95 9/388 5603
/proc/meminfo: memFree=20288584/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=809816 CPUtime=407.75 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 622864 0 0 0 40663 112 0 0 25 0 4 0 669967544 829251584 148415 33554432000 4194304 4625164 140733531821056 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 202454 148415 385 106 0 197957 0
[pid=5588/tid=5590] ppid=5586 vsize=809816 CPUtime=102.24 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 56329 0 0 0 10207 17 0 0 25 0 4 0 669967547 829251584 148415 33554432000 4194304 4625164 140733531821056 18446744073709551615 4353587 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=809816 CPUtime=100.96 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 52879 0 0 0 10076 20 0 0 25 0 4 0 669967547 829251584 148415 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=809816 CPUtime=102.25 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 402110 0 0 0 10169 56 0 0 25 0 4 0 669967547 829251584 148415 33554432000 4194304 4625164 140733531821056 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 407.75
Current children cumulated vsize (KiB) 809816

[startup+162.301 s]
/proc/loadavg: 8.08 8.00 7.96 9/388 5605
/proc/meminfo: memFree=19899068/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=1130324 CPUtime=646.97 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 1273319 0 0 0 64483 214 0 0 25 0 4 0 669967544 1157451776 216738 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393112 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 282581 216738 556 106 0 278084 0
[pid=5588/tid=5590] ppid=5586 vsize=1130324 CPUtime=162.23 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 83313 0 0 0 16195 28 0 0 25 0 4 0 669967547 1157451776 216738 33554432000 4194304 4625164 140733531821056 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=1130324 CPUtime=160.21 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 72628 0 0 0 15997 24 0 0 25 0 4 0 669967547 1157451776 216738 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=1130324 CPUtime=162.24 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 874915 0 0 0 16100 124 0 0 25 0 4 0 669967547 1157451776 216738 33554432000 4194304 4625164 140733531821056 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 646.97
Current children cumulated vsize (KiB) 1130324

[startup+222.3 s]
/proc/loadavg: 8.10 8.02 7.96 9/388 5606
/proc/meminfo: memFree=19593636/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=1382352 CPUtime=886.19 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 1953794 0 0 0 88297 322 0 0 25 0 4 0 669967544 1415528448 269513 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 345588 269513 523 106 0 341091 0
[pid=5588/tid=5590] ppid=5586 vsize=1382352 CPUtime=222.24 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 96722 0 0 0 22192 32 0 0 25 0 4 0 669967547 1415528448 269513 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=1382352 CPUtime=219.43 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 98050 0 0 0 21913 30 0 0 25 0 4 0 669967547 1415528448 269513 33554432000 4194304 4625164 140733531821056 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=1382352 CPUtime=222.24 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 1438938 0 0 0 22017 207 0 0 25 0 4 0 669967547 1415528448 269513 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 886.19
Current children cumulated vsize (KiB) 1382352

[startup+282.301 s]
/proc/loadavg: 8.10 8.03 7.97 9/388 5608
/proc/meminfo: memFree=19244536/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=1527396 CPUtime=1125.44 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 2655800 0 0 0 112107 437 0 0 25 0 4 0 669967544 1564053504 302449 33554432000 4194304 4625164 140733531821056 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 381849 302449 523 106 0 377352 0
[pid=5588/tid=5590] ppid=5586 vsize=1527396 CPUtime=282.25 cores=0,2,4,6

################
# More data... #
################

[pid=5588] ppid=5586 vsize=2131224 CPUtime=2560.76 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 5573155 0 0 0 255149 927 0 0 25 0 4 0 669967544 2182373376 420844 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 532806 420844 523 106 0 528309 0
[pid=5588/tid=5590] ppid=5586 vsize=2131224 CPUtime=642.24 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 118941 0 0 0 64189 35 0 0 25 0 4 0 669967547 2182373376 420844 33554432000 4194304 4625164 140733531821056 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2131224 CPUtime=634.1 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 162364 0 0 0 63342 68 0 0 25 0 4 0 669967547 2182373376 420844 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2131224 CPUtime=642.21 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 4394025 0 0 0 63546 675 0 0 25 0 4 0 669967547 2182373376 420844 33554432000 4194304 4625164 140733531821056 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2560.76
Current children cumulated vsize (KiB) 2131224

[startup+702.301 s]
/proc/loadavg: 8.11 8.09 8.01 9/388 5619
/proc/meminfo: memFree=18404332/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2196760 CPUtime=2800 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 6130136 0 0 0 278980 1020 0 0 25 0 4 0 669967544 2249482240 427463 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 549190 427463 523 106 0 544693 0
[pid=5588/tid=5590] ppid=5586 vsize=2196760 CPUtime=702.24 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 119054 0 0 0 70189 35 0 0 25 0 4 0 669967547 2249482240 427463 33554432000 4194304 4625164 140733531821056 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2196760 CPUtime=693.35 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 162654 0 0 0 69267 68 0 0 25 0 4 0 669967547 2249482240 427463 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2196760 CPUtime=702.21 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 4913852 0 0 0 69461 760 0 0 25 0 4 0 669967547 2249482240 427463 33554432000 4194304 4625164 140733531821056 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2800
Current children cumulated vsize (KiB) 2196760

[startup+762.3 s]
/proc/loadavg: 8.08 8.08 8.01 9/388 5621
/proc/meminfo: memFree=18331140/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2225660 CPUtime=3039.21 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 6653836 0 0 0 302817 1104 0 0 25 0 4 0 669967544 2279075840 435179 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 556415 435179 523 106 0 551918 0
[pid=5588/tid=5590] ppid=5586 vsize=2225660 CPUtime=762.25 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 119513 0 0 0 76189 36 0 0 25 0 4 0 669967547 2279075840 435179 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2225660 CPUtime=752.58 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 162786 0 0 0 75190 68 0 0 25 0 4 0 669967547 2279075840 435179 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2225660 CPUtime=762.22 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 5347346 0 0 0 75394 828 0 0 25 0 4 0 669967547 2279075840 435179 33554432000 4194304 4625164 140733531821056 18446744073709551615 4547216 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3039.21
Current children cumulated vsize (KiB) 2225660

[startup+822.301 s]
/proc/loadavg: 8.10 8.10 8.01 9/388 5622
/proc/meminfo: memFree=18259304/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2291196 CPUtime=3278.46 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 7210831 0 0 0 326644 1202 0 0 25 0 4 0 669967544 2346184704 442399 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393112 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 572799 442399 523 106 0 568302 0
[pid=5588/tid=5590] ppid=5586 vsize=2291196 CPUtime=822.25 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 119597 0 0 0 82189 36 0 0 25 0 4 0 669967547 2346184704 442399 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2291196 CPUtime=811.83 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 163192 0 0 0 81114 69 0 0 25 0 4 0 669967547 2346184704 442400 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2291196 CPUtime=822.22 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 5794678 0 0 0 81317 905 0 0 25 0 4 0 669967547 2346184704 442400 33554432000 4194304 4625164 140733531821056 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3278.46
Current children cumulated vsize (KiB) 2291196

[startup+882.3 s]
/proc/loadavg: 8.18 8.12 8.02 9/388 5624
/proc/meminfo: memFree=18187232/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2291196 CPUtime=3517.67 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 7789045 0 0 0 350474 1293 0 0 25 0 4 0 669967544 2346184704 449940 33554432000 4194304 4625164 140733531821056 18446744073709551615 4512891 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 572799 449940 523 106 0 568302 0
[pid=5588/tid=5590] ppid=5586 vsize=2291196 CPUtime=882.25 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 119682 0 0 0 88189 36 0 0 25 0 4 0 669967547 2346184704 449940 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2291196 CPUtime=871.06 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 163447 0 0 0 87037 69 0 0 25 0 4 0 669967547 2346184704 449940 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2291196 CPUtime=882.22 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 6266860 0 0 0 87243 979 0 0 25 0 4 0 669967547 2346184704 449940 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3517.67
Current children cumulated vsize (KiB) 2291196

[startup+942.301 s]
/proc/loadavg: 8.25 8.14 8.03 9/388 5626
/proc/meminfo: memFree=18001072/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2291196 CPUtime=3756.93 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 8413879 0 0 0 374301 1392 0 0 25 0 4 0 669967544 2346184704 456803 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 572799 456803 523 106 0 568302 0
[pid=5588/tid=5590] ppid=5586 vsize=2291196 CPUtime=942.27 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 119868 0 0 0 94191 36 0 0 25 0 4 0 669967547 2346184704 456728 33554432000 4194304 4625164 140733531821056 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2291196 CPUtime=930.3 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 163806 0 0 0 92961 69 0 0 25 0 4 0 669967547 2346184704 456728 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2291196 CPUtime=942.24 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 6778113 0 0 0 93165 1059 0 0 25 0 4 0 669967547 2346184704 456728 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3756.93
Current children cumulated vsize (KiB) 2291196

[startup+1002.3 s]
/proc/loadavg: 8.23 8.15 8.04 9/388 5627
/proc/meminfo: memFree=17937928/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2291196 CPUtime=3996.14 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 9042158 0 0 0 398119 1495 0 0 25 0 4 0 669967544 2346184704 462711 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 572799 462711 524 106 0 568302 0
[pid=5588/tid=5590] ppid=5586 vsize=2291196 CPUtime=1002.26 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 120019 0 0 0 100190 36 0 0 25 0 4 0 669967547 2346184704 462711 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2291196 CPUtime=989.53 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 164172 0 0 0 98884 69 0 0 25 0 4 0 669967547 2346184704 462711 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2291196 CPUtime=1002.23 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 7298148 0 0 0 99080 1143 0 0 25 0 4 0 669967547 2346184704 462711 33554432000 4194304 4625164 140733531821056 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3996.14
Current children cumulated vsize (KiB) 2291196

[startup+1062.32 s]
/proc/loadavg: 8.21 8.15 8.04 9/388 5629
/proc/meminfo: memFree=17878368/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2356732 CPUtime=4235.42 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 9645327 0 0 0 421950 1592 0 0 25 0 4 0 669967544 2413293568 470670 33554432000 4194304 4625164 140733531821056 18446744073709551615 4519357 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 589183 470670 523 106 0 584686 0
[pid=5588/tid=5590] ppid=5586 vsize=2356732 CPUtime=1062.27 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 120221 0 0 0 106191 36 0 0 25 0 4 0 669967547 2413293568 470670 33554432000 4194304 4625164 140733531821056 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2356732 CPUtime=1048.79 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 164497 0 0 0 104809 70 0 0 25 0 4 0 669967547 2413293568 470670 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2356732 CPUtime=1062.24 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 7794366 0 0 0 105002 1222 0 0 25 0 4 0 669967547 2413293568 470670 33554432000 4194304 4625164 140733531821056 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4235.42
Current children cumulated vsize (KiB) 2356732

[startup+1122.3 s]
/proc/loadavg: 8.20 8.15 8.05 9/388 5630
/proc/meminfo: memFree=17816712/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2356732 CPUtime=4474.59 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 10246469 0 0 0 445765 1694 0 0 25 0 4 0 669967544 2413293568 477554 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393124 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 589183 477554 523 106 0 584686 0
[pid=5588/tid=5590] ppid=5586 vsize=2356732 CPUtime=1122.26 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 120334 0 0 0 112190 36 0 0 25 0 4 0 669967547 2413293568 477554 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2356732 CPUtime=1108.02 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 164769 0 0 0 110732 70 0 0 25 0 4 0 669967547 2413293568 477554 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2356732 CPUtime=1122.23 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 8282528 0 0 0 110919 1304 0 0 25 0 4 0 669967547 2413293568 477554 33554432000 4194304 4625164 140733531821056 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4474.59
Current children cumulated vsize (KiB) 2356732

[startup+1182.3 s]
/proc/loadavg: 8.12 8.14 8.05 9/388 5632
/proc/meminfo: memFree=17751076/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2356732 CPUtime=4713.82 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 10854957 0 0 0 469588 1794 0 0 25 0 4 0 669967544 2413293568 483207 33554432000 4194304 4625164 140733531821056 18446744073709551615 4519369 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 589183 483207 523 106 0 584686 0
[pid=5588/tid=5590] ppid=5586 vsize=2356732 CPUtime=1182.26 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 120429 0 0 0 118190 36 0 0 25 0 4 0 669967547 2413293568 483207 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2356732 CPUtime=1167.24 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 165128 0 0 0 116654 70 0 0 25 0 4 0 669967547 2413293568 483207 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2356732 CPUtime=1182.22 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 8781569 0 0 0 116840 1382 0 0 25 0 4 0 669967547 2413293568 483207 33554432000 4194304 4625164 140733531821056 18446744073709551615 4334473 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4713.82
Current children cumulated vsize (KiB) 2356732



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204 s]
/proc/loadavg: 8.08 8.12 8.04 9/388 5633
/proc/meminfo: memFree=17735932/32950928 swapFree=45972156/67111528
[pid=5588] ppid=5586 vsize=2356732 CPUtime=4800.38 cores=0,2,4,6
/proc/5588/stat : 5588 (SArTagnan) R 5586 5588 4682 0 -1 4202496 11077914 0 0 0 478204 1834 0 0 25 0 4 0 669967544 2413293568 485414 33554432000 4194304 4625164 140733531821056 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/5588/statm: 589183 485414 523 106 0 584686 0
[pid=5588/tid=5590] ppid=5586 vsize=2356732 CPUtime=1203.97 cores=0,2,4,6
/proc/5588/task/5590/stat : 5590 (SArTagnan) R 5586 5588 4682 0 -1 4202560 120453 0 0 0 120361 36 0 0 25 0 4 0 669967547 2413293568 485414 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5588/tid=5591] ppid=5586 vsize=2356732 CPUtime=1188.67 cores=0,2,4,6
/proc/5588/task/5591/stat : 5591 (SArTagnan) R 5586 5588 4682 0 -1 4202560 165185 0 0 0 118797 70 0 0 25 0 4 0 669967547 2413293568 485414 33554432000 4194304 4625164 140733531821056 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5588/tid=5592] ppid=5586 vsize=2356732 CPUtime=1203.94 cores=0,2,4,6
/proc/5588/task/5592/stat : 5592 (SArTagnan) R 5586 5588 4682 0 -1 4202560 8971754 0 0 0 118979 1415 0 0 25 0 4 0 669967547 2413293568 485414 33554432000 4194304 4625164 140733531821056 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.38
Current children cumulated vsize (KiB) 2356732

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.1
CPU time (s): 4800.51
CPU user time (s): 4782.08
CPU system time (s): 18.4232
CPU usage (%): 398.679
Max. virtual memory (cumulated for all children) (KiB): 2444172

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4782.08
system time used= 18.4232
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11078306
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2150
involuntary context switches= 21396

runsolver used 4.03739 second user time and 11.3073 second system time

The end

Launcher Data 

Begin job on node120 at 2011-05-17 00:08:08
IDJOB=3385839
IDBENCH=88218
IDSOLVER=1871
FILE ID=node120/3385839-1305583688
RUNJOBID= node120-1305583688-5574
PBS_JOBID= 13350219
Free space on /tmp= 73496 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385839-1305583688/watcher-3385839-1305583688 -o /tmp/evaluation-result-3385839-1305583688/solver-3385839-1305583688 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385839-1305583688.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c86ce640ddb0138bf41ccc37bc6fcf28
RANDOM SEED=9348677

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      22112560 kB
Buffers:         84512 kB
Cached:         566800 kB
SwapCached:      63496 kB
Active:         409596 kB
Inactive:     10202864 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      22112560 kB
SwapTotal:    67111528 kB
SwapFree:     45972156 kB
Dirty:            4044 kB
Writeback:           0 kB
AnonPages:     9903316 kB
Mapped:          15432 kB
Slab:            77812 kB
PageTables:      81696 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 78717720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73484 MiB
End job on node120 at 2011-05-17 00:28:14