Trace number 3385852

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4398.49 1300.11

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m52-q918.75-n50-p15-s98191766.cnf
MD5SUM71638ad618721ad48c6bd2d48b828020
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark3.2785
Satisfiable
(Un)Satisfiability was proved
Number of variables2377
Number of clauses566749
Sum of the clauses size1135775
Maximum clause length52
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2566699
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 550

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385852-1305583791/watcher-3385852-1305583791 -o /tmp/evaluation-result-3385852-1305583791/solver-3385852-1305583791 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385852-1305583791.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.19 9.11 8.05 7/482 1795
/proc/meminfo: memFree=11347924/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=32136 CPUtime=0 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 533 0 0 0 0 0 0 0 25 0 1 0 748609746 32907264 471 33554432000 4194304 4625164 140735831716384 18446744073709551615 216735178496 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1795/statm: 8034 471 296 106 0 3537 0

[startup+0.02494 s]
/proc/loadavg: 9.19 9.11 8.05 7/482 1795
/proc/meminfo: memFree=11347924/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=33492 CPUtime=0.02 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 1454 0 0 0 2 0 0 0 25 0 1 0 748609746 34295808 723 33554432000 4194304 4625164 140735831716384 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1795/statm: 8373 724 296 106 0 3876 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 33492

[startup+0.100927 s]
/proc/loadavg: 9.19 9.11 8.05 7/482 1795
/proc/meminfo: memFree=11347924/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=39536 CPUtime=0.09 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 5492 0 0 0 9 0 0 0 25 0 1 0 748609746 40484864 1744 33554432000 4194304 4625164 140735831716384 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1795/statm: 9884 1744 296 106 0 5387 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 39536

[startup+0.300859 s]
/proc/loadavg: 9.19 9.11 8.05 7/482 1795
/proc/meminfo: memFree=11347924/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=292672 CPUtime=0.57 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 13984 0 0 0 56 1 0 0 25 0 4 0 748609746 299696128 9719 33554432000 4194304 4625164 140735831716384 18446744073709551615 216734875767 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 73168 9729 333 106 0 68671 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 292672

[startup+0.700789 s]
/proc/loadavg: 9.19 9.11 8.05 7/482 1795
/proc/meminfo: memFree=11347924/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=297896 CPUtime=1.76 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 19140 0 0 0 174 2 0 0 25 0 4 0 748609746 305045504 14863 33554432000 4194304 4625164 140735831716384 18446744073709551615 216734876025 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1795/statm: 74474 14864 335 106 0 69977 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 297896

[startup+1.50065 s]
/proc/loadavg: 9.19 9.11 8.05 11/486 1799
/proc/meminfo: memFree=11269392/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=325216 CPUtime=4.13 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 36887 0 0 0 409 4 0 0 25 0 4 0 748609746 333021184 23361 33554432000 4194304 4625164 140735831716384 18446744073709551615 4360205 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 81304 23361 348 106 0 76807 0
[pid=1795/tid=1797] ppid=1793 vsize=325216 CPUtime=1.21 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 2922 0 0 0 121 0 0 0 25 0 4 0 748609760 333021184 23361 33554432000 4194304 4625164 140735831716384 18446744073709551615 4316846 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=325216 CPUtime=1.21 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 2908 0 0 0 121 0 0 0 19 0 4 0 748609760 333021184 23361 33554432000 4194304 4625164 140735831716384 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=325216 CPUtime=1.34 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 1516 0 0 0 134 0 0 0 25 0 4 0 748609760 333021184 23361 33554432000 4194304 4625164 140735831716384 18446744073709551615 4547398 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.13
Current children cumulated vsize (KiB) 325216

[startup+3.10037 s]
/proc/loadavg: 9.19 9.11 8.05 10/486 1799
/proc/meminfo: memFree=11201804/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=435064 CPUtime=8.91 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 131278 0 0 0 872 19 0 0 18 0 4 0 748609746 445505536 63809 33554432000 4194304 4625164 140735831716384 18446744073709551615 4360558 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 108766 63809 386 106 0 104269 0
[pid=1795/tid=1797] ppid=1793 vsize=435064 CPUtime=2.44 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 4135 0 0 0 244 0 0 0 25 0 4 0 748609760 445505536 63809 33554432000 4194304 4625164 140735831716384 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=435064 CPUtime=2.32 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 5544 0 0 0 232 0 0 0 21 0 4 0 748609760 445505536 63809 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=435064 CPUtime=2.94 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 3225 0 0 0 294 0 0 0 25 0 4 0 748609760 445505536 63809 33554432000 4194304 4625164 140735831716384 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 8.91
Current children cumulated vsize (KiB) 435064

[startup+6.30081 s]
/proc/loadavg: 9.18 9.10 8.06 10/486 1799
/proc/meminfo: memFree=11014812/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=506060 CPUtime=18.46 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 151963 0 0 0 1824 22 0 0 22 0 4 0 748609746 518205440 83696 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393091 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 126515 83696 705 106 0 122018 0
[pid=1795/tid=1797] ppid=1793 vsize=506060 CPUtime=3.22 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 5475 0 0 0 322 0 0 0 25 0 4 0 748609760 518205440 83696 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=506060 CPUtime=5.52 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 8260 0 0 0 551 1 0 0 25 0 4 0 748609760 518205440 83696 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=506060 CPUtime=6.14 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 3443 0 0 0 614 0 0 0 25 0 4 0 748609760 518205440 83696 33554432000 4194304 4625164 140735831716384 18446744073709551615 4335146 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.46
Current children cumulated vsize (KiB) 506060

[startup+12.7007 s]
/proc/loadavg: 9.16 9.10 8.06 10/486 1799
/proc/meminfo: memFree=10981612/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=537492 CPUtime=37.55 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 161732 0 0 0 3732 23 0 0 25 0 4 0 748609746 550391808 93384 33554432000 4194304 4625164 140735831716384 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 134373 93384 846 106 0 129876 0
[pid=1795/tid=1797] ppid=1793 vsize=537492 CPUtime=6.62 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 10561 0 0 0 661 1 0 0 25 0 4 0 748609760 550391808 93384 33554432000 4194304 4625164 140735831716384 18446744073709551615 4339546 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=537492 CPUtime=8.6 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 11718 0 0 0 859 1 0 0 25 0 4 0 748609760 550391808 93384 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=537492 CPUtime=12.53 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 4662 0 0 0 1253 0 0 0 25 0 4 0 748609760 550391808 93384 33554432000 4194304 4625164 140735831716384 18446744073709551615 4334254 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 37.55
Current children cumulated vsize (KiB) 537492

[startup+25.5005 s]
/proc/loadavg: 9.12 9.10 8.08 10/486 1799
/proc/meminfo: memFree=10948252/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=546316 CPUtime=75.74 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 180806 0 0 0 7547 27 0 0 25 0 4 0 748609746 559427584 97378 33554432000 4194304 4625164 140735831716384 18446744073709551615 4512432 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 136579 97378 679 106 0 132082 0
[pid=1795/tid=1797] ppid=1793 vsize=546316 CPUtime=13.12 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 11699 0 0 0 1311 1 0 0 25 0 4 0 748609760 559427584 97378 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=546316 CPUtime=14.91 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 12393 0 0 0 1489 2 0 0 25 0 4 0 748609760 559427584 97378 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=546316 CPUtime=25.33 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 21920 0 0 0 2530 3 0 0 25 0 4 0 748609760 559427584 97378 33554432000 4194304 4625164 140735831716384 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 75.74
Current children cumulated vsize (KiB) 546316

[startup+51.101 s]
/proc/loadavg: 9.14 9.10 8.11 10/486 1800
/proc/meminfo: memFree=10891748/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=642492 CPUtime=152.15 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 202554 0 0 0 15182 33 0 0 25 0 4 0 748609746 657911808 109841 33554432000 4194304 4625164 140735831716384 18446744073709551615 4338080 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 160623 109841 718 106 0 156126 0
[pid=1795/tid=1797] ppid=1793 vsize=642492 CPUtime=26.03 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 23458 0 0 0 2599 4 0 0 25 0 4 0 748609760 657911808 109841 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=642492 CPUtime=27.61 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 20929 0 0 0 2756 5 0 0 25 0 4 0 748609760 657911808 109841 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=642492 CPUtime=50.94 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 23350 0 0 0 5090 4 0 0 25 0 4 0 748609760 657911808 109841 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 152.15
Current children cumulated vsize (KiB) 642492

[startup+102.318 s]
/proc/loadavg: 9.25 9.13 8.17 10/486 1801
/proc/meminfo: memFree=10729148/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=786352 CPUtime=304.98 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 305285 0 0 0 30451 47 0 0 25 0 4 0 748609746 805224448 144323 33554432000 4194304 4625164 140735831716384 18446744073709551615 4365352 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 196588 144323 384 106 0 192091 0
[pid=1795/tid=1797] ppid=1793 vsize=786352 CPUtime=65.9 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 35083 0 0 0 6584 6 0 0 25 0 4 0 748609760 805224448 144323 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=786352 CPUtime=53.12 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 38976 0 0 0 5305 7 0 0 25 0 4 0 748609760 805224448 144323 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=786352 CPUtime=87.98 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 45660 0 0 0 8792 6 0 0 25 0 4 0 748609760 805224448 144323 33554432000 4194304 4625164 140735831716384 18446744073709551615 216734875856 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 304.98
Current children cumulated vsize (KiB) 786352

[startup+162.301 s]
/proc/loadavg: 9.19 9.14 8.23 11/486 1803
/proc/meminfo: memFree=10483328/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=1081116 CPUtime=493.18 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 793316 0 0 0 49203 115 0 0 25 0 4 0 748609746 1107062784 203489 33554432000 4194304 4625164 140735831716384 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 270279 203489 473 106 0 265782 0
[pid=1795/tid=1797] ppid=1793 vsize=1081116 CPUtime=99.74 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 42594 0 0 0 9966 8 0 0 25 0 4 0 748609760 1107062784 203489 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=1081116 CPUtime=109.39 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 62213 0 0 0 10928 11 0 0 25 0 4 0 748609760 1107062784 203489 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=1081116 CPUtime=137.98 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 420582 0 0 0 13743 55 0 0 25 0 4 0 748609760 1107062784 203489 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 493.18
Current children cumulated vsize (KiB) 1081116

[startup+222.301 s]
/proc/loadavg: 9.17 9.14 8.28 10/486 1804
/proc/meminfo: memFree=10268636/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=1312524 CPUtime=672.22 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 1127747 0 0 0 67062 160 0 0 25 0 4 0 748609746 1344024576 249529 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 328131 249530 470 106 0 323634 0
[pid=1795/tid=1797] ppid=1793 vsize=1312524 CPUtime=135.71 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 60283 0 0 0 13559 12 0 0 25 0 4 0 748609760 1344024576 249530 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=1312524 CPUtime=149.83 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 71109 0 0 0 14969 14 0 0 25 0 4 0 748609760 1344024576 249532 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=1312524 CPUtime=188.4 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 627157 0 0 0 18759 81 0 0 25 0 4 0 748609760 1344024576 249532 33554432000 4194304 4625164 140735831716384 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 672.22
Current children cumulated vsize (KiB) 1312524

[startup+282.301 s]

################
# More data... #
################

[pid=1795] ppid=1793 vsize=2910220 CPUtime=2104.45 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 3505528 0 0 0 209937 508 0 0 25 0 4 0 748609746 2980065280 542571 33554432000 4194304 4625164 140735831716384 18446744073709551615 216734876117 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1795/statm: 727555 542571 6607 106 0 723058 0
[pid=1795/tid=1797] ppid=1793 vsize=2910220 CPUtime=512.56 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 72570 0 0 0 51237 19 0 0 25 0 4 0 748609760 2980065280 542571 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2910220 CPUtime=522.75 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 121462 0 0 0 52246 29 0 0 25 0 4 0 748609760 2980065280 542571 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2910220 CPUtime=515.35 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 2307728 0 0 0 51221 314 0 0 25 0 4 0 748609760 2980065280 542571 33554432000 4194304 4625164 140735831716384 18446744073709551615 4546840 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2104.45
Current children cumulated vsize (KiB) 2910220

[startup+762.319 s]
/proc/loadavg: 8.49 9.01 8.61 6/477 1837
/proc/meminfo: memFree=10119868/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2327520 CPUtime=2283.53 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 3833324 0 0 0 227798 555 0 0 25 0 4 0 748609746 2383380480 438579 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1795/statm: 581880 438579 343 106 0 577383 0
[pid=1795/tid=1797] ppid=1793 vsize=2327520 CPUtime=572.58 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 72657 0 0 0 57239 19 0 0 25 0 4 0 748609760 2383380480 438579 33554432000 4194304 4625164 140735831716384 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2327520 CPUtime=553.93 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 121680 0 0 0 55363 30 0 0 25 0 4 0 748609760 2383380480 438579 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2327520 CPUtime=545.23 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 2544315 0 0 0 54175 348 0 0 25 0 4 0 748609760 2383380480 438579 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2283.53
Current children cumulated vsize (KiB) 2327520

[startup+822.301 s]
/proc/loadavg: 6.32 8.29 8.38 6/477 1838
/proc/meminfo: memFree=10076332/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2362276 CPUtime=2495.13 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 4257346 0 0 0 248882 631 0 0 25 0 4 0 748609746 2418970624 448665 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393055 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 590569 448665 343 106 0 586072 0
[pid=1795/tid=1797] ppid=1793 vsize=2362276 CPUtime=632.05 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 91631 0 0 0 63183 22 0 0 25 0 4 0 748609760 2418970624 448665 33554432000 4194304 4625164 140735831716384 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2362276 CPUtime=600.03 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 122088 0 0 0 59973 30 0 0 25 0 4 0 748609760 2418970624 448665 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2362276 CPUtime=591.34 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 2903511 0 0 0 58731 403 0 0 25 0 4 0 748609760 2418970624 448665 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2495.13
Current children cumulated vsize (KiB) 2362276

[startup+882.301 s]
/proc/loadavg: 5.48 7.69 8.17 6/477 1840
/proc/meminfo: memFree=10048380/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2427812 CPUtime=2734.13 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 4782951 0 0 0 272681 732 0 0 25 0 4 0 748609746 2486079488 455916 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393127 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 606953 455916 343 106 0 602456 0
[pid=1795/tid=1797] ppid=1793 vsize=2427812 CPUtime=692.05 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 92012 0 0 0 69183 22 0 0 25 0 4 0 748609760 2486079488 455916 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2427812 CPUtime=660.01 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 122469 0 0 0 65970 31 0 0 25 0 4 0 748609760 2486079488 455916 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2427812 CPUtime=650.38 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 3376928 0 0 0 64549 489 0 0 25 0 4 0 748609760 2486079488 455916 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2734.13
Current children cumulated vsize (KiB) 2427812

[startup+942.3 s]
/proc/loadavg: 5.21 7.21 7.97 6/477 1841
/proc/meminfo: memFree=10020432/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2427812 CPUtime=2973.18 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 5218136 0 0 0 296505 813 0 0 25 0 4 0 748609746 2486079488 463044 33554432000 4194304 4625164 140735831716384 18446744073709551615 4512054 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 606953 463044 343 106 0 602456 0
[pid=1795/tid=1797] ppid=1793 vsize=2427812 CPUtime=752.04 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 92329 0 0 0 75182 22 0 0 25 0 4 0 748609760 2486079488 463044 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2427812 CPUtime=720 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 122993 0 0 0 71968 32 0 0 25 0 4 0 748609760 2486079488 463044 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2427812 CPUtime=709.43 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 3752574 0 0 0 70392 551 0 0 25 0 4 0 748609760 2486079488 463044 33554432000 4194304 4625164 140735831716384 18446744073709551615 4339220 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2973.18
Current children cumulated vsize (KiB) 2427812

[startup+1002.3 s]
/proc/loadavg: 5.11 6.82 7.79 6/477 1843
/proc/meminfo: memFree=9988028/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2427812 CPUtime=3212.22 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 5702488 0 0 0 320327 895 0 0 25 0 4 0 748609746 2486079488 471224 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 606953 471224 343 106 0 602456 0
[pid=1795/tid=1797] ppid=1793 vsize=2427812 CPUtime=812.05 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 92533 0 0 0 81183 22 0 0 25 0 4 0 748609760 2486079488 471224 33554432000 4194304 4625164 140735831716384 18446744073709551615 4330853 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2427812 CPUtime=779.99 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 123464 0 0 0 77966 33 0 0 25 0 4 0 748609760 2486079488 471224 33554432000 4194304 4625164 140735831716384 18446744073709551615 4330822 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2427812 CPUtime=768.48 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 4181939 0 0 0 76230 618 0 0 25 0 4 0 748609760 2486079488 471224 33554432000 4194304 4625164 140735831716384 18446744073709551615 4551099 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3212.22
Current children cumulated vsize (KiB) 2427812

[startup+1062.3 s]
/proc/loadavg: 5.23 6.53 7.63 6/477 1845
/proc/meminfo: memFree=9891760/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2427812 CPUtime=3451.27 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 6262612 0 0 0 344110 1017 0 0 25 0 4 0 748609746 2486079488 496400 33554432000 4194304 4625164 140735831716384 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 606953 496400 343 106 0 602456 0
[pid=1795/tid=1797] ppid=1793 vsize=2427812 CPUtime=872.04 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 92902 0 0 0 87182 22 0 0 25 0 4 0 748609760 2486079488 496400 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2427812 CPUtime=839.99 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 123913 0 0 0 83964 35 0 0 25 0 4 0 748609760 2486079488 496400 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2427812 CPUtime=827.53 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 4682288 0 0 0 82056 697 0 0 25 0 4 0 748609760 2486079488 496400 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3451.27
Current children cumulated vsize (KiB) 2427812

[startup+1122.3 s]
/proc/loadavg: 5.16 6.27 7.47 6/477 1847
/proc/meminfo: memFree=9853160/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2431484 CPUtime=3690.32 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 6761885 0 0 0 367929 1103 0 0 25 0 4 0 748609746 2489839616 504021 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 607871 504021 343 106 0 603374 0
[pid=1795/tid=1797] ppid=1793 vsize=2431484 CPUtime=932.05 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 93005 0 0 0 93183 22 0 0 25 0 4 0 748609760 2489839616 504021 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2431484 CPUtime=899.99 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 124285 0 0 0 89963 36 0 0 25 0 4 0 748609760 2489839616 504021 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2431484 CPUtime=886.58 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 5125091 0 0 0 87892 766 0 0 25 0 4 0 748609760 2489839616 504021 33554432000 4194304 4625164 140735831716384 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3690.32
Current children cumulated vsize (KiB) 2431484

[startup+1182.3 s]
/proc/loadavg: 5.09 6.05 7.31 6/477 1848
/proc/meminfo: memFree=9812192/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2578508 CPUtime=3929.38 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 7276521 0 0 0 391747 1191 0 0 25 0 4 0 748609746 2640392192 514302 33554432000 4194304 4625164 140735831716384 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 644627 514302 343 106 0 640130 0
[pid=1795/tid=1797] ppid=1793 vsize=2578508 CPUtime=992.04 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 93253 0 0 0 99182 22 0 0 25 0 4 0 748609760 2640392192 514302 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2578508 CPUtime=959.98 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 124757 0 0 0 95962 36 0 0 25 0 4 0 748609760 2640392192 514302 33554432000 4194304 4625164 140735831716384 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2578508 CPUtime=945.64 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 5583038 0 0 0 93721 843 0 0 25 0 4 0 748609760 2640392192 514302 33554432000 4194304 4625164 140735831716384 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3929.38
Current children cumulated vsize (KiB) 2578508

[startup+1242.3 s]
/proc/loadavg: 5.03 5.85 7.17 6/477 1850
/proc/meminfo: memFree=9778296/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2578508 CPUtime=4168.43 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 7713701 0 0 0 415580 1263 0 0 25 0 4 0 748609746 2640392192 523805 33554432000 4194304 4625164 140735831716384 18446744073709551615 4393112 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 644627 523805 343 106 0 640130 0
[pid=1795/tid=1797] ppid=1793 vsize=2578508 CPUtime=1052.05 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 93559 0 0 0 105182 23 0 0 25 0 4 0 748609760 2640392192 523805 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2578508 CPUtime=1019.99 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 125258 0 0 0 101961 38 0 0 25 0 4 0 748609760 2640392192 523805 33554432000 4194304 4625164 140735831716384 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2578508 CPUtime=1004.69 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 6014830 0 0 0 99558 911 0 0 25 0 4 0 748609760 2640392192 523805 33554432000 4194304 4625164 140735831716384 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4168.43
Current children cumulated vsize (KiB) 2578508



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 5.08 5.71 7.03 6/477 1851
/proc/meminfo: memFree=9750492/32951124 swapFree=65586204/67111528
[pid=1795] ppid=1793 vsize=2578508 CPUtime=4398.34 cores=0,2,4,6
/proc/1795/stat : 1795 (SArTagnan) R 1793 1795 1608 0 -1 4202496 8160033 0 0 0 438493 1341 0 0 25 0 4 0 748609746 2640392192 530878 33554432000 4194304 4625164 140735831716384 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1795/statm: 644627 530878 343 106 0 640130 0
[pid=1795/tid=1797] ppid=1793 vsize=2578508 CPUtime=1109.76 cores=0,2,4,6
/proc/1795/task/1797/stat : 1797 (SArTagnan) R 1793 1795 1608 0 -1 4202560 93875 0 0 0 110953 23 0 0 25 0 4 0 748609760 2640392192 530880 33554432000 4194304 4625164 140735831716384 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1795/tid=1798] ppid=1793 vsize=2578508 CPUtime=1077.71 cores=0,2,4,6
/proc/1795/task/1798/stat : 1798 (SArTagnan) R 1793 1795 1608 0 -1 4202560 125737 0 0 0 107733 38 0 0 25 0 4 0 748609760 2640392192 530880 33554432000 4194304 4625164 140735831716384 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1795/tid=1799] ppid=1793 vsize=2578508 CPUtime=1061.48 cores=0,2,4,6
/proc/1795/task/1799/stat : 1799 (SArTagnan) R 1793 1795 1608 0 -1 4202560 6456692 0 0 0 105163 985 0 0 25 0 4 0 748609760 2640392192 530880 33554432000 4194304 4625164 140735831716384 18446744073709551615 4351866 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4398.34
Current children cumulated vsize (KiB) 2578508

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.11
CPU time (s): 4398.49
CPU user time (s): 4385
CPU system time (s): 13.4929
CPU usage (%): 338.317
Max. virtual memory (cumulated for all children) (KiB): 2910220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4385
system time used= 13.4929
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 8160035
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4499
involuntary context switches= 29351

runsolver used 6.05808 second user time and 14.5668 second system time

The end

Launcher Data 

Begin job on node119 at 2011-05-17 00:09:51
IDJOB=3385852
IDBENCH=88228
IDSOLVER=1871
FILE ID=node119/3385852-1305583791
RUNJOBID= node119-1305582131-1626
PBS_JOBID= 13350300
Free space on /tmp= 73044 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m52-q918.75-n50-p15-s98191766.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385852-1305583791/watcher-3385852-1305583791 -o /tmp/evaluation-result-3385852-1305583791/solver-3385852-1305583791 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385852-1305583791.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 71638ad618721ad48c6bd2d48b828020
RANDOM SEED=1810874815

node119.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.815
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      11347964 kB
Buffers:        320720 kB
Cached:        5548776 kB
SwapCached:       4756 kB
Active:       17464716 kB
Inactive:      3781516 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      11347964 kB
SwapTotal:    67111528 kB
SwapFree:     65586204 kB
Dirty:            7384 kB
Writeback:          28 kB
AnonPages:    15375196 kB
Mapped:          36596 kB
Slab:           216496 kB
PageTables:      73316 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 142478924 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73048 MiB
End job on node119 at 2011-05-17 00:31:33