Trace number 3386210

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4016.84 1300.09

General information on the benchmark

NameSAT03/industrial/goldberg/hard_eq_check/
x1mul.miter.shuffled-as.sat03-359.cnf
MD5SUM9edcffddbe07377cf6685697aafad673
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark16.6405
Satisfiable
(Un)Satisfiability was proved
Number of variables8756
Number of clauses55571
Sum of the clauses size187746
Maximum clause length70
Minimum clause length1
Number of clauses of size 128
Number of clauses of size 212786
Number of clauses of size 325852
Number of clauses of size 40
Number of clauses of size 516904
Number of clauses of size over 51

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386210-1305582505/watcher-3386210-1305582505 -o /tmp/evaluation-result-3386210-1305582505/solver-3386210-1305582505 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386210-1305582505.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.14 7.85 4.70 8/399 6807
/proc/meminfo: memFree=12817540/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=22028 CPUtime=0.01 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 1282 0 0 0 1 0 0 0 25 0 1 0 669848404 22556672 918 33554432000 4194304 4625164 140736976022544 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/6807/statm: 5507 919 299 106 0 1010 0

[startup+0.025086 s]
/proc/loadavg: 10.14 7.85 4.70 8/399 6807
/proc/meminfo: memFree=12817540/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=22876 CPUtime=0.01 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 1793 0 0 0 1 0 0 0 25 0 1 0 669848404 23425024 1211 33554432000 4194304 4625164 140736976022544 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/6807/statm: 5719 1211 299 106 0 1222 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 22876

[startup+0.155064 s]
/proc/loadavg: 10.14 7.85 4.70 8/399 6807
/proc/meminfo: memFree=12817540/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=200880 CPUtime=0.25 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 6296 0 0 0 25 0 0 0 25 0 4 0 669848404 205701120 4863 33554432000 4194304 4625164 140736976022544 18446744073709551615 255376957447 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 50220 4863 336 106 0 45723 0
Current children cumulated CPU time (s) 0.25
Current children cumulated vsize (KiB) 200880

[startup+0.301042 s]
/proc/loadavg: 10.14 7.85 4.70 8/399 6807
/proc/meminfo: memFree=12817540/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=200880 CPUtime=0.64 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 7426 0 0 0 63 1 0 0 25 0 4 0 669848404 205701120 5180 33554432000 4194304 4625164 140736976022544 18446744073709551615 4513486 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 50220 5180 342 106 0 45723 0
Current children cumulated CPU time (s) 0.64
Current children cumulated vsize (KiB) 200880

[startup+0.700967 s]
/proc/loadavg: 10.14 7.85 4.70 8/399 6807
/proc/meminfo: memFree=12817540/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=203884 CPUtime=1.64 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 11101 0 0 0 163 1 0 0 25 0 4 0 669848404 208777216 5442 33554432000 4194304 4625164 140736976022544 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 50971 5442 342 106 0 46474 0
Current children cumulated CPU time (s) 1.64
Current children cumulated vsize (KiB) 203884

[startup+1.50082 s]
/proc/loadavg: 10.13 7.89 4.73 11/403 6811
/proc/meminfo: memFree=12796304/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=203884 CPUtime=3.68 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 15654 0 0 0 366 2 0 0 25 0 4 0 669848404 208777216 5884 33554432000 4194304 4625164 140736976022544 18446744073709551615 4519357 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 50971 5884 342 106 0 46474 0
[pid=6807/tid=6809] ppid=6805 vsize=203884 CPUtime=0.73 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 798 0 0 0 73 0 0 0 25 0 4 0 669848409 208777216 5884 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=203884 CPUtime=0.71 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 800 0 0 0 71 0 0 0 25 0 4 0 669848409 208777216 5884 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=203884 CPUtime=1.43 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 8471 0 0 0 142 1 0 0 25 0 4 0 669848409 208777216 5884 33554432000 4194304 4625164 140736976022544 18446744073709551615 4547578 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.68
Current children cumulated vsize (KiB) 203884

[startup+3.10052 s]
/proc/loadavg: 10.13 7.89 4.73 11/403 6811
/proc/meminfo: memFree=12790600/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=203884 CPUtime=8.46 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 22801 0 0 0 843 3 0 0 25 0 4 0 669848404 208777216 6942 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512224 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 50971 6942 342 106 0 46474 0
[pid=6807/tid=6809] ppid=6805 vsize=203884 CPUtime=1.53 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 923 0 0 0 153 0 0 0 25 0 4 0 669848409 208777216 6942 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352183 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=203884 CPUtime=1.51 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 918 0 0 0 151 0 0 0 25 0 4 0 669848409 208777216 6942 33554432000 4194304 4625164 140736976022544 18446744073709551615 4288940 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=203884 CPUtime=3.02 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 15290 0 0 0 300 2 0 0 25 0 4 0 669848409 208777216 6942 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352089 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 8.46
Current children cumulated vsize (KiB) 203884

[startup+6.30093 s]
/proc/loadavg: 10.13 7.89 4.73 11/403 6811
/proc/meminfo: memFree=12778528/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=211144 CPUtime=18.02 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 40801 0 0 0 1797 5 0 0 25 0 4 0 669848404 216211456 9214 33554432000 4194304 4625164 140736976022544 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 52786 9214 343 106 0 48289 0
[pid=6807/tid=6809] ppid=6805 vsize=211144 CPUtime=3.13 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 2069 0 0 0 313 0 0 0 25 0 4 0 669848409 216211456 9214 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=211144 CPUtime=3.11 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 2055 0 0 0 311 0 0 0 25 0 4 0 669848409 216211456 9214 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=211144 CPUtime=6.18 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 30282 0 0 0 614 4 0 0 25 0 4 0 669848409 216211456 9214 33554432000 4194304 4625164 140736976022544 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 18.02
Current children cumulated vsize (KiB) 211144

[startup+12.7007 s]
/proc/loadavg: 10.11 7.95 4.79 11/403 6811
/proc/meminfo: memFree=12738488/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=242684 CPUtime=37.13 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 65519 0 0 0 3704 9 0 0 25 0 4 0 669848404 248508416 19394 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 60671 19394 347 106 0 56174 0
[pid=6807/tid=6809] ppid=6805 vsize=242684 CPUtime=7.62 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 6532 0 0 0 761 1 0 0 25 0 4 0 669848409 248508416 19394 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=242684 CPUtime=6.26 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 6044 0 0 0 626 0 0 0 25 0 4 0 669848409 248508416 19394 33554432000 4194304 4625164 140736976022544 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=242684 CPUtime=11.24 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 38191 0 0 0 1119 5 0 0 25 0 4 0 669848409 248508416 19394 33554432000 4194304 4625164 140736976022544 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37.13
Current children cumulated vsize (KiB) 242684

[startup+25.5004 s]
/proc/loadavg: 10.17 8.04 4.85 12/403 6812
/proc/meminfo: memFree=12707892/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=316032 CPUtime=75.37 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 120816 0 0 0 7519 18 0 0 25 0 4 0 669848404 323616768 25773 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512249 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 79008 25773 347 106 0 74511 0
[pid=6807/tid=6809] ppid=6805 vsize=316032 CPUtime=14.38 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 9225 0 0 0 1436 2 0 0 25 0 4 0 669848409 323616768 25773 33554432000 4194304 4625164 140736976022544 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=316032 CPUtime=12.3 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 6609 0 0 0 1229 1 0 0 25 0 4 0 669848409 323616768 25773 33554432000 4194304 4625164 140736976022544 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=316032 CPUtime=23.86 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 89060 0 0 0 2375 11 0 0 25 0 4 0 669848409 323616768 25773 33554432000 4194304 4625164 140736976022544 18446744073709551615 4557107 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 75.37
Current children cumulated vsize (KiB) 316032

[startup+51.1006 s]
/proc/loadavg: 10.11 8.19 4.98 11/403 6812
/proc/meminfo: memFree=12611012/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=338512 CPUtime=153.83 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 226593 0 0 0 15347 36 0 0 25 0 4 0 669848404 346636288 40505 33554432000 4194304 4625164 140736976022544 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 84628 40505 347 106 0 80131 0
[pid=6807/tid=6809] ppid=6805 vsize=338512 CPUtime=29.07 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 16197 0 0 0 2903 4 0 0 25 0 4 0 669848409 346636288 40505 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=338512 CPUtime=29.17 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 9829 0 0 0 2915 2 0 0 25 0 4 0 669848409 346636288 40505 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=338512 CPUtime=45.18 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 180898 0 0 0 4492 26 0 0 25 0 4 0 669848409 346636288 40505 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 153.83
Current children cumulated vsize (KiB) 338512

[startup+102.315 s]
/proc/loadavg: 10.19 8.54 5.28 11/403 6814
/proc/meminfo: memFree=12484140/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=444008 CPUtime=310.22 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 309643 0 0 0 30966 56 0 0 25 0 4 0 669848404 454664192 61757 33554432000 4194304 4625164 140736976022544 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 111002 61757 347 106 0 106505 0
[pid=6807/tid=6809] ppid=6805 vsize=444008 CPUtime=61.32 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 27149 0 0 0 6120 12 0 0 25 0 4 0 669848409 454664192 61757 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351734 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=444008 CPUtime=80.38 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 14086 0 0 0 8036 2 0 0 25 0 4 0 669848409 454664192 61757 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=444008 CPUtime=78.37 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 248005 0 0 0 7800 37 0 0 25 0 4 0 669848409 454664192 61757 33554432000 4194304 4625164 140736976022544 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 310.22
Current children cumulated vsize (KiB) 444008

[startup+162.301 s]
/proc/loadavg: 10.21 8.85 5.59 11/403 6815
/proc/meminfo: memFree=12333456/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=595312 CPUtime=489.42 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 506558 0 0 0 48851 91 0 0 25 0 4 0 669848404 609599488 91801 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 148828 91801 347 106 0 144331 0
[pid=6807/tid=6809] ppid=6805 vsize=595312 CPUtime=108.37 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 41153 0 0 0 10822 15 0 0 25 0 4 0 669848409 609599488 91801 33554432000 4194304 4625164 140736976022544 18446744073709551615 4463825 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=595312 CPUtime=122.89 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 16175 0 0 0 12284 5 0 0 25 0 4 0 669848409 609599488 91801 33554432000 4194304 4625164 140736976022544 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=595312 CPUtime=126.93 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 428094 0 0 0 12627 66 0 0 25 0 4 0 669848409 609599488 91801 33554432000 4194304 4625164 140736976022544 18446744073709551615 4339616 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 489.42
Current children cumulated vsize (KiB) 595312

[startup+222.301 s]
/proc/loadavg: 10.17 9.08 5.87 11/403 6817
/proc/meminfo: memFree=12214528/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=592760 CPUtime=669.85 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 616503 0 0 0 66875 110 0 0 25 0 4 0 669848404 606986240 106468 33554432000 4194304 4625164 140736976022544 18446744073709551615 4391821 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 148190 106468 347 106 0 143693 0
[pid=6807/tid=6809] ppid=6805 vsize=592760 CPUtime=154.06 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 43468 0 0 0 15390 16 0 0 25 0 4 0 669848409 606986240 106468 33554432000 4194304 4625164 140736976022544 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=592760 CPUtime=165.69 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 17669 0 0 0 16563 6 0 0 25 0 4 0 669848409 606986240 106468 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352562 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=592760 CPUtime=158.87 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 530739 0 0 0 15805 82 0 0 25 0 4 0 669848409 606986240 106468 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 669.85
Current children cumulated vsize (KiB) 592760

[startup+282.301 s]

################
# More data... #
################

[pid=6807] ppid=6805 vsize=1253088 CPUtime=2117 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 1852610 0 0 0 211381 319 0 0 25 0 4 0 669848404 1283162112 254652 33554432000 4194304 4625164 140736976022544 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/6807/statm: 313272 254652 873 106 0 308775 0
[pid=6807/tid=6809] ppid=6805 vsize=1253088 CPUtime=505.84 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 87133 0 0 0 50552 32 0 0 25 0 4 0 669848409 1283162112 254652 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1253088 CPUtime=589.32 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 34942 0 0 0 58922 10 0 0 25 0 4 0 669848409 1283162112 254652 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1253088 CPUtime=466.41 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 1680709 0 0 0 46376 265 0 0 25 0 4 0 669848409 1283162112 254652 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351844 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2117
Current children cumulated vsize (KiB) 1253088

[startup+762.315 s]
/proc/loadavg: 10.38 10.12 7.82 11/403 6840
/proc/meminfo: memFree=11276272/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1382916 CPUtime=2297.04 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 2136008 0 0 0 229338 366 0 0 25 0 4 0 669848404 1416105984 284735 33554432000 4194304 4625164 140736976022544 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 345729 284735 1626 106 0 341232 0
[pid=6807/tid=6809] ppid=6805 vsize=1382916 CPUtime=535.69 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 88833 0 0 0 53536 33 0 0 25 0 4 0 669848409 1416105984 284736 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1382916 CPUtime=625.11 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 35046 0 0 0 62501 10 0 0 25 0 4 0 669848409 1416105984 284736 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1382916 CPUtime=521.93 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 1945857 0 0 0 51884 309 0 0 25 0 4 0 669848409 1416105984 284736 33554432000 4194304 4625164 140736976022544 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2297.04
Current children cumulated vsize (KiB) 1382916

[startup+822.301 s]
/proc/loadavg: 10.28 10.14 7.97 11/403 6842
/proc/meminfo: memFree=11172524/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1421964 CPUtime=2477.01 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 2446422 0 0 0 247285 416 0 0 25 0 4 0 669848404 1456091136 306232 33554432000 4194304 4625164 140736976022544 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 355491 306232 1557 106 0 350994 0
[pid=6807/tid=6809] ppid=6805 vsize=1421964 CPUtime=565.69 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 90131 0 0 0 56535 34 0 0 25 0 4 0 669848409 1456091136 306232 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1421964 CPUtime=655.1 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 35200 0 0 0 65500 10 0 0 25 0 4 0 669848409 1456091136 306232 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1421964 CPUtime=581.92 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 2229154 0 0 0 57838 354 0 0 25 0 4 0 669848409 1456091136 306232 33554432000 4194304 4625164 140736976022544 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2477.01
Current children cumulated vsize (KiB) 1421964

[startup+882.301 s]
/proc/loadavg: 10.36 10.19 8.12 11/403 6843
/proc/meminfo: memFree=11061152/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1487500 CPUtime=2657.01 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 2758320 0 0 0 265233 468 0 0 25 0 4 0 669848404 1523200000 329240 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 371875 329240 1461 106 0 367378 0
[pid=6807/tid=6809] ppid=6805 vsize=1487500 CPUtime=595.69 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 91320 0 0 0 59535 34 0 0 25 0 4 0 669848409 1523200000 329240 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1487500 CPUtime=685.1 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 35372 0 0 0 68500 10 0 0 25 0 4 0 669848409 1523200000 329240 33554432000 4194304 4625164 140736976022544 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1487500 CPUtime=641.92 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 2532833 0 0 0 63788 404 0 0 25 0 4 0 669848409 1523200000 329240 33554432000 4194304 4625164 140736976022544 18446744073709551615 4334424 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2657.01
Current children cumulated vsize (KiB) 1487500

[startup+942.301 s]
/proc/loadavg: 10.23 10.18 8.25 11/403 6876
/proc/meminfo: memFree=11819176/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1700228 CPUtime=2844.22 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 3085958 0 0 0 283903 519 0 0 25 0 4 0 669848404 1741033472 360287 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 425057 360287 1101 106 0 420560 0
[pid=6807/tid=6809] ppid=6805 vsize=1700228 CPUtime=636.1 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 121830 0 0 0 63572 38 0 0 25 0 4 0 669848409 1741033472 360287 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1700228 CPUtime=720.99 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 35617 0 0 0 72089 10 0 0 25 0 4 0 669848409 1741033472 360287 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352305 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1700228 CPUtime=698.38 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 2789191 0 0 0 69393 445 0 0 25 0 4 0 669848409 1741033472 360287 33554432000 4194304 4625164 140736976022544 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2844.22
Current children cumulated vsize (KiB) 1700228

[startup+1002.3 s]
/proc/loadavg: 10.46 10.25 8.39 11/403 6881
/proc/meminfo: memFree=11621560/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1765764 CPUtime=3053.24 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 3327925 0 0 0 304767 557 0 0 25 0 4 0 669848404 1808142336 380676 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 441441 380676 1100 106 0 436944 0
[pid=6807/tid=6809] ppid=6805 vsize=1765764 CPUtime=696.1 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 124539 0 0 0 69570 40 0 0 25 0 4 0 669848409 1808142336 380676 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1765764 CPUtime=750.78 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 35798 0 0 0 75068 10 0 0 25 0 4 0 669848409 1808142336 380676 33554432000 4194304 4625164 140736976022544 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1765764 CPUtime=757.61 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 3021964 0 0 0 75281 480 0 0 25 0 4 0 669848409 1808142336 380676 33554432000 4194304 4625164 140736976022544 18446744073709551615 4328194 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3053.24
Current children cumulated vsize (KiB) 1765764

[startup+1062.3 s]
/proc/loadavg: 10.25 10.23 8.50 11/403 6882
/proc/meminfo: memFree=11468728/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1875468 CPUtime=3262.49 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 3647500 0 0 0 325640 609 0 0 25 0 4 0 669848404 1920479232 404077 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 468867 404077 1100 106 0 464370 0
[pid=6807/tid=6809] ppid=6805 vsize=1875468 CPUtime=756.1 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 127053 0 0 0 75567 43 0 0 25 0 4 0 669848409 1920479232 404077 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1875468 CPUtime=780.79 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 36156 0 0 0 78068 11 0 0 25 0 4 0 669848409 1920479232 404077 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1875468 CPUtime=816.85 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 3309123 0 0 0 81161 524 0 0 25 0 4 0 669848409 1920479232 404077 33554432000 4194304 4625164 140736976022544 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3262.49
Current children cumulated vsize (KiB) 1875468

[startup+1122.3 s]
/proc/loadavg: 10.25 10.23 8.60 11/403 6884
/proc/meminfo: memFree=11311108/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1941004 CPUtime=3471.72 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 3913355 0 0 0 346515 657 0 0 25 0 4 0 669848404 1987588096 423984 33554432000 4194304 4625164 140736976022544 18446744073709551615 4519394 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 485251 423984 1100 106 0 480754 0
[pid=6807/tid=6809] ppid=6805 vsize=1941004 CPUtime=816.1 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 129882 0 0 0 81563 47 0 0 25 0 4 0 669848409 1987588096 423984 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1941004 CPUtime=810.78 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 36219 0 0 0 81067 11 0 0 25 0 4 0 669848409 1987588096 423984 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1941004 CPUtime=876.09 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 3567423 0 0 0 87042 567 0 0 25 0 4 0 669848409 1987588096 423984 33554432000 4194304 4625164 140736976022544 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3471.72
Current children cumulated vsize (KiB) 1941004

[startup+1182.3 s]
/proc/loadavg: 10.36 10.26 8.71 11/403 6885
/proc/meminfo: memFree=11181380/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=1985080 CPUtime=3665.11 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 4151248 0 0 0 365812 699 0 0 25 0 4 0 669848404 2032721920 442521 33554432000 4194304 4625164 140736976022544 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 496270 442521 827 106 0 491773 0
[pid=6807/tid=6809] ppid=6805 vsize=1985080 CPUtime=863.08 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 132403 0 0 0 86257 51 0 0 25 0 4 0 669848409 2032721920 442521 33554432000 4194304 4625164 140736976022544 18446744073709551615 4353075 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=1985080 CPUtime=853.54 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 36773 0 0 0 85343 11 0 0 25 0 4 0 669848409 2032721920 442521 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=1985080 CPUtime=919.74 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 3774595 0 0 0 91374 600 0 0 25 0 4 0 669848409 2032721920 442521 33554432000 4194304 4625164 140736976022544 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3665.11
Current children cumulated vsize (KiB) 1985080

[startup+1242.3 s]
/proc/loadavg: 10.41 10.29 8.82 11/403 6887
/proc/meminfo: memFree=11043112/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=2050616 CPUtime=3844.34 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 4296726 0 0 0 383710 724 0 0 25 0 4 0 669848404 2099830784 455388 33554432000 4194304 4625164 140736976022544 18446744073709551615 4508897 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 512654 455388 830 106 0 508157 0
[pid=6807/tid=6809] ppid=6805 vsize=2050616 CPUtime=893.16 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 134140 0 0 0 89263 53 0 0 25 0 4 0 669848409 2099830784 455388 33554432000 4194304 4625164 140736976022544 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=2050616 CPUtime=912.19 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 37329 0 0 0 91206 13 0 0 25 0 4 0 669848409 2099830784 455388 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=2050616 CPUtime=950.25 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 3914462 0 0 0 94404 621 0 0 25 0 4 0 669848409 2099830784 455388 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3844.34
Current children cumulated vsize (KiB) 2050616



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 10.45 10.32 8.91 11/403 6889
/proc/meminfo: memFree=10968076/32951124 swapFree=63308196/67111528
[pid=6807] ppid=6805 vsize=2116152 CPUtime=4016.73 cores=1,3,5,7
/proc/6807/stat : 6807 (SArTagnan) R 6805 6807 6726 0 -1 4202496 4446706 0 0 0 400923 750 0 0 25 0 4 0 669848404 2166939648 466516 33554432000 4194304 4625164 140736976022544 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/6807/statm: 529038 466516 827 106 0 524541 0
[pid=6807/tid=6809] ppid=6805 vsize=2116152 CPUtime=922.08 cores=1,3,5,7
/proc/6807/task/6809/stat : 6809 (SArTagnan) R 6805 6807 6726 0 -1 4202560 135424 0 0 0 92152 56 0 0 25 0 4 0 669848409 2166939648 466521 33554432000 4194304 4625164 140736976022544 18446744073709551615 4353075 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=6807/tid=6810] ppid=6805 vsize=2116152 CPUtime=969.15 cores=1,3,5,7
/proc/6807/task/6810/stat : 6810 (SArTagnan) R 6805 6807 6726 0 -1 4202560 37673 0 0 0 96902 13 0 0 25 0 4 0 669848409 2166939648 466521 33554432000 4194304 4625164 140736976022544 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=6807/tid=6811] ppid=6805 vsize=2116152 CPUtime=979.05 cores=1,3,5,7
/proc/6807/task/6811/stat : 6811 (SArTagnan) R 6805 6807 6726 0 -1 4202560 4058608 0 0 0 97262 643 0 0 25 0 4 0 669848409 2166939648 466521 33554432000 4194304 4625164 140736976022544 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4016.73
Current children cumulated vsize (KiB) 2116152

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.09
CPU time (s): 4016.84
CPU user time (s): 4009.26
CPU system time (s): 7.57885
CPU usage (%): 308.965
Max. virtual memory (cumulated for all children) (KiB): 2116152

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4009.26
system time used= 7.57885
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4446713
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2759
involuntary context switches= 23127

runsolver used 4.46932 second user time and 12.1751 second system time

The end

Launcher Data 

Begin job on node135 at 2011-05-16 23:48:25
IDJOB=3386210
IDBENCH=84211
IDSOLVER=1871
FILE ID=node135/3386210-1305582505
RUNJOBID= node135-1305582131-6745
PBS_JOBID= 13350294
Free space on /tmp= 73504 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/industrial/goldberg/hard_eq_check/x1mul.miter.shuffled-as.sat03-359.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386210-1305582505/watcher-3386210-1305582505 -o /tmp/evaluation-result-3386210-1305582505/solver-3386210-1305582505 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386210-1305582505.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9edcffddbe07377cf6685697aafad673
RANDOM SEED=412212672

node135.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6640.14
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.851
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      12818060 kB
Buffers:        323432 kB
Cached:        6471556 kB
SwapCached:      18100 kB
Active:       11288900 kB
Inactive:      8572140 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      12818060 kB
SwapTotal:    67111528 kB
SwapFree:     63308196 kB
Dirty:            1596 kB
Writeback:           0 kB
AnonPages:    13053436 kB
Mapped:          22588 kB
Slab:           145688 kB
PageTables:      60584 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 105397648 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73504 MiB
End job on node135 at 2011-05-17 00:10:07