Trace number 3280159

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.43 1202.63

General information on the benchmark

Nameindustrial/anbulagan/
hard-sat/partial-10-17-s.cnf
MD5SUMf72920912a1bb14f90e9fea5dee0ec1c
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark77.9931
Satisfiable
(Un)Satisfiability was proved
Number of variables298900
Number of clauses1409628
Sum of the clauses size3261218
Maximum clause length10
Minimum clause length1
Number of clauses of size 122283
Number of clauses of size 21089480
Number of clauses of size 3242405
Number of clauses of size 46160
Number of clauses of size 524640
Number of clauses of size over 524660

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280159-1304036511/watcher-3280159-1304036511 -o /tmp/evaluation-result-3280159-1304036511/solver-3280159-1304036511 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3280159-1304036511.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.84 7.76 7.29 5/180 14648
/proc/meminfo: memFree=18365912/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=23204 CPUtime=0 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 1274 0 0 0 0 0 0 0 21 0 1 0 593881920 23760896 1211 33554432000 4194304 4623224 140736586678400 18446744073709551615 4315013 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/14648/statm: 5801 1213 290 105 0 1305 0

[startup+0.084897 s]
/proc/loadavg: 6.84 7.76 7.29 5/180 14648
/proc/meminfo: memFree=18365912/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=84076 CPUtime=0.07 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 10093 0 0 0 6 1 0 0 21 0 1 0 593881920 86093824 7250 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/14648/statm: 21019 7251 297 105 0 16523 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 84076

[startup+0.100886 s]
/proc/loadavg: 6.84 7.76 7.29 5/180 14648
/proc/meminfo: memFree=18365912/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=84076 CPUtime=0.09 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 10278 0 0 0 8 1 0 0 21 0 1 0 593881920 86093824 7435 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/14648/statm: 21019 7435 297 105 0 16523 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 84076

[startup+0.300859 s]
/proc/loadavg: 6.84 7.76 7.29 5/180 14648
/proc/meminfo: memFree=18365912/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=106456 CPUtime=0.28 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 19259 0 0 0 26 2 0 0 22 0 1 0 593881920 109010944 12787 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/14648/statm: 26614 12788 297 105 0 22118 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 106456

[startup+0.700755 s]
/proc/loadavg: 6.84 7.76 7.29 5/180 14648
/proc/meminfo: memFree=18365912/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=538724 CPUtime=0.9 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 67357 0 0 0 82 8 0 0 25 0 4 0 593881920 551653376 57763 33554432000 4194304 4623224 140736586678400 18446744073709551615 4498370 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 134681 57765 324 105 0 130185 0
Current children cumulated CPU time (s) 0.9
Current children cumulated vsize (KiB) 538724

[startup+1.50063 s]
/proc/loadavg: 6.84 7.76 7.29 9/184 14652
/proc/meminfo: memFree=18092084/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=538724 CPUtime=4.09 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 78320 0 0 0 399 10 0 0 25 0 4 0 593881920 551653376 62983 33554432000 4194304 4623224 140736586678400 18446744073709551615 4358654 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 134681 62983 334 105 0 130185 0
[pid=14648/tid=14650] ppid=14646 vsize=538724 CPUtime=0.86 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3394 0 0 0 86 0 0 0 25 0 4 0 593881982 551653376 62983 33554432000 4194304 4623224 140736586678400 18446744073709551615 224284593170 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=538724 CPUtime=0.85 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 4695 0 0 0 85 0 0 0 25 0 4 0 593881982 551653376 62983 33554432000 4194304 4623224 140736586678400 18446744073709551615 4467999 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=538724 CPUtime=0.86 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3275 0 0 0 86 0 0 0 25 0 4 0 593881982 551653376 62983 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4.09
Current children cumulated vsize (KiB) 538724

[startup+3.10036 s]
/proc/loadavg: 6.84 7.76 7.29 9/184 14652
/proc/meminfo: memFree=18117876/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=538724 CPUtime=10.49 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 81324 0 0 0 1038 11 0 0 25 0 4 0 593881920 551653376 61901 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412585 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 134681 61901 335 105 0 130185 0
[pid=14648/tid=14650] ppid=14646 vsize=538724 CPUtime=2.46 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3431 0 0 0 246 0 0 0 25 0 4 0 593881982 551653376 61901 33554432000 4194304 4623224 140736586678400 18446744073709551615 4377419 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=538724 CPUtime=2.45 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 7516 0 0 0 244 1 0 0 25 0 4 0 593881982 551653376 61901 33554432000 4194304 4623224 140736586678400 18446744073709551615 4355396 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=538724 CPUtime=2.46 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3298 0 0 0 246 0 0 0 25 0 4 0 593881982 551653376 61904 33554432000 4194304 4623224 140736586678400 18446744073709551615 4545353 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 10.49
Current children cumulated vsize (KiB) 538724

[startup+6.30083 s]
/proc/loadavg: 6.93 7.76 7.30 9/184 14652
/proc/meminfo: memFree=18098228/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=540764 CPUtime=23.27 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 87358 0 0 0 2315 12 0 0 25 0 4 0 593881920 553742336 63507 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412527 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 135191 63507 335 105 0 130695 0
[pid=14648/tid=14650] ppid=14646 vsize=540764 CPUtime=5.66 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3450 0 0 0 566 0 0 0 25 0 4 0 593881982 553742336 63507 33554432000 4194304 4623224 140736586678400 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=540764 CPUtime=5.63 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 12827 0 0 0 561 2 0 0 25 0 4 0 593881982 553742336 63507 33554432000 4194304 4623224 140736586678400 18446744073709551615 4363970 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=540764 CPUtime=5.66 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3651 0 0 0 566 0 0 0 25 0 4 0 593881982 553742336 63507 33554432000 4194304 4623224 140736586678400 18446744073709551615 4363755 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 23.27
Current children cumulated vsize (KiB) 540764

[startup+12.7008 s]
/proc/loadavg: 7.02 7.77 7.30 9/184 14652
/proc/meminfo: memFree=18075236/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=540764 CPUtime=48.83 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 96472 0 0 0 4869 14 0 0 25 0 4 0 593881920 553742336 66446 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412513 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 135191 66446 335 105 0 130695 0
[pid=14648/tid=14650] ppid=14646 vsize=540764 CPUtime=12.06 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3550 0 0 0 1206 0 0 0 25 0 4 0 593881982 553742336 66446 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=540764 CPUtime=12 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 21436 0 0 0 1196 4 0 0 25 0 4 0 593881982 553742336 66446 33554432000 4194304 4623224 140736586678400 18446744073709551615 4317214 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=540764 CPUtime=12.06 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 3737 0 0 0 1206 0 0 0 25 0 4 0 593881982 553742336 66446 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 48.83
Current children cumulated vsize (KiB) 540764

[startup+25.5006 s]
/proc/loadavg: 6.99 7.73 7.29 9/184 14682
/proc/meminfo: memFree=17917996/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=573600 CPUtime=99.96 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 132217 0 0 0 9975 21 0 0 25 0 4 0 593881920 587366400 80232 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412473 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 143400 80232 389 105 0 138904 0
[pid=14648/tid=14650] ppid=14646 vsize=573600 CPUtime=24.86 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 9211 0 0 0 2484 2 0 0 25 0 4 0 593881982 587366400 80232 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=573600 CPUtime=24.72 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 26928 0 0 0 2467 5 0 0 25 0 4 0 593881982 587366400 80232 33554432000 4194304 4623224 140736586678400 18446744073709551615 4317194 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=573600 CPUtime=24.86 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 22857 0 0 0 2483 3 0 0 25 0 4 0 593881982 587366400 80232 33554432000 4194304 4623224 140736586678400 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 99.96
Current children cumulated vsize (KiB) 573600

[startup+51.1004 s]
/proc/loadavg: 7.45 7.78 7.32 9/184 14682
/proc/meminfo: memFree=17693088/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=688136 CPUtime=202.21 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 280074 0 0 0 20175 46 0 0 25 0 4 0 593881920 704651264 108865 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412446 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 172034 108865 336 105 0 167538 0
[pid=14648/tid=14650] ppid=14646 vsize=688136 CPUtime=50.46 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 17337 0 0 0 5040 6 0 0 25 0 4 0 593881982 704651264 108865 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=688136 CPUtime=50.18 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 42251 0 0 0 5009 9 0 0 25 0 4 0 593881982 704651264 108865 33554432000 4194304 4623224 140736586678400 18446744073709551615 4466128 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=688136 CPUtime=50.46 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 111275 0 0 0 5031 15 0 0 25 0 4 0 593881982 704651264 108865 33554432000 4194304 4623224 140736586678400 18446744073709551615 4376579 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 202.21
Current children cumulated vsize (KiB) 688136

[startup+102.307 s]
/proc/loadavg: 7.88 7.84 7.37 9/184 14684
/proc/meminfo: memFree=17394200/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=802284 CPUtime=406.75 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 487936 0 0 0 40585 90 0 0 25 0 4 0 593881920 821538816 151973 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412592 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 200571 151974 441 105 0 196075 0
[pid=14648/tid=14650] ppid=14646 vsize=802284 CPUtime=101.66 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 43018 0 0 0 10152 14 0 0 25 0 4 0 593881982 821538816 151974 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=802284 CPUtime=101.1 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 96129 0 0 0 10089 21 0 0 25 0 4 0 593881982 821538816 151974 33554432000 4194304 4623224 140736586678400 18446744073709551615 4316634 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=802284 CPUtime=101.66 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 230645 0 0 0 10131 35 0 0 25 0 4 0 593881982 821538816 151975 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 406.75
Current children cumulated vsize (KiB) 802284

[startup+162.301 s]
/proc/loadavg: 8.05 7.90 7.41 9/184 14686
/proc/meminfo: memFree=17061888/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=979624 CPUtime=646.4 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 748048 0 0 0 64503 137 0 0 25 0 4 0 593881920 1003134976 184945 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412473 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 244906 184945 337 105 0 240410 0
[pid=14648/tid=14650] ppid=14646 vsize=979624 CPUtime=161.66 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 67985 0 0 0 16144 22 0 0 25 0 4 0 593881982 1003134976 184945 33554432000 4194304 4623224 140736586678400 18446744073709551615 4376846 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=979624 CPUtime=160.77 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 117702 0 0 0 16050 27 0 0 25 0 4 0 593881982 1003134976 184946 33554432000 4194304 4623224 140736586678400 18446744073709551615 4316589 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=979624 CPUtime=161.65 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 423034 0 0 0 16100 65 0 0 25 0 4 0 593881982 1003134976 184946 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 646.4
Current children cumulated vsize (KiB) 979624

[startup+222.301 s]
/proc/loadavg: 8.06 7.93 7.45 9/184 14686
/proc/meminfo: memFree=16606292/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=1160304 CPUtime=886.07 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 971244 0 0 0 88429 178 0 0 25 0 4 0 593881920 1188151296 240693 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412446 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 290076 240693 479 105 0 285580 0
[pid=14648/tid=14650] ppid=14646 vsize=1160304 CPUtime=221.66 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 92361 0 0 0 22139 27 0 0 25 0 4 0 593881982 1188151296 240693 33554432000 4194304 4623224 140736586678400 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=1160304 CPUtime=220.44 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 154939 0 0 0 22007 37 0 0 25 0 4 0 593881982 1188151296 240693 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=1160304 CPUtime=221.64 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 543603 0 0 0 22081 83 0 0 25 0 4 0 593881982 1188151296 240693 33554432000 4194304 4623224 140736586678400 18446744073709551615 4363858 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 886.07
Current children cumulated vsize (KiB) 1160304

[startup+282.301 s]

################
# More data... #
################

Current children cumulated CPU time (s) 2563.76
Current children cumulated vsize (KiB) 2050472

[startup+702.301 s]
/proc/loadavg: 8.24 8.11 7.72 9/184 14700
/proc/meminfo: memFree=14880304/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=2070064 CPUtime=2803.42 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 2089682 0 0 0 279951 391 0 0 25 0 4 0 593881920 2119745536 428037 33554432000 4194304 4623224 140736586678400 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 517516 428037 346 105 0 513020 0
[pid=14648/tid=14650] ppid=14646 vsize=2070064 CPUtime=701.67 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 111945 0 0 0 70134 33 0 0 25 0 4 0 593881982 2119745536 428037 33554432000 4194304 4623224 140736586678400 18446744073709551615 4357390 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=2070064 CPUtime=697.82 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 294010 0 0 0 69701 81 0 0 25 0 4 0 593881982 2119745536 428037 33554432000 4194304 4623224 140736586678400 18446744073709551615 4317214 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=2070064 CPUtime=701.6 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 1341906 0 0 0 69938 222 0 0 25 0 4 0 593881982 2119745536 428037 33554432000 4194304 4623224 140736586678400 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2803.42
Current children cumulated vsize (KiB) 2070064

[startup+762.307 s]
/proc/loadavg: 8.15 8.10 7.74 9/184 14702
/proc/meminfo: memFree=14588260/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=2204344 CPUtime=3043.11 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 2233504 0 0 0 303892 419 0 0 25 0 4 0 593881920 2257248256 451382 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412446 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 551086 451383 346 105 0 546590 0
[pid=14648/tid=14650] ppid=14646 vsize=2204344 CPUtime=761.67 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 123632 0 0 0 76133 34 0 0 25 0 4 0 593881982 2257248256 451383 33554432000 4194304 4623224 140736586678400 18446744073709551615 4357390 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=2204344 CPUtime=757.5 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 326158 0 0 0 75659 91 0 0 25 0 4 0 593881982 2257248256 451383 33554432000 4194304 4623224 140736586678400 18446744073709551615 4317176 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=2204344 CPUtime=761.59 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 1438989 0 0 0 75921 238 0 0 25 0 4 0 593881982 2257248256 451383 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3043.11
Current children cumulated vsize (KiB) 2204344

[startup+822.301 s]
/proc/loadavg: 8.16 8.11 7.76 9/184 14702
/proc/meminfo: memFree=14242776/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=2276460 CPUtime=3282.75 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 2442344 0 0 0 327815 460 0 0 25 0 4 0 593881920 2331095040 474842 33554432000 4194304 4623224 140736586678400 18446744073709551615 4506903 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 569115 474842 346 105 0 564619 0
[pid=14648/tid=14650] ppid=14646 vsize=2276460 CPUtime=821.66 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 125198 0 0 0 82132 34 0 0 25 0 4 0 593881982 2331095040 474842 33554432000 4194304 4623224 140736586678400 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=2276460 CPUtime=817.17 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 343641 0 0 0 81618 99 0 0 25 0 4 0 593881982 2331095040 474842 33554432000 4194304 4623224 140736586678400 18446744073709551615 4466062 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=2276460 CPUtime=821.59 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 1624269 0 0 0 81889 270 0 0 25 0 4 0 593881982 2331095040 474842 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3282.75
Current children cumulated vsize (KiB) 2276460

[startup+882.301 s]
/proc/loadavg: 8.24 8.14 7.79 9/184 14704
/proc/meminfo: memFree=13900020/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=2326040 CPUtime=3522.42 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 2670320 0 0 0 351740 502 0 0 25 0 4 0 593881920 2381864960 502990 33554432000 4194304 4623224 140736586678400 18446744073709551615 4507139 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 581510 502990 346 105 0 577014 0
[pid=14648/tid=14650] ppid=14646 vsize=2326040 CPUtime=881.67 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 126293 0 0 0 88132 35 0 0 25 0 4 0 593881982 2381864960 502990 33554432000 4194304 4623224 140736586678400 18446744073709551615 4357390 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=2326040 CPUtime=876.84 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 361836 0 0 0 87578 106 0 0 25 0 4 0 593881982 2381864960 502990 33554432000 4194304 4623224 140736586678400 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=2326040 CPUtime=881.58 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 1805832 0 0 0 87858 300 0 0 25 0 4 0 593881982 2381864960 502990 33554432000 4194304 4623224 140736586678400 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3522.42
Current children cumulated vsize (KiB) 2326040

[startup+942.301 s]
/proc/loadavg: 8.21 8.14 7.81 9/184 14706
/proc/meminfo: memFree=13693788/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=2430032 CPUtime=3762.08 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 2893294 0 0 0 375662 546 0 0 25 0 4 0 593881920 2488352768 534438 33554432000 4194304 4623224 140736586678400 18446744073709551615 4507293 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 607508 534438 346 105 0 603012 0
[pid=14648/tid=14650] ppid=14646 vsize=2430032 CPUtime=941.67 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 127436 0 0 0 94132 35 0 0 25 0 4 0 593881982 2488352768 534438 33554432000 4194304 4623224 140736586678400 18446744073709551615 4357776 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=2430032 CPUtime=936.51 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 380739 0 0 0 93537 114 0 0 25 0 4 0 593881982 2488352768 534438 33554432000 4194304 4623224 140736586678400 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=2430032 CPUtime=941.57 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 1998150 0 0 0 93824 333 0 0 25 0 4 0 593881982 2488352768 534438 33554432000 4194304 4623224 140736586678400 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3762.08
Current children cumulated vsize (KiB) 2430032

[startup+1002.3 s]
/proc/loadavg: 8.19 8.14 7.83 9/184 14708
/proc/meminfo: memFree=13379804/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=2762476 CPUtime=4001.75 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 3199289 0 0 0 399578 597 0 0 25 0 4 0 593881920 2828775424 574667 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412473 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 690619 574668 346 105 0 686123 0
[pid=14648/tid=14650] ppid=14646 vsize=2762476 CPUtime=1001.67 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 128781 0 0 0 100132 35 0 0 25 0 4 0 593881982 2828775424 574668 33554432000 4194304 4623224 140736586678400 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=2762476 CPUtime=996.18 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 397616 0 0 0 99496 122 0 0 25 0 4 0 593881982 2828775424 574668 33554432000 4194304 4623224 140736586678400 18446744073709551615 224284585895 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=2762476 CPUtime=1001.57 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 2174899 0 0 0 99796 361 0 0 25 0 4 0 593881982 2828775424 574669 33554432000 4194304 4623224 140736586678400 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4001.75
Current children cumulated vsize (KiB) 2762476

[startup+1062.3 s]
/proc/loadavg: 8.39 8.21 7.87 9/184 14713
/proc/meminfo: memFree=12933408/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=3185708 CPUtime=4240.25 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 3627773 0 0 0 423349 676 0 0 25 0 4 0 593881920 3262164992 669168 33554432000 4194304 4623224 140736586678400 18446744073709551615 4412446 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/14648/statm: 796427 669168 347 105 0 791931 0
[pid=14648/tid=14650] ppid=14646 vsize=3185708 CPUtime=1061.41 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 164854 0 0 0 106095 46 0 0 25 0 4 0 593881982 3262164992 669168 33554432000 4194304 4623224 140736586678400 18446744073709551615 4461031 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=3185708 CPUtime=1055.09 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 439693 0 0 0 105377 132 0 0 25 0 4 0 593881982 3262164992 669168 33554432000 4194304 4623224 140736586678400 18446744073709551615 4330719 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=3185708 CPUtime=1061.56 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 2422782 0 0 0 105756 400 0 0 25 0 4 0 593881982 3262164992 669168 33554432000 4194304 4623224 140736586678400 18446744073709551615 4365979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4240.25
Current children cumulated vsize (KiB) 3185708

[startup+1122.3 s]
/proc/loadavg: 8.24 8.20 7.89 9/184 14713
/proc/meminfo: memFree=12756216/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=3320576 CPUtime=4479.91 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 3705709 0 0 0 447293 698 0 0 25 0 4 0 593881920 3400269824 690068 33554432000 4194304 4623224 140736586678400 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/14648/statm: 830144 690068 347 105 0 825648 0
[pid=14648/tid=14650] ppid=14646 vsize=3320576 CPUtime=1121.42 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 187387 0 0 0 112092 50 0 0 25 0 4 0 593881982 3400269824 690068 33554432000 4194304 4623224 140736586678400 18446744073709551615 224284584369 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=3320576 CPUtime=1115.08 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 472858 0 0 0 111363 145 0 0 25 0 4 0 593881982 3400269824 690068 33554432000 4194304 4623224 140736586678400 18446744073709551615 4317197 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=3320576 CPUtime=1121.55 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 2441965 0 0 0 111751 404 0 0 25 0 4 0 593881982 3400269824 690068 33554432000 4194304 4623224 140736586678400 18446744073709551615 4560918 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4479.91
Current children cumulated vsize (KiB) 3320576

[startup+1182.3 s]
/proc/loadavg: 8.18 8.19 7.90 9/184 14715
/proc/meminfo: memFree=12530140/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=3531864 CPUtime=4719.58 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 3944899 0 0 0 471220 738 0 0 25 0 4 0 593881920 3616628736 724732 33554432000 4194304 4623224 140736586678400 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/14648/statm: 882966 724732 347 105 0 878470 0
[pid=14648/tid=14650] ppid=14646 vsize=3531864 CPUtime=1181.4 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 197634 0 0 0 118084 56 0 0 25 0 4 0 593881982 3616628736 724732 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=3531864 CPUtime=1175.09 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 475626 0 0 0 117363 146 0 0 25 0 4 0 593881982 3616628736 724732 33554432000 4194304 4623224 140736586678400 18446744073709551615 4377675 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=3531864 CPUtime=1181.55 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 2542307 0 0 0 117735 420 0 0 25 0 4 0 593881982 3616628736 724732 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289853 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4719.58
Current children cumulated vsize (KiB) 3531864



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.5 s]
/proc/loadavg: 8.26 8.20 7.91 9/184 14717
/proc/meminfo: memFree=12444324/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=3531864 CPUtime=4800.28 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4202496 3986221 0 0 0 479282 746 0 0 25 0 4 0 593881920 3616628736 734531 33554432000 4194304 4623224 140736586678400 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/14648/statm: 882966 734531 347 105 0 878470 0
[pid=14648/tid=14650] ppid=14646 vsize=3531864 CPUtime=1201.61 cores=1,3,5,7
/proc/14648/task/14650/stat : 14650 (SArTagnan) R 14646 14648 13846 0 -1 4202560 198629 0 0 0 120104 57 0 0 25 0 4 0 593881982 3616628736 734531 33554432000 4194304 4623224 140736586678400 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=14648/tid=14651] ppid=14646 vsize=3531864 CPUtime=1195.29 cores=1,3,5,7
/proc/14648/task/14651/stat : 14651 (SArTagnan) R 14646 14648 13846 0 -1 4202560 476194 0 0 0 119383 146 0 0 25 0 4 0 593881982 3616628736 734531 33554432000 4194304 4623224 140736586678400 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=14648/tid=14652] ppid=14646 vsize=3531864 CPUtime=1201.75 cores=1,3,5,7
/proc/14648/task/14652/stat : 14652 (SArTagnan) R 14646 14648 13846 0 -1 4202560 2570649 0 0 0 119751 424 0 0 25 0 4 0 593881982 3616628736 734531 33554432000 4194304 4623224 140736586678400 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.28
Current children cumulated vsize (KiB) 3531864

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1202.61 s]
/proc/loadavg: 8.26 8.20 7.91 9/184 14717
/proc/meminfo: memFree=12444324/32951124 swapFree=67110396/67111528
[pid=14648] ppid=14646 vsize=0 CPUtime=4800.4 cores=1,3,5,7
/proc/14648/stat : 14648 (SArTagnan) R 14646 14648 13846 0 -1 4203524 3986222 0 0 0 479284 756 0 0 25 0 1 0 593881920 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/14648/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 4800.4
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.63
CPU time (s): 4800.43
CPU user time (s): 4792.84
CPU system time (s): 7.58585
CPU usage (%): 399.161
Max. virtual memory (cumulated for all children) (KiB): 3954248

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4792.84
system time used= 7.58585
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3986222
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8186
involuntary context switches= 34273

runsolver used 1.74073 second user time and 4.82926 second system time

The end

Launcher Data

Begin job on node118 at 2011-04-29 02:21:53
IDJOB=3280159
IDBENCH=20349
IDSOLVER=1656
FILE ID=node118/3280159-1304036511
RUNJOBID= node118-1304036511-14626
PBS_JOBID= 13170334
Free space on /tmp= 71584 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT07/industrial/anbulagan/hard-sat/partial-10-17-s.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280159-1304036511/watcher-3280159-1304036511 -o /tmp/evaluation-result-3280159-1304036511/solver-3280159-1304036511 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3280159-1304036511.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f72920912a1bb14f90e9fea5dee0ec1c
RANDOM SEED=1415553981

node118.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.842
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5374.59
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      18365944 kB
Buffers:       1897512 kB
Cached:       11994160 kB
SwapCached:        600 kB
Active:        9494696 kB
Inactive:      4553176 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      18365944 kB
SwapTotal:    67111528 kB
SwapFree:     67110396 kB
Dirty:           34820 kB
Writeback:           8 kB
AnonPages:      155268 kB
Mapped:          14936 kB
Slab:           472496 kB
PageTables:       5040 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   349468 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71572 MiB
End job on node118 at 2011-04-29 02:41:57