Trace number 3291291

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.36 1201.99

General information on the benchmark

NameSAT03/industrial/maris/CNF/
gripper13u.shuffled-as.sat03-395.cnf
MD5SUM3889b7ed90cc1fbe8bc8d140a1763832
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark4427.96
Satisfiable
(Un)Satisfiability was proved
Number of variables4268
Number of clauses38965
Sum of the clauses size86077
Maximum clause length28
Minimum clause length1
Number of clauses of size 169
Number of clauses of size 235984
Number of clauses of size 3104
Number of clauses of size 42704
Number of clauses of size 50
Number of clauses of size over 5104

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3291291-1304102205/watcher-3291291-1304102205 -o /tmp/evaluation-result-3291291-1304102205/solver-3291291-1304102205 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3291291-1304102205.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.46 7.96 7.99 2/174 25854
/proc/meminfo: memFree=29742912/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=20104 CPUtime=0 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 627 0 0 0 0 0 0 0 25 0 1 0 600451185 20586496 553 33554432000 4194304 4623224 140735607254736 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/25854/statm: 5026 553 301 105 0 530 0

[startup+0.0867941 s]
/proc/loadavg: 7.46 7.96 7.99 2/174 25854
/proc/meminfo: memFree=29742912/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=253804 CPUtime=0.28 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 4583 0 0 0 28 0 0 0 25 0 4 0 600451185 259895296 3356 33554432000 4194304 4623224 140735607254736 18446744073709551615 256415058886 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 63451 3356 342 105 0 58955 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 253804

[startup+0.154368 s]
/proc/loadavg: 7.46 7.96 7.99 2/174 25854
/proc/meminfo: memFree=29742912/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=259908 CPUtime=0.55 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 8701 0 0 0 54 1 0 0 25 0 4 0 600451185 266145792 5220 33554432000 4194304 4623224 140735607254736 18446744073709551615 4366247 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 64977 5220 343 105 0 60481 0
Current children cumulated CPU time (s) 0.55
Current children cumulated vsize (KiB) 259908

[startup+0.300679 s]
/proc/loadavg: 7.46 7.96 7.99 2/174 25854
/proc/meminfo: memFree=29742912/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=258272 CPUtime=1.14 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 10719 0 0 0 112 2 0 0 25 0 4 0 600451185 264470528 6760 33554432000 4194304 4623224 140735607254736 18446744073709551615 4388004 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 64568 6760 344 105 0 60072 0
Current children cumulated CPU time (s) 1.14
Current children cumulated vsize (KiB) 258272

[startup+0.700606 s]
/proc/loadavg: 7.46 7.96 7.99 2/174 25854
/proc/meminfo: memFree=29742912/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=262792 CPUtime=2.74 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 14606 0 0 0 271 3 0 0 25 0 4 0 600451185 269099008 9831 33554432000 4194304 4623224 140735607254736 18446744073709551615 4507151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 65698 9831 345 105 0 61202 0
Current children cumulated CPU time (s) 2.74
Current children cumulated vsize (KiB) 262792

[startup+1.50046 s]
/proc/loadavg: 7.46 7.96 7.99 9/184 25867
/proc/meminfo: memFree=29613832/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=272272 CPUtime=5.93 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 22007 0 0 0 589 4 0 0 25 0 4 0 600451185 278806528 13811 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510199 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 68068 13811 348 105 0 63572 0
[pid=25854/tid=25856] ppid=25852 vsize=272272 CPUtime=1.47 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 4743 0 0 0 146 1 0 0 25 0 4 0 600451186 278806528 13811 33554432000 4194304 4623224 140735607254736 18446744073709551615 4377018 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=272272 CPUtime=1.47 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 2600 0 0 0 147 0 0 0 20 0 4 0 600451186 278806528 13811 33554432000 4194304 4623224 140735607254736 18446744073709551615 4461225 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=272272 CPUtime=1.47 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 3066 0 0 0 147 0 0 0 20 0 4 0 600451186 278806528 13811 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 272272

[startup+3.10115 s]
/proc/loadavg: 7.46 7.96 7.99 9/184 25867
/proc/meminfo: memFree=29577996/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=281688 CPUtime=12.32 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 33098 0 0 0 1226 6 0 0 25 0 4 0 600451185 288448512 19145 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 70422 19145 366 105 0 65926 0
[pid=25854/tid=25856] ppid=25852 vsize=281688 CPUtime=3.06 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 7551 0 0 0 305 1 0 0 25 0 4 0 600451186 288448512 19145 33554432000 4194304 4623224 140735607254736 18446744073709551615 4468031 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=281688 CPUtime=3.07 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 3840 0 0 0 307 0 0 0 25 0 4 0 600451186 288448512 19145 33554432000 4194304 4623224 140735607254736 18446744073709551615 4289942 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=281688 CPUtime=3.07 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 6235 0 0 0 307 0 0 0 25 0 4 0 600451186 288448512 19145 33554432000 4194304 4623224 140735607254736 18446744073709551615 4577681 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 281688

[startup+6.30055 s]
/proc/loadavg: 7.50 7.96 7.99 9/184 25867
/proc/meminfo: memFree=29508112/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=312544 CPUtime=25.1 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 56486 0 0 0 2501 9 0 0 25 0 4 0 600451185 320045056 26999 33554432000 4194304 4623224 140735607254736 18446744073709551615 4279912 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 78136 27025 373 105 0 73640 0
[pid=25854/tid=25856] ppid=25852 vsize=312544 CPUtime=6.25 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 11221 0 0 0 623 2 0 0 25 0 4 0 600451186 320045056 27035 33554432000 4194304 4623224 140735607254736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=312544 CPUtime=6.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 6747 0 0 0 626 1 0 0 25 0 4 0 600451186 320045056 27050 33554432000 4194304 4623224 140735607254736 18446744073709551615 4467803 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=314976 CPUtime=6.28 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 17933 0 0 0 626 2 0 0 25 0 4 0 600451186 322535424 27060 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 312544

[startup+12.7003 s]
/proc/loadavg: 7.54 7.96 7.99 9/184 25868
/proc/meminfo: memFree=29368072/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=354300 CPUtime=50.67 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 93312 0 0 0 5052 15 0 0 25 0 4 0 600451185 362803200 42589 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 88575 42589 416 105 0 84079 0
[pid=25854/tid=25856] ppid=25852 vsize=354300 CPUtime=12.61 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 18307 0 0 0 1258 3 0 0 25 0 4 0 600451186 362803200 42589 33554432000 4194304 4623224 140735607254736 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=354300 CPUtime=12.67 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 10902 0 0 0 1265 2 0 0 25 0 4 0 600451186 362803200 42589 33554432000 4194304 4623224 140735607254736 18446744073709551615 4317222 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=354300 CPUtime=12.67 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 30186 0 0 0 1265 2 0 0 25 0 4 0 600451186 362803200 42589 33554432000 4194304 4623224 140735607254736 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 354300

[startup+25.5009 s]
/proc/loadavg: 7.64 7.96 7.99 9/184 25868
/proc/meminfo: memFree=29115848/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=405388 CPUtime=101.79 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 239505 0 0 0 10136 43 0 0 25 0 4 0 600451185 415117312 67211 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 101347 67211 494 105 0 96851 0
[pid=25854/tid=25856] ppid=25852 vsize=405388 CPUtime=25.33 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 31759 0 0 0 2524 9 0 0 25 0 4 0 600451186 415117312 67211 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=405388 CPUtime=25.47 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 14825 0 0 0 2544 3 0 0 25 0 4 0 600451186 415117312 67211 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=405388 CPUtime=25.48 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 141532 0 0 0 2527 21 0 0 25 0 4 0 600451186 415117312 67211 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 405388

[startup+51.1011 s]
/proc/loadavg: 7.84 7.98 7.99 9/184 25899
/proc/meminfo: memFree=29361536/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=568248 CPUtime=204.04 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 356275 0 0 0 20338 66 0 0 25 0 4 0 600451185 581885952 84271 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 142062 84271 509 105 0 137566 0
[pid=25854/tid=25856] ppid=25852 vsize=568248 CPUtime=50.79 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 45822 0 0 0 5065 14 0 0 25 0 4 0 600451186 581885952 84271 33554432000 4194304 4623224 140735607254736 18446744073709551615 4462984 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=568248 CPUtime=51.07 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 22253 0 0 0 5100 7 0 0 25 0 4 0 600451186 581885952 84271 33554432000 4194304 4623224 140735607254736 18446744073709551615 4377040 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=568248 CPUtime=51.07 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 233300 0 0 0 5075 32 0 0 25 0 4 0 600451186 581885952 84271 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 204.04
Current children cumulated vsize (KiB) 568248

[startup+102.306 s]
/proc/loadavg: 7.93 7.98 7.99 9/184 25900
/proc/meminfo: memFree=29001364/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=761340 CPUtime=408.58 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 936178 0 0 0 40689 169 0 0 25 0 4 0 600451185 779612160 139849 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 190335 139849 416 105 0 185839 0
[pid=25854/tid=25856] ppid=25852 vsize=761340 CPUtime=101.71 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 78709 0 0 0 10138 33 0 0 25 0 4 0 600451186 779612160 139849 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=761340 CPUtime=102.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 26531 0 0 0 10218 9 0 0 25 0 4 0 600451186 779612160 139849 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=761340 CPUtime=102.28 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 714928 0 0 0 10123 105 0 0 25 0 4 0 600451186 779612160 139849 33554432000 4194304 4623224 140735607254736 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 408.58
Current children cumulated vsize (KiB) 761340

[startup+162.301 s]
/proc/loadavg: 8.21 8.05 8.01 9/184 25905
/proc/meminfo: memFree=28679872/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=1009476 CPUtime=647.4 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 1595665 0 0 0 64458 282 0 0 25 0 4 0 600451185 1033703424 181880 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 252369 181880 372 105 0 247873 0
[pid=25854/tid=25856] ppid=25852 vsize=1009476 CPUtime=160.7 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 108839 0 0 0 16017 53 0 0 25 0 4 0 600451186 1033703424 181880 33554432000 4194304 4623224 140735607254736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=1009476 CPUtime=162.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 35288 0 0 0 16215 12 0 0 25 0 4 0 600451186 1033703424 181880 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=1009476 CPUtime=162.12 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 1294592 0 0 0 16022 190 0 0 25 0 4 0 600451186 1033703424 181880 33554432000 4194304 4623224 140735607254736 18446744073709551615 4577423 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 647.4
Current children cumulated vsize (KiB) 1009476

[startup+222.301 s]
/proc/loadavg: 8.13 8.05 8.01 9/184 25906
/proc/meminfo: memFree=28400680/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=1220560 CPUtime=887.07 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 2021290 0 0 0 88353 354 0 0 25 0 4 0 600451185 1249853440 220767 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 305140 220767 436 105 0 300644 0
[pid=25854/tid=25856] ppid=25852 vsize=1220560 CPUtime=220.38 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 117235 0 0 0 21975 63 0 0 25 0 4 0 600451186 1249853440 220767 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376829 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=1220560 CPUtime=222.26 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 41298 0 0 0 22212 14 0 0 25 0 4 0 600451186 1249853440 220767 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=1220560 CPUtime=222.12 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 1640932 0 0 0 21972 240 0 0 25 0 4 0 600451186 1249853440 220767 33554432000 4194304 4623224 140735607254736 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 887.07
Current children cumulated vsize (KiB) 1220560

[startup+282.301 s]

################
# More data... #
################

[pid=25854] ppid=25852 vsize=1887504 CPUtime=2804.5 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 3378488 0 0 0 279826 624 0 0 25 0 4 0 600451185 1932804096 386534 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510119 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 471876 386534 349 105 0 467380 0
[pid=25854/tid=25856] ppid=25852 vsize=1887504 CPUtime=697.78 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 170246 0 0 0 69683 95 0 0 25 0 4 0 600451186 1932804096 386534 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=1887504 CPUtime=702.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 70375 0 0 0 70188 39 0 0 25 0 4 0 600451186 1932804096 386534 33554432000 4194304 4623224 140735607254736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=1887504 CPUtime=702.12 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 2715337 0 0 0 69799 413 0 0 25 0 4 0 600451186 1932804096 386534 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2804.5
Current children cumulated vsize (KiB) 1887504

[startup+762.307 s]
/proc/loadavg: 8.12 8.09 8.03 9/184 25921
/proc/meminfo: memFree=26691800/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=1973692 CPUtime=3044.21 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 3404267 0 0 0 303792 629 0 0 25 0 4 0 600451185 2021060608 401881 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 493423 401881 349 105 0 488927 0
[pid=25854/tid=25856] ppid=25852 vsize=1973692 CPUtime=757.46 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 170484 0 0 0 75651 95 0 0 25 0 4 0 600451186 2021060608 401881 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=1973692 CPUtime=762.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 70711 0 0 0 76188 39 0 0 25 0 4 0 600451186 2021060608 401881 33554432000 4194304 4623224 140735607254736 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=1973692 CPUtime=762.14 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 2717650 0 0 0 75800 414 0 0 25 0 4 0 600451186 2021060608 401881 33554432000 4194304 4623224 140735607254736 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3044.21
Current children cumulated vsize (KiB) 1973692

[startup+822.301 s]
/proc/loadavg: 8.18 8.11 8.04 9/184 25922
/proc/meminfo: memFree=26538612/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2192504 CPUtime=3283.86 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 3493949 0 0 0 327742 644 0 0 25 0 4 0 600451185 2245124096 420312 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 548126 420312 349 105 0 543630 0
[pid=25854/tid=25856] ppid=25852 vsize=2192504 CPUtime=817.13 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 170759 0 0 0 81618 95 0 0 25 0 4 0 600451186 2245124096 420312 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2192504 CPUtime=822.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 71749 0 0 0 82187 40 0 0 25 0 4 0 600451186 2245124096 420312 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376738 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2192504 CPUtime=822.13 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 2720290 0 0 0 81798 415 0 0 25 0 4 0 600451186 2245124096 420312 33554432000 4194304 4623224 140735607254736 18446744073709551615 4377789 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3283.86
Current children cumulated vsize (KiB) 2192504

[startup+882.3 s]
/proc/loadavg: 8.19 8.11 8.04 9/184 25924
/proc/meminfo: memFree=26391496/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2202104 CPUtime=3523.53 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 3508266 0 0 0 351701 652 0 0 25 0 4 0 600451185 2254954496 434483 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 550526 434483 345 105 0 546030 0
[pid=25854/tid=25856] ppid=25852 vsize=2202104 CPUtime=876.8 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 171482 0 0 0 87585 95 0 0 25 0 4 0 600451186 2254954496 434483 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357776 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2202104 CPUtime=882.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 75148 0 0 0 88182 45 0 0 25 0 4 0 600451186 2254954496 434483 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2202104 CPUtime=882.13 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 2722854 0 0 0 87797 416 0 0 25 0 4 0 600451186 2254954496 434483 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3523.53
Current children cumulated vsize (KiB) 2202104

[startup+942.301 s]
/proc/loadavg: 8.18 8.12 8.05 9/184 25925
/proc/meminfo: memFree=26253440/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2274028 CPUtime=3763.22 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 3542568 0 0 0 375658 664 0 0 25 0 4 0 600451185 2328604672 448995 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 568507 448995 345 105 0 564011 0
[pid=25854/tid=25856] ppid=25852 vsize=2274028 CPUtime=936.48 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 171978 0 0 0 93552 96 0 0 25 0 4 0 600451186 2328604672 448995 33554432000 4194304 4623224 140735607254736 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2274028 CPUtime=942.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 77805 0 0 0 94178 49 0 0 25 0 4 0 600451186 2328604672 448995 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2274028 CPUtime=942.14 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 2744873 0 0 0 93794 420 0 0 25 0 4 0 600451186 2328604672 448995 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364041 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3763.22
Current children cumulated vsize (KiB) 2274028

[startup+1002.3 s]
/proc/loadavg: 8.17 8.13 8.05 9/184 25927
/proc/meminfo: memFree=26076076/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2302064 CPUtime=4002.9 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 3796916 0 0 0 399581 709 0 0 25 0 4 0 600451185 2357313536 459603 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 575516 459603 345 105 0 571020 0
[pid=25854/tid=25856] ppid=25852 vsize=2302064 CPUtime=996.15 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 172381 0 0 0 99519 96 0 0 25 0 4 0 600451186 2357313536 459603 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2302064 CPUtime=1002.26 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 93004 0 0 0 100175 51 0 0 25 0 4 0 600451186 2357313536 459603 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2302064 CPUtime=1002.14 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 2973814 0 0 0 99755 459 0 0 25 0 4 0 600451186 2357313536 459603 33554432000 4194304 4623224 140735607254736 18446744073709551615 4545353 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4002.9
Current children cumulated vsize (KiB) 2302064

[startup+1062.3 s]
/proc/loadavg: 8.11 8.12 8.05 9/184 25929
/proc/meminfo: memFree=25991104/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2302064 CPUtime=4242.58 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 4175840 0 0 0 423485 773 0 0 25 0 4 0 600451185 2357313536 468208 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 575516 468208 345 105 0 571020 0
[pid=25854/tid=25856] ppid=25852 vsize=2302064 CPUtime=1055.83 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 172861 0 0 0 105487 96 0 0 25 0 4 0 600451186 2357313536 468208 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2302064 CPUtime=1062.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 93431 0 0 0 106175 52 0 0 25 0 4 0 600451186 2357313536 468208 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2302064 CPUtime=1062.14 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 3345450 0 0 0 105693 521 0 0 25 0 4 0 600451186 2357313536 468208 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4242.58
Current children cumulated vsize (KiB) 2302064

[startup+1122.3 s]
/proc/loadavg: 8.04 8.09 8.05 9/184 25930
/proc/meminfo: memFree=25849328/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2367600 CPUtime=4482.26 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 4680016 0 0 0 447367 859 0 0 25 0 4 0 600451185 2424422400 481669 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 591900 481669 348 105 0 587404 0
[pid=25854/tid=25856] ppid=25852 vsize=2367600 CPUtime=1115.5 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 173190 0 0 0 111454 96 0 0 25 0 4 0 600451186 2424422400 481669 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2367600 CPUtime=1122.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 95246 0 0 0 112172 55 0 0 25 0 4 0 600451186 2424422400 481669 33554432000 4194304 4623224 140735607254736 18446744073709551615 4317194 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2367600 CPUtime=1122.14 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 3838466 0 0 0 111614 600 0 0 25 0 4 0 600451186 2424422400 481669 33554432000 4194304 4623224 140735607254736 18446744073709551615 4377679 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4482.26
Current children cumulated vsize (KiB) 2367600

[startup+1182.3 s]
/proc/loadavg: 8.06 8.09 8.05 9/184 25932
/proc/meminfo: memFree=25730996/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2367600 CPUtime=4721.94 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 5202298 0 0 0 471252 942 0 0 25 0 4 0 600451185 2424422400 490606 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 591900 490606 345 105 0 587404 0
[pid=25854/tid=25856] ppid=25852 vsize=2367600 CPUtime=1175.18 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 173511 0 0 0 117422 96 0 0 25 0 4 0 600451186 2424422400 490606 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2367600 CPUtime=1182.27 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 96651 0 0 0 118170 57 0 0 25 0 4 0 600451186 2424422400 490606 33554432000 4194304 4623224 140735607254736 18446744073709551615 4377410 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2367600 CPUtime=1182.14 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 4353239 0 0 0 117535 679 0 0 25 0 4 0 600451186 2424422400 490606 33554432000 4194304 4623224 140735607254736 18446744073709551615 4363970 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4721.94
Current children cumulated vsize (KiB) 2367600



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.04 8.08 8.04 9/184 25932
/proc/meminfo: memFree=25692304/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2367600 CPUtime=4800.25 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 5387193 0 0 0 479055 970 0 0 25 0 4 0 600451185 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 591900 494485 350 105 0 587404 0
[pid=25854/tid=25856] ppid=25852 vsize=2367600 CPUtime=1194.67 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 173641 0 0 0 119371 96 0 0 25 0 4 0 600451186 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2367600 CPUtime=1201.87 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 96848 0 0 0 120130 57 0 0 25 0 4 0 600451186 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2367600 CPUtime=1201.75 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 4535336 0 0 0 119469 706 0 0 25 0 4 0 600451186 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 2367600

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.9 s]
/proc/loadavg: 8.04 8.08 8.04 9/184 25932
/proc/meminfo: memFree=25692304/32950928 swapFree=67111364/67111528
[pid=25854] ppid=25852 vsize=2367600 CPUtime=4800.25 cores=1,3,5,7
/proc/25854/stat : 25854 (SArTagnan) R 25852 25854 25177 0 -1 4202496 5387193 0 0 0 479055 970 0 0 25 0 4 0 600451185 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25854/statm: 591900 494485 350 105 0 587404 0
[pid=25854/tid=25856] ppid=25852 vsize=2367600 CPUtime=1194.67 cores=1,3,5,7
/proc/25854/task/25856/stat : 25856 (SArTagnan) R 25852 25854 25177 0 -1 4202560 173641 0 0 0 119371 96 0 0 25 0 4 0 600451186 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=25854/tid=25857] ppid=25852 vsize=2367600 CPUtime=1201.87 cores=1,3,5,7
/proc/25854/task/25857/stat : 25857 (SArTagnan) R 25852 25854 25177 0 -1 4202560 96848 0 0 0 120130 57 0 0 25 0 4 0 600451186 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25854/tid=25858] ppid=25852 vsize=2367600 CPUtime=1201.75 cores=1,3,5,7
/proc/25854/task/25858/stat : 25858 (SArTagnan) R 25852 25854 25177 0 -1 4202560 4535336 0 0 0 119469 706 0 0 25 0 4 0 600451186 2424422400 494485 33554432000 4194304 4623224 140735607254736 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.25
Current children cumulated vsize (KiB) 2367600

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.99
CPU time (s): 4800.36
CPU user time (s): 4790.58
CPU system time (s): 9.78351
CPU usage (%): 399.366
Max. virtual memory (cumulated for all children) (KiB): 2471144

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4790.58
system time used= 9.78351
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 5387193
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6113
involuntary context switches= 30925

runsolver used 1.77973 second user time and 4.77827 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-29 20:36:45
IDJOB=3291291
IDBENCH=84180
IDSOLVER=1656
FILE ID=node115/3291291-1304102205
RUNJOBID= node115-1304102204-25781
PBS_JOBID= 13170604
Free space on /tmp= 72724 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT03/industrial/maris/CNF/gripper13u.shuffled-as.sat03-395.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3291291-1304102205/watcher-3291291-1304102205 -o /tmp/evaluation-result-3291291-1304102205/solver-3291291-1304102205 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3291291-1304102205.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3889b7ed90cc1fbe8bc8d140a1763832
RANDOM SEED=599403369

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29743192 kB
Buffers:        799076 kB
Cached:        1915108 kB
SwapCached:          0 kB
Active:         155824 kB
Inactive:      2626156 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29743192 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            7784 kB
Writeback:           0 kB
AnonPages:       67212 kB
Mapped:          14496 kB
Slab:           362328 kB
PageTables:       4480 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   192316 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72728 MiB
End job on node115 at 2011-04-29 20:56:49