Trace number 3290325

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.46 1201.75

General information on the benchmark

Nameapplication/kullmann/AES/Benchmarks/
32/aes_32_5_keyfind_1.cnf
MD5SUM3f4ea4cf17e734bbe947db7c1dc9fde7
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables1116
Number of clauses4312
Sum of the clauses size13688
Maximum clause length5
Minimum clause length1
Number of clauses of size 184
Number of clauses of size 2200
Number of clauses of size 33008
Number of clauses of size 4920
Number of clauses of size 5100
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3290325-1304097132/watcher-3290325-1304097132 -o /tmp/evaluation-result-3290325-1304097132/solver-3290325-1304097132 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3290325-1304097132.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.03 7.48 7.82 5/180 2287
/proc/meminfo: memFree=30861404/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=18960 CPUtime=0 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 533 0 0 0 0 0 0 0 25 0 1 0 502129067 19415040 470 33554432000 4194304 4623224 140736941832784 18446744073709551615 220816236288 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/2287/statm: 4740 471 301 105 0 244 0
[pid=2287/tid=2288] ppid=2285 vsize=50420 CPUtime=0 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 502129068 51630080 671 33554432000 4194304 4623224 140736941832784 18446744073709551615 220816292849 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=50420 CPUtime=0 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 502129068 51630080 671 33554432000 4194304 4623224 140736941832784 18446744073709551615 220816292849 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=50420 CPUtime=0 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 502129068 51630080 671 33554432000 4194304 4623224 140736941832784 18446744073709551615 220811268328 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.155365 s]
/proc/loadavg: 6.03 7.48 7.82 5/180 2287
/proc/meminfo: memFree=30861404/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=251516 CPUtime=0.6 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 3693 0 0 0 60 0 0 0 25 0 4 0 502129067 257552384 2090 33554432000 4194304 4623224 140736941832784 18446744073709551615 4511134 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 62879 2090 343 105 0 58383 0
[pid=2287/tid=2288] ppid=2285 vsize=251516 CPUtime=0.14 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 518 0 0 0 14 0 0 0 25 0 4 0 502129068 257552384 2090 33554432000 4194304 4623224 140736941832784 18446744073709551615 4460968 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=251516 CPUtime=0.14 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 493 0 0 0 14 0 0 0 25 0 4 0 502129068 257552384 2090 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=251516 CPUtime=0.14 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 953 0 0 0 14 0 0 0 25 0 4 0 502129068 257552384 2090 33554432000 4194304 4623224 140736941832784 18446744073709551615 4289581 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.6
Current children cumulated vsize (KiB) 251516

[startup+0.200356 s]
/proc/loadavg: 6.03 7.48 7.82 5/180 2287
/proc/meminfo: memFree=30861404/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=251856 CPUtime=0.77 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4209 0 0 0 77 0 0 0 25 0 4 0 502129067 257900544 2150 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510486 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 62964 2150 343 105 0 58468 0
[pid=2287/tid=2288] ppid=2285 vsize=251856 CPUtime=0.19 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 708 0 0 0 19 0 0 0 25 0 4 0 502129068 257900544 2150 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376946 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=251856 CPUtime=0.19 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 517 0 0 0 19 0 0 0 25 0 4 0 502129068 257900544 2150 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=251856 CPUtime=0.19 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 1248 0 0 0 19 0 0 0 25 0 4 0 502129068 257900544 2150 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 251856

[startup+0.300338 s]
/proc/loadavg: 6.03 7.48 7.82 5/180 2287
/proc/meminfo: memFree=30861404/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=252544 CPUtime=1.17 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 5263 0 0 0 117 0 0 0 25 0 4 0 502129067 258605056 2339 33554432000 4194304 4623224 140736941832784 18446744073709551615 220815892487 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 63136 2339 343 105 0 58640 0
[pid=2287/tid=2288] ppid=2285 vsize=252544 CPUtime=0.29 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 764 0 0 0 29 0 0 0 25 0 4 0 502129068 258605056 2339 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376858 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=252544 CPUtime=0.29 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 712 0 0 0 29 0 0 0 25 0 4 0 502129068 258605056 2339 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=252544 CPUtime=0.29 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 2024 0 0 0 29 0 0 0 25 0 4 0 502129068 258605056 2339 33554432000 4194304 4623224 140736941832784 18446744073709551615 4467750 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1.17
Current children cumulated vsize (KiB) 252544

[startup+0.700266 s]
/proc/loadavg: 6.03 7.48 7.82 5/180 2287
/proc/meminfo: memFree=30861404/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=253652 CPUtime=2.78 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 9006 0 0 0 277 1 0 0 25 0 4 0 502129067 259739648 3107 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 63413 3107 343 105 0 58917 0
[pid=2287/tid=2288] ppid=2285 vsize=253652 CPUtime=0.69 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 1215 0 0 0 69 0 0 0 25 0 4 0 502129068 259739648 3107 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376692 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=253652 CPUtime=0.69 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 1214 0 0 0 69 0 0 0 25 0 4 0 502129068 259739648 3107 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=253652 CPUtime=0.68 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4487 0 0 0 68 0 0 0 25 0 4 0 502129068 259739648 3107 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 253652

[startup+1.50112 s]
/proc/loadavg: 6.03 7.48 7.82 9/184 2291
/proc/meminfo: memFree=30842420/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=255852 CPUtime=5.97 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 16698 0 0 0 595 2 0 0 25 0 4 0 502129067 261992448 4276 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510495 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 63963 4276 343 105 0 59467 0
[pid=2287/tid=2288] ppid=2285 vsize=255852 CPUtime=1.48 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 1419 0 0 0 148 0 0 0 25 0 4 0 502129068 261992448 4276 33554432000 4194304 4623224 140736941832784 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=255852 CPUtime=1.49 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 1887 0 0 0 149 0 0 0 25 0 4 0 502129068 261992448 4276 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376643 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=255852 CPUtime=1.48 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 11160 0 0 0 147 1 0 0 25 0 4 0 502129068 261992448 4276 33554432000 4194304 4623224 140736941832784 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 255852

[startup+3.10083 s]
/proc/loadavg: 6.03 7.48 7.82 9/184 2291
/proc/meminfo: memFree=30827196/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=259808 CPUtime=12.36 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 30105 0 0 0 1232 4 0 0 25 0 4 0 502129067 266043392 6347 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 64952 6347 343 105 0 60456 0
[pid=2287/tid=2288] ppid=2285 vsize=259808 CPUtime=3.08 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 2170 0 0 0 308 0 0 0 25 0 4 0 502129068 266043392 6347 33554432000 4194304 4623224 140736941832784 18446744073709551615 4364911 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=259808 CPUtime=3.09 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 2210 0 0 0 309 0 0 0 25 0 4 0 502129068 266043392 6347 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376904 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=259808 CPUtime=3.08 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 22749 0 0 0 305 3 0 0 25 0 4 0 502129068 266043392 6347 33554432000 4194304 4623224 140736941832784 18446744073709551615 4377056 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 259808

[startup+6.30024 s]
/proc/loadavg: 6.18 7.49 7.82 9/184 2291
/proc/meminfo: memFree=30794212/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=265908 CPUtime=25.15 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 40900 0 0 0 2509 6 0 0 25 0 4 0 502129067 272289792 9631 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 66477 9631 350 105 0 61981 0
[pid=2287/tid=2288] ppid=2285 vsize=265908 CPUtime=6.25 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 3359 0 0 0 625 0 0 0 25 0 4 0 502129068 272289792 9631 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=265908 CPUtime=6.28 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 3387 0 0 0 628 0 0 0 25 0 4 0 502129068 272289792 9631 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=265908 CPUtime=6.28 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 29993 0 0 0 624 4 0 0 25 0 4 0 502129068 272289792 9631 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 265908

[startup+12.7011 s]
/proc/loadavg: 6.33 7.49 7.82 9/184 2291
/proc/meminfo: memFree=30751200/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=277944 CPUtime=50.71 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 81383 0 0 0 5057 14 0 0 25 0 4 0 502129067 284614656 14707 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 69486 14707 357 105 0 64990 0
[pid=2287/tid=2288] ppid=2285 vsize=277944 CPUtime=12.61 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 5243 0 0 0 1261 0 0 0 25 0 4 0 502129068 284614656 14707 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376895 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=277944 CPUtime=12.69 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 5207 0 0 0 1268 1 0 0 25 0 4 0 502129068 284614656 14707 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376993 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=277944 CPUtime=12.69 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 65167 0 0 0 1258 11 0 0 25 0 4 0 502129068 284614656 14707 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 277944

[startup+25.5007 s]
/proc/loadavg: 6.70 7.52 7.82 9/184 2291
/proc/meminfo: memFree=30660288/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=290960 CPUtime=101.84 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 120513 0 0 0 10161 23 0 0 25 0 4 0 502129067 297943040 22826 33554432000 4194304 4623224 140736941832784 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 72740 22826 398 105 0 68244 0
[pid=2287/tid=2288] ppid=2285 vsize=290960 CPUtime=25.35 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 7851 0 0 0 2534 1 0 0 25 0 4 0 502129068 297943040 22826 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=290960 CPUtime=25.48 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 10667 0 0 0 2545 3 0 0 25 0 4 0 502129068 297943040 22826 33554432000 4194304 4623224 140736941832784 18446744073709551615 4461117 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=290960 CPUtime=25.49 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 93741 0 0 0 2533 16 0 0 25 0 4 0 502129068 297943040 22826 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.84
Current children cumulated vsize (KiB) 290960

[startup+51.101 s]
/proc/loadavg: 7.14 7.56 7.82 9/184 2292
/proc/meminfo: memFree=30531668/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=306840 CPUtime=204.11 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 296239 0 0 0 20359 52 0 0 25 0 4 0 502129067 314204160 31924 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 76710 31924 463 105 0 72214 0
[pid=2287/tid=2288] ppid=2285 vsize=306840 CPUtime=50.82 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 11808 0 0 0 5080 2 0 0 25 0 4 0 502129068 314204160 31924 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=306840 CPUtime=51.09 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 12109 0 0 0 5105 4 0 0 25 0 4 0 502129068 314204160 31925 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=306840 CPUtime=51.08 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 261872 0 0 0 5065 43 0 0 25 0 4 0 502129068 314204160 31935 33554432000 4194304 4623224 140736941832784 18446744073709551615 220815933559 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 204.11
Current children cumulated vsize (KiB) 306840

[startup+102.301 s]
/proc/loadavg: 7.62 7.62 7.83 9/184 2293
/proc/meminfo: memFree=30340792/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=368888 CPUtime=408.64 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 501268 0 0 0 40780 84 0 0 25 0 4 0 502129067 377741312 55534 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 92222 55534 669 105 0 87726 0
[pid=2287/tid=2288] ppid=2285 vsize=368888 CPUtime=101.74 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 17948 0 0 0 10171 3 0 0 25 0 4 0 502129068 377741312 55538 33554432000 4194304 4623224 140736941832784 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=368888 CPUtime=102.3 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 17406 0 0 0 10225 5 0 0 25 0 4 0 502129068 377741312 55538 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=368888 CPUtime=102.3 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 441712 0 0 0 10158 72 0 0 25 0 4 0 502129068 377741312 55538 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 408.64
Current children cumulated vsize (KiB) 368888

[startup+162.3 s]

################
# More data... #
################

[pid=2287] ppid=2285 vsize=846424 CPUtime=2565.76 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 3530963 0 0 0 255981 595 0 0 25 0 4 0 502129067 866738176 162338 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 211606 162338 344 105 0 207110 0
[pid=2287/tid=2288] ppid=2285 vsize=846424 CPUtime=638.81 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 44520 0 0 0 63866 15 0 0 25 0 4 0 502129068 866738176 162338 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=846424 CPUtime=642.3 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 59472 0 0 0 64216 14 0 0 25 0 4 0 502129068 866738176 162338 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=846424 CPUtime=642.3 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 3290768 0 0 0 63688 542 0 0 25 0 4 0 502129068 866738176 162338 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376806 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2565.76
Current children cumulated vsize (KiB) 846424

[startup+702.301 s]
/proc/loadavg: 8.07 8.02 7.93 9/184 2311
/proc/meminfo: memFree=29100164/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=864916 CPUtime=2805.44 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 3855959 0 0 0 279896 648 0 0 25 0 4 0 502129067 885673984 170618 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 216229 170618 344 105 0 211733 0
[pid=2287/tid=2288] ppid=2285 vsize=864916 CPUtime=698.48 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 45857 0 0 0 69831 17 0 0 25 0 4 0 502129068 885673984 170618 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=864916 CPUtime=702.3 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 60950 0 0 0 70215 15 0 0 25 0 4 0 502129068 885673984 170618 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=864916 CPUtime=702.31 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 3604232 0 0 0 69641 590 0 0 25 0 4 0 502129068 885673984 170618 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2805.44
Current children cumulated vsize (KiB) 864916

[startup+762.301 s]
/proc/loadavg: 8.07 8.03 7.93 9/184 2313
/proc/meminfo: memFree=29014552/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=959596 CPUtime=3045.13 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4182534 0 0 0 303811 702 0 0 25 0 4 0 502129067 982626304 180856 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 239899 180856 344 105 0 235403 0
[pid=2287/tid=2288] ppid=2285 vsize=959596 CPUtime=758.16 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 58970 0 0 0 75796 20 0 0 25 0 4 0 502129068 982626304 180856 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=959596 CPUtime=762.32 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 62310 0 0 0 76216 16 0 0 25 0 4 0 502129068 982626304 180856 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=959596 CPUtime=762.31 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 3906752 0 0 0 75592 639 0 0 25 0 4 0 502129068 982626304 180856 33554432000 4194304 4623224 140736941832784 18446744073709551615 4577681 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3045.13
Current children cumulated vsize (KiB) 959596

[startup+822.301 s]
/proc/loadavg: 8.24 8.09 7.96 9/184 2317
/proc/meminfo: memFree=28938044/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1048884 CPUtime=3284.79 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4546653 0 0 0 327717 762 0 0 25 0 4 0 502129067 1074057216 191524 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 262221 191524 346 105 0 257725 0
[pid=2287/tid=2288] ppid=2285 vsize=1048884 CPUtime=817.83 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 59958 0 0 0 81762 21 0 0 25 0 4 0 502129068 1074057216 191524 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376960 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1048884 CPUtime=822.31 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 62655 0 0 0 82215 16 0 0 25 0 4 0 502129068 1074057216 191524 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1048884 CPUtime=822.3 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4218756 0 0 0 81539 691 0 0 25 0 4 0 502129068 1074057216 191524 33554432000 4194304 4623224 140736941832784 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3284.79
Current children cumulated vsize (KiB) 1048884

[startup+882.307 s]
/proc/loadavg: 8.13 8.09 7.96 9/184 2319
/proc/meminfo: memFree=28865704/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1067400 CPUtime=3524.49 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4559832 0 0 0 351684 765 0 0 25 0 4 0 502129067 1093017600 196368 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 266850 196368 344 105 0 262354 0
[pid=2287/tid=2288] ppid=2285 vsize=1067400 CPUtime=877.51 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 60251 0 0 0 87730 21 0 0 25 0 4 0 502129068 1093017600 196368 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1067400 CPUtime=882.32 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 62794 0 0 0 88216 16 0 0 25 0 4 0 502129068 1093017600 196368 33554432000 4194304 4623224 140736941832784 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1067400 CPUtime=882.31 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4228162 0 0 0 87537 694 0 0 25 0 4 0 502129068 1093017600 196368 33554432000 4194304 4623224 140736941832784 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3524.49
Current children cumulated vsize (KiB) 1067400

[startup+942.301 s]
/proc/loadavg: 8.08 8.08 7.97 9/184 2321
/proc/meminfo: memFree=28790648/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1079012 CPUtime=3764.15 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4572383 0 0 0 375646 769 0 0 25 0 4 0 502129067 1104908288 201917 33554432000 4194304 4623224 140736941832784 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 269753 201917 344 105 0 265257 0
[pid=2287/tid=2288] ppid=2285 vsize=1079012 CPUtime=937.18 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 61474 0 0 0 93695 23 0 0 25 0 4 0 502129068 1104908288 201917 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1079012 CPUtime=942.31 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 63061 0 0 0 94215 16 0 0 25 0 4 0 502129068 1104908288 201917 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1079012 CPUtime=942.3 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4231437 0 0 0 93536 694 0 0 25 0 4 0 502129068 1104908288 201917 33554432000 4194304 4623224 140736941832784 18446744073709551615 4355414 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3764.15
Current children cumulated vsize (KiB) 1079012

[startup+1002.3 s]
/proc/loadavg: 8.06 8.08 7.98 9/184 2322
/proc/meminfo: memFree=28717552/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1093124 CPUtime=4003.84 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4591302 0 0 0 399608 776 0 0 25 0 4 0 502129067 1119358976 208353 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 273281 208353 344 105 0 268785 0
[pid=2287/tid=2288] ppid=2285 vsize=1093124 CPUtime=996.85 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 62447 0 0 0 99661 24 0 0 25 0 4 0 502129068 1119358976 208353 33554432000 4194304 4623224 140736941832784 18446744073709551615 4377608 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1093124 CPUtime=1002.32 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 63957 0 0 0 100215 17 0 0 25 0 4 0 502129068 1119358976 208353 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1093124 CPUtime=1002.31 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4238461 0 0 0 99535 696 0 0 25 0 4 0 502129068 1119358976 208353 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4003.84
Current children cumulated vsize (KiB) 1093124

[startup+1062.3 s]
/proc/loadavg: 8.05 8.08 7.98 9/184 2324
/proc/meminfo: memFree=28575672/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1234952 CPUtime=4243.51 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4629218 0 0 0 423569 782 0 0 25 0 4 0 502129067 1264590848 222893 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510252 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 308738 222893 344 105 0 304242 0
[pid=2287/tid=2288] ppid=2285 vsize=1234952 CPUtime=1056.53 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 68632 0 0 0 105628 25 0 0 25 0 4 0 502129068 1264590848 222893 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1234952 CPUtime=1062.32 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 84238 0 0 0 106212 20 0 0 25 0 4 0 502129068 1264590848 222893 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1234952 CPUtime=1062.31 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4241534 0 0 0 105535 696 0 0 25 0 4 0 502129068 1264590848 222893 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4243.51
Current children cumulated vsize (KiB) 1234952

[startup+1122.3 s]
/proc/loadavg: 8.02 8.06 7.98 9/184 2325
/proc/meminfo: memFree=28497376/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1249628 CPUtime=4483.19 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4637096 0 0 0 447532 787 0 0 25 0 4 0 502129067 1279619072 230661 33554432000 4194304 4623224 140736941832784 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 312407 230661 344 105 0 307911 0
[pid=2287/tid=2288] ppid=2285 vsize=1249628 CPUtime=1116.2 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 70163 0 0 0 111593 27 0 0 25 0 4 0 502129068 1279619072 230661 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1249628 CPUtime=1122.32 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 85200 0 0 0 112211 21 0 0 25 0 4 0 502129068 1279619072 230661 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1249628 CPUtime=1122.31 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4245164 0 0 0 111534 697 0 0 25 0 4 0 502129068 1279619072 230661 33554432000 4194304 4623224 140736941832784 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4483.19
Current children cumulated vsize (KiB) 1249628

[startup+1182.3 s]
/proc/loadavg: 8.04 8.06 7.99 9/184 2327
/proc/meminfo: memFree=28404476/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1260944 CPUtime=4722.88 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4646335 0 0 0 471498 790 0 0 25 0 4 0 502129067 1291206656 239737 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 315236 239737 344 105 0 310740 0
[pid=2287/tid=2288] ppid=2285 vsize=1260944 CPUtime=1175.88 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 70748 0 0 0 117560 28 0 0 25 0 4 0 502129068 1291206656 239737 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376832 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1260944 CPUtime=1182.32 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 86125 0 0 0 118210 22 0 0 25 0 4 0 502129068 1291206656 239737 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1260944 CPUtime=1182.32 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4248275 0 0 0 117534 698 0 0 25 0 4 0 502129068 1291206656 239737 33554432000 4194304 4623224 140736941832784 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4722.88
Current children cumulated vsize (KiB) 1260944



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 7.71 7.99 7.96 5/176 2346
/proc/meminfo: memFree=29955852/32951124 swapFree=67105204/67111528
[pid=2287] ppid=2285 vsize=1264056 CPUtime=4800.38 cores=1,3,5,7
/proc/2287/stat : 2287 (SArTagnan) R 2285 2287 1676 0 -1 4202496 4647992 0 0 0 479248 790 0 0 25 0 4 0 502129067 1294393344 241323 33554432000 4194304 4623224 140736941832784 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/2287/statm: 316014 241323 344 105 0 311518 0
[pid=2287/tid=2288] ppid=2285 vsize=1264056 CPUtime=1195.18 cores=1,3,5,7
/proc/2287/task/2288/stat : 2288 (SArTagnan) R 2285 2287 1676 0 -1 4202560 70824 0 0 0 119490 28 0 0 25 0 4 0 502129068 1294393344 241323 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=2287/tid=2289] ppid=2285 vsize=1264056 CPUtime=1201.73 cores=1,3,5,7
/proc/2287/task/2289/stat : 2289 (SArTagnan) R 2285 2287 1676 0 -1 4202560 86293 0 0 0 120151 22 0 0 25 0 4 0 502129068 1294393344 241323 33554432000 4194304 4623224 140736941832784 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=2287/tid=2290] ppid=2285 vsize=1264056 CPUtime=1201.72 cores=1,3,5,7
/proc/2287/task/2290/stat : 2290 (SArTagnan) R 2285 2287 1676 0 -1 4202560 4249123 0 0 0 119474 698 0 0 25 0 4 0 502129068 1294393344 241323 33554432000 4194304 4623224 140736941832784 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.38
Current children cumulated vsize (KiB) 1264056

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.75
CPU time (s): 4800.46
CPU user time (s): 4792.52
CPU system time (s): 7.94479
CPU usage (%): 399.456
Max. virtual memory (cumulated for all children) (KiB): 1264056

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4792.52
system time used= 7.94479
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4647992
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 411
involuntary context switches= 29889

runsolver used 2.01069 second user time and 4.54631 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 19:12:12
IDJOB=3290325
IDBENCH=83430
IDSOLVER=1656
FILE ID=node147/3290325-1304097132
RUNJOBID= node147-1304097124-2195
PBS_JOBID= 13170578
Free space on /tmp= 72660 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/application/kullmann/AES/Benchmarks/32/aes_32_5_keyfind_1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3290325-1304097132/watcher-3290325-1304097132 -o /tmp/evaluation-result-3290325-1304097132/solver-3290325-1304097132 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3290325-1304097132.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3f4ea4cf17e734bbe947db7c1dc9fde7
RANDOM SEED=1188467935

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30861668 kB
Buffers:        277212 kB
Cached:        1365880 kB
SwapCached:       3000 kB
Active:         197168 kB
Inactive:      1568728 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30861668 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:            1380 kB
Writeback:          48 kB
AnonPages:      121140 kB
Mapped:          15496 kB
Slab:           260872 kB
PageTables:       4904 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   305436 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72660 MiB
End job on node147 at 2011-04-29 19:32:15