Trace number 3292855

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.34 1201.8

General information on the benchmark

NameSAT02/industrial/aloul/
Homer/homer17.shuffled.cnf
MD5SUMca62f6128dc3cad7229c7b9ee33a7492
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark0.484925
Satisfiable
(Un)Satisfiability was proved
Number of variables286
Number of clauses1742
Sum of the clauses size3718
Maximum clause length11
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 21716
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 526

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3292855-1304114228/watcher-3292855-1304114228 -o /tmp/evaluation-result-3292855-1304114228/solver-3292855-1304114228 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3292855-1304114228.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.08 8.06 7.97 5/180 4324
/proc/meminfo: memFree=23734396/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 469 0 0 0 0 0 0 0 25 0 4 0 523020489 50524160 405 33554432000 4194304 4623224 140736153494448 18446744073709551615 47130444298162 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 12335 405 301 105 0 7839 0
[pid=4324/tid=4325] ppid=4322 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 523020489 50524160 405 33554432000 4194304 4623224 140736153494448 18446744073709551615 212687731697 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 523020489 50524160 405 33554432000 4194304 4623224 140736153494448 18446744073709551615 47130444298162 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=49340 CPUtime=0 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 523020489 50524160 405 33554432000 4194304 4623224 140736153494448 18446744073709551615 47130444298160 0 0 4096 2 0 0 0 -1 0 0 0 0

[startup+0.102227 s]
/proc/loadavg: 8.08 8.06 7.97 5/180 4324
/proc/meminfo: memFree=23734396/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=248520 CPUtime=0.38 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 2213 0 0 0 38 0 0 0 25 0 4 0 523020489 254484480 1633 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 62130 1633 344 105 0 57634 0
[pid=4324/tid=4325] ppid=4322 vsize=248520 CPUtime=0.09 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 405 0 0 0 9 0 0 0 25 0 4 0 523020489 254484480 1633 33554432000 4194304 4623224 140736153494448 18446744073709551615 212687718583 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=248520 CPUtime=0.09 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 562 0 0 0 9 0 0 0 25 0 4 0 523020489 254484480 1633 33554432000 4194304 4623224 140736153494448 18446744073709551615 4367191 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=248520 CPUtime=0.09 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) D 4322 4324 4006 0 -1 4202560 316 0 0 0 9 0 0 0 25 0 4 0 523020489 254484480 1633 33554432000 4194304 4623224 140736153494448 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 248520

[startup+0.201117 s]
/proc/loadavg: 8.08 8.06 7.97 5/180 4324
/proc/meminfo: memFree=23734396/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=249876 CPUtime=0.78 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 3581 0 0 0 78 0 0 0 25 0 4 0 523020489 255873024 2388 33554432000 4194304 4623224 140736153494448 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 62469 2388 344 105 0 57973 0
[pid=4324/tid=4325] ppid=4322 vsize=249876 CPUtime=0.19 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 877 0 0 0 19 0 0 0 25 0 4 0 523020489 255873024 2389 33554432000 4194304 4623224 140736153494448 18446744073709551615 4463905 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=249876 CPUtime=0.19 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 960 0 0 0 19 0 0 0 25 0 4 0 523020489 255873024 2389 33554432000 4194304 4623224 140736153494448 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=249876 CPUtime=0.19 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 617 0 0 0 19 0 0 0 25 0 4 0 523020489 255873024 2389 33554432000 4194304 4623224 140736153494448 18446744073709551615 4560735 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.78
Current children cumulated vsize (KiB) 249876

[startup+0.301098 s]
/proc/loadavg: 8.08 8.06 7.97 5/180 4324
/proc/meminfo: memFree=23734396/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=250976 CPUtime=1.18 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 5003 0 0 0 118 0 0 0 25 0 4 0 523020489 256999424 3104 33554432000 4194304 4623224 140736153494448 18446744073709551615 4415995 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 62744 3104 344 105 0 58248 0
[pid=4324/tid=4325] ppid=4322 vsize=250976 CPUtime=0.29 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 1303 0 0 0 29 0 0 0 25 0 4 0 523020489 256999424 3104 33554432000 4194304 4623224 140736153494448 18446744073709551615 4465938 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=250976 CPUtime=0.29 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 1547 0 0 0 29 0 0 0 25 0 4 0 523020489 256999424 3104 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=250976 CPUtime=0.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 1000 0 0 0 29 0 0 0 25 0 4 0 523020489 256999424 3104 33554432000 4194304 4623224 140736153494448 18446744073709551615 4554357 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.18
Current children cumulated vsize (KiB) 250976

[startup+0.701027 s]
/proc/loadavg: 8.08 8.06 7.97 5/180 4324
/proc/meminfo: memFree=23734396/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=253372 CPUtime=2.78 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 10056 0 0 0 277 1 0 0 25 0 4 0 523020489 259452928 5052 33554432000 4194304 4623224 140736153494448 18446744073709551615 4359136 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 63343 5052 344 105 0 58847 0
[pid=4324/tid=4325] ppid=4322 vsize=253372 CPUtime=0.68 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 2263 0 0 0 68 0 0 0 25 0 4 0 523020489 259452928 5052 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=253372 CPUtime=0.69 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 3006 0 0 0 69 0 0 0 25 0 4 0 523020489 259452928 5052 33554432000 4194304 4623224 140736153494448 18446744073709551615 4366416 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=253372 CPUtime=0.69 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 3213 0 0 0 69 0 0 0 25 0 4 0 523020489 259452928 5052 33554432000 4194304 4623224 140736153494448 18446744073709551615 212687342559 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 253372

[startup+1.50088 s]
/proc/loadavg: 8.08 8.06 7.97 9/184 4328
/proc/meminfo: memFree=23703376/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=261172 CPUtime=5.97 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 17107 0 0 0 595 2 0 0 25 0 4 0 523020489 267440128 7803 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 65293 7803 347 105 0 60797 0
[pid=4324/tid=4325] ppid=4322 vsize=261172 CPUtime=1.48 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 4269 0 0 0 148 0 0 0 25 0 4 0 523020489 267440128 7803 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=261172 CPUtime=1.48 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 4582 0 0 0 148 0 0 0 18 0 4 0 523020489 267440128 7803 33554432000 4194304 4623224 140736153494448 18446744073709551615 4463033 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=261172 CPUtime=1.48 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 6285 0 0 0 148 0 0 0 25 0 4 0 523020489 267440128 7803 33554432000 4194304 4623224 140736153494448 18446744073709551615 4330845 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 261172

[startup+3.10059 s]
/proc/loadavg: 8.08 8.06 7.97 9/184 4328
/proc/meminfo: memFree=23692340/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=268076 CPUtime=12.36 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 30564 0 0 0 1233 3 0 0 25 0 4 0 523020489 274509824 12197 33554432000 4194304 4623224 140736153494448 18446744073709551615 4414891 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 67019 12197 366 105 0 62523 0
[pid=4324/tid=4325] ppid=4322 vsize=268076 CPUtime=3.07 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 6973 0 0 0 306 1 0 0 25 0 4 0 523020489 274509824 12197 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=268076 CPUtime=3.09 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 6534 0 0 0 308 1 0 0 21 0 4 0 523020489 274509824 12197 33554432000 4194304 4623224 140736153494448 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=268076 CPUtime=3.09 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 14276 0 0 0 308 1 0 0 25 0 4 0 523020489 274509824 12197 33554432000 4194304 4623224 140736153494448 18446744073709551615 4559216 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 268076

[startup+6.30101 s]
/proc/loadavg: 8.07 8.05 7.97 9/184 4328
/proc/meminfo: memFree=23666048/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=280460 CPUtime=25.15 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 63294 0 0 0 2507 8 0 0 25 0 4 0 523020489 287191040 17198 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510130 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 70115 17198 358 105 0 65619 0
[pid=4324/tid=4325] ppid=4322 vsize=280460 CPUtime=6.25 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 9956 0 0 0 624 1 0 0 25 0 4 0 523020489 287191040 17198 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=280460 CPUtime=6.28 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 9834 0 0 0 627 1 0 0 25 0 4 0 523020489 287191040 17198 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=280460 CPUtime=6.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 40508 0 0 0 625 4 0 0 25 0 4 0 523020489 287191040 17198 33554432000 4194304 4623224 140736153494448 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 280460

[startup+12.7008 s]
/proc/loadavg: 8.06 8.05 7.97 9/184 4329
/proc/meminfo: memFree=23616448/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=296488 CPUtime=50.71 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 100415 0 0 0 5058 13 0 0 25 0 4 0 523020489 303603712 27263 33554432000 4194304 4623224 140736153494448 18446744073709551615 4517479 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 74122 27263 434 105 0 69626 0
[pid=4324/tid=4325] ppid=4322 vsize=296488 CPUtime=12.62 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 15051 0 0 0 1260 2 0 0 25 0 4 0 523020489 303603712 27263 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=296488 CPUtime=12.68 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 15263 0 0 0 1266 2 0 0 25 0 4 0 523020489 303603712 27263 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376880 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=296488 CPUtime=12.69 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 66297 0 0 0 1261 8 0 0 25 0 4 0 523020489 303603712 27263 33554432000 4194304 4623224 140736153494448 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.71
Current children cumulated vsize (KiB) 296488

[startup+25.5005 s]
/proc/loadavg: 8.05 8.05 7.97 9/184 4329
/proc/meminfo: memFree=23549136/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=334252 CPUtime=101.83 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 158844 0 0 0 10161 22 0 0 25 0 4 0 523020489 342274048 39220 33554432000 4194304 4623224 140736153494448 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 83563 39220 406 105 0 79067 0
[pid=4324/tid=4325] ppid=4322 vsize=334252 CPUtime=25.34 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 22255 0 0 0 2531 3 0 0 25 0 4 0 523020489 342274048 39220 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=334252 CPUtime=25.48 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 23528 0 0 0 2544 4 0 0 25 0 4 0 523020489 342274048 39220 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376862 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=334252 CPUtime=25.48 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 108456 0 0 0 2535 13 0 0 25 0 4 0 523020489 342274048 39220 33554432000 4194304 4623224 140736153494448 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 101.83
Current children cumulated vsize (KiB) 334252

[startup+51.1008 s]
/proc/loadavg: 8.14 8.08 7.98 9/184 4330
/proc/meminfo: memFree=23428344/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=429928 CPUtime=204.09 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 349197 0 0 0 20358 51 0 0 25 0 4 0 523020489 440246272 55935 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 107482 55935 456 105 0 102986 0
[pid=4324/tid=4325] ppid=4322 vsize=429928 CPUtime=50.81 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 33865 0 0 0 5076 5 0 0 25 0 4 0 523020489 440246272 55935 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=429928 CPUtime=51.08 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 32118 0 0 0 5102 6 0 0 25 0 4 0 523020489 440246272 55935 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=429928 CPUtime=51.09 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 268393 0 0 0 5072 37 0 0 25 0 4 0 523020489 440246272 55935 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 204.09
Current children cumulated vsize (KiB) 429928

[startup+102.301 s]
/proc/loadavg: 8.13 8.08 7.98 9/184 4331
/proc/meminfo: memFree=23264148/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=469556 CPUtime=408.63 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 434173 0 0 0 40792 71 0 0 25 0 4 0 523020489 480825344 83070 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 117389 83070 460 105 0 112893 0
[pid=4324/tid=4325] ppid=4322 vsize=469556 CPUtime=101.74 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 48610 0 0 0 10165 9 0 0 25 0 4 0 523020489 480825344 83070 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=469556 CPUtime=102.29 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 47139 0 0 0 10216 13 0 0 25 0 4 0 523020489 480825344 83070 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=469556 CPUtime=102.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 296146 0 0 0 10188 41 0 0 25 0 4 0 523020489 480825344 83070 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 469556

[startup+162.301 s]

################
# More data... #
################

[pid=4324] ppid=4322 vsize=1286204 CPUtime=2565.62 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 5644329 0 0 0 255671 891 0 0 25 0 4 0 523020489 1317072896 236758 33554432000 4194304 4623224 140736153494448 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 321551 236758 344 105 0 317055 0
[pid=4324/tid=4325] ppid=4322 vsize=1286204 CPUtime=638.79 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 164931 0 0 0 63848 31 0 0 25 0 4 0 523020489 1317072896 236758 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=1286204 CPUtime=642.29 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 88530 0 0 0 64195 34 0 0 25 0 4 0 523020489 1317072896 236758 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=1286204 CPUtime=642.28 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 4061754 0 0 0 63626 602 0 0 25 0 4 0 523020489 1317072896 236758 33554432000 4194304 4623224 140736153494448 18446744073709551615 4550411 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2565.62
Current children cumulated vsize (KiB) 1286204

[startup+702.301 s]
/proc/loadavg: 8.08 8.12 8.03 9/184 4359
/proc/meminfo: memFree=22066640/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=1286204 CPUtime=2805.29 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 5945746 0 0 0 279591 938 0 0 25 0 4 0 523020489 1317072896 247892 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 321551 247892 366 105 0 317055 0
[pid=4324/tid=4325] ppid=4322 vsize=1286204 CPUtime=698.46 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 169580 0 0 0 69812 34 0 0 25 0 4 0 523020489 1317072896 247892 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=1286204 CPUtime=702.29 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 89392 0 0 0 70195 34 0 0 25 0 4 0 523020489 1317072896 247892 33554432000 4194304 4623224 140736153494448 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=1286204 CPUtime=702.28 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 4354180 0 0 0 69584 644 0 0 25 0 4 0 523020489 1317072896 247892 33554432000 4194304 4623224 140736153494448 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2805.29
Current children cumulated vsize (KiB) 1286204

[startup+762.3 s]
/proc/loadavg: 8.06 8.11 8.03 9/184 4361
/proc/meminfo: memFree=21983312/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=1289108 CPUtime=3044.97 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 6321365 0 0 0 303501 996 0 0 25 0 4 0 523020489 1320046592 255735 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 322277 255735 344 105 0 317781 0
[pid=4324/tid=4325] ppid=4322 vsize=1289108 CPUtime=758.14 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 174790 0 0 0 75777 37 0 0 25 0 4 0 523020489 1320046592 255735 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=1289108 CPUtime=762.29 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 90756 0 0 0 76195 34 0 0 25 0 4 0 523020489 1320046592 255735 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376858 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=1289108 CPUtime=762.28 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 4720252 0 0 0 75530 698 0 0 25 0 4 0 523020489 1320046592 255735 33554432000 4194304 4623224 140736153494448 18446744073709551615 4577687 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3044.97
Current children cumulated vsize (KiB) 1289108

[startup+822.3 s]
/proc/loadavg: 8.10 8.11 8.04 9/184 4362
/proc/meminfo: memFree=21913476/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=1359000 CPUtime=3284.63 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 6813431 0 0 0 327393 1070 0 0 25 0 4 0 523020489 1391616000 265642 33554432000 4194304 4623224 140736153494448 18446744073709551615 4355942 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 339750 265642 433 105 0 335254 0
[pid=4324/tid=4325] ppid=4322 vsize=1359000 CPUtime=817.81 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 177490 0 0 0 81741 40 0 0 25 0 4 0 523020489 1391616000 265642 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=1359000 CPUtime=822.29 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 92191 0 0 0 82194 35 0 0 25 0 4 0 523020489 1391616000 265642 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=1359000 CPUtime=822.28 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 5205366 0 0 0 81461 767 0 0 25 0 4 0 523020489 1391616000 265642 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376883 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.63
Current children cumulated vsize (KiB) 1359000

[startup+882.306 s]
/proc/loadavg: 8.07 8.11 8.04 9/184 4364
/proc/meminfo: memFree=21787964/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=1517328 CPUtime=3524.32 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 7279018 0 0 0 351290 1142 0 0 25 0 4 0 523020489 1553743872 287600 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 379332 287600 344 105 0 374836 0
[pid=4324/tid=4325] ppid=4322 vsize=1517328 CPUtime=877.48 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 235800 0 0 0 87700 48 0 0 25 0 4 0 523020489 1553743872 287600 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=1517328 CPUtime=882.3 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 116394 0 0 0 88191 39 0 0 25 0 4 0 523020489 1553743872 287600 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=1517328 CPUtime=882.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 5450676 0 0 0 87426 803 0 0 25 0 4 0 523020489 1553743872 287600 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3524.32
Current children cumulated vsize (KiB) 1517328

[startup+942.301 s]
/proc/loadavg: 8.06 8.10 8.04 9/184 4365
/proc/meminfo: memFree=21694556/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=1667688 CPUtime=3763.97 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 7977465 0 0 0 375150 1247 0 0 25 0 4 0 523020489 1707712512 306646 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 416922 306646 450 105 0 412426 0
[pid=4324/tid=4325] ppid=4322 vsize=1667688 CPUtime=937.16 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 238470 0 0 0 93666 50 0 0 25 0 4 0 523020489 1707712512 306646 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=1667688 CPUtime=942.29 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 117805 0 0 0 94190 39 0 0 25 0 4 0 523020489 1707712512 306646 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=1667688 CPUtime=942.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 5759137 0 0 0 93380 849 0 0 25 0 4 0 523020489 1707712512 306646 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3763.97
Current children cumulated vsize (KiB) 1667688

[startup+1002.3 s]
/proc/loadavg: 8.13 8.11 8.04 9/184 4367
/proc/meminfo: memFree=21493412/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=1733224 CPUtime=4003.63 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 8779241 0 0 0 398994 1369 0 0 25 0 4 0 523020489 1774821376 345833 33554432000 4194304 4623224 140736153494448 18446744073709551615 4355951 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 433306 345833 344 105 0 428810 0
[pid=4324/tid=4325] ppid=4322 vsize=1733224 CPUtime=996.83 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 240676 0 0 0 99632 51 0 0 25 0 4 0 523020489 1774821376 345833 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=1733224 CPUtime=1002.3 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 120717 0 0 0 100190 40 0 0 25 0 4 0 523020489 1774821376 345833 33554432000 4194304 4623224 140736153494448 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=1733224 CPUtime=1002.28 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 6264813 0 0 0 99304 924 0 0 25 0 4 0 523020489 1774821376 345833 33554432000 4194304 4623224 140736153494448 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.63
Current children cumulated vsize (KiB) 1733224

[startup+1062.3 s]
/proc/loadavg: 8.17 8.12 8.05 9/184 4369
/proc/meminfo: memFree=21255688/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=2063644 CPUtime=4243.32 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 9466696 0 0 0 422861 1471 0 0 25 0 4 0 523020489 2113171456 403086 33554432000 4194304 4623224 140736153494448 18446744073709551615 4414885 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 515911 403086 393 105 0 511415 0
[pid=4324/tid=4325] ppid=4322 vsize=2063644 CPUtime=1056.51 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 243442 0 0 0 105600 51 0 0 25 0 4 0 523020489 2113171456 403086 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=2063644 CPUtime=1062.3 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 120746 0 0 0 106190 40 0 0 25 0 4 0 523020489 2113171456 403086 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=2063644 CPUtime=1062.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 6778949 0 0 0 105228 1001 0 0 25 0 4 0 523020489 2113171456 403086 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4243.32
Current children cumulated vsize (KiB) 2063644

[startup+1122.3 s]
/proc/loadavg: 5.58 7.38 7.79 5/175 4388
/proc/meminfo: memFree=22498760/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=2131204 CPUtime=4483 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 9895686 0 0 0 446764 1536 0 0 25 0 4 0 523020489 2182352896 412747 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 532801 412747 379 105 0 528305 0
[pid=4324/tid=4325] ppid=4322 vsize=2131204 CPUtime=1116.2 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 246205 0 0 0 111568 52 0 0 25 0 4 0 523020489 2182352896 412747 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=2131204 CPUtime=1122.3 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 121344 0 0 0 112190 40 0 0 25 0 4 0 523020489 2182352896 412747 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=2131204 CPUtime=1122.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 7129095 0 0 0 111176 1053 0 0 25 0 4 0 523020489 2182352896 412747 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4483
Current children cumulated vsize (KiB) 2131204

[startup+1182.3 s]
/proc/loadavg: 4.62 6.78 7.56 5/175 4390
/proc/meminfo: memFree=22457808/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=2131204 CPUtime=4722.72 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 10367229 0 0 0 470660 1612 0 0 25 0 4 0 523020489 2182352896 420608 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 532801 420608 344 105 0 528305 0
[pid=4324/tid=4325] ppid=4322 vsize=2131204 CPUtime=1175.92 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 249157 0 0 0 117538 54 0 0 25 0 4 0 523020489 2182352896 420608 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=2131204 CPUtime=1182.3 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 121578 0 0 0 118190 40 0 0 25 0 4 0 523020489 2182352896 420608 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=2131204 CPUtime=1182.29 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 7548378 0 0 0 117114 1115 0 0 25 0 4 0 523020489 2182352896 420608 33554432000 4194304 4623224 140736153494448 18446744073709551615 4545903 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.72
Current children cumulated vsize (KiB) 2131204



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 4.44 6.60 7.48 5/175 4390
/proc/meminfo: memFree=22425804/32951124 swapFree=67111524/67111528
[pid=4324] ppid=4322 vsize=2131204 CPUtime=4800.22 cores=0,2,4,6
/proc/4324/stat : 4324 (SArTagnan) R 4322 4324 4006 0 -1 4202496 10528663 0 0 0 478375 1647 0 0 20 0 4 0 523020489 2182352896 430897 33554432000 4194304 4623224 140736153494448 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/4324/statm: 532801 430897 374 105 0 528305 0
[pid=4324/tid=4325] ppid=4322 vsize=2131204 CPUtime=1195.22 cores=0,2,4,6
/proc/4324/task/4325/stat : 4325 (SArTagnan) R 4322 4324 4006 0 -1 4202560 250370 0 0 0 119465 57 0 0 20 0 4 0 523020489 2182352896 430898 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=4324/tid=4326] ppid=4322 vsize=2131204 CPUtime=1201.71 cores=0,2,4,6
/proc/4324/task/4326/stat : 4326 (SArTagnan) R 4322 4324 4006 0 -1 4202560 121658 0 0 0 120131 40 0 0 25 0 4 0 523020489 2182352896 430898 33554432000 4194304 4623224 140736153494448 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=4324/tid=4327] ppid=4322 vsize=2131204 CPUtime=1201.7 cores=0,2,4,6
/proc/4324/task/4327/stat : 4327 (SArTagnan) R 4322 4324 4006 0 -1 4202560 7699205 0 0 0 119033 1137 0 0 19 0 4 0 523020489 2182352896 430898 33554432000 4194304 4623224 140736153494448 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.22
Current children cumulated vsize (KiB) 2131204

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.8
CPU time (s): 4800.34
CPU user time (s): 4783.78
CPU system time (s): 16.5595
CPU usage (%): 399.43
Max. virtual memory (cumulated for all children) (KiB): 2265300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4783.78
system time used= 16.5595
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10529380
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1996
involuntary context switches= 21987

runsolver used 1.9367 second user time and 4.55531 second system time

The end

Launcher Data 

Begin job on node139 at 2011-04-29 23:57:08
IDJOB=3292855
IDBENCH=87946
IDSOLVER=1656
FILE ID=node139/3292855-1304114228
RUNJOBID= node139-1304111820-4024
PBS_JOBID= 13170691
Free space on /tmp= 72552 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT02/industrial/aloul/Homer/homer17.shuffled.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3292855-1304114228/watcher-3292855-1304114228 -o /tmp/evaluation-result-3292855-1304114228/solver-3292855-1304114228 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3292855-1304114228.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca62f6128dc3cad7229c7b9ee33a7492
RANDOM SEED=1646522473

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23734560 kB
Buffers:       2048764 kB
Cached:        6168928 kB
SwapCached:          4 kB
Active:        1347108 kB
Inactive:      7350664 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23734560 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             424 kB
Writeback:           0 kB
AnonPages:      479972 kB
Mapped:          15472 kB
Slab:           454024 kB
PageTables:       5624 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   747720 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72552 MiB
End job on node139 at 2011-04-30 00:17:11