Trace number 3439341

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001 5006.03

General information on the benchmark

NameSAT03/handmade/anton/SAT/
SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf
MD5SUM22bbcb4a25a1da66113c240898c75509
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1.35479
Satisfiable
(Un)Satisfiability was proved
Number of variables450
Number of clauses28508
Sum of the clauses size57436
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 228493
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 515

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439341-1306960629/watcher-3439341-1306960629 -o /tmp/evaluation-result-3439341-1306960629/solver-3439341-1306960629 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439341-1306960629.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/266 25575
/proc/meminfo: memFree=28409968/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=19564 CPUtime=0 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 599 0 0 0 0 0 0 0 25 0 1 0 807663704 20033536 466 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921776896 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/25575/statm: 4891 466 296 106 0 394 0
[pid=25575/tid=25576] ppid=25573 vsize=94600 CPUtime=0 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 8 0 807663705 96870400 1159 33554432000 4194304 4625164 140735598943632 18446744073709551615 222916808936 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=94600 CPUtime=0 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807663705 96870400 1159 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921833457 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=94600 CPUtime=0 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807663705 96870400 1159 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921833457 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=94600 CPUtime=0 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807663705 96870400 1159 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921833457 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=94600 CPUtime=0 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807663705 96870400 1159 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921833457 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=94600 CPUtime=0 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807663705 96870400 1159 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921833457 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=94600 CPUtime=0 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 807663705 96870400 1159 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921833457 0 0 4096 2 0 0 0 -1 6 0 0 0

[startup+0.0943811 s]
/proc/loadavg: 0.00 0.00 0.00 2/266 25575
/proc/meminfo: memFree=28409968/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=489372 CPUtime=0.41 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) D 25573 25575 25549 0 -1 4202496 2899 0 0 0 41 0 0 0 18 0 8 0 807663704 501116928 2328 33554432000 4194304 4625164 140735598943632 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 122343 2328 340 106 0 117846 0
[pid=25575/tid=25576] ppid=25573 vsize=489372 CPUtime=0.06 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 81 0 0 0 6 0 0 0 18 0 8 0 807663705 501116928 2346 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921474167 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=489372 CPUtime=0.02 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 93 0 0 0 2 0 0 0 18 0 8 0 807663705 501116928 2346 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=489372 CPUtime=0.06 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 98 0 0 0 6 0 0 0 18 0 8 0 807663705 501116928 2346 33554432000 4194304 4625164 140735598943632 18446744073709551615 4565677 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=489372 CPUtime=0.05 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 140 0 0 0 5 0 0 0 17 0 8 0 807663705 501116928 2346 33554432000 4194304 4625164 140735598943632 18446744073709551615 4486934 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=489372 CPUtime=0.05 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 151 0 0 0 5 0 0 0 18 0 8 0 807663705 501116928 2346 33554432000 4194304 4625164 140735598943632 18446744073709551615 4289678 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=489372 CPUtime=0.07 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 113 0 0 0 7 0 0 0 18 0 8 0 807663705 501116928 2346 33554432000 4194304 4625164 140735598943632 18446744073709551615 4464944 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=489372 CPUtime=0.01 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 74 0 0 0 1 0 0 0 25 0 8 0 807663705 501116928 2349 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 489372

[startup+0.102503 s]
/proc/loadavg: 0.00 0.00 0.00 2/266 25575
/proc/meminfo: memFree=28409968/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=489372 CPUtime=0.44 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) D 25573 25575 25549 0 -1 4202496 3095 0 0 0 44 0 0 0 18 0 8 0 807663704 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 122343 2524 340 106 0 117846 0
[pid=25575/tid=25576] ppid=25573 vsize=489372 CPUtime=0.06 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) D 25573 25575 25549 0 -1 4202560 102 0 0 0 6 0 0 0 18 0 8 0 807663705 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921820343 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=489372 CPUtime=0.02 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 127 0 0 0 2 0 0 0 18 0 8 0 807663705 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 4467415 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=489372 CPUtime=0.06 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) D 25573 25575 25549 0 -1 4202560 129 0 0 0 6 0 0 0 18 0 8 0 807663705 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=489372 CPUtime=0.06 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 171 0 0 0 6 0 0 0 17 0 8 0 807663705 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=489372 CPUtime=0.05 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) D 25573 25575 25549 0 -1 4202560 164 0 0 0 5 0 0 0 18 0 8 0 807663705 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921438241 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=489372 CPUtime=0.08 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 117 0 0 0 8 0 0 0 18 0 8 0 807663705 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352688 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=489372 CPUtime=0.02 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 89 0 0 0 2 0 0 0 25 0 8 0 807663705 501116928 2524 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921474256 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 489372

[startup+0.385945 s]
/proc/loadavg: 0.00 0.00 0.00 2/266 25575
/proc/meminfo: memFree=28409968/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=496916 CPUtime=3.01 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 12919 0 0 0 298 3 0 0 18 0 8 0 807663704 508841984 10084 33554432000 4194304 4625164 140735598943632 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25575/statm: 124229 10084 357 106 0 119732 0
[pid=25575/tid=25576] ppid=25573 vsize=496916 CPUtime=0.43 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1096 0 0 0 43 0 0 0 18 0 8 0 807663705 508841984 10084 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=496916 CPUtime=0.38 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1280 0 0 0 38 0 0 0 18 0 8 0 807663705 508841984 10084 33554432000 4194304 4625164 140735598943632 18446744073709551615 4464914 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=496916 CPUtime=0.43 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1038 0 0 0 43 0 0 0 18 0 8 0 807663705 508841984 10084 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352522 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=496916 CPUtime=0.42 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1212 0 0 0 42 0 0 0 18 0 8 0 807663705 508841984 10085 33554432000 4194304 4625164 140735598943632 18446744073709551615 222921437893 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=496916 CPUtime=0.41 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1170 0 0 0 41 0 0 0 18 0 8 0 807663705 508841984 10085 33554432000 4194304 4625164 140735598943632 18446744073709551615 4348841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=496916 CPUtime=0.44 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 963 0 0 0 44 0 0 0 18 0 8 0 807663705 508841984 10085 33554432000 4194304 4625164 140735598943632 18446744073709551615 4487099 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=496916 CPUtime=0.02 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 100 0 0 0 2 0 0 0 25 0 8 0 807663705 508841984 10085 33554432000 4194304 4625164 140735598943632 18446744073709551615 4479935 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3.01
Current children cumulated vsize (KiB) 496916

[startup+0.700363 s]
/proc/loadavg: 0.00 0.00 0.00 2/266 25575
/proc/meminfo: memFree=28409968/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=500688 CPUtime=4.78 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 17488 0 0 0 474 4 0 0 18 0 8 0 807663704 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25575/statm: 125172 14066 376 106 0 120675 0
[pid=25575/tid=25576] ppid=25573 vsize=500688 CPUtime=0.65 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1681 0 0 0 65 0 0 0 18 0 8 0 807663705 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4288883 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=500688 CPUtime=0.61 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1788 0 0 0 61 0 0 0 18 0 8 0 807663705 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=500688 CPUtime=0.65 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1850 0 0 0 65 0 0 0 18 0 8 0 807663705 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=500688 CPUtime=0.64 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1694 0 0 0 64 0 0 0 18 0 8 0 807663705 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=500688 CPUtime=0.63 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1763 0 0 0 63 0 0 0 18 0 8 0 807663705 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4348804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=500688 CPUtime=0.66 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 1417 0 0 0 66 0 0 0 18 0 8 0 807663705 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4288755 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=500688 CPUtime=0.22 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 837 0 0 0 22 0 0 0 25 0 8 0 807663705 512704512 14066 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.78
Current children cumulated vsize (KiB) 500688

[startup+1.50122 s]
/proc/loadavg: 0.00 0.00 0.00 10/274 25583
/proc/meminfo: memFree=28330924/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=503172 CPUtime=11.17 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 30030 0 0 0 1112 5 0 0 19 0 8 0 807663704 515248128 23855 33554432000 4194304 4625164 140735598943632 18446744073709551615 4511941 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25575/statm: 125793 23858 369 106 0 121296 0
[pid=25575/tid=25576] ppid=25573 vsize=503172 CPUtime=1.45 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 2610 0 0 0 145 0 0 0 19 0 8 0 807663705 515248128 23859 33554432000 4194304 4625164 140735598943632 18446744073709551615 4292272 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=503172 CPUtime=1.41 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 2840 0 0 0 141 0 0 0 19 0 8 0 807663705 515248128 23861 33554432000 4194304 4625164 140735598943632 18446744073709551615 4278611 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=503172 CPUtime=1.45 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 5071 0 0 0 145 0 0 0 19 0 8 0 807663705 515248128 23863 33554432000 4194304 4625164 140735598943632 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=503172 CPUtime=1.44 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 2542 0 0 0 144 0 0 0 19 0 8 0 807663705 515248128 23863 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=503172 CPUtime=1.43 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 3561 0 0 0 143 0 0 0 19 0 8 0 807663705 515248128 23863 33554432000 4194304 4625164 140735598943632 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=503172 CPUtime=1.46 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 2511 0 0 0 146 0 0 0 20 0 8 0 807663705 515248128 23863 33554432000 4194304 4625164 140735598943632 18446744073709551615 4327796 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=503172 CPUtime=1.01 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 2043 0 0 0 101 0 0 0 25 0 8 0 807663705 515248128 23863 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.17
Current children cumulated vsize (KiB) 503172

[startup+3.10092 s]
/proc/loadavg: 0.00 0.00 0.00 9/274 25583
/proc/meminfo: memFree=28277852/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=516916 CPUtime=23.96 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 54752 0 0 0 2385 11 0 0 23 0 8 0 807663704 529321984 42395 33554432000 4194304 4625164 140735598943632 18446744073709551615 4393080 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25575/statm: 129229 42395 593 106 0 124732 0
[pid=25575/tid=25576] ppid=25573 vsize=516916 CPUtime=3.05 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 5692 0 0 0 304 1 0 0 25 0 8 0 807663705 529321984 42395 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=516916 CPUtime=3 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 5292 0 0 0 300 0 0 0 25 0 8 0 807663705 529321984 42395 33554432000 4194304 4625164 140735598943632 18446744073709551615 4469816 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=516916 CPUtime=3.06 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 10839 0 0 0 304 2 0 0 23 0 8 0 807663705 529321984 42395 33554432000 4194304 4625164 140735598943632 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=516916 CPUtime=3.05 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 5429 0 0 0 304 1 0 0 22 0 8 0 807663705 529321984 42395 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=516916 CPUtime=3.03 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 5330 0 0 0 303 0 0 0 25 0 8 0 807663705 529321984 42396 33554432000 4194304 4625164 140735598943632 18446744073709551615 4343980 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=516916 CPUtime=3.06 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 5560 0 0 0 305 1 0 0 25 0 8 0 807663705 529321984 42396 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=516916 CPUtime=2.59 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 4198 0 0 0 259 0 0 0 25 0 8 0 807663705 529321984 42396 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 23.96
Current children cumulated vsize (KiB) 516916

[startup+6.30034 s]
/proc/loadavg: 0.64 0.13 0.04 9/274 25583
/proc/meminfo: memFree=28159220/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=558172 CPUtime=49.53 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 106420 0 0 0 4934 19 0 0 25 0 8 0 807663704 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/25575/statm: 139543 70636 737 106 0 135046 0
[pid=25575/tid=25576] ppid=25573 vsize=558172 CPUtime=6.25 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 9408 0 0 0 624 1 0 0 20 0 8 0 807663705 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=558172 CPUtime=6.21 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 7725 0 0 0 620 1 0 0 25 0 8 0 807663705 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=558172 CPUtime=6.25 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 20455 0 0 0 622 3 0 0 20 0 8 0 807663705 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=558172 CPUtime=6.25 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 8976 0 0 0 623 2 0 0 25 0 8 0 807663705 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=558172 CPUtime=6.24 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 8211 0 0 0 623 1 0 0 25 0 8 0 807663705 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4319115 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=558172 CPUtime=6.26 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 11429 0 0 0 625 1 0 0 25 0 8 0 807663705 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=558172 CPUtime=5.77 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 6137 0 0 0 576 1 0 0 25 0 8 0 807663705 571568128 70636 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 7 0 0 0

################
# More data... #
################

/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 290452 0 0 0 466117 52 0 0 25 0 8 0 807663705 9438064640 1888188 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=9216860 CPUtime=4657.79 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 215099 0 0 0 465639 140 0 0 25 0 8 0 807663705 9438064640 1888188 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37256.4
Current children cumulated vsize (KiB) 9216860

[startup+4722.3 s]
/proc/loadavg: 8.06 8.03 7.95 9/274 25721
/proc/meminfo: memFree=20781372/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=9312860 CPUtime=37735.9 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 44651806 0 0 0 3765972 7622 0 0 25 0 8 0 807663704 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 2328215 1904041 431 106 0 2323718 0
[pid=25575/tid=25576] ppid=25573 vsize=9312860 CPUtime=4722.37 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 233000 0 0 0 472193 44 0 0 25 0 8 0 807663705 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=9312860 CPUtime=4722.15 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 291201 0 0 0 472046 169 0 0 25 0 8 0 807663705 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=9312860 CPUtime=4722.13 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 37447172 0 0 0 466053 6160 0 0 25 0 8 0 807663705 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4578811 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=9312860 CPUtime=4722.33 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 252113 0 0 0 472185 48 0 0 25 0 8 0 807663705 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=9312860 CPUtime=4722.33 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 182508 0 0 0 472158 75 0 0 25 0 8 0 807663705 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4329735 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=9312860 CPUtime=4721.7 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 314748 0 0 0 472114 56 0 0 25 0 8 0 807663705 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=9312860 CPUtime=4717.8 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 215181 0 0 0 471640 140 0 0 25 0 8 0 807663705 9536368640 1904041 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37735.9
Current children cumulated vsize (KiB) 9312860

[startup+4782.3 s]
/proc/loadavg: 8.09 8.04 7.96 9/274 25723
/proc/meminfo: memFree=20747500/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=9312860 CPUtime=38215.4 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 45181230 0 0 0 3813830 7707 0 0 25 0 8 0 807663704 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 2328215 1914100 537 106 0 2323718 0
[pid=25575/tid=25576] ppid=25573 vsize=9312860 CPUtime=4782.37 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 233187 0 0 0 478192 45 0 0 25 0 8 0 807663705 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=9312860 CPUtime=4782.14 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 294334 0 0 0 478042 172 0 0 25 0 8 0 807663705 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4317274 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=9312860 CPUtime=4782.12 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 37967813 0 0 0 471971 6241 0 0 25 0 8 0 807663705 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=9312860 CPUtime=4782.33 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 252393 0 0 0 478185 48 0 0 25 0 8 0 807663705 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=9312860 CPUtime=4782.32 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 182508 0 0 0 478157 75 0 0 25 0 8 0 807663705 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=9312860 CPUtime=4781.68 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 315007 0 0 0 478112 56 0 0 25 0 8 0 807663705 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=9312860 CPUtime=4777.79 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 215182 0 0 0 477639 140 0 0 25 0 8 0 807663705 9536368640 1914100 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38215.4
Current children cumulated vsize (KiB) 9312860

[startup+4842.31 s]
/proc/loadavg: 8.03 8.03 7.96 9/274 25724
/proc/meminfo: memFree=20715248/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=9312860 CPUtime=38694.9 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 45651325 0 0 0 3861703 7787 0 0 25 0 8 0 807663704 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 2328215 1920883 431 106 0 2323718 0
[pid=25575/tid=25576] ppid=25573 vsize=9312860 CPUtime=4842.38 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 233310 0 0 0 484193 45 0 0 25 0 8 0 807663705 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=9312860 CPUtime=4842.15 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 295333 0 0 0 484043 172 0 0 25 0 8 0 807663705 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=9312860 CPUtime=4842.12 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 38430178 0 0 0 477894 6318 0 0 25 0 8 0 807663705 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=9312860 CPUtime=4842.34 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 252581 0 0 0 484186 48 0 0 25 0 8 0 807663705 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=9312860 CPUtime=4842.34 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 182704 0 0 0 484158 76 0 0 25 0 8 0 807663705 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=9312860 CPUtime=4841.68 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 315172 0 0 0 484112 56 0 0 25 0 8 0 807663705 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=9312860 CPUtime=4837.8 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 215183 0 0 0 483640 140 0 0 25 0 8 0 807663705 9536368640 1920883 33554432000 4194304 4625164 140735598943632 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38694.9
Current children cumulated vsize (KiB) 9312860

[startup+4902.3 s]
/proc/loadavg: 8.01 8.02 7.96 9/274 25726
/proc/meminfo: memFree=20690312/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=9408860 CPUtime=39174.3 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 46043280 0 0 0 3909572 7858 0 0 25 0 8 0 807663704 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 2352215 1928515 440 106 0 2347718 0
[pid=25575/tid=25576] ppid=25573 vsize=9408860 CPUtime=4902.37 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 257447 0 0 0 490189 48 0 0 25 0 8 0 807663705 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=9408860 CPUtime=4902.14 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 299410 0 0 0 490039 175 0 0 25 0 8 0 807663705 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=9408860 CPUtime=4902.12 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 38789859 0 0 0 483831 6381 0 0 25 0 8 0 807663705 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4578811 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=9408860 CPUtime=4902.34 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 252809 0 0 0 490185 49 0 0 25 0 8 0 807663705 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=9408860 CPUtime=4902.33 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 182709 0 0 0 490157 76 0 0 25 0 8 0 807663705 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4329721 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=9408860 CPUtime=4901.66 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 315330 0 0 0 490110 56 0 0 25 0 8 0 807663705 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=9408860 CPUtime=4897.79 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 215184 0 0 0 489639 140 0 0 25 0 8 0 807663705 9634672640 1928515 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39174.3
Current children cumulated vsize (KiB) 9408860

[startup+4962.3 s]
/proc/loadavg: 8.05 8.03 7.96 9/274 25728
/proc/meminfo: memFree=20653964/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=9408860 CPUtime=39653.8 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 46539364 0 0 0 3957427 7949 0 0 25 0 8 0 807663704 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 2352215 1935703 398 106 0 2347718 0
[pid=25575/tid=25576] ppid=25573 vsize=9408860 CPUtime=4962.37 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 257585 0 0 0 496189 48 0 0 25 0 8 0 807663705 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=9408860 CPUtime=4962.14 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 302813 0 0 0 496033 181 0 0 25 0 8 0 807663705 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=9408860 CPUtime=4962.11 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 39276760 0 0 0 489746 6465 0 0 25 0 8 0 807663705 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4578811 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=9408860 CPUtime=4962.34 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 253027 0 0 0 496185 49 0 0 25 0 8 0 807663705 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=9408860 CPUtime=4962.34 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 182790 0 0 0 496158 76 0 0 25 0 8 0 807663705 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4329984 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=9408860 CPUtime=4961.66 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 315517 0 0 0 496110 56 0 0 25 0 8 0 807663705 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=9408860 CPUtime=4957.79 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 215185 0 0 0 495639 140 0 0 25 0 8 0 807663705 9634672640 1935703 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39653.8
Current children cumulated vsize (KiB) 9408860



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5005.7 s]
/proc/loadavg: 8.08 8.04 7.97 9/274 25729
/proc/meminfo: memFree=20621832/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=9415856 CPUtime=40000.6 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4202496 46954540 0 0 0 3992042 8020 0 0 25 0 8 0 807663704 9641836544 1943993 33554432000 4194304 4625164 140735598943632 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/25575/statm: 2353964 1943993 475 106 0 2349467 0
[pid=25575/tid=25576] ppid=25573 vsize=9415856 CPUtime=5005.78 cores=0-7
/proc/25575/task/25576/stat : 25576 (SArTagnan) R 25573 25575 25549 0 -1 4202560 257656 0 0 0 500530 48 0 0 25 0 8 0 807663705 9641836544 1944042 33554432000 4194304 4625164 140735598943632 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25575/tid=25577] ppid=25573 vsize=9415856 CPUtime=5005.55 cores=0-7
/proc/25575/task/25577/stat : 25577 (SArTagnan) R 25573 25575 25549 0 -1 4202560 305494 0 0 0 500373 182 0 0 25 0 8 0 807663705 9641836544 1944042 33554432000 4194304 4625164 140735598943632 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25575/tid=25578] ppid=25573 vsize=9415856 CPUtime=5005.53 cores=0-7
/proc/25575/task/25578/stat : 25578 (SArTagnan) R 25573 25575 25549 0 -1 4202560 39684656 0 0 0 494019 6534 0 0 25 0 8 0 807663705 9641836544 1944042 33554432000 4194304 4625164 140735598943632 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25575/tid=25579] ppid=25573 vsize=9415856 CPUtime=5005.75 cores=0-7
/proc/25575/task/25579/stat : 25579 (SArTagnan) R 25573 25575 25549 0 -1 4202560 253172 0 0 0 500526 49 0 0 25 0 8 0 807663705 9641836544 1944043 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25575/tid=25580] ppid=25573 vsize=9415856 CPUtime=5005.75 cores=0-7
/proc/25575/task/25580/stat : 25580 (SArTagnan) R 25573 25575 25549 0 -1 4202560 182792 0 0 0 500499 76 0 0 25 0 8 0 807663705 9641836544 1944043 33554432000 4194304 4625164 140735598943632 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25575/tid=25581] ppid=25573 vsize=9415856 CPUtime=5005.06 cores=0-7
/proc/25575/task/25581/stat : 25581 (SArTagnan) R 25573 25575 25549 0 -1 4202560 315651 0 0 0 500450 56 0 0 25 0 8 0 807663705 9641836544 1944043 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=25575/tid=25582] ppid=25573 vsize=9415856 CPUtime=5001.2 cores=0-7
/proc/25575/task/25582/stat : 25582 (SArTagnan) R 25573 25575 25549 0 -1 4202560 215186 0 0 0 499980 140 0 0 25 0 8 0 807663705 9641836544 1944043 33554432000 4194304 4625164 140735598943632 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 9415856

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5005.9 s]
/proc/loadavg: 8.08 8.04 7.97 9/274 25729
/proc/meminfo: memFree=20621832/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=0 CPUtime=40000.9 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4203524 46954642 0 0 0 3992049 8039 0 0 25 0 1 0 807663704 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/25575/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

[startup+5006 s]
/proc/loadavg: 8.08 8.04 7.97 9/274 25729
/proc/meminfo: memFree=20621832/32951124 swapFree=55664332/67111528
[pid=25575] ppid=25573 vsize=0 CPUtime=40001 cores=0-7
/proc/25575/stat : 25575 (SArTagnan) R 25573 25575 25549 0 -1 4203524 46954642 0 0 0 3992049 8049 0 0 25 0 1 0 807663704 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/25575/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 40001
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5006.03
CPU time (s): 40001
CPU user time (s): 39920.5
CPU system time (s): 80.5228
CPU usage (%): 799.056
Max. virtual memory (cumulated for all children) (KiB): 10494848

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39920.5
system time used= 80.5228
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 46954642
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 22685
involuntary context switches= 173765

runsolver used 11.1953 second user time and 31.8382 second system time

The end

Launcher Data 

Begin job on node109 at 2011-06-01 22:37:10
IDJOB=3439341
IDBENCH=84010
IDSOLVER=1936
FILE ID=node109/3439341-1306960629
RUNJOBID= node109-1306960629-25563
PBS_JOBID= 13497644
Free space on /tmp= 73688 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/SAT/SGI_30_80_15_90_4-dir.shuffled-as.sat03-6.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439341-1306960629/watcher-3439341-1306960629 -o /tmp/evaluation-result-3439341-1306960629/solver-3439341-1306960629 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439341-1306960629.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 22bbcb4a25a1da66113c240898c75509
RANDOM SEED=481871933

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      28410256 kB
Buffers:        272792 kB
Cached:        2300128 kB
SwapCached:      10360 kB
Active:         898804 kB
Inactive:      3400424 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      28410256 kB
SwapTotal:    67111528 kB
SwapFree:     55664332 kB
Dirty:             812 kB
Writeback:           0 kB
AnonPages:     1722784 kB
Mapped:          15596 kB
Slab:           139556 kB
PageTables:      37304 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 30861996 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73688 MiB
End job on node109 at 2011-06-02 00:00:37