Trace number 3438651

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.8 5011.45

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n170-s56409011-unsat.cnf
MD5SUM6545c783f127618649f1200914f62dc5
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables173
Number of clauses356
Sum of the clauses size1068
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3356
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438651-1306921191/watcher-3438651-1306921191 -o /tmp/evaluation-result-3438651-1306921191/solver-3438651-1306921191 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438651-1306921191.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.18 8.10 8.00 2/508 25741
/proc/meminfo: memFree=20178568/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=90472 CPUtime=0.04 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 492 0 0 0 4 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 47810643761078 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 22618 428 300 106 0 18121 0
[pid=25741/tid=25742] ppid=25739 vsize=90472 CPUtime=0.01 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1 0 0 0 1 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 47810643761068 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=90472 CPUtime=0 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=90472 CPUtime=0 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415448049 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=90472 CPUtime=0.01 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 0 0 0 0 1 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 47810643761064 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=90472 CPUtime=0 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 47810643761064 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=90472 CPUtime=0 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 47810643761068 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=90472 CPUtime=0 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 8 0 882349774 92643328 428 33554432000 4194304 4625164 140736511199824 18446744073709551615 47810643761074 0 0 4096 2 0 0 0 -1 6 0 0 0

[startup+0.0930471 s]
/proc/loadavg: 8.18 8.10 8.00 2/508 25741
/proc/meminfo: memFree=20178568/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=354080 CPUtime=0.48 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 1784 0 0 0 48 0 0 0 25 0 8 0 882349774 362577920 1550 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415496686 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 88520 1552 351 106 0 84023 0
[pid=25741/tid=25742] ppid=25739 vsize=354080 CPUtime=0.08 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 211 0 0 0 8 0 0 0 25 0 8 0 882349774 362577920 1552 33554432000 4194304 4625164 140736511199824 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=354080 CPUtime=0.06 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 153 0 0 0 6 0 0 0 18 0 8 0 882349774 362577920 1552 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415496735 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=354080 CPUtime=0.07 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 255 0 0 0 7 0 0 0 18 0 8 0 882349774 362577920 1552 33554432000 4194304 4625164 140736511199824 18446744073709551615 4552399 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=354080 CPUtime=0.08 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 175 0 0 0 8 0 0 0 25 0 8 0 882349774 362577920 1552 33554432000 4194304 4625164 140736511199824 18446744073709551615 4340391 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=354080 CPUtime=0.06 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 201 0 0 0 6 0 0 0 25 0 8 0 882349774 362577920 1552 33554432000 4194304 4625164 140736511199824 18446744073709551615 4349649 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=354080 CPUtime=0.01 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 10 0 0 0 1 0 0 0 25 0 8 0 882349774 362577920 1552 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415496686 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=354080 CPUtime=0.02 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 81 0 0 0 2 0 0 0 25 0 8 0 882349774 362577920 1553 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415496686 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 354080

[startup+0.107038 s]
/proc/loadavg: 8.18 8.10 8.00 2/508 25741
/proc/meminfo: memFree=20178568/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=354496 CPUtime=0.58 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 2183 0 0 0 58 0 0 0 25 0 8 0 882349774 363003904 1746 33554432000 4194304 4625164 140736511199824 18446744073709551615 4511811 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 88624 1746 351 106 0 84127 0
[pid=25741/tid=25742] ppid=25739 vsize=354496 CPUtime=0.1 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 286 0 0 0 10 0 0 0 25 0 8 0 882349774 363003904 1746 33554432000 4194304 4625164 140736511199824 18446744073709551615 4463229 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=354496 CPUtime=0.08 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 218 0 0 0 8 0 0 0 18 0 8 0 882349774 363003904 1747 33554432000 4194304 4625164 140736511199824 18446744073709551615 4352565 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=354496 CPUtime=0.08 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 317 0 0 0 8 0 0 0 18 0 8 0 882349774 363003904 1747 33554432000 4194304 4625164 140736511199824 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=354496 CPUtime=0.1 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 242 0 0 0 10 0 0 0 25 0 8 0 882349774 363003904 1747 33554432000 4194304 4625164 140736511199824 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=354496 CPUtime=0.08 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 267 0 0 0 8 0 0 0 25 0 8 0 882349774 363003904 1748 33554432000 4194304 4625164 140736511199824 18446744073709551615 4436904 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=354496 CPUtime=0.02 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 38 0 0 0 2 0 0 0 18 0 8 0 882349774 363003904 1748 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415052833 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=354496 CPUtime=0.02 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 81 0 0 0 2 0 0 0 25 0 8 0 882349774 363003904 1749 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415496686 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 354496

[startup+0.300946 s]
/proc/loadavg: 8.18 8.10 8.00 2/508 25741
/proc/meminfo: memFree=20178568/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=361144 CPUtime=2.1 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 6962 0 0 0 209 1 0 0 25 0 8 0 882349774 369811456 5002 33554432000 4194304 4625164 140736511199824 18446744073709551615 4425285 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 90286 5003 352 106 0 85789 0
[pid=25741/tid=25742] ppid=25739 vsize=361144 CPUtime=0.29 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 695 0 0 0 29 0 0 0 25 0 8 0 882349774 369811456 5003 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=361144 CPUtime=0.27 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 838 0 0 0 27 0 0 0 18 0 8 0 882349774 369811456 5003 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=361144 CPUtime=0.27 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1370 0 0 0 27 0 0 0 18 0 8 0 882349774 369811456 5003 33554432000 4194304 4625164 140736511199824 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=361144 CPUtime=0.29 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 579 0 0 0 29 0 0 0 25 0 8 0 882349774 369811456 5003 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=361144 CPUtime=0.27 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 898 0 0 0 27 0 0 0 25 0 8 0 882349774 369811456 5003 33554432000 4194304 4625164 140736511199824 18446744073709551615 256415434935 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=361144 CPUtime=0.22 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 793 0 0 0 22 0 0 0 18 0 8 0 882349774 369811456 5004 33554432000 4194304 4625164 140736511199824 18446744073709551615 4487022 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=361144 CPUtime=0.18 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 582 0 0 0 18 0 0 0 25 0 8 0 882349774 369811456 5004 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351925 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.1
Current children cumulated vsize (KiB) 361144

[startup+0.700872 s]
/proc/loadavg: 8.18 8.10 8.00 2/508 25741
/proc/meminfo: memFree=20178568/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=368988 CPUtime=5.3 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 14428 0 0 0 528 2 0 0 25 0 8 0 882349774 377843712 9388 33554432000 4194304 4625164 140736511199824 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 92247 9388 351 106 0 87750 0
[pid=25741/tid=25742] ppid=25739 vsize=368988 CPUtime=0.69 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1493 0 0 0 69 0 0 0 25 0 8 0 882349774 377843712 9388 33554432000 4194304 4625164 140736511199824 18446744073709551615 4466334 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=368988 CPUtime=0.67 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1424 0 0 0 67 0 0 0 18 0 8 0 882349774 377843712 9388 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=368988 CPUtime=0.67 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 3732 0 0 0 67 0 0 0 18 0 8 0 882349774 377843712 9388 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=368988 CPUtime=0.69 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1349 0 0 0 69 0 0 0 25 0 8 0 882349774 377843712 9390 33554432000 4194304 4625164 140736511199824 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=368988 CPUtime=0.67 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1541 0 0 0 67 0 0 0 25 0 8 0 882349774 377843712 9390 33554432000 4194304 4625164 140736511199824 18446744073709551615 4349336 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=368988 CPUtime=0.62 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1876 0 0 0 62 0 0 0 18 0 8 0 882349774 377843712 9390 33554432000 4194304 4625164 140736511199824 18446744073709551615 4339865 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=368988 CPUtime=0.57 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 1325 0 0 0 57 0 0 0 25 0 8 0 882349774 377843712 9390 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351790 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.3
Current children cumulated vsize (KiB) 368988

[startup+1.50072 s]
/proc/loadavg: 8.18 8.10 8.00 9/516 25749
/proc/meminfo: memFree=20131888/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=381196 CPUtime=11.68 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 26437 0 0 0 1164 4 0 0 25 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 95299 15669 353 106 0 90802 0
[pid=25741/tid=25742] ppid=25739 vsize=381196 CPUtime=1.49 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 3187 0 0 0 148 1 0 0 25 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=381196 CPUtime=1.47 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 2258 0 0 0 147 0 0 0 19 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=381196 CPUtime=1.47 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 7478 0 0 0 147 0 0 0 19 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=381196 CPUtime=1.48 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 2179 0 0 0 148 0 0 0 25 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=381196 CPUtime=1.47 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 2965 0 0 0 147 0 0 0 25 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=381196 CPUtime=1.42 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 2978 0 0 0 142 0 0 0 19 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=381196 CPUtime=1.35 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 2933 0 0 0 135 0 0 0 25 0 8 0 882349774 390344704 15669 33554432000 4194304 4625164 140736511199824 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 11.68
Current children cumulated vsize (KiB) 381196

[startup+3.10043 s]
/proc/loadavg: 8.17 8.09 8.00 9/516 25749
/proc/meminfo: memFree=20101080/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=401780 CPUtime=24.46 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 44412 0 0 0 2438 8 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 100445 24887 353 106 0 95948 0
[pid=25741/tid=25742] ppid=25739 vsize=401780 CPUtime=3.09 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 4906 0 0 0 308 1 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=401780 CPUtime=3.06 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 4503 0 0 0 306 0 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=401780 CPUtime=3.07 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 13943 0 0 0 305 2 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4552432 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=401780 CPUtime=3.08 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 4722 0 0 0 308 0 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=401780 CPUtime=3.06 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 4630 0 0 0 306 0 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4349768 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=401780 CPUtime=3.01 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 4567 0 0 0 301 0 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=401780 CPUtime=2.93 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 3522 0 0 0 293 0 0 0 25 0 8 0 882349774 411422720 24887 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 24.46
Current children cumulated vsize (KiB) 401780

[startup+6.30083 s]
/proc/loadavg: 8.17 8.09 8.00 9/516 25749
/proc/meminfo: memFree=20034120/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=432964 CPUtime=50 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 79396 0 0 0 4987 13 0 0 25 0 8 0 882349774 443355136 39183 33554432000 4194304 4625164 140736511199824 18446744073709551615 4511973 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 108241 39184 395 106 0 103744 0
[pid=25741/tid=25742] ppid=25739 vsize=432964 CPUtime=6.29 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 7642 0 0 0 627 2 0 0 25 0 8 0 882349774 443355136 39184 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=432964 CPUtime=6.27 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 7093 0 0 0 626 1 0 0 25 0 8 0 882349774 443355136 39184 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=432964 CPUtime=6.27 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 27941 0 0 0 624 3 0 0 25 0 8 0 882349774 443355136 39184 33554432000 4194304 4625164 140736511199824 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=432964 CPUtime=6.29 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 7041 0 0 0 628 1 0 0 25 0 8 0 882349774 443355136 39184 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=432964 CPUtime=6.27 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 9522 0 0 0 626 1 0 0 25 0 8 0 882349774 443355136 39184 33554432000 4194304 4625164 140736511199824 18446744073709551615 4349598 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=432964 CPUtime=6.22 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 9362 0 0 0 621 1 0 0 25 0 8 0 882349774 443355136 39184 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=432964 CPUtime=6.07 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 5649 0 0 0 607 0 0 0 25 0 8 0 882349774 443355136 39184 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0

################
# More data... #
################

[pid=25741/tid=25744] ppid=25739 vsize=5351996 CPUtime=4662.42 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 10851341 0 0 0 464312 1930 0 0 25 0 8 0 882349774 5480443904 1131303 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=5351996 CPUtime=4662.44 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 276963 0 0 0 466185 59 0 0 25 0 8 0 882349774 5480443904 1131303 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=5351996 CPUtime=4661.11 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 266547 0 0 0 466059 52 0 0 25 0 8 0 882349774 5480443904 1131303 33554432000 4194304 4625164 140736511199824 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=5351996 CPUtime=4662.35 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 367999 0 0 0 466145 90 0 0 25 0 8 0 882349774 5480443904 1131303 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=5351996 CPUtime=4580.54 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 221319 0 0 0 458001 53 0 0 25 0 8 0 882349774 5480443904 1131303 33554432000 4194304 4625164 140736511199824 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37215.4
Current children cumulated vsize (KiB) 5351996

[startup+4722.32 s]
/proc/loadavg: 8.08 8.08 8.04 9/516 25886
/proc/meminfo: memFree=15643484/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=5352788 CPUtime=37694.5 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 15011953 0 0 0 3766672 2778 0 0 25 0 8 0 882349774 5481254912 1133511 33554432000 4194304 4625164 140736511199824 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 1338197 1133512 672 106 0 1333700 0
[pid=25741/tid=25742] ppid=25739 vsize=5352788 CPUtime=4722.48 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 218159 0 0 0 472204 44 0 0 25 0 8 0 882349774 5481254912 1133517 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=5352788 CPUtime=4721.64 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 209797 0 0 0 472112 52 0 0 25 0 8 0 882349774 5481254912 1133522 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=5352788 CPUtime=4722.45 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 11002701 0 0 0 470288 1957 0 0 25 0 8 0 882349774 5481254912 1133522 33554432000 4194304 4625164 140736511199824 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=5352788 CPUtime=4722.46 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 276971 0 0 0 472187 59 0 0 25 0 8 0 882349774 5481254912 1133522 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=5352788 CPUtime=4721.11 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 266559 0 0 0 472059 52 0 0 25 0 8 0 882349774 5481254912 1133522 33554432000 4194304 4625164 140736511199824 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=5352788 CPUtime=4722.37 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 368467 0 0 0 472146 91 0 0 25 0 8 0 882349774 5481254912 1133522 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=5352788 CPUtime=4639.49 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 221334 0 0 0 463896 53 0 0 25 0 8 0 882349774 5481254912 1133522 33554432000 4194304 4625164 140736511199824 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 37694.5
Current children cumulated vsize (KiB) 5352788

[startup+4782.3 s]
/proc/loadavg: 8.03 8.06 8.03 9/516 25888
/proc/meminfo: memFree=15639464/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=5354504 CPUtime=38173.3 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 15187011 0 0 0 3814517 2812 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 1338626 1132857 559 106 0 1334129 0
[pid=25741/tid=25742] ppid=25739 vsize=5354504 CPUtime=4782.46 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 218171 0 0 0 478202 44 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=5354504 CPUtime=4781.62 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 209799 0 0 0 478110 52 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=5354504 CPUtime=4782.42 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 11177210 0 0 0 476252 1990 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4334439 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=5354504 CPUtime=4782.44 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 276980 0 0 0 478185 59 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=5354504 CPUtime=4781.08 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 266575 0 0 0 478056 52 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=5354504 CPUtime=4782.35 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 368940 0 0 0 478144 91 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=5354504 CPUtime=4698.42 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 221347 0 0 0 469789 53 0 0 25 0 8 0 882349774 5483012096 1132857 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38173.3
Current children cumulated vsize (KiB) 5354504

[startup+4842.3 s]
/proc/loadavg: 8.01 8.05 8.03 9/516 25890
/proc/meminfo: memFree=15635076/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=5355428 CPUtime=38652.2 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 15366464 0 0 0 3862373 2850 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 1338857 1133904 603 106 0 1334360 0
[pid=25741/tid=25742] ppid=25739 vsize=5355428 CPUtime=4842.46 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 218185 0 0 0 484202 44 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=5355428 CPUtime=4841.62 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 209801 0 0 0 484110 52 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=5355428 CPUtime=4842.43 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 11356298 0 0 0 482216 2027 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4548757 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=5355428 CPUtime=4842.45 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 276990 0 0 0 484185 60 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=5355428 CPUtime=4841.06 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 266585 0 0 0 484054 52 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=5355428 CPUtime=4842.36 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 369232 0 0 0 484144 92 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=5355428 CPUtime=4757.36 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 221364 0 0 0 475683 53 0 0 25 0 8 0 882349774 5483958272 1133904 33554432000 4194304 4625164 140736511199824 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 38652.2
Current children cumulated vsize (KiB) 5355428

[startup+4902.3 s]
/proc/loadavg: 8.05 8.05 8.03 9/516 25900
/proc/meminfo: memFree=15640316/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=5356616 CPUtime=39131.1 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 15535921 0 0 0 3910231 2883 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 1339154 1134017 580 106 0 1334657 0
[pid=25741/tid=25742] ppid=25739 vsize=5356616 CPUtime=4902.46 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 218192 0 0 0 490202 44 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=5356616 CPUtime=4901.62 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 209804 0 0 0 490110 52 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=5356616 CPUtime=4902.42 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 11525342 0 0 0 488184 2058 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=5356616 CPUtime=4902.42 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 276998 0 0 0 490182 60 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=5356616 CPUtime=4901.04 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 266599 0 0 0 490052 52 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=5356616 CPUtime=4902.35 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 369578 0 0 0 490143 92 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=5356616 CPUtime=4816.32 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 221379 0 0 0 481579 53 0 0 25 0 8 0 882349774 5485174784 1134017 33554432000 4194304 4625164 140736511199824 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39131.1
Current children cumulated vsize (KiB) 5356616

[startup+4962.3 s]
/proc/loadavg: 8.02 8.04 8.02 9/516 25902
/proc/meminfo: memFree=15631584/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=5357672 CPUtime=39610.1 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 15720400 0 0 0 3958089 2919 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 1339418 1134335 536 106 0 1334921 0
[pid=25741/tid=25742] ppid=25739 vsize=5357672 CPUtime=4962.46 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 218204 0 0 0 496202 44 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=5357672 CPUtime=4961.62 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 209811 0 0 0 496110 52 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=5357672 CPUtime=4962.43 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 11709297 0 0 0 494149 2094 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=5357672 CPUtime=4962.42 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 277007 0 0 0 496182 60 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=5357672 CPUtime=4961.03 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 266611 0 0 0 496051 52 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=5357672 CPUtime=4962.36 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 369862 0 0 0 496143 93 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=5357672 CPUtime=4875.25 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 221391 0 0 0 487472 53 0 0 25 0 8 0 882349774 5486256128 1134335 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 39610.1
Current children cumulated vsize (KiB) 5357672



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.2 s]
/proc/loadavg: 8.06 8.05 8.02 9/516 25903
/proc/meminfo: memFree=15634256/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=5360708 CPUtime=40000.5 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) R 25739 25741 25524 0 -1 4202496 15871974 0 0 0 3997104 2950 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 1340177 1133348 381 106 0 1335680 0
[pid=25741/tid=25742] ppid=25739 vsize=5360708 CPUtime=5011.38 cores=0-7
/proc/25741/task/25742/stat : 25742 (SArTagnan) R 25739 25741 25524 0 -1 4202560 218215 0 0 0 501094 44 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=25741/tid=25743] ppid=25739 vsize=5360708 CPUtime=5010.54 cores=0-7
/proc/25741/task/25743/stat : 25743 (SArTagnan) R 25739 25741 25524 0 -1 4202560 209816 0 0 0 501002 52 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=25741/tid=25744] ppid=25739 vsize=5360708 CPUtime=5011.35 cores=0-7
/proc/25741/task/25744/stat : 25744 (SArTagnan) R 25739 25741 25524 0 -1 4202560 11859966 0 0 0 499011 2124 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351871 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=25741/tid=25745] ppid=25739 vsize=5360708 CPUtime=5011.35 cores=0-7
/proc/25741/task/25745/stat : 25745 (SArTagnan) R 25739 25741 25524 0 -1 4202560 277014 0 0 0 501075 60 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=25741/tid=25746] ppid=25739 vsize=5360708 CPUtime=5009.94 cores=0-7
/proc/25741/task/25746/stat : 25746 (SArTagnan) R 25739 25741 25524 0 -1 4202560 266628 0 0 0 500942 52 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=25741/tid=25747] ppid=25739 vsize=5360708 CPUtime=5011.27 cores=0-7
/proc/25741/task/25747/stat : 25747 (SArTagnan) R 25739 25741 25524 0 -1 4202560 370704 0 0 0 501034 93 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=5360708 CPUtime=4923.3 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4202560 221401 0 0 0 492277 53 0 0 25 0 8 0 882349774 5489364992 1133348 33554432000 4194304 4625164 140736511199824 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 5360708

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.4 s]
/proc/loadavg: 8.06 8.05 8.02 9/516 25903
/proc/meminfo: memFree=15634256/32950928 swapFree=61513528/67111528
[pid=25741] ppid=25739 vsize=0 CPUtime=40000.8 cores=0-7
/proc/25741/stat : 25741 (SArTagnan) Z 25739 25741 25524 0 -1 4203548 15871974 0 0 0 3997110 2967 0 0 25 0 2 0 882349774 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/25741/statm: 0 0 0 0 0 0 0
[pid=25741/tid=25748] ppid=25739 vsize=0 CPUtime=4923.48 cores=0-7
/proc/25741/task/25748/stat : 25748 (SArTagnan) R 25739 25741 25524 0 -1 4203588 221401 0 0 0 492277 71 0 0 25 0 2 0 882349774 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.45
CPU time (s): 40000.8
CPU user time (s): 39971.1
CPU system time (s): 29.7205
CPU usage (%): 798.189
Max. virtual memory (cumulated for all children) (KiB): 5658044

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39971.1
system time used= 29.7205
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15871974
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 808
involuntary context switches= 172721

runsolver used 23.1675 second user time and 64.6092 second system time

The end

Launcher Data 

Begin job on node115 at 2011-06-01 11:39:51
IDJOB=3438651
IDBENCH=83145
IDSOLVER=1936
FILE ID=node115/3438651-1306921191
RUNJOBID= node115-1306916177-25538
PBS_JOBID= 13488514
Free space on /tmp= 73768 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n170-s56409011-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438651-1306921191/watcher-3438651-1306921191 -o /tmp/evaluation-result-3438651-1306921191/solver-3438651-1306921191 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438651-1306921191.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 6545c783f127618649f1200914f62dc5
RANDOM SEED=447401037

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      20178724 kB
Buffers:        159836 kB
Cached:         456664 kB
SwapCached:       5268 kB
Active:       11984636 kB
Inactive:       502760 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      20178724 kB
SwapTotal:    67111528 kB
SwapFree:     61513528 kB
Dirty:             428 kB
Writeback:           0 kB
AnonPages:    11869452 kB
Mapped:          33244 kB
Slab:           136348 kB
PageTables:      74892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 151808764 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73768 MiB
End job on node115 at 2011-06-01 13:03:24