Trace number 3438491

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.6 5010.29

General information on the benchmark

NameCRAFTED/rbsat/random/forced/
rbsat-v2640c305320gyes10.cnf
MD5SUMe4e4b653016e98f210aa8da2214e783a
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2640
Number of clauses305320
Sum of the clauses size613120
Maximum clause length33
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2305240
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 580

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438491-1306919519/watcher-3438491-1306919519 -o /tmp/evaluation-result-3438491-1306919519/solver-3438491-1306919519 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438491-1306919519.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.85 2.00 1.99 2/451 22516
/proc/meminfo: memFree=26277084/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=27484 CPUtime=0.01 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 946 0 0 0 1 0 0 0 25 0 1 0 803550075 28143616 645 33554432000 4194304 4625164 140734294188752 18446744073709551615 232335589584 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/22516/statm: 6871 659 296 106 0 2374 0

[startup+0.0750369 s]
/proc/loadavg: 1.85 2.00 1.99 2/451 22516
/proc/meminfo: memFree=26277084/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=35472 CPUtime=0.07 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 4566 0 0 0 7 0 0 0 25 0 1 0 803550075 36323328 2232 33554432000 4194304 4625164 140734294188752 18446744073709551615 232335589845 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/22516/statm: 8868 2254 298 106 0 4371 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 35472

[startup+0.104755 s]
/proc/loadavg: 1.85 2.00 1.99 2/451 22516
/proc/meminfo: memFree=26277084/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=267640 CPUtime=0.16 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 10689 0 0 0 15 1 0 0 25 0 8 0 803550075 274063360 8347 33554432000 4194304 4625164 140734294188752 18446744073709551615 4500224 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 66910 8347 337 106 0 62413 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 267640

[startup+0.916156 s]
/proc/loadavg: 1.85 2.00 1.99 2/451 22516
/proc/meminfo: memFree=26277084/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=420368 CPUtime=6.65 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 36235 0 0 0 659 6 0 0 19 0 8 0 803550075 430456832 28132 33554432000 4194304 4625164 140734294188752 18446744073709551615 4508785 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 105092 28132 354 106 0 100595 0
Current children cumulated CPU time (s) 6.65
Current children cumulated vsize (KiB) 420368

[startup+1.04483 s]
/proc/loadavg: 1.85 2.00 1.99 2/451 22516
/proc/meminfo: memFree=26277084/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=420368 CPUtime=7.45 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 37481 0 0 0 739 6 0 0 19 0 8 0 803550075 430456832 29375 33554432000 4194304 4625164 140734294188752 18446744073709551615 4512432 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 105092 29375 357 106 0 100595 0
Current children cumulated CPU time (s) 7.45
Current children cumulated vsize (KiB) 420368

[startup+1.50075 s]
/proc/loadavg: 1.85 2.00 1.99 2/451 22516
/proc/meminfo: memFree=26277084/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=420600 CPUtime=11.1 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 41734 0 0 0 1103 7 0 0 20 0 8 0 803550075 430694400 33211 33554432000 4194304 4625164 140734294188752 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 105150 33211 355 106 0 100653 0
Current children cumulated CPU time (s) 11.1
Current children cumulated vsize (KiB) 420600

[startup+3.10046 s]
/proc/loadavg: 1.85 2.00 1.99 9/459 22524
/proc/meminfo: memFree=26092392/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=454060 CPUtime=23.86 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 69202 0 0 0 2375 11 0 0 24 0 8 0 803550075 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 113515 47533 365 106 0 109018 0
[pid=22516/tid=22518] ppid=22514 vsize=454060 CPUtime=3 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 6098 0 0 0 299 1 0 0 25 0 8 0 803550083 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352017 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=454060 CPUtime=2.83 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 4226 0 0 0 283 0 0 0 25 0 8 0 803550083 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=454060 CPUtime=2.99 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 9450 0 0 0 298 1 0 0 25 0 8 0 803550083 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=454060 CPUtime=2.95 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 3995 0 0 0 295 0 0 0 18 0 8 0 803550083 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=454060 CPUtime=2.98 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 3885 0 0 0 297 1 0 0 25 0 8 0 803550083 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4349779 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=454060 CPUtime=2.96 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 5472 0 0 0 296 0 0 0 25 0 8 0 803550084 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=454060 CPUtime=2.99 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 3956 0 0 0 298 1 0 0 24 0 8 0 803550084 464957440 47533 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351632 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 23.86
Current children cumulated vsize (KiB) 454060

[startup+6.3009 s]
/proc/loadavg: 2.34 2.10 2.02 9/459 22524
/proc/meminfo: memFree=26009468/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=466572 CPUtime=49.42 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 96032 0 0 0 4925 17 0 0 25 0 8 0 803550075 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 116643 67850 377 106 0 112146 0
[pid=22516/tid=22518] ppid=22514 vsize=466572 CPUtime=6.2 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 9065 0 0 0 619 1 0 0 25 0 8 0 803550083 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4288786 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=466572 CPUtime=6.03 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 6152 0 0 0 602 1 0 0 25 0 8 0 803550083 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=466572 CPUtime=6.19 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 11259 0 0 0 618 1 0 0 25 0 8 0 803550083 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=466572 CPUtime=6.15 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 8256 0 0 0 614 1 0 0 25 0 8 0 803550083 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=466572 CPUtime=6.18 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 4123 0 0 0 617 1 0 0 25 0 8 0 803550083 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4348858 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=466572 CPUtime=6.11 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 8321 0 0 0 610 1 0 0 25 0 8 0 803550084 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=466572 CPUtime=6.2 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 5805 0 0 0 618 2 0 0 25 0 8 0 803550084 477769728 67850 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.42
Current children cumulated vsize (KiB) 466572

[startup+12.7178 s]
/proc/loadavg: 2.79 2.20 2.05 9/459 22524
/proc/meminfo: memFree=25938612/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=586608 CPUtime=100.65 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 124945 0 0 0 10043 22 0 0 25 0 8 0 803550075 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 146652 85107 388 106 0 142155 0
[pid=22516/tid=22518] ppid=22514 vsize=586608 CPUtime=12.61 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 13842 0 0 0 1260 1 0 0 25 0 8 0 803550083 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=586608 CPUtime=12.45 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 9147 0 0 0 1244 1 0 0 25 0 8 0 803550083 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=586608 CPUtime=12.61 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 17353 0 0 0 1258 3 0 0 25 0 8 0 803550083 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=586608 CPUtime=12.58 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 9642 0 0 0 1256 2 0 0 25 0 8 0 803550083 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351814 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=586608 CPUtime=12.6 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 6056 0 0 0 1258 2 0 0 25 0 8 0 803550083 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4437721 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=586608 CPUtime=12.42 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 12498 0 0 0 1241 1 0 0 25 0 8 0 803550084 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=586608 CPUtime=12.61 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 8200 0 0 0 1259 2 0 0 25 0 8 0 803550084 600686592 85107 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.65
Current children cumulated vsize (KiB) 586608

[startup+25.5005 s]
/proc/loadavg: 3.95 2.48 2.15 9/459 22525
/proc/meminfo: memFree=25822004/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=650892 CPUtime=202.72 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 203448 0 0 0 20236 36 0 0 25 0 8 0 803550075 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 162723 116123 458 106 0 158226 0
[pid=22516/tid=22518] ppid=22514 vsize=650892 CPUtime=25.4 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 15319 0 0 0 2538 2 0 0 25 0 8 0 803550083 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=650892 CPUtime=25.23 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 9843 0 0 0 2522 1 0 0 25 0 8 0 803550083 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352002 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=650892 CPUtime=25.39 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 60574 0 0 0 2529 10 0 0 25 0 8 0 803550083 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351801 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=650892 CPUtime=25.36 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 13578 0 0 0 2534 2 0 0 25 0 8 0 803550083 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=650892 CPUtime=25.38 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 10683 0 0 0 2536 2 0 0 25 0 8 0 803550083 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4348864 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=650892 CPUtime=25.02 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 18702 0 0 0 2500 2 0 0 25 0 8 0 803550084 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=650892 CPUtime=25.39 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 8708 0 0 0 2537 2 0 0 25 0 8 0 803550084 666513408 116123 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.72
Current children cumulated vsize (KiB) 650892

[startup+51.1009 s]
/proc/loadavg: 5.33 2.92 2.30 10/459 22525
/proc/meminfo: memFree=25630472/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=998660 CPUtime=407.21 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 337271 0 0 0 40663 58 0 0 25 0 8 0 803550075 1022627840 162397 33554432000 4194304 4625164 140734294188752 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 249665 162397 641 106 0 245168 0
[pid=22516/tid=22518] ppid=22514 vsize=998660 CPUtime=51.01 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 21726 0 0 0 5098 3 0 0 25 0 8 0 803550083 1022627840 162398 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=998660 CPUtime=50.85 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 9936 0 0 0 5083 2 0 0 25 0 8 0 803550083 1022627840 162398 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=998660 CPUtime=51 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 133460 0 0 0 5079 21 0 0 25 0 8 0 803550083 1022627840 162398 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=998660 CPUtime=50.97 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 20210 0 0 0 5094 3 0 0 25 0 8 0 803550083 1022627840 162398 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=998660 CPUtime=51 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 17337 0 0 0 5096 4 0 0 25 0 8 0 803550083 1022627840 162398 33554432000 4194304 4625164 140734294188752 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=998660 CPUtime=50.23 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 30084 0 0 0 5018 5 0 0 25 0 8 0 803550084 1022627840 162398 33554432000 4194304 4625164 140734294188752 18446744073709551615 4339646 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=998660 CPUtime=51 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 12517 0 0 0 5097 3 0 0 25 0 8 0 803550084 1022627840 162398 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.21
Current children cumulated vsize (KiB) 998660

[startup+102.301 s]
/proc/loadavg: 6.89 3.72 2.60 9/459 22527
/proc/meminfo: memFree=25413948/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=1238068 CPUtime=815.91 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 680573 0 0 0 81480 111 0 0 25 0 8 0 803550075 1267781632 217128 33554432000 4194304 4625164 140734294188752 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 309517 217128 420 106 0 305020 0
[pid=22516/tid=22518] ppid=22514 vsize=1238068 CPUtime=102.2 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 31026 0 0 0 10215 5 0 0 25 0 8 0 803550083 1267781632 217128 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352085 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=1238068 CPUtime=102.03 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 16740 0 0 0 10200 3 0 0 25 0 8 0 803550083 1267781632 217128 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=1238068 CPUtime=102.18 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 384521 0 0 0 10162 56 0 0 25 0 8 0 803550083 1267781632 217128 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=22516/tid=22520] ppid=22514 vsize=6412804 CPUtime=4660.21 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 25839099 0 0 0 462032 3989 0 0 25 0 8 0 803550083 6566711296 1285022 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=6412804 CPUtime=4662.28 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 173608 0 0 0 466195 33 0 0 25 0 8 0 803550083 6566711296 1285022 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=6412804 CPUtime=4662.28 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 132454 0 0 0 466196 32 0 0 25 0 8 0 803550083 6566711296 1285022 33554432000 4194304 4625164 140734294188752 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=6412804 CPUtime=4590.31 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 167052 0 0 0 458993 38 0 0 25 0 8 0 803550084 6566711296 1285022 33554432000 4194304 4625164 140734294188752 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=6412804 CPUtime=4662.19 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 100892 0 0 0 466165 54 0 0 25 0 8 0 803550084 6566711296 1285022 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37223.9
Current children cumulated vsize (KiB) 6412804

[startup+4722.3 s]
/proc/loadavg: 8.25 8.21 8.11 9/459 22662
/proc/meminfo: memFree=21086324/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=6508804 CPUtime=37702.9 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 29254141 0 0 0 3765587 4701 0 0 25 0 8 0 803550075 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 1627201 1294903 349 106 0 1622704 0
[pid=22516/tid=22518] ppid=22514 vsize=6508804 CPUtime=4722.16 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 131480 0 0 0 472188 28 0 0 25 0 8 0 803550083 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=6508804 CPUtime=4722.03 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 190963 0 0 0 472079 124 0 0 25 0 8 0 803550083 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=6508804 CPUtime=4720.18 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 26156074 0 0 0 467980 4038 0 0 25 0 8 0 803550083 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4547603 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=6508804 CPUtime=4722.27 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 173709 0 0 0 472194 33 0 0 25 0 8 0 803550083 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=6508804 CPUtime=4722.26 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 132582 0 0 0 472194 32 0 0 25 0 8 0 803550083 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4460420 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=6508804 CPUtime=4649.37 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 179207 0 0 0 464897 40 0 0 25 0 8 0 803550084 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=6508804 CPUtime=4722.18 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 101507 0 0 0 472163 55 0 0 25 0 8 0 803550084 6665015296 1294903 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37702.9
Current children cumulated vsize (KiB) 6508804

[startup+4782.32 s]
/proc/loadavg: 8.09 8.17 8.10 9/459 22664
/proc/meminfo: memFree=21057788/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=6574340 CPUtime=38182.1 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 29624704 0 0 0 3813447 4760 0 0 25 0 8 0 803550075 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 1643585 1303521 349 106 0 1639088 0
[pid=22516/tid=22518] ppid=22514 vsize=6574340 CPUtime=4782.19 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 131787 0 0 0 478190 29 0 0 25 0 8 0 803550083 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=6574340 CPUtime=4782.04 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 191135 0 0 0 478080 124 0 0 25 0 8 0 803550083 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=6574340 CPUtime=4780.19 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 26515238 0 0 0 473925 4094 0 0 25 0 8 0 803550083 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=6574340 CPUtime=4782.29 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 173925 0 0 0 478196 33 0 0 25 0 8 0 803550083 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=6574340 CPUtime=4782.28 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 132721 0 0 0 478196 32 0 0 25 0 8 0 803550083 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=6574340 CPUtime=4708.45 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 179660 0 0 0 470805 40 0 0 25 0 8 0 803550084 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=6574340 CPUtime=4782.2 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 101674 0 0 0 478165 55 0 0 25 0 8 0 803550084 6732124160 1303521 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38182.1
Current children cumulated vsize (KiB) 6574340

[startup+4842.3 s]
/proc/loadavg: 8.06 8.15 8.09 9/459 22665
/proc/meminfo: memFree=21003336/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=6574340 CPUtime=38661 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 29977906 0 0 0 3861284 4818 0 0 25 0 8 0 803550075 6732124160 1314404 33554432000 4194304 4625164 140734294188752 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 1643585 1314404 349 106 0 1639088 0
[pid=22516/tid=22518] ppid=22514 vsize=6574340 CPUtime=4842.17 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 131900 0 0 0 484188 29 0 0 25 0 8 0 803550083 6732124160 1314405 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=6574340 CPUtime=4842.03 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 192185 0 0 0 484077 126 0 0 25 0 8 0 803550083 6732124160 1314405 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=6574340 CPUtime=4840.16 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 26844358 0 0 0 479870 4146 0 0 25 0 8 0 803550083 6732124160 1314406 33554432000 4194304 4625164 140734294188752 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=6574340 CPUtime=4842.27 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 174219 0 0 0 484194 33 0 0 25 0 8 0 803550083 6732124160 1314406 33554432000 4194304 4625164 140734294188752 18446744073709551615 4330958 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=6574340 CPUtime=4842.28 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 133198 0 0 0 484195 33 0 0 25 0 8 0 803550083 6732124160 1314407 33554432000 4194304 4625164 140734294188752 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=6574340 CPUtime=4767.52 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 180090 0 0 0 476712 40 0 0 25 0 8 0 803550084 6732124160 1314407 33554432000 4194304 4625164 140734294188752 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=6574340 CPUtime=4842.18 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 102463 0 0 0 484163 55 0 0 25 0 8 0 803550084 6732124160 1314407 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38661
Current children cumulated vsize (KiB) 6574340

[startup+4902.3 s]
/proc/loadavg: 8.20 8.17 8.10 9/459 22667
/proc/meminfo: memFree=20975052/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=6647736 CPUtime=39140.1 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 30303705 0 0 0 3909139 4868 0 0 25 0 8 0 803550075 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4393127 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 1661934 1323496 349 106 0 1657437 0
[pid=22516/tid=22518] ppid=22514 vsize=6647736 CPUtime=4902.17 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 132051 0 0 0 490188 29 0 0 25 0 8 0 803550083 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4330853 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=6647736 CPUtime=4902.03 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 193215 0 0 0 490077 126 0 0 25 0 8 0 803550083 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4291697 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=6647736 CPUtime=4900.14 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 27151302 0 0 0 485822 4192 0 0 25 0 8 0 803550083 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=6647736 CPUtime=4902.28 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 174347 0 0 0 490194 34 0 0 25 0 8 0 803550083 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=6647736 CPUtime=4902.28 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 133468 0 0 0 490195 33 0 0 25 0 8 0 803550083 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=6647736 CPUtime=4826.59 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 180196 0 0 0 482618 41 0 0 25 0 8 0 803550084 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=6647736 CPUtime=4902.18 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 103090 0 0 0 490162 56 0 0 25 0 8 0 803550084 6807281664 1323496 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39140.1
Current children cumulated vsize (KiB) 6647736

[startup+4962.3 s]
/proc/loadavg: 8.18 8.16 8.10 9/459 22668
/proc/meminfo: memFree=20936228/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=6651864 CPUtime=39619.1 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 30475289 0 0 0 3957019 4895 0 0 25 0 8 0 803550075 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 1662966 1333295 349 106 0 1658469 0
[pid=22516/tid=22518] ppid=22514 vsize=6651864 CPUtime=4962.17 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 132345 0 0 0 496188 29 0 0 25 0 8 0 803550083 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=6651864 CPUtime=4962.03 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 194897 0 0 0 496076 127 0 0 25 0 8 0 803550083 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=6651864 CPUtime=4960.12 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 27295983 0 0 0 491798 4214 0 0 25 0 8 0 803550083 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=6651864 CPUtime=4962.28 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 174472 0 0 0 496194 34 0 0 25 0 8 0 803550083 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=6651864 CPUtime=4962.28 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 133691 0 0 0 496195 33 0 0 25 0 8 0 803550083 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=6651864 CPUtime=4885.67 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 180320 0 0 0 488526 41 0 0 25 0 8 0 803550084 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=6651864 CPUtime=4962.18 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 105135 0 0 0 496161 57 0 0 25 0 8 0 803550084 6811508736 1333295 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39619.1
Current children cumulated vsize (KiB) 6651864



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5010.02 s]
/proc/loadavg: 8.15 8.15 8.09 9/459 22670
/proc/meminfo: memFree=20895032/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=6717400 CPUtime=40000.2 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) R 22514 22516 22490 0 -1 4202496 30803830 0 0 0 3995075 4947 0 0 25 0 8 0 803550075 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 1679350 1343425 349 106 0 1674853 0
[pid=22516/tid=22518] ppid=22514 vsize=6717400 CPUtime=5009.9 cores=0-7
/proc/22516/task/22518/stat : 22518 (SArTagnan) R 22514 22516 22490 0 -1 4202560 132428 0 0 0 500961 29 0 0 25 0 8 0 803550083 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22516/tid=22519] ppid=22514 vsize=6717400 CPUtime=5009.77 cores=0-7
/proc/22516/task/22519/stat : 22519 (SArTagnan) R 22514 22516 22490 0 -1 4202560 196415 0 0 0 500849 128 0 0 25 0 8 0 803550083 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22516/tid=22520] ppid=22514 vsize=6717400 CPUtime=5007.85 cores=0-7
/proc/22516/task/22520/stat : 22520 (SArTagnan) R 22514 22516 22490 0 -1 4202560 27611278 0 0 0 496521 4264 0 0 25 0 8 0 803550083 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22516/tid=22521] ppid=22514 vsize=6717400 CPUtime=5010.02 cores=0-7
/proc/22516/task/22521/stat : 22521 (SArTagnan) R 22514 22516 22490 0 -1 4202560 174832 0 0 0 500968 34 0 0 25 0 8 0 803550083 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22516/tid=22522] ppid=22514 vsize=6717400 CPUtime=5010.01 cores=0-7
/proc/22516/task/22522/stat : 22522 (SArTagnan) R 22514 22516 22490 0 -1 4202560 133782 0 0 0 500968 33 0 0 25 0 8 0 803550083 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=6717400 CPUtime=4932.64 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4202560 180611 0 0 0 493223 41 0 0 25 0 8 0 803550084 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22516/tid=22524] ppid=22514 vsize=6717400 CPUtime=5009.92 cores=0-7
/proc/22516/task/22524/stat : 22524 (SArTagnan) R 22514 22516 22490 0 -1 4202560 105203 0 0 0 500934 58 0 0 25 0 8 0 803550084 6878617600 1343425 33554432000 4194304 4625164 140734294188752 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.2
Current children cumulated vsize (KiB) 6717400

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5010.2 s]
/proc/loadavg: 8.15 8.15 8.09 9/459 22670
/proc/meminfo: memFree=20895032/32951124 swapFree=60688864/67111528
[pid=22516] ppid=22514 vsize=0 CPUtime=40000.5 cores=0-7
/proc/22516/stat : 22516 (SArTagnan) Z 22514 22516 22490 0 -1 4203548 30803830 0 0 0 3995083 4963 0 0 25 0 2 0 803550075 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/22516/statm: 0 0 0 0 0 0 0
[pid=22516/tid=22523] ppid=22514 vsize=0 CPUtime=4932.81 cores=0-7
/proc/22516/task/22523/stat : 22523 (SArTagnan) R 22514 22516 22490 0 -1 4203588 180611 0 0 0 493224 57 0 0 25 0 2 0 803550084 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.5
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5010.29
CPU time (s): 40000.6
CPU user time (s): 39950.8
CPU system time (s): 49.7254
CPU usage (%): 798.368
Max. virtual memory (cumulated for all children) (KiB): 7483848

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39950.8
system time used= 49.7254
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 30803830
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10110
involuntary context switches= 353602

runsolver used 20.4519 second user time and 56.9763 second system time

The end

Launcher Data 

Begin job on node132 at 2011-06-01 11:11:59
IDJOB=3438491
IDBENCH=71425
IDSOLVER=1936
FILE ID=node132/3438491-1306919519
RUNJOBID= node132-1306919519-22504
PBS_JOBID= 13488527
Free space on /tmp= 73572 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2640c305320gyes10.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438491-1306919519/watcher-3438491-1306919519 -o /tmp/evaluation-result-3438491-1306919519/solver-3438491-1306919519 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438491-1306919519.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= e4e4b653016e98f210aa8da2214e783a
RANDOM SEED=495803239

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26277364 kB
Buffers:        274812 kB
Cached:        3078112 kB
SwapCached:      15140 kB
Active:        1121676 kB
Inactive:      5288500 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26277364 kB
SwapTotal:    67111528 kB
SwapFree:     60688864 kB
Dirty:            4320 kB
Writeback:          56 kB
AnonPages:     3050372 kB
Mapped:          18796 kB
Slab:           144128 kB
PageTables:      50288 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 109201900 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73572 MiB
End job on node132 at 2011-06-01 12:35:31