Trace number 3438441

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40000.7 5011.65

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2640c305320gyes2.cnf
MD5SUMa931e6258afb576eab04f38421c07518
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2640
Number of clauses305320
Sum of the clauses size613120
Maximum clause length33
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2305240
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 580

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3438441-1306917020/watcher-3438441-1306917020 -o /tmp/evaluation-result-3438441-1306917020/solver-3438441-1306917020 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3438441-1306917020.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.09 8.06 7.61 2/507 22707
/proc/meminfo: memFree=19810404/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=26868 CPUtime=0.01 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 1057 0 0 0 1 0 0 0 25 0 1 0 881932760 27512832 602 33554432000 4194304 4625164 140735640435616 18446744073709551615 215988592384 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/22707/statm: 6717 602 296 106 0 2220 0

[startup+0.113776 s]
/proc/loadavg: 8.09 8.06 7.61 2/507 22707
/proc/meminfo: memFree=19810404/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=399404 CPUtime=0.26 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 12233 0 0 0 25 1 0 0 25 0 8 0 881932760 408989696 9855 33554432000 4194304 4625164 140735640435616 18446744073709551615 4390435 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/22707/statm: 99851 9855 340 106 0 95354 0
Current children cumulated CPU time (s) 0.26
Current children cumulated vsize (KiB) 399404

[startup+0.200762 s]
/proc/loadavg: 8.09 8.06 7.61 2/507 22707
/proc/meminfo: memFree=19810404/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=475960 CPUtime=0.93 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 21680 0 0 0 91 2 0 0 25 0 8 0 881932760 487383040 16182 33554432000 4194304 4625164 140735640435616 18446744073709551615 4381778 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 118990 16185 348 106 0 114493 0
Current children cumulated CPU time (s) 0.93
Current children cumulated vsize (KiB) 475960

[startup+0.307137 s]
/proc/loadavg: 8.09 8.06 7.61 2/507 22707
/proc/meminfo: memFree=19810404/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=555136 CPUtime=3.04 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) S 22705 22707 22379 0 -1 4202496 42104 0 0 0 299 5 0 0 18 0 8 0 881932760 568459264 29273 33554432000 4194304 4625164 140735640435616 18446744073709551615 215988697582 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 138784 29289 385 106 0 134287 0
Current children cumulated CPU time (s) 3.04
Current children cumulated vsize (KiB) 555136

[startup+0.761998 s]
/proc/loadavg: 8.09 8.06 7.61 2/507 22707
/proc/meminfo: memFree=19810404/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=559160 CPUtime=9.97 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 50590 0 0 0 989 8 0 0 19 0 8 0 881932760 572579840 34491 33554432000 4194304 4625164 140735640435616 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 139790 34491 382 106 0 135293 0
Current children cumulated CPU time (s) 9.97
Current children cumulated vsize (KiB) 559160

[startup+1.53353 s]
/proc/loadavg: 8.09 8.06 7.61 2/507 22707
/proc/meminfo: memFree=19810404/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=572728 CPUtime=11.57 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 56785 0 0 0 1148 9 0 0 19 0 8 0 881932760 586473472 36197 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 143182 36197 382 106 0 138685 0
Current children cumulated CPU time (s) 11.57
Current children cumulated vsize (KiB) 572728

[startup+3.10126 s]
/proc/loadavg: 8.08 8.06 7.61 9/515 22715
/proc/meminfo: memFree=19613740/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=574208 CPUtime=24.2 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 74446 0 0 0 2406 14 0 0 22 0 8 0 881932760 587988992 48670 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 143552 48670 356 106 0 139055 0
[pid=22707/tid=22709] ppid=22705 vsize=574208 CPUtime=3.02 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 6791 0 0 0 301 1 0 0 22 0 8 0 881932769 587988992 48678 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=574208 CPUtime=3.02 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 5018 0 0 0 301 1 0 0 19 0 8 0 881932769 587988992 48678 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=574208 CPUtime=3.02 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 8362 0 0 0 301 1 0 0 25 0 8 0 881932769 587988992 48678 33554432000 4194304 4625164 140735640435616 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=574208 CPUtime=3.02 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 6222 0 0 0 301 1 0 0 21 0 8 0 881932769 587988992 48678 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=574208 CPUtime=3 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 4063 0 0 0 300 0 0 0 25 0 8 0 881932769 587988992 48678 33554432000 4194304 4625164 140735640435616 18446744073709551615 215988259771 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=574208 CPUtime=3.02 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 5765 0 0 0 301 1 0 0 25 0 8 0 881932769 587988992 48678 33554432000 4194304 4625164 140735640435616 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=574208 CPUtime=3.02 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 3995 0 0 0 301 1 0 0 23 0 8 0 881932769 587988992 48678 33554432000 4194304 4625164 140735640435616 18446744073709551615 215988253729 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.2
Current children cumulated vsize (KiB) 574208

[startup+6.3007 s]
/proc/loadavg: 8.08 8.06 7.61 9/515 22715
/proc/meminfo: memFree=19551748/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=598004 CPUtime=49.63 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 113449 0 0 0 4944 19 0 0 25 0 8 0 881932760 612356096 68603 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 149501 68604 376 106 0 145004 0
[pid=22707/tid=22709] ppid=22705 vsize=598004 CPUtime=6.21 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 9545 0 0 0 619 2 0 0 25 0 8 0 881932769 612356096 68604 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=598004 CPUtime=6.2 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 5535 0 0 0 619 1 0 0 25 0 8 0 881932769 612356096 68605 33554432000 4194304 4625164 140735640435616 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=598004 CPUtime=6.19 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 22265 0 0 0 617 2 0 0 25 0 8 0 881932769 612356096 68605 33554432000 4194304 4625164 140735640435616 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=598004 CPUtime=6.2 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 9054 0 0 0 618 2 0 0 25 0 8 0 881932769 612356096 68605 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351909 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=598004 CPUtime=6.18 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 8344 0 0 0 617 1 0 0 25 0 8 0 881932769 612356096 68606 33554432000 4194304 4625164 140735640435616 18446744073709551615 4319070 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=598004 CPUtime=6.2 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 8528 0 0 0 619 1 0 0 25 0 8 0 881932769 612356096 68606 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=598004 CPUtime=6.2 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 5770 0 0 0 619 1 0 0 25 0 8 0 881932769 612356096 68607 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 49.63
Current children cumulated vsize (KiB) 598004

[startup+12.7006 s]
/proc/loadavg: 8.07 8.06 7.61 9/515 22716
/proc/meminfo: memFree=19460864/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=679488 CPUtime=100.72 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 162575 0 0 0 10043 29 0 0 25 0 8 0 881932760 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 169872 90891 458 106 0 165375 0
[pid=22707/tid=22709] ppid=22705 vsize=679488 CPUtime=12.6 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 14519 0 0 0 1258 2 0 0 25 0 8 0 881932769 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=679488 CPUtime=12.6 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 8527 0 0 0 1258 2 0 0 25 0 8 0 881932769 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4339541 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=679488 CPUtime=12.59 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 47000 0 0 0 1252 7 0 0 25 0 8 0 881932769 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=679488 CPUtime=12.59 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 10137 0 0 0 1257 2 0 0 25 0 8 0 881932769 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=679488 CPUtime=12.58 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 10290 0 0 0 1257 1 0 0 25 0 8 0 881932769 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4349325 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=679488 CPUtime=12.6 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 13697 0 0 0 1258 2 0 0 25 0 8 0 881932769 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=679488 CPUtime=12.6 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 8198 0 0 0 1258 2 0 0 25 0 8 0 881932769 695795712 90891 33554432000 4194304 4625164 140735640435616 18446744073709551615 4288793 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 100.72
Current children cumulated vsize (KiB) 679488

[startup+25.5003 s]
/proc/loadavg: 8.06 8.06 7.62 9/515 22716
/proc/meminfo: memFree=19336268/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=773228 CPUtime=202.87 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 261436 0 0 0 20243 44 0 0 25 0 8 0 881932760 791785472 119462 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 193307 119462 494 106 0 188810 0
[pid=22707/tid=22709] ppid=22705 vsize=773228 CPUtime=25.4 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 20993 0 0 0 2537 3 0 0 25 0 8 0 881932769 791785472 119462 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=773228 CPUtime=25.4 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 9731 0 0 0 2538 2 0 0 25 0 8 0 881932769 791785472 119462 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=773228 CPUtime=25.39 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 107523 0 0 0 2524 15 0 0 25 0 8 0 881932769 791785472 119462 33554432000 4194304 4625164 140735640435616 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=773228 CPUtime=25.38 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 10368 0 0 0 2536 2 0 0 25 0 8 0 881932769 791785472 119463 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=773228 CPUtime=25.38 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 15129 0 0 0 2536 2 0 0 25 0 8 0 881932769 791785472 119463 33554432000 4194304 4625164 140735640435616 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=773228 CPUtime=25.4 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 20229 0 0 0 2536 4 0 0 25 0 8 0 881932769 791785472 119463 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=773228 CPUtime=25.4 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 9822 0 0 0 2538 2 0 0 25 0 8 0 881932769 791785472 119463 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351820 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 202.87
Current children cumulated vsize (KiB) 773228

[startup+51.1009 s]
/proc/loadavg: 8.10 8.07 7.64 9/515 22717
/proc/meminfo: memFree=19192400/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=947360 CPUtime=407.24 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 428529 0 0 0 40647 77 0 0 25 0 8 0 881932760 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 236840 155313 395 106 0 232343 0
[pid=22707/tid=22709] ppid=22705 vsize=947360 CPUtime=51.01 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 24536 0 0 0 5096 5 0 0 25 0 8 0 881932769 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=947360 CPUtime=51 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 11018 0 0 0 5097 3 0 0 25 0 8 0 881932769 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=947360 CPUtime=50.99 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 218000 0 0 0 5067 32 0 0 25 0 8 0 881932769 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=947360 CPUtime=50.99 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 18175 0 0 0 5095 4 0 0 25 0 8 0 881932769 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=947360 CPUtime=50.97 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 21909 0 0 0 5094 3 0 0 25 0 8 0 881932769 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4348903 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=947360 CPUtime=51 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 30290 0 0 0 5093 7 0 0 25 0 8 0 881932769 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=947360 CPUtime=51 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 14970 0 0 0 5095 5 0 0 25 0 8 0 881932769 970096640 155313 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 407.24
Current children cumulated vsize (KiB) 947360

[startup+102.301 s]
/proc/loadavg: 8.04 8.06 7.65 9/515 22718
/proc/meminfo: memFree=18964860/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=1258664 CPUtime=815.94 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 845566 0 0 0 81447 147 0 0 25 0 8 0 881932760 1288871936 211205 33554432000 4194304 4625164 140735640435616 18446744073709551615 4512015 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 314666 211205 400 106 0 310169 0
[pid=22707/tid=22709] ppid=22705 vsize=1258664 CPUtime=102.2 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 34827 0 0 0 10213 7 0 0 25 0 8 0 881932769 1288871936 211205 33554432000 4194304 4625164 140735640435616 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=1258664 CPUtime=102.2 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 19029 0 0 0 10215 5 0 0 25 0 8 0 881932769 1288871936 211205 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=1258664 CPUtime=102.2 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 564318 0 0 0 10136 84 0 0 25 0 8 0 881932769 1288871936 211205 33554432000 4194304 4625164 140735640435616 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 6 0 0 0

################
# More data... #
################

[pid=22707/tid=22711] ppid=22705 vsize=4845144 CPUtime=4662.2 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 30495887 0 0 0 461297 4923 0 0 25 0 8 0 881932769 4961427456 987187 33554432000 4194304 4625164 140735640435616 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=4845144 CPUtime=4661.01 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 132178 0 0 0 466067 34 0 0 25 0 8 0 881932769 4961427456 987187 33554432000 4194304 4625164 140735640435616 18446744073709551615 4488027 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=4845144 CPUtime=4662.25 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 137006 0 0 0 466191 34 0 0 25 0 8 0 881932769 4961427456 987188 33554432000 4194304 4625164 140735640435616 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=4845144 CPUtime=4662.14 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 178999 0 0 0 466169 45 0 0 25 0 8 0 881932769 4961427456 987188 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=4845144 CPUtime=4662.26 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 110136 0 0 0 466150 76 0 0 25 0 8 0 881932769 4961427456 987188 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37213.5
Current children cumulated vsize (KiB) 4845144

[startup+4722.3 s]
/proc/loadavg: 8.05 8.10 8.04 9/515 22861
/proc/meminfo: memFree=15832712/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=4846224 CPUtime=37692.4 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 32382373 0 0 0 3763647 5598 0 0 25 0 8 0 881932760 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 1211556 992452 349 106 0 1207059 0
[pid=22707/tid=22709] ppid=22705 vsize=4846224 CPUtime=4722.31 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 133953 0 0 0 472199 32 0 0 25 0 8 0 881932769 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=4846224 CPUtime=4722.21 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 262737 0 0 0 471954 267 0 0 25 0 8 0 881932769 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=4846224 CPUtime=4722.19 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 30797183 0 0 0 467240 4979 0 0 25 0 8 0 881932769 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=4846224 CPUtime=4720.99 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 132361 0 0 0 472065 34 0 0 25 0 8 0 881932769 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=4846224 CPUtime=4722.25 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 137215 0 0 0 472191 34 0 0 25 0 8 0 881932769 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=4846224 CPUtime=4722.14 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 179181 0 0 0 472169 45 0 0 25 0 8 0 881932769 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=4846224 CPUtime=4722.26 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 110288 0 0 0 472150 76 0 0 25 0 8 0 881932769 4962533376 992452 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37692.4
Current children cumulated vsize (KiB) 4846224

[startup+4782.3 s]
/proc/loadavg: 8.06 8.10 8.04 9/515 22863
/proc/meminfo: memFree=15793972/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=4918040 CPUtime=38171.4 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 32521058 0 0 0 3811516 5624 0 0 25 0 8 0 881932760 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 1229510 1002974 349 106 0 1225013 0
[pid=22707/tid=22709] ppid=22705 vsize=4918040 CPUtime=4782.31 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 134041 0 0 0 478199 32 0 0 25 0 8 0 881932769 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=4918040 CPUtime=4782.21 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 263753 0 0 0 477953 268 0 0 25 0 8 0 881932769 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=4918040 CPUtime=4782.2 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 30924257 0 0 0 473221 4999 0 0 25 0 8 0 881932769 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=4918040 CPUtime=4780.99 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 132547 0 0 0 478064 35 0 0 25 0 8 0 881932769 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=4918040 CPUtime=4782.25 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 137390 0 0 0 478191 34 0 0 25 0 8 0 881932769 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=4918040 CPUtime=4782.14 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 179305 0 0 0 478169 45 0 0 25 0 8 0 881932769 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=4918040 CPUtime=4782.27 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 112486 0 0 0 478148 79 0 0 25 0 8 0 881932769 5036072960 1002974 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38171.4
Current children cumulated vsize (KiB) 4918040

[startup+4842.3 s]
/proc/loadavg: 8.06 8.09 8.04 9/515 22864
/proc/meminfo: memFree=15764668/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=4918040 CPUtime=38650.3 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 32918010 0 0 0 3859331 5701 0 0 25 0 8 0 881932760 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 1229510 1011672 349 106 0 1225013 0
[pid=22707/tid=22709] ppid=22705 vsize=4918040 CPUtime=4842.31 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 134202 0 0 0 484199 32 0 0 25 0 8 0 881932769 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=4918040 CPUtime=4842.21 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 266678 0 0 0 483949 272 0 0 25 0 8 0 881932769 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=4918040 CPUtime=4842.2 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 31312789 0 0 0 479151 5069 0 0 25 0 8 0 881932769 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=4918040 CPUtime=4840.96 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 132754 0 0 0 484061 35 0 0 25 0 8 0 881932769 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=4918040 CPUtime=4842.25 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 137554 0 0 0 484191 34 0 0 25 0 8 0 881932769 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=4918040 CPUtime=4842.13 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 179679 0 0 0 484168 45 0 0 25 0 8 0 881932769 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=4918040 CPUtime=4842.27 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 112969 0 0 0 484148 79 0 0 25 0 8 0 881932769 5036072960 1011672 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 38650.3
Current children cumulated vsize (KiB) 4918040

[startup+4902.3 s]
/proc/loadavg: 8.02 8.07 8.03 9/515 22866
/proc/meminfo: memFree=15740056/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=4918040 CPUtime=39129.3 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 33298301 0 0 0 3907162 5764 0 0 25 0 8 0 881932760 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 1229510 1015121 349 106 0 1225013 0
[pid=22707/tid=22709] ppid=22705 vsize=4918040 CPUtime=4902.31 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 134323 0 0 0 490199 32 0 0 25 0 8 0 881932769 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=4918040 CPUtime=4902.22 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 266862 0 0 0 489949 273 0 0 25 0 8 0 881932769 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=4918040 CPUtime=4902.2 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 31688979 0 0 0 485089 5131 0 0 25 0 8 0 881932769 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=4918040 CPUtime=4900.95 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 132885 0 0 0 490060 35 0 0 25 0 8 0 881932769 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=4918040 CPUtime=4902.25 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 137690 0 0 0 490191 34 0 0 25 0 8 0 881932769 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=4918040 CPUtime=4902.13 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 179996 0 0 0 490168 45 0 0 25 0 8 0 881932769 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=4918040 CPUtime=4902.27 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 113008 0 0 0 490148 79 0 0 25 0 8 0 881932769 5036072960 1015121 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39129.3
Current children cumulated vsize (KiB) 4918040

[startup+4962.3 s]
/proc/loadavg: 8.04 8.07 8.03 9/515 22868
/proc/meminfo: memFree=15711608/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=4918040 CPUtime=39608.2 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 33635989 0 0 0 3954994 5825 0 0 25 0 8 0 881932760 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/22707/statm: 1229510 1022831 349 106 0 1225013 0
[pid=22707/tid=22709] ppid=22705 vsize=4918040 CPUtime=4962.31 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 134551 0 0 0 496199 32 0 0 25 0 8 0 881932769 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=4918040 CPUtime=4962.22 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 266864 0 0 0 495949 273 0 0 25 0 8 0 881932769 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=4918040 CPUtime=4962.2 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 32021366 0 0 0 491030 5190 0 0 25 0 8 0 881932769 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=4918040 CPUtime=4960.94 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 133052 0 0 0 496059 35 0 0 25 0 8 0 881932769 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=4918040 CPUtime=4962.26 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 137846 0 0 0 496191 35 0 0 25 0 8 0 881932769 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4460412 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=4918040 CPUtime=4962.13 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 180342 0 0 0 496168 45 0 0 25 0 8 0 881932769 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=4918040 CPUtime=4962.27 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 113041 0 0 0 496148 79 0 0 25 0 8 0 881932769 5036072960 1022831 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 39608.2
Current children cumulated vsize (KiB) 4918040



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.4 s]
/proc/loadavg: 8.09 8.09 8.04 10/515 22869
/proc/meminfo: memFree=15674492/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=4918040 CPUtime=40000.4 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) R 22705 22707 22379 0 -1 4202496 33908047 0 0 0 3994160 5876 0 0 25 0 8 0 881932760 5036072960 1032057 33554432000 4194304 4625164 140735640435616 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22707/statm: 1229510 1032057 349 106 0 1225013 0
[pid=22707/tid=22709] ppid=22705 vsize=4918040 CPUtime=5011.45 cores=0-7
/proc/22707/task/22709/stat : 22709 (SArTagnan) R 22705 22707 22379 0 -1 4202560 134676 0 0 0 501113 32 0 0 25 0 8 0 881932769 5036072960 1032058 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=22707/tid=22710] ppid=22705 vsize=4918040 CPUtime=5011.36 cores=0-7
/proc/22707/task/22710/stat : 22710 (SArTagnan) R 22705 22707 22379 0 -1 4202560 271301 0 0 0 500855 281 0 0 25 0 8 0 881932769 5036072960 1032058 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=4918040 CPUtime=5010.79 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4202560 32285047 0 0 0 495848 5231 0 0 25 0 8 0 881932769 5036072960 1032058 33554432000 4194304 4625164 140735640435616 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=22707/tid=22712] ppid=22705 vsize=4918040 CPUtime=5010.05 cores=0-7
/proc/22707/task/22712/stat : 22712 (SArTagnan) R 22705 22707 22379 0 -1 4202560 133173 0 0 0 500970 35 0 0 25 0 8 0 881932769 5036072960 1032058 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331104 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=22707/tid=22713] ppid=22705 vsize=4918040 CPUtime=5011.4 cores=0-7
/proc/22707/task/22713/stat : 22713 (SArTagnan) R 22705 22707 22379 0 -1 4202560 137965 0 0 0 501105 35 0 0 25 0 8 0 881932769 5036072960 1032058 33554432000 4194304 4625164 140735640435616 18446744073709551615 4329981 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=22707/tid=22714] ppid=22705 vsize=4918040 CPUtime=5011.26 cores=0-7
/proc/22707/task/22714/stat : 22714 (SArTagnan) R 22705 22707 22379 0 -1 4202560 180414 0 0 0 501081 45 0 0 25 0 8 0 881932769 5036072960 1032058 33554432000 4194304 4625164 140735640435616 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=22707/tid=22715] ppid=22705 vsize=4918040 CPUtime=5011.41 cores=0-7
/proc/22707/task/22715/stat : 22715 (SArTagnan) R 22705 22707 22379 0 -1 4202560 113060 0 0 0 501062 79 0 0 25 0 8 0 881932769 5036072960 1032058 33554432000 4194304 4625164 140735640435616 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.4
Current children cumulated vsize (KiB) 4918040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.6 s]
/proc/loadavg: 8.09 8.09 8.04 10/515 22869
/proc/meminfo: memFree=15674492/32950940 swapFree=67111364/67111528
[pid=22707] ppid=22705 vsize=0 CPUtime=40000.6 cores=0-7
/proc/22707/stat : 22707 (SArTagnan) Z 22705 22707 22379 0 -1 4203548 33908092 0 0 0 3994168 5892 0 0 25 0 2 0 881932760 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/22707/statm: 0 0 0 0 0 0 0
[pid=22707/tid=22711] ppid=22705 vsize=0 CPUtime=5010.95 cores=0-7
/proc/22707/task/22711/stat : 22711 (SArTagnan) R 22705 22707 22379 0 -1 4203588 32285091 0 0 0 495848 5247 0 0 25 0 2 0 881932769 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.65
CPU time (s): 40000.7
CPU user time (s): 39941.7
CPU system time (s): 58.972
CPU usage (%): 798.154
Max. virtual memory (cumulated for all children) (KiB): 5169832

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39941.7
system time used= 58.972
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 33908092
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9587
involuntary context switches= 169272

runsolver used 22.3776 second user time and 65.3621 second system time

The end

Launcher Data 

Begin job on node117 at 2011-06-01 10:30:20
IDJOB=3438441
IDBENCH=71345
IDSOLVER=1936
FILE ID=node117/3438441-1306917020
RUNJOBID= node117-1306914555-22393
PBS_JOBID= 13488510
Free space on /tmp= 73624 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2640c305320gyes2.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3438441-1306917020/watcher-3438441-1306917020 -o /tmp/evaluation-result-3438441-1306917020/solver-3438441-1306917020 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3438441-1306917020.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= a931e6258afb576eab04f38421c07518
RANDOM SEED=444692148

node117.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.849
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5267.44
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950940 kB
MemFree:      19810808 kB
Buffers:        313248 kB
Cached:        2662464 kB
SwapCached:          0 kB
Active:        9974236 kB
Inactive:      2786528 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950940 kB
LowFree:      19810808 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:            4376 kB
Writeback:           0 kB
AnonPages:     9784984 kB
Mapped:          41380 kB
Slab:           251220 kB
PageTables:      57592 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586996 kB
Committed_AS: 149467808 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73624 MiB
End job on node117 at 2011-06-01 11:53:53