Trace number 3386366

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4076 1300.09

General information on the benchmark

NameSAT03/industrial/kukula/addm_bench/
am_7_7.shuffled-as.sat03-363.cnf
MD5SUMc7f51e1ee7556440ab29e1c4bfe29538
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables4264
Number of clauses14751
Sum of the clauses size40035
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 24214
Number of clauses of size 310535
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386366-1305582650/watcher-3386366-1305582650 -o /tmp/evaluation-result-3386366-1305582650/solver-3386366-1305582650 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386366-1305582650.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.08 9.07 8.83 7/398 26823
/proc/meminfo: memFree=22388940/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=53944 CPUtime=0.01 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 1598 0 0 0 1 0 0 0 25 0 4 0 669863136 55238656 1347 33554432000 4194304 4625164 140733531727824 18446744073709551615 47169510016940 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 13486 1347 304 106 0 8989 0
[pid=26823/tid=26824] ppid=26821 vsize=53944 CPUtime=0 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669863138 55238656 1347 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335948785 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=53944 CPUtime=0 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669863138 55238656 1347 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335948785 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=53944 CPUtime=0 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669863138 55238656 1347 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335948785 0 0 4096 2 0 0 0 -1 2 0 0 0

[startup+0.0916461 s]
/proc/loadavg: 9.08 9.07 8.83 7/398 26823
/proc/meminfo: memFree=22388940/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=185816 CPUtime=0.15 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) D 26821 26823 25968 0 -1 4202496 1873 0 0 0 15 0 0 0 25 0 4 0 669863136 190275584 1622 33554432000 4194304 4625164 140733531727824 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/26823/statm: 46454 1622 329 106 0 41957 0
[pid=26823/tid=26824] ppid=26821 vsize=185816 CPUtime=0.06 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 87 0 0 0 6 0 0 0 25 0 4 0 669863138 190275584 1622 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335935671 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=185816 CPUtime=0.01 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 119 0 0 0 1 0 0 0 25 0 4 0 669863138 190275584 1622 33554432000 4194304 4625164 140733531727824 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=185816 CPUtime=0.05 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 50 0 0 0 5 0 0 0 25 0 4 0 669863138 190275584 1622 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351632 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 185816

[startup+0.149512 s]
/proc/loadavg: 9.08 9.07 8.83 7/398 26823
/proc/meminfo: memFree=22388940/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=252880 CPUtime=0.31 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 2642 0 0 0 31 0 0 0 25 0 4 0 669863136 258949120 2154 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335559642 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 63220 2155 342 106 0 58723 0
[pid=26823/tid=26824] ppid=26821 vsize=252880 CPUtime=0.11 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 281 0 0 0 11 0 0 0 25 0 4 0 669863138 258949120 2155 33554432000 4194304 4625164 140733531727824 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=252880 CPUtime=0.01 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 122 0 0 0 1 0 0 0 25 0 4 0 669863138 258949120 2155 33554432000 4194304 4625164 140733531727824 18446744073709551615 4353008 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=252880 CPUtime=0.11 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 210 0 0 0 11 0 0 0 25 0 4 0 669863138 258949120 2155 33554432000 4194304 4625164 140733531727824 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 0.31
Current children cumulated vsize (KiB) 252880

[startup+0.300487 s]
/proc/loadavg: 9.08 9.07 8.83 7/398 26823
/proc/meminfo: memFree=22388940/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=253528 CPUtime=0.76 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 3359 0 0 0 76 0 0 0 18 0 4 0 669863136 259612672 2524 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335548315 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 63382 2524 346 106 0 58885 0
[pid=26823/tid=26824] ppid=26821 vsize=253528 CPUtime=0.14 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 318 0 0 0 14 0 0 0 25 0 4 0 669863138 259612672 2524 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335997422 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=253528 CPUtime=0.14 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 327 0 0 0 14 0 0 0 25 0 4 0 669863138 259612672 2524 33554432000 4194304 4625164 140733531727824 18446744073709551615 4462955 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=253528 CPUtime=0.25 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 385 0 0 0 25 0 0 0 25 0 4 0 669863138 259612672 2524 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 0.76
Current children cumulated vsize (KiB) 253528

[startup+0.700416 s]
/proc/loadavg: 9.08 9.07 8.83 7/398 26823
/proc/meminfo: memFree=22388940/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=254972 CPUtime=1.97 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 4844 0 0 0 196 1 0 0 18 0 4 0 669863136 261091328 3164 33554432000 4194304 4625164 140733531727824 18446744073709551615 4511906 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 63743 3164 346 106 0 59246 0
[pid=26823/tid=26824] ppid=26821 vsize=254972 CPUtime=0.29 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 508 0 0 0 29 0 0 0 25 0 4 0 669863138 261091328 3164 33554432000 4194304 4625164 140733531727824 18446744073709551615 4334228 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=254972 CPUtime=0.54 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 797 0 0 0 54 0 0 0 25 0 4 0 669863138 261091328 3164 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=254972 CPUtime=0.5 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1002 0 0 0 50 0 0 0 25 0 4 0 669863138 261091328 3164 33554432000 4194304 4625164 140733531727824 18446744073709551615 4490174 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1.97
Current children cumulated vsize (KiB) 254972

[startup+1.50027 s]
/proc/loadavg: 9.08 9.07 8.83 12/402 26827
/proc/meminfo: memFree=22369316/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=256024 CPUtime=4.35 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 7577 0 0 0 433 2 0 0 19 0 4 0 669863136 262168576 4664 33554432000 4194304 4625164 140733531727824 18446744073709551615 4511892 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 64006 4664 346 106 0 59509 0
[pid=26823/tid=26824] ppid=26821 vsize=256024 CPUtime=0.74 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1148 0 0 0 74 0 0 0 25 0 4 0 669863138 262168576 4664 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352562 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=256024 CPUtime=1.15 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1596 0 0 0 115 0 0 0 25 0 4 0 669863138 262168576 4665 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335553569 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=256024 CPUtime=1.02 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1971 0 0 0 102 0 0 0 25 0 4 0 669863138 262168576 4665 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.35
Current children cumulated vsize (KiB) 256024

[startup+3.10099 s]
/proc/loadavg: 9.07 9.07 8.83 10/402 26827
/proc/meminfo: memFree=22352948/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=263224 CPUtime=9.12 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 12524 0 0 0 909 3 0 0 22 0 4 0 669863136 269541376 7866 33554432000 4194304 4625164 140733531727824 18446744073709551615 4508743 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 65806 7866 347 106 0 61309 0
[pid=26823/tid=26824] ppid=26821 vsize=263224 CPUtime=1.49 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1979 0 0 0 149 0 0 0 25 0 4 0 669863138 269541376 7866 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=263224 CPUtime=2.64 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 3700 0 0 0 264 0 0 0 25 0 4 0 669863138 269541376 7866 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335559570 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=263224 CPUtime=2.34 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 3243 0 0 0 234 0 0 0 25 0 4 0 669863138 269541376 7866 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.12
Current children cumulated vsize (KiB) 263224

[startup+6.30042 s]
/proc/loadavg: 9.07 9.07 8.83 10/402 26827
/proc/meminfo: memFree=22317828/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=267624 CPUtime=18.67 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 20528 0 0 0 1861 6 0 0 25 0 4 0 669863136 274046976 12400 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 66906 12400 347 106 0 62409 0
[pid=26823/tid=26824] ppid=26821 vsize=267624 CPUtime=3.14 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 3433 0 0 0 313 1 0 0 25 0 4 0 669863138 274046976 12400 33554432000 4194304 4625164 140733531727824 18446744073709551615 4353022 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=267624 CPUtime=4.43 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 5408 0 0 0 442 1 0 0 25 0 4 0 669863138 274046976 12400 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=267624 CPUtime=5.5 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 7134 0 0 0 549 1 0 0 25 0 4 0 669863138 274046976 12400 33554432000 4194304 4625164 140733531727824 18446744073709551615 4339600 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 18.67
Current children cumulated vsize (KiB) 267624

[startup+12.7003 s]
/proc/loadavg: 9.21 9.10 8.84 10/402 26828
/proc/meminfo: memFree=22251624/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=278396 CPUtime=37.79 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 39822 0 0 0 3769 10 0 0 25 0 4 0 669863136 285077504 18880 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512159 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/26823/statm: 69599 18880 378 106 0 65102 0
[pid=26823/tid=26824] ppid=26821 vsize=278396 CPUtime=6.33 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 6862 0 0 0 632 1 0 0 25 0 4 0 669863138 285077504 18880 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=278396 CPUtime=7.63 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 7702 0 0 0 761 2 0 0 25 0 4 0 669863138 285077504 18880 33554432000 4194304 4625164 140733531727824 18446744073709551615 4465169 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=278396 CPUtime=11.82 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 19797 0 0 0 1178 4 0 0 25 0 4 0 669863138 285077504 18880 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 37.79
Current children cumulated vsize (KiB) 278396

[startup+25.501 s]
/proc/loadavg: 9.17 9.10 8.84 10/402 26828
/proc/meminfo: memFree=22152164/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=296152 CPUtime=75.99 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 73177 0 0 0 7581 18 0 0 25 0 4 0 669863136 303259648 26948 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 74038 26948 351 106 0 69541 0
[pid=26823/tid=26824] ppid=26821 vsize=296152 CPUtime=14.09 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 10692 0 0 0 1406 3 0 0 25 0 4 0 669863138 303259648 26948 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=296152 CPUtime=13.67 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 11513 0 0 0 1363 4 0 0 25 0 4 0 669863138 303259648 26948 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=296152 CPUtime=23.79 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 44267 0 0 0 2371 8 0 0 25 0 4 0 669863138 303259648 26948 33554432000 4194304 4625164 140733531727824 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 75.99
Current children cumulated vsize (KiB) 296152

[startup+51.1005 s]
/proc/loadavg: 9.18 9.11 8.85 10/402 26829
/proc/meminfo: memFree=22023912/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=330356 CPUtime=152.45 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 126385 0 0 0 15217 28 0 0 25 0 4 0 669863136 338284544 41647 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 82589 41647 411 106 0 78092 0
[pid=26823/tid=26824] ppid=26821 vsize=330356 CPUtime=35.63 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 21973 0 0 0 3556 7 0 0 25 0 4 0 669863138 338284544 41647 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352208 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=330356 CPUtime=30.31 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 17286 0 0 0 3026 5 0 0 25 0 4 0 669863138 338284544 41647 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352393 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=330356 CPUtime=36.82 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 75147 0 0 0 3670 12 0 0 25 0 4 0 669863138 338284544 41647 33554432000 4194304 4625164 140733531727824 18446744073709551615 4547847 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 152.45
Current children cumulated vsize (KiB) 330356

[startup+102.315 s]
/proc/loadavg: 9.16 9.12 8.87 10/402 26830
/proc/meminfo: memFree=21756544/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=442620 CPUtime=305.43 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 266227 0 0 0 30490 53 0 0 25 0 4 0 669863136 453242880 75834 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512021 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 110655 75860 1099 106 0 106158 0
[pid=26823/tid=26824] ppid=26821 vsize=442620 CPUtime=81.76 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 27853 0 0 0 8166 10 0 0 25 0 4 0 669863138 453242880 75873 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=442620 CPUtime=59.71 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 26108 0 0 0 5963 8 0 0 25 0 4 0 669863138 453242880 75888 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=442620 CPUtime=82.7 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 179084 0 0 0 8242 28 0 0 25 0 4 0 669863138 453242880 75900 33554432000 4194304 4625164 140733531727824 18446744073709551615 232335589773 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 305.43
Current children cumulated vsize (KiB) 442620

[startup+162.301 s]

################
# More data... #
################

[pid=26823] ppid=26821 vsize=1376996 CPUtime=2097.7 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 1718156 0 0 0 209457 313 0 0 25 0 4 0 669863136 1410043904 279598 33554432000 4194304 4625164 140733531727824 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 344249 279598 347 106 0 339752 0
[pid=26823/tid=26824] ppid=26821 vsize=1376996 CPUtime=600.44 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 97041 0 0 0 60013 31 0 0 25 0 4 0 669863138 1410043904 279598 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1376996 CPUtime=402.36 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 91233 0 0 0 40196 40 0 0 25 0 4 0 669863138 1410043904 279598 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1376996 CPUtime=520.79 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1253411 0 0 0 51882 197 0 0 25 0 4 0 669863138 1410043904 279598 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2097.7
Current children cumulated vsize (KiB) 1376996

[startup+762.315 s]
/proc/loadavg: 9.26 9.24 9.05 10/402 26857
/proc/meminfo: memFree=20384844/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1376996 CPUtime=2277.63 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 1904984 0 0 0 227415 348 0 0 25 0 4 0 669863136 1410043904 289407 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 344249 289407 347 106 0 339752 0
[pid=26823/tid=26824] ppid=26821 vsize=1376996 CPUtime=649.04 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 97574 0 0 0 64873 31 0 0 25 0 4 0 669863138 1410043904 289407 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1376996 CPUtime=437.98 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 93951 0 0 0 43756 42 0 0 25 0 4 0 669863138 1410043904 289407 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1376996 CPUtime=558.02 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1431565 0 0 0 55574 228 0 0 25 0 4 0 669863138 1410043904 289407 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2277.63
Current children cumulated vsize (KiB) 1376996

[startup+822.301 s]
/proc/loadavg: 9.23 9.23 9.06 10/402 26860
/proc/meminfo: memFree=20278428/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1589672 CPUtime=2456.8 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 2157626 0 0 0 245291 389 0 0 25 0 4 0 669863136 1627824128 308236 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 397418 308236 348 106 0 392921 0
[pid=26823/tid=26824] ppid=26821 vsize=1589672 CPUtime=707.43 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 123370 0 0 0 70709 34 0 0 25 0 4 0 669863138 1627824128 308236 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1589672 CPUtime=467.78 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 96454 0 0 0 46733 45 0 0 25 0 4 0 669863138 1627824128 308236 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1589672 CPUtime=589.22 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1597800 0 0 0 58666 256 0 0 25 0 4 0 669863138 1627824128 308236 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2456.8
Current children cumulated vsize (KiB) 1589672

[startup+882.301 s]
/proc/loadavg: 9.39 9.30 9.09 10/402 26863
/proc/meminfo: memFree=20214408/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1631812 CPUtime=2636.03 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 2324801 0 0 0 263185 418 0 0 25 0 4 0 669863136 1670975488 320875 33554432000 4194304 4625164 140733531727824 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 407953 320875 348 106 0 403456 0
[pid=26823/tid=26824] ppid=26821 vsize=1631812 CPUtime=767.43 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 129049 0 0 0 76707 36 0 0 25 0 4 0 669863138 1670975488 320875 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1631812 CPUtime=497.4 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 98216 0 0 0 49693 47 0 0 25 0 4 0 669863138 1670975488 320875 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1631812 CPUtime=618.81 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1754846 0 0 0 61601 280 0 0 25 0 4 0 669863138 1670975488 320875 33554432000 4194304 4625164 140733531727824 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2636.03
Current children cumulated vsize (KiB) 1631812

[startup+942.3 s]
/proc/loadavg: 9.27 9.29 9.10 10/402 26864
/proc/meminfo: memFree=20174076/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1695700 CPUtime=2815.26 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 2526444 0 0 0 281075 451 0 0 25 0 4 0 669863136 1736396800 330268 33554432000 4194304 4625164 140733531727824 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 423925 330268 348 106 0 419428 0
[pid=26823/tid=26824] ppid=26821 vsize=1695700 CPUtime=827.43 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 129521 0 0 0 82707 36 0 0 25 0 4 0 669863138 1736396800 330268 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1695700 CPUtime=527.03 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 99961 0 0 0 52653 50 0 0 25 0 4 0 669863138 1736396800 330268 33554432000 4194304 4625164 140733531727824 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1695700 CPUtime=648.4 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 1916664 0 0 0 64536 304 0 0 25 0 4 0 669863138 1736396800 330268 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2815.26
Current children cumulated vsize (KiB) 1695700

[startup+1002.3 s]
/proc/loadavg: 9.31 9.31 9.11 10/402 26866
/proc/meminfo: memFree=20117748/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1761236 CPUtime=2994.49 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 2720376 0 0 0 298965 484 0 0 25 0 4 0 669863136 1803505664 339563 33554432000 4194304 4625164 140733531727824 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 440309 339563 348 106 0 435812 0
[pid=26823/tid=26824] ppid=26821 vsize=1761236 CPUtime=887.43 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 130476 0 0 0 88707 36 0 0 25 0 4 0 669863138 1803505664 339563 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1761236 CPUtime=559.53 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 101813 0 0 0 55901 52 0 0 25 0 4 0 669863138 1803505664 339563 33554432000 4194304 4625164 140733531727824 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1761236 CPUtime=682 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 2102242 0 0 0 67867 333 0 0 25 0 4 0 669863138 1803505664 339563 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2994.49
Current children cumulated vsize (KiB) 1761236

[startup+1062.3 s]
/proc/loadavg: 9.35 9.34 9.13 10/402 26868
/proc/meminfo: memFree=20056820/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1809208 CPUtime=3173.72 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 2981912 0 0 0 316844 528 0 0 25 0 4 0 669863136 1852628992 349297 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/26823/statm: 452302 349297 347 106 0 447805 0
[pid=26823/tid=26824] ppid=26821 vsize=1809208 CPUtime=947.18 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 132364 0 0 0 94681 37 0 0 25 0 4 0 669863138 1852628992 349297 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1809208 CPUtime=590.73 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 126910 0 0 0 59015 58 0 0 25 0 4 0 669863138 1852628992 349297 33554432000 4194304 4625164 140733531727824 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1809208 CPUtime=724.55 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 2334121 0 0 0 72085 370 0 0 25 0 4 0 669863138 1852628992 349297 33554432000 4194304 4625164 140733531727824 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3173.72
Current children cumulated vsize (KiB) 1809208

[startup+1122.3 s]
/proc/loadavg: 8.38 9.12 9.07 6/393 26887
/proc/meminfo: memFree=21407028/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1858344 CPUtime=3367.32 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 3213214 0 0 0 336163 569 0 0 25 0 4 0 669863136 1902944256 365721 33554432000 4194304 4625164 140733531727824 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26823/statm: 464586 365721 349 106 0 460089 0
[pid=26823/tid=26824] ppid=26821 vsize=1858344 CPUtime=1007.18 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 135209 0 0 0 100679 39 0 0 25 0 4 0 669863138 1902944256 365721 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1858344 CPUtime=627.74 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 134102 0 0 0 62714 60 0 0 25 0 4 0 669863138 1902944256 365721 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1858344 CPUtime=764.33 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 2550060 0 0 0 76030 403 0 0 25 0 4 0 669863138 1902944256 365721 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3367.32
Current children cumulated vsize (KiB) 1858344

[startup+1182.3 s]
/proc/loadavg: 6.42 8.44 8.84 6/393 26889
/proc/meminfo: memFree=21341808/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=1932376 CPUtime=3606.56 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 3562942 0 0 0 360027 629 0 0 25 0 4 0 669863136 1978753024 376528 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26823/statm: 483094 376528 347 106 0 478597 0
[pid=26823/tid=26824] ppid=26821 vsize=1932376 CPUtime=1067.18 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 137139 0 0 0 106678 40 0 0 25 0 4 0 669863138 1978753024 376528 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=1932376 CPUtime=687.75 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 135792 0 0 0 68714 61 0 0 25 0 4 0 669863138 1978753024 376528 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=1932376 CPUtime=823.57 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 2890290 0 0 0 81900 457 0 0 25 0 4 0 669863138 1978753024 376528 33554432000 4194304 4625164 140733531727824 18446744073709551615 4547283 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3606.56
Current children cumulated vsize (KiB) 1932376

[startup+1242.3 s]
/proc/loadavg: 5.63 7.81 8.59 6/393 26890
/proc/meminfo: memFree=21274348/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=2008340 CPUtime=3845.8 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 3907158 0 0 0 383886 694 0 0 25 0 4 0 669863136 2056540160 393638 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26823/statm: 502085 393638 347 106 0 497588 0
[pid=26823/tid=26824] ppid=26821 vsize=2008340 CPUtime=1127.19 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 141332 0 0 0 112670 49 0 0 25 0 4 0 669863138 2056540160 393638 33554432000 4194304 4625164 140733531727824 18446744073709551615 4352404 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=2008340 CPUtime=747.75 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 140086 0 0 0 74711 64 0 0 25 0 4 0 669863138 2056540160 393638 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=2008340 CPUtime=882.8 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 3220887 0 0 0 87773 507 0 0 18 0 4 0 669863138 2056540160 393638 33554432000 4194304 4625164 140733531727824 18446744073709551615 4335104 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 3845.8
Current children cumulated vsize (KiB) 2008340



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 5.52 7.40 8.40 6/393 26892
/proc/meminfo: memFree=21208988/32951124 swapFree=65173164/67111528
[pid=26823] ppid=26821 vsize=2015732 CPUtime=4075.9 cores=0,2,4,6
/proc/26823/stat : 26823 (SArTagnan) R 26821 26823 25968 0 -1 4202496 4234598 0 0 0 406822 768 0 0 25 0 4 0 669863136 2064109568 409929 33554432000 4194304 4625164 140733531727824 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/26823/statm: 503933 409929 348 106 0 499436 0
[pid=26823/tid=26824] ppid=26821 vsize=2015732 CPUtime=1184.9 cores=0,2,4,6
/proc/26823/task/26824/stat : 26824 (SArTagnan) R 26821 26823 25968 0 -1 4202560 146214 0 0 0 118422 68 0 0 25 0 4 0 669863138 2064109568 409929 33554432000 4194304 4625164 140733531727824 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=26823/tid=26825] ppid=26821 vsize=2015732 CPUtime=805.46 cores=0,2,4,6
/proc/26823/task/26825/stat : 26825 (SArTagnan) R 26821 26823 25968 0 -1 4202560 145063 0 0 0 80481 65 0 0 25 0 4 0 669863138 2064109568 409929 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=26823/tid=26826] ppid=26821 vsize=2015732 CPUtime=939.75 cores=0,2,4,6
/proc/26823/task/26826/stat : 26826 (SArTagnan) R 26821 26823 25968 0 -1 4202560 3534198 0 0 0 93419 556 0 0 25 0 4 0 669863138 2064109568 409929 33554432000 4194304 4625164 140733531727824 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4075.9
Current children cumulated vsize (KiB) 2015732

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.09
CPU time (s): 4076
CPU user time (s): 4068.24
CPU system time (s): 7.75882
CPU usage (%): 313.517
Max. virtual memory (cumulated for all children) (KiB): 2015732

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4068.24
system time used= 7.75882
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4234600
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2805
involuntary context switches= 86888

runsolver used 4.65329 second user time and 12.0392 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-16 23:50:50
IDJOB=3386366
IDBENCH=84237
IDSOLVER=1871
FILE ID=node132/3386366-1305582650
RUNJOBID= node132-1305581346-26644
PBS_JOBID= 13350206
Free space on /tmp= 73288 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/industrial/kukula/addm_bench/am_7_7.shuffled-as.sat03-363.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386366-1305582650/watcher-3386366-1305582650 -o /tmp/evaluation-result-3386366-1305582650/solver-3386366-1305582650 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386366-1305582650.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c7f51e1ee7556440ab29e1c4bfe29538
RANDOM SEED=324440924

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      22389460 kB
Buffers:        317308 kB
Cached:        3551616 kB
SwapCached:       9908 kB
Active:        4184144 kB
Inactive:      6049944 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      22389460 kB
SwapTotal:    67111528 kB
SwapFree:     65173164 kB
Dirty:             788 kB
Writeback:           0 kB
AnonPages:     6362644 kB
Mapped:          25188 kB
Slab:           220872 kB
PageTables:      41292 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 78734140 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73292 MiB
End job on node132 at 2011-05-17 00:12:32