Trace number 3385892

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4010.39 1300.09

General information on the benchmark

Namecrafted/skvortsov/automata-synchronization/
crn_40_1520_u.cnf
MD5SUMac02a3a5c06227748ecf75dd451ebb7e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables63840
Number of clauses123900
Sum of the clauses size369320
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22380
Number of clauses of size 3121520
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385892-1305581475/watcher-3385892-1305581475 -o /tmp/evaluation-result-3385892-1305581475/solver-3385892-1305581475 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385892-1305581475.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 10.10 10.15 10.08 7/348 6208
/proc/meminfo: memFree=15826212/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=27276 CPUtime=0 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 1809 0 0 0 0 0 0 0 25 0 1 0 669745732 27930624 1685 33554432000 4194304 4625164 140735344492896 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/6208/statm: 6819 1686 296 106 0 2322 0

[startup+0.0226919 s]
/proc/loadavg: 10.10 10.15 10.08 7/348 6208
/proc/meminfo: memFree=15826212/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=29604 CPUtime=0.01 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 3235 0 0 0 1 0 0 0 25 0 1 0 669745732 30314496 2312 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/6208/statm: 7401 2313 296 106 0 2904 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 29604

[startup+0.104642 s]
/proc/loadavg: 10.10 10.15 10.08 7/348 6208
/proc/meminfo: memFree=15826212/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=100748 CPUtime=0.11 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 16348 0 0 0 9 2 0 0 25 0 4 0 669745732 103165952 12409 33554432000 4194304 4625164 140735344492896 18446744073709551615 47683177801650 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 25187 12409 312 106 0 20690 0
Current children cumulated CPU time (s) 0.11
Current children cumulated vsize (KiB) 100748

[startup+0.336553 s]
/proc/loadavg: 10.10 10.15 10.08 7/348 6208
/proc/meminfo: memFree=15826212/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=319524 CPUtime=0.82 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) D 6206 6208 5768 0 -1 4202496 31898 0 0 0 79 3 0 0 25 0 4 0 669745732 327192576 22060 33554432000 4194304 4625164 140735344492896 18446744073709551615 4281780 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 79881 22060 340 106 0 75384 0
Current children cumulated CPU time (s) 0.82
Current children cumulated vsize (KiB) 319524

[startup+0.742555 s]
/proc/loadavg: 10.10 10.15 10.08 7/348 6208
/proc/meminfo: memFree=15826212/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=333124 CPUtime=1.99 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 47834 0 0 0 193 6 0 0 25 0 4 0 669745732 341118976 27101 33554432000 4194304 4625164 140735344492896 18446744073709551615 246516877495 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6208/statm: 83281 27101 340 106 0 78784 0
Current children cumulated CPU time (s) 1.99
Current children cumulated vsize (KiB) 333124

[startup+1.50038 s]
/proc/loadavg: 10.10 10.15 10.08 11/352 6212
/proc/meminfo: memFree=15598896/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=459196 CPUtime=4.24 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 115383 0 0 0 408 16 0 0 18 0 4 0 669745732 470216704 55300 33554432000 4194304 4625164 140735344492896 18446744073709551615 4392942 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 114799 55300 346 106 0 110302 0
[pid=6208/tid=6210] ppid=6206 vsize=459196 CPUtime=1.26 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 17848 0 0 0 124 2 0 0 19 0 4 0 669745741 470216704 55300 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=459196 CPUtime=0.54 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 5922 0 0 0 54 0 0 0 25 0 4 0 669745741 470216704 55300 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339868 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=459196 CPUtime=1.36 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 28986 0 0 0 133 3 0 0 18 0 4 0 669745741 470216704 55300 33554432000 4194304 4625164 140735344492896 18446744073709551615 4547411 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4.24
Current children cumulated vsize (KiB) 459196

[startup+3.10109 s]
/proc/loadavg: 10.10 10.15 10.08 11/352 6212
/proc/meminfo: memFree=15577196/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=463880 CPUtime=9.03 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 133605 0 0 0 885 18 0 0 21 0 4 0 669745732 475013120 63637 33554432000 4194304 4625164 140735344492896 18446744073709551615 246516492661 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 115970 63637 347 106 0 111473 0
[pid=6208/tid=6210] ppid=6206 vsize=463880 CPUtime=2.35 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 18267 0 0 0 233 2 0 0 21 0 4 0 669745741 475013120 63637 33554432000 4194304 4625164 140735344492896 18446744073709551615 4469010 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=463880 CPUtime=1.56 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 14598 0 0 0 155 1 0 0 25 0 4 0 669745741 475013120 63637 33554432000 4194304 4625164 140735344492896 18446744073709551615 246516490247 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=463880 CPUtime=2.5 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 38036 0 0 0 246 4 0 0 20 0 4 0 669745741 475013120 63637 33554432000 4194304 4625164 140735344492896 18446744073709551615 246516501466 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 9.03
Current children cumulated vsize (KiB) 463880

[startup+6.30051 s]
/proc/loadavg: 10.10 10.15 10.08 13/352 6212
/proc/meminfo: memFree=15541268/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=463880 CPUtime=18.58 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 142098 0 0 0 1839 19 0 0 25 0 4 0 669745732 475013120 66402 33554432000 4194304 4625164 140735344492896 18446744073709551615 4337998 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 115970 66402 347 106 0 111473 0
[pid=6208/tid=6210] ppid=6206 vsize=463880 CPUtime=3.92 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 18563 0 0 0 390 2 0 0 25 0 4 0 669745741 475013120 66402 33554432000 4194304 4625164 140735344492896 18446744073709551615 4469027 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=463880 CPUtime=4.77 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 15778 0 0 0 475 2 0 0 25 0 4 0 669745741 475013120 66402 33554432000 4194304 4625164 140735344492896 18446744073709551615 246516501506 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=463880 CPUtime=4.13 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 44897 0 0 0 408 5 0 0 25 0 4 0 669745741 475013120 66402 33554432000 4194304 4625164 140735344492896 18446744073709551615 4546872 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 18.58
Current children cumulated vsize (KiB) 463880

[startup+12.7003 s]
/proc/loadavg: 10.09 10.14 10.08 12/352 6213
/proc/meminfo: memFree=15505076/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=515648 CPUtime=37.72 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 177845 0 0 0 3748 24 0 0 25 0 4 0 669745732 528023552 69599 33554432000 4194304 4625164 140735344492896 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 128912 69599 347 106 0 124415 0
[pid=6208/tid=6210] ppid=6206 vsize=515648 CPUtime=7.85 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 24631 0 0 0 782 3 0 0 25 0 4 0 669745741 528023552 69599 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=515648 CPUtime=9.97 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 22169 0 0 0 995 2 0 0 25 0 4 0 669745741 528023552 69599 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=515648 CPUtime=7.79 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 61601 0 0 0 772 7 0 0 25 0 4 0 669745741 528023552 69599 33554432000 4194304 4625164 140735344492896 18446744073709551615 4556494 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37.72
Current children cumulated vsize (KiB) 515648

[startup+25.513 s]
/proc/loadavg: 10.14 10.15 10.09 12/352 6213
/proc/meminfo: memFree=15435136/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=515648 CPUtime=76.01 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 246066 0 0 0 7567 34 0 0 25 0 4 0 669745732 528023552 75804 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 128912 75804 347 106 0 124415 0
[pid=6208/tid=6210] ppid=6206 vsize=515648 CPUtime=15.61 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 26044 0 0 0 1558 3 0 0 25 0 4 0 669745741 528023552 75804 33554432000 4194304 4625164 140735344492896 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=515648 CPUtime=16.25 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 24105 0 0 0 1623 2 0 0 25 0 4 0 669745741 528023552 75804 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=515648 CPUtime=19.37 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 124290 0 0 0 1921 16 0 0 25 0 4 0 669745741 528023552 75804 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 76.01
Current children cumulated vsize (KiB) 515648

[startup+51.1003 s]
/proc/loadavg: 10.09 10.14 10.09 12/352 6214
/proc/meminfo: memFree=15269440/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=568016 CPUtime=152.49 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 292753 0 0 0 15207 42 0 0 25 0 4 0 669745732 581648384 88177 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511882 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 142004 88177 347 106 0 137507 0
[pid=6208/tid=6210] ppid=6206 vsize=568016 CPUtime=28.51 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 35556 0 0 0 2846 5 0 0 25 0 4 0 669745741 581648384 88177 33554432000 4194304 4625164 140735344492896 18446744073709551615 4487000 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=568016 CPUtime=28.94 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 35375 0 0 0 2890 4 0 0 25 0 4 0 669745741 581648384 88177 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=568016 CPUtime=44.97 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 138960 0 0 0 4478 19 0 0 25 0 4 0 669745741 581648384 88177 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 152.49
Current children cumulated vsize (KiB) 568016

[startup+102.301 s]
/proc/loadavg: 10.22 10.16 10.09 12/352 6215
/proc/meminfo: memFree=15021904/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=633208 CPUtime=305.55 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 595344 0 0 0 30465 90 0 0 25 0 4 0 669745732 648404992 113483 33554432000 4194304 4625164 140735344492896 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 158302 113483 347 106 0 153805 0
[pid=6208/tid=6210] ppid=6206 vsize=633208 CPUtime=58.21 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 40358 0 0 0 5814 7 0 0 25 0 4 0 669745741 648404992 113483 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=633208 CPUtime=62.78 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 37625 0 0 0 6273 5 0 0 25 0 4 0 669745741 648404992 113483 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352133 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=633208 CPUtime=83.83 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 409633 0 0 0 8324 59 0 0 25 0 4 0 669745741 648404992 113483 33554432000 4194304 4625164 140735344492896 18446744073709551615 4552452 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 305.55
Current children cumulated vsize (KiB) 633208

[startup+162.301 s]
/proc/loadavg: 10.25 10.19 10.10 12/352 6217
/proc/meminfo: memFree=14751288/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=694588 CPUtime=484.89 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 1022164 0 0 0 48335 154 0 0 25 0 4 0 669745732 711258112 141731 33554432000 4194304 4625164 140735344492896 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 173647 141731 347 106 0 169150 0
[pid=6208/tid=6210] ppid=6206 vsize=694588 CPUtime=87.97 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 56140 0 0 0 8787 10 0 0 25 0 4 0 669745741 711258112 141731 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=694588 CPUtime=112.48 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 57640 0 0 0 11239 9 0 0 25 0 4 0 669745741 711258112 141731 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=694588 CPUtime=124.87 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 795272 0 0 0 12373 114 0 0 25 0 4 0 669745741 711258112 141731 33554432000 4194304 4625164 140735344492896 18446744073709551615 4547244 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 484.89
Current children cumulated vsize (KiB) 694588

[startup+222.301 s]
/proc/loadavg: 10.24 10.20 10.11 12/352 6218
/proc/meminfo: memFree=14509592/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=1005096 CPUtime=664.23 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 1305427 0 0 0 66230 193 0 0 25 0 4 0 669745732 1029218304 174368 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/6208/statm: 251274 174368 347 106 0 246777 0
[pid=6208/tid=6210] ppid=6206 vsize=1005096 CPUtime=129.73 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 84084 0 0 0 12959 14 0 0 25 0 4 0 669745741 1029218304 174368 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=1005096 CPUtime=163.15 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 84646 0 0 0 16300 15 0 0 25 0 4 0 669745741 1029218304 174368 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=1005096 CPUtime=155.38 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 988646 0 0 0 15399 139 0 0 25 0 4 0 669745741 1029218304 174368 33554432000 4194304 4625164 140735344492896 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 664.23
Current children cumulated vsize (KiB) 1005096

[startup+282.301 s]

################
# More data... #
################

[pid=6208] ppid=6206 vsize=1763032 CPUtime=2098.99 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 4148217 0 0 0 209310 589 0 0 25 0 4 0 669745732 1805344768 337606 33554432000 4194304 4625164 140735344492896 18446744073709551615 4393003 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6208/statm: 440758 337606 347 106 0 436261 0
[pid=6208/tid=6210] ppid=6206 vsize=1763032 CPUtime=487.28 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 141344 0 0 0 48702 26 0 0 25 0 4 0 669745741 1805344768 337606 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=1763032 CPUtime=465 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 136452 0 0 0 46474 26 0 0 25 0 4 0 669745741 1805344768 337607 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352861 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=1763032 CPUtime=506.49 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 3586010 0 0 0 50161 488 0 0 25 0 4 0 669745741 1805344768 337607 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2098.99
Current children cumulated vsize (KiB) 1763032

[startup+762.301 s]
/proc/loadavg: 10.45 10.25 10.14 12/352 6233
/proc/meminfo: memFree=13305172/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=1763032 CPUtime=2278.35 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 4467696 0 0 0 227204 631 0 0 25 0 4 0 669745732 1805344768 341015 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6208/statm: 440758 341015 347 106 0 436261 0
[pid=6208/tid=6210] ppid=6206 vsize=1763032 CPUtime=547.29 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 142926 0 0 0 54702 27 0 0 25 0 4 0 669745741 1805344768 341015 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=1763032 CPUtime=524.36 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 138422 0 0 0 52409 27 0 0 25 0 4 0 669745741 1805344768 341015 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=1763032 CPUtime=536.41 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 3900361 0 0 0 53113 528 0 0 25 0 4 0 669745741 1805344768 341015 33554432000 4194304 4625164 140735344492896 18446744073709551615 4490174 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2278.35
Current children cumulated vsize (KiB) 1763032

[startup+822.301 s]
/proc/loadavg: 10.23 10.22 10.13 12/352 6234
/proc/meminfo: memFree=13230620/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=1823796 CPUtime=2457.69 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 4878475 0 0 0 245086 683 0 0 25 0 4 0 669745732 1867567104 354073 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 455949 354073 347 106 0 451452 0
[pid=6208/tid=6210] ppid=6206 vsize=1823796 CPUtime=601.38 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 144742 0 0 0 60111 27 0 0 25 0 4 0 669745741 1867567104 354073 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=1823796 CPUtime=581.5 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 147329 0 0 0 58122 28 0 0 25 0 4 0 669745741 1867567104 354073 33554432000 4194304 4625164 140735344492896 18446744073709551615 4465169 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=1823796 CPUtime=574.39 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 4298550 0 0 0 56861 578 0 0 25 0 4 0 669745741 1867567104 354073 33554432000 4194304 4625164 140735344492896 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2457.69
Current children cumulated vsize (KiB) 1823796

[startup+882.301 s]
/proc/loadavg: 10.29 10.22 10.14 12/352 6236
/proc/meminfo: memFree=13160156/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=1823796 CPUtime=2637.06 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 5744869 0 0 0 262907 799 0 0 25 0 4 0 669745732 1867567104 358730 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 455949 358730 347 106 0 451452 0
[pid=6208/tid=6210] ppid=6206 vsize=1823796 CPUtime=637 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 145462 0 0 0 63673 27 0 0 25 0 4 0 669745741 1867567104 358730 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339581 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=1823796 CPUtime=635.25 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 148119 0 0 0 63496 29 0 0 25 0 4 0 669745741 1867567104 358730 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352731 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=1823796 CPUtime=634.4 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 5161347 0 0 0 62748 692 0 0 25 0 4 0 669745741 1867567104 358730 33554432000 4194304 4625164 140735344492896 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2637.06
Current children cumulated vsize (KiB) 1823796

[startup+942.301 s]
/proc/loadavg: 10.22 10.21 10.13 12/352 6237
/proc/meminfo: memFree=13051888/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=1902668 CPUtime=2816.38 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 6795913 0 0 0 280695 943 0 0 25 0 4 0 669745732 1948332032 367110 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 475667 367110 347 106 0 471170 0
[pid=6208/tid=6210] ppid=6206 vsize=1902668 CPUtime=667 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 147021 0 0 0 66672 28 0 0 25 0 4 0 669745741 1948332032 367110 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=1902668 CPUtime=694.59 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 190107 0 0 0 69425 34 0 0 25 0 4 0 669745741 1948332032 367110 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339643 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=1902668 CPUtime=694.4 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 6165952 0 0 0 68610 830 0 0 25 0 4 0 669745741 1948332032 367110 33554432000 4194304 4625164 140735344492896 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2816.38
Current children cumulated vsize (KiB) 1902668

[startup+1002.31 s]
/proc/loadavg: 10.20 10.20 10.13 12/352 6239
/proc/meminfo: memFree=12972508/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=2097172 CPUtime=2995.77 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 7495808 0 0 0 298534 1043 0 0 25 0 4 0 669745732 2147504128 379673 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 524293 379673 347 106 0 519796 0
[pid=6208/tid=6210] ppid=6206 vsize=2097172 CPUtime=697.03 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 188752 0 0 0 69669 34 0 0 25 0 4 0 669745741 2147504128 379673 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=2097172 CPUtime=753.95 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 190809 0 0 0 75360 35 0 0 25 0 4 0 669745741 2147504128 379673 33554432000 4194304 4625164 140735344492896 18446744073709551615 4467677 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=2097172 CPUtime=739.58 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 6794946 0 0 0 73039 919 0 0 25 0 4 0 669745741 2147504128 379673 33554432000 4194304 4625164 140735344492896 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2995.77
Current children cumulated vsize (KiB) 2097172

[startup+1062.3 s]
/proc/loadavg: 10.17 10.19 10.13 12/352 6241
/proc/meminfo: memFree=12893508/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=2031636 CPUtime=3175.08 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 7815789 0 0 0 316418 1090 0 0 25 0 4 0 669745732 2080395264 384445 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 507909 384446 347 106 0 503412 0
[pid=6208/tid=6210] ppid=6206 vsize=2031636 CPUtime=727.01 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 191135 0 0 0 72666 35 0 0 25 0 4 0 669745741 2080395264 384446 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352519 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=2031636 CPUtime=809.72 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 192371 0 0 0 80937 35 0 0 25 0 4 0 669745741 2080395264 384446 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=2031636 CPUtime=773.15 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 7108187 0 0 0 76351 964 0 0 25 0 4 0 669745741 2080395264 384446 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3175.08
Current children cumulated vsize (KiB) 2031636

[startup+1122.3 s]
/proc/loadavg: 10.22 10.20 10.14 12/352 6242
/proc/meminfo: memFree=12825160/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=2031636 CPUtime=3354.43 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 8112711 0 0 0 334309 1134 0 0 25 0 4 0 669745732 2080395264 390150 33554432000 4194304 4625164 140735344492896 18446744073709551615 4393000 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/6208/statm: 507909 390150 347 106 0 503412 0
[pid=6208/tid=6210] ppid=6206 vsize=2031636 CPUtime=757 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 193454 0 0 0 75664 36 0 0 25 0 4 0 669745741 2080395264 390150 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339536 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=2031636 CPUtime=869.07 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 193983 0 0 0 86871 36 0 0 25 0 4 0 669745741 2080395264 390150 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=2031636 CPUtime=803.16 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 7398593 0 0 0 79311 1005 0 0 25 0 4 0 669745741 2080395264 390150 33554432000 4194304 4625164 140735344492896 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3354.43
Current children cumulated vsize (KiB) 2031636

[startup+1182.3 s]
/proc/loadavg: 8.39 9.75 9.99 7/343 6262
/proc/meminfo: memFree=15201828/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=2084088 CPUtime=3540.75 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 8540290 0 0 0 352881 1194 0 0 25 0 4 0 669745732 2134106112 402724 33554432000 4194304 4625164 140735344492896 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6208/statm: 521022 402724 347 106 0 516525 0
[pid=6208/tid=6210] ppid=6206 vsize=2084088 CPUtime=795.37 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 196029 0 0 0 79499 38 0 0 25 0 4 0 669745741 2134106112 402724 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=2084088 CPUtime=928.42 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 195245 0 0 0 92806 36 0 0 25 0 4 0 669745741 2134106112 402724 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=2084088 CPUtime=856.69 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 7820091 0 0 0 84607 1062 0 0 25 0 4 0 669745741 2134106112 402725 33554432000 4194304 4625164 140735344492896 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3540.75
Current children cumulated vsize (KiB) 2084088

[startup+1242.3 s]
/proc/loadavg: 6.98 9.09 9.75 7/343 6263
/proc/meminfo: memFree=15173924/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=2095060 CPUtime=3780.09 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 8882379 0 0 0 376768 1241 0 0 25 0 4 0 669745732 2145341440 408571 33554432000 4194304 4625164 140735344492896 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6208/statm: 523765 408571 347 106 0 519268 0
[pid=6208/tid=6210] ppid=6206 vsize=2095060 CPUtime=855.36 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 199919 0 0 0 85497 39 0 0 25 0 4 0 669745741 2145341440 408571 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=2095060 CPUtime=987.77 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 196988 0 0 0 98740 37 0 0 25 0 4 0 669745741 2145341440 408571 33554432000 4194304 4625164 140735344492896 18446744073709551615 4462375 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=2095060 CPUtime=916.69 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 8153571 0 0 0 90563 1106 0 0 25 0 4 0 669745741 2145341440 408571 33554432000 4194304 4625164 140735344492896 18446744073709551615 4335179 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 3780.09
Current children cumulated vsize (KiB) 2095060



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 6.47 8.57 9.52 7/343 6265
/proc/meminfo: memFree=15132988/32951124 swapFree=54450792/67111528
[pid=6208] ppid=6206 vsize=2095060 CPUtime=4010.27 cores=0,2,4,6
/proc/6208/stat : 6208 (SArTagnan) R 6206 6208 5768 0 -1 4202496 9087397 0 0 0 399753 1274 0 0 25 0 4 0 669745732 2145341440 418538 33554432000 4194304 4625164 140735344492896 18446744073709551615 4512012 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/6208/statm: 523765 418538 347 106 0 519268 0
[pid=6208/tid=6210] ppid=6206 vsize=2095060 CPUtime=913.06 cores=0,2,4,6
/proc/6208/task/6210/stat : 6210 (SArTagnan) R 6206 6208 5768 0 -1 4202560 203129 0 0 0 91266 40 0 0 25 0 4 0 669745741 2145341440 418539 33554432000 4194304 4625164 140735344492896 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=6208/tid=6211] ppid=6206 vsize=2095060 CPUtime=1044.85 cores=0,2,4,6
/proc/6208/task/6211/stat : 6211 (SArTagnan) R 6206 6208 5768 0 -1 4202560 197854 0 0 0 104448 37 0 0 25 0 4 0 669745741 2145341440 418539 33554432000 4194304 4625164 140735344492896 18446744073709551615 4352108 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=6208/tid=6212] ppid=6206 vsize=2095060 CPUtime=974.4 cores=0,2,4,6
/proc/6208/task/6212/stat : 6212 (SArTagnan) R 6206 6208 5768 0 -1 4202560 8347543 0 0 0 96303 1137 0 0 25 0 4 0 669745741 2145341440 418539 33554432000 4194304 4625164 140735344492896 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 4010.27
Current children cumulated vsize (KiB) 2095060

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.09
CPU time (s): 4010.39
CPU user time (s): 3997.57
CPU system time (s): 12.8201
CPU usage (%): 308.469
Max. virtual memory (cumulated for all children) (KiB): 2188888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3997.57
system time used= 12.8201
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9087398
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2634
involuntary context switches= 88913

runsolver used 4.02639 second user time and 10.1715 second system time

The end

Launcher Data 

Begin job on node134 at 2011-05-16 23:31:15
IDJOB=3385892
IDBENCH=83198
IDSOLVER=1871
FILE ID=node134/3385892-1305581475
RUNJOBID= node134-1305577288-5786
PBS_JOBID= 13350221
Free space on /tmp= 73576 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_40_1520_u.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385892-1305581475/watcher-3385892-1305581475 -o /tmp/evaluation-result-3385892-1305581475/solver-3385892-1305581475 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385892-1305581475.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac02a3a5c06227748ecf75dd451ebb7e
RANDOM SEED=1688597124

node134.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 7186.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15826492 kB
Buffers:        167320 kB
Cached:         723860 kB
SwapCached:      16428 kB
Active:        5759856 kB
Inactive:     11125924 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15826492 kB
SwapTotal:    67111528 kB
SwapFree:     54450792 kB
Dirty:            3096 kB
Writeback:           0 kB
AnonPages:    15985896 kB
Mapped:          16536 kB
Slab:            98004 kB
PageTables:      78920 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 73839708 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73580 MiB
End job on node134 at 2011-05-16 23:52:57