Trace number 3386240

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.15 1204.28

General information on the benchmark

NameSAT04/industrial/vangelder/
cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf
MD5SUM65c5a1442ec07e466934f093e50229c2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark17.8123
Satisfiable
(Un)Satisfiability was proved
Number of variables6228
Number of clauses484871
Sum of the clauses size3850952
Maximum clause length8
Minimum clause length1
Number of clauses of size 115
Number of clauses of size 24651
Number of clauses of size 31
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 5480204

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386240-1305582933/watcher-3386240-1305582933 -o /tmp/evaluation-result-3386240-1305582933/solver-3386240-1305582933 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386240-1305582933.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.88 8.08 7.96 6/401 2366
/proc/meminfo: memFree=12315352/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=30696 CPUtime=0 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 670 0 0 0 0 0 0 0 24 0 1 0 669893042 31432704 597 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2366/statm: 7674 597 299 106 0 3177 0

[startup+0.095452 s]
/proc/loadavg: 7.88 8.08 7.96 6/401 2366
/proc/meminfo: memFree=12315352/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=48292 CPUtime=0.08 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 8574 0 0 0 7 1 0 0 24 0 1 0 669893042 49451008 4757 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2366/statm: 12073 4757 299 106 0 7576 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 48292

[startup+0.100447 s]
/proc/loadavg: 7.88 8.08 7.96 6/401 2366
/proc/meminfo: memFree=12315352/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=48292 CPUtime=0.09 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 8719 0 0 0 8 1 0 0 24 0 1 0 669893042 49451008 4902 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2366/statm: 12073 4902 299 106 0 7576 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 48292

[startup+0.300414 s]
/proc/loadavg: 7.88 8.08 7.96 6/401 2366
/proc/meminfo: memFree=12315352/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=70804 CPUtime=0.29 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 20388 0 0 0 26 3 0 0 25 0 1 0 669893042 72503296 12297 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/2366/statm: 17701 12301 299 106 0 13204 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 70804

[startup+0.727593 s]
/proc/loadavg: 7.88 8.08 7.96 6/401 2366
/proc/meminfo: memFree=12315352/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=524936 CPUtime=1.62 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 110227 0 0 0 145 17 0 0 18 0 4 0 669893042 537534464 76213 33554432000 4194304 4625164 140735813563152 18446744073709551615 208080275591 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 131234 76213 400 106 0 126737 0
Current children cumulated CPU time (s) 1.62
Current children cumulated vsize (KiB) 524936

[startup+1.50119 s]
/proc/loadavg: 7.88 8.08 7.96 10/405 2370
/proc/meminfo: memFree=11873020/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=645956 CPUtime=4.54 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 179294 0 0 0 425 29 0 0 18 0 4 0 669893042 661458944 114710 33554432000 4194304 4625164 140735813563152 18446744073709551615 208079891920 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 161489 114710 338 106 0 156992 0
[pid=2366/tid=2368] ppid=2364 vsize=645956 CPUtime=1 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 29160 0 0 0 96 4 0 0 25 0 4 0 669893089 661458944 114710 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=645956 CPUtime=1.01 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 28493 0 0 0 96 5 0 0 25 0 4 0 669893089 661458944 114710 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=645956 CPUtime=1 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 9805 0 0 0 99 1 0 0 19 0 4 0 669893089 661458944 114710 33554432000 4194304 4625164 140735813563152 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 4.54
Current children cumulated vsize (KiB) 645956

[startup+3.10088 s]
/proc/loadavg: 7.89 8.08 7.96 9/405 2370
/proc/meminfo: memFree=11837060/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=665632 CPUtime=10.92 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 204312 0 0 0 1059 33 0 0 21 0 4 0 669893042 681607168 119296 33554432000 4194304 4625164 140735813563152 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 166408 119296 339 106 0 161911 0
[pid=2366/tid=2368] ppid=2364 vsize=665632 CPUtime=2.6 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 40342 0 0 0 254 6 0 0 25 0 4 0 669893089 681607168 119296 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=665632 CPUtime=2.61 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 29500 0 0 0 256 5 0 0 25 0 4 0 669893089 681607168 119296 33554432000 4194304 4625164 140735813563152 18446744073709551615 4487121 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=665632 CPUtime=2.58 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 21843 0 0 0 255 3 0 0 22 0 4 0 669893089 681607168 119296 33554432000 4194304 4625164 140735813563152 18446744073709551615 208079890694 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 10.92
Current children cumulated vsize (KiB) 665632

[startup+6.30027 s]
/proc/loadavg: 7.89 8.08 7.96 9/405 2370
/proc/meminfo: memFree=11828244/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=685312 CPUtime=23.68 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 221751 0 0 0 2333 35 0 0 25 0 4 0 669893042 701759488 121255 33554432000 4194304 4625164 140735813563152 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 171328 121255 345 106 0 166831 0
[pid=2366/tid=2368] ppid=2364 vsize=685312 CPUtime=5.8 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 40601 0 0 0 574 6 0 0 25 0 4 0 669893089 701759488 121255 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=685312 CPUtime=5.81 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 29565 0 0 0 576 5 0 0 25 0 4 0 669893089 701759488 121255 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351955 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=685312 CPUtime=5.75 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 28224 0 0 0 571 4 0 0 25 0 4 0 669893089 701759488 121255 33554432000 4194304 4625164 140735813563152 18446744073709551615 4573808 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 23.68
Current children cumulated vsize (KiB) 685312

[startup+12.7011 s]
/proc/loadavg: 7.91 8.08 7.96 9/405 2370
/proc/meminfo: memFree=11819844/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=705004 CPUtime=49.18 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 289355 0 0 0 4874 44 0 0 25 0 4 0 669893042 721924096 121403 33554432000 4194304 4625164 140735813563152 18446744073709551615 4391265 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 176251 121403 345 106 0 171754 0
[pid=2366/tid=2368] ppid=2364 vsize=705004 CPUtime=12.2 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 40604 0 0 0 1214 6 0 0 25 0 4 0 669893089 721924096 121403 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=705004 CPUtime=12.2 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 39819 0 0 0 1214 6 0 0 25 0 4 0 669893089 721924096 121403 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=705004 CPUtime=12.06 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 85553 0 0 0 1194 12 0 0 25 0 4 0 669893089 721924096 121403 33554432000 4194304 4625164 140735813563152 18446744073709551615 208079899610 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.18
Current children cumulated vsize (KiB) 705004

[startup+25.5006 s]
/proc/loadavg: 8.08 8.11 7.97 9/405 2370
/proc/meminfo: memFree=11801616/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=731000 CPUtime=100.21 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 334077 0 0 0 9970 51 0 0 25 0 4 0 669893042 748544000 123088 33554432000 4194304 4625164 140735813563152 18446744073709551615 4519319 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 182750 123088 347 106 0 178253 0
[pid=2366/tid=2368] ppid=2364 vsize=731000 CPUtime=25 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 40633 0 0 0 2494 6 0 0 25 0 4 0 669893089 748544000 123088 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=731000 CPUtime=25.01 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 40466 0 0 0 2494 7 0 0 25 0 4 0 669893089 748544000 123088 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=731000 CPUtime=24.69 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 116185 0 0 0 2452 17 0 0 25 0 4 0 669893089 748544000 123088 33554432000 4194304 4625164 140735813563152 18446744073709551615 208079899650 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 100.21
Current children cumulated vsize (KiB) 731000

[startup+51.1007 s]
/proc/loadavg: 8.05 8.10 7.97 9/405 2371
/proc/meminfo: memFree=11747512/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=744148 CPUtime=202.29 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 387680 0 0 0 20169 60 0 0 25 0 4 0 669893042 762007552 127928 33554432000 4194304 4625164 140735813563152 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 186037 127928 347 106 0 181540 0
[pid=2366/tid=2368] ppid=2364 vsize=744148 CPUtime=50.6 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 42015 0 0 0 5053 7 0 0 25 0 4 0 669893089 762007552 127928 33554432000 4194304 4625164 140735813563152 18446744073709551615 4353587 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=744148 CPUtime=50.6 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 41474 0 0 0 5053 7 0 0 25 0 4 0 669893089 762007552 127928 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=744148 CPUtime=49.98 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 166241 0 0 0 4973 25 0 0 25 0 4 0 669893089 762007552 127928 33554432000 4194304 4625164 140735813563152 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 202.29
Current children cumulated vsize (KiB) 744148

[startup+102.301 s]
/proc/loadavg: 8.20 8.13 7.99 10/405 2373
/proc/meminfo: memFree=11678308/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=744148 CPUtime=406.46 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 704563 0 0 0 40534 112 0 0 25 0 4 0 669893042 762007552 136605 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 186037 136605 347 106 0 181540 0
[pid=2366/tid=2368] ppid=2364 vsize=744148 CPUtime=101.81 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 44603 0 0 0 10173 8 0 0 25 0 4 0 669893089 762007552 136605 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=744148 CPUtime=101.82 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 42755 0 0 0 10174 8 0 0 25 0 4 0 669893089 762007552 136605 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=744148 CPUtime=100.53 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 476521 0 0 0 9980 73 0 0 25 0 4 0 669893089 762007552 136605 33554432000 4194304 4625164 140735813563152 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 406.46
Current children cumulated vsize (KiB) 744148

[startup+162.301 s]
/proc/loadavg: 8.14 8.12 7.99 9/405 2375
/proc/meminfo: memFree=11594948/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=773696 CPUtime=645.68 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 821267 0 0 0 64439 129 0 0 25 0 4 0 669893042 792264704 145942 33554432000 4194304 4625164 140735813563152 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 193424 145942 347 106 0 188927 0
[pid=2366/tid=2368] ppid=2364 vsize=773696 CPUtime=161.8 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 64056 0 0 0 16168 12 0 0 25 0 4 0 669893089 792264704 145942 33554432000 4194304 4625164 140735813563152 18446744073709551615 4487011 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=773696 CPUtime=161.8 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 43829 0 0 0 16172 8 0 0 25 0 4 0 669893089 792264704 145942 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=773696 CPUtime=159.77 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 571069 0 0 0 15890 87 0 0 25 0 4 0 669893089 792264704 145942 33554432000 4194304 4625164 140735813563152 18446744073709551615 4547807 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 645.68
Current children cumulated vsize (KiB) 773696

[startup+222.315 s]
/proc/loadavg: 8.10 8.11 8.00 10/405 2377
/proc/meminfo: memFree=11495144/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=852480 CPUtime=884.98 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 1403404 0 0 0 88279 219 0 0 25 0 4 0 669893042 872939520 158174 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512138 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 213120 158174 347 106 0 208623 0
[pid=2366/tid=2368] ppid=2364 vsize=852480 CPUtime=221.82 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 67413 0 0 0 22169 13 0 0 25 0 4 0 669893089 872939520 158174 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=852480 CPUtime=221.82 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 62067 0 0 0 22170 12 0 0 25 0 4 0 669893089 872939520 158174 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=852480 CPUtime=219 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 1114575 0 0 0 21732 168 0 0 25 0 4 0 669893089 872939520 158174 33554432000 4194304 4625164 140735813563152 18446744073709551615 208079881304 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 884.98
Current children cumulated vsize (KiB) 852480

[startup+282.301 s]

################
# More data... #
################

[pid=2366] ppid=2364 vsize=1168704 CPUtime=2798.77 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 6216406 0 0 0 278905 972 0 0 25 0 4 0 669893042 1196752896 210730 33554432000 4194304 4625164 140735813563152 18446744073709551615 4511945 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 292176 210730 347 106 0 287679 0
[pid=2366/tid=2368] ppid=2364 vsize=1168704 CPUtime=701.79 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 140703 0 0 0 70153 26 0 0 25 0 4 0 669893089 1196752896 210730 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1168704 CPUtime=699.37 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 69126 0 0 0 69922 15 0 0 25 0 4 0 669893089 1196752896 210731 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1168704 CPUtime=695.28 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 5811374 0 0 0 68630 898 0 0 25 0 4 0 669893089 1196752896 210731 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2798.77
Current children cumulated vsize (KiB) 1168704

[startup+762.301 s]
/proc/loadavg: 8.09 8.14 8.05 9/405 2403
/proc/meminfo: memFree=10972412/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1198260 CPUtime=3038.04 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 6314572 0 0 0 302816 988 0 0 25 0 4 0 669893042 1227018240 212782 33554432000 4194304 4625164 140735813563152 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 299565 212782 347 106 0 295068 0
[pid=2366/tid=2368] ppid=2364 vsize=1198260 CPUtime=761.82 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 141342 0 0 0 76155 27 0 0 25 0 4 0 669893089 1227018240 212782 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1198260 CPUtime=758.6 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 70507 0 0 0 75844 16 0 0 25 0 4 0 669893089 1227018240 212782 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1198260 CPUtime=755.29 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 5905832 0 0 0 74617 912 0 0 25 0 4 0 669893089 1227018240 212782 33554432000 4194304 4625164 140735813563152 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3038.04
Current children cumulated vsize (KiB) 1198260

[startup+822.301 s]
/proc/loadavg: 8.11 8.13 8.05 10/405 2405
/proc/meminfo: memFree=10928596/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1263796 CPUtime=3277.26 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 6856075 0 0 0 326659 1067 0 0 25 0 4 0 669893042 1294127104 218469 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 315949 218469 347 106 0 311452 0
[pid=2366/tid=2368] ppid=2364 vsize=1263796 CPUtime=821.81 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 142035 0 0 0 82154 27 0 0 25 0 4 0 669893089 1294127104 218469 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1263796 CPUtime=817.83 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 70848 0 0 0 81767 16 0 0 25 0 4 0 669893089 1294127104 218469 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351860 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1263796 CPUtime=815.28 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 6444227 0 0 0 80537 991 0 0 25 0 4 0 669893089 1294127104 218469 33554432000 4194304 4625164 140735813563152 18446744073709551615 4547423 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3277.26
Current children cumulated vsize (KiB) 1263796

[startup+882.315 s]
/proc/loadavg: 8.10 8.12 8.05 9/405 2406
/proc/meminfo: memFree=10882796/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1347352 CPUtime=3516.54 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 7602677 0 0 0 350472 1182 0 0 25 0 4 0 669893042 1379688448 224764 33554432000 4194304 4625164 140735813563152 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 336838 224764 347 106 0 332341 0
[pid=2366/tid=2368] ppid=2364 vsize=1347352 CPUtime=881.82 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 142538 0 0 0 88155 27 0 0 25 0 4 0 669893089 1379688448 224764 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1347352 CPUtime=877.07 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 94952 0 0 0 87687 20 0 0 25 0 4 0 669893089 1379688448 224764 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1347352 CPUtime=875.3 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 7144822 0 0 0 86430 1100 0 0 25 0 4 0 669893089 1379688448 224764 33554432000 4194304 4625164 140735813563152 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3516.54
Current children cumulated vsize (KiB) 1347352

[startup+942.301 s]
/proc/loadavg: 8.10 8.11 8.05 9/405 2408
/proc/meminfo: memFree=10805460/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1347352 CPUtime=3755.73 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 8346313 0 0 0 374280 1293 0 0 25 0 4 0 669893042 1379688448 234905 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 336838 234905 347 106 0 332341 0
[pid=2366/tid=2368] ppid=2364 vsize=1347352 CPUtime=941.8 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 145783 0 0 0 94152 28 0 0 25 0 4 0 669893089 1379688448 234905 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1347352 CPUtime=936.3 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 98662 0 0 0 93608 22 0 0 25 0 4 0 669893089 1379688448 234905 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1347352 CPUtime=935.29 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 7879574 0 0 0 92322 1207 0 0 25 0 4 0 669893089 1379688448 234905 33554432000 4194304 4625164 140735813563152 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3755.73
Current children cumulated vsize (KiB) 1347352

[startup+1002.3 s]
/proc/loadavg: 8.08 8.10 8.05 9/405 2409
/proc/meminfo: memFree=10752952/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1347352 CPUtime=3994.95 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 8976335 0 0 0 398108 1387 0 0 25 0 4 0 669893042 1379688448 247406 33554432000 4194304 4625164 140735813563152 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 336838 247407 355 106 0 332341 0
[pid=2366/tid=2368] ppid=2364 vsize=1347352 CPUtime=1001.81 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 149422 0 0 0 100151 30 0 0 25 0 4 0 669893089 1379688448 247407 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352776 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1347352 CPUtime=995.51 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 101262 0 0 0 99529 22 0 0 25 0 4 0 669893089 1379688448 247407 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351860 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1347352 CPUtime=995.29 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 8501873 0 0 0 98231 1298 0 0 25 0 4 0 669893089 1379688448 247408 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3994.95
Current children cumulated vsize (KiB) 1347352

[startup+1062.3 s]
/proc/loadavg: 6.78 7.79 7.95 5/396 2429
/proc/meminfo: memFree=11582096/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1347352 CPUtime=4234.21 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 9490085 0 0 0 421959 1462 0 0 25 0 4 0 669893042 1379688448 257112 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 336838 257113 347 106 0 332341 0
[pid=2366/tid=2368] ppid=2364 vsize=1347352 CPUtime=1061.8 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 152932 0 0 0 106149 31 0 0 25 0 4 0 669893089 1379688448 257114 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1347352 CPUtime=1054.76 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 103167 0 0 0 105453 23 0 0 25 0 4 0 669893089 1379688448 257114 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1347352 CPUtime=1055.29 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 9008415 0 0 0 104159 1370 0 0 25 0 4 0 669893089 1379688448 257114 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4234.21
Current children cumulated vsize (KiB) 1347352

[startup+1122.3 s]
/proc/loadavg: 4.99 7.06 7.68 5/396 2431
/proc/meminfo: memFree=11545188/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1347352 CPUtime=4473.44 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 10342976 0 0 0 445758 1586 0 0 25 0 4 0 669893042 1379688448 264198 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 336838 264199 347 106 0 332341 0
[pid=2366/tid=2368] ppid=2364 vsize=1347352 CPUtime=1121.81 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 156473 0 0 0 112149 32 0 0 25 0 4 0 669893089 1379688448 264199 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352145 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1347352 CPUtime=1113.99 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 104561 0 0 0 111376 23 0 0 25 0 4 0 669893089 1379688448 264199 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1347352 CPUtime=1115.29 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 9854907 0 0 0 110037 1492 0 0 25 0 4 0 669893089 1379688448 264199 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4473.44
Current children cumulated vsize (KiB) 1347352

[startup+1182.3 s]
/proc/loadavg: 4.45 6.56 7.47 5/396 2432
/proc/meminfo: memFree=11523660/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1413908 CPUtime=4712.68 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 10978015 0 0 0 469591 1677 0 0 25 0 4 0 669893042 1447841792 268795 33554432000 4194304 4625164 140735813563152 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 353477 268795 347 106 0 348980 0
[pid=2366/tid=2368] ppid=2364 vsize=1413908 CPUtime=1181.8 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 159173 0 0 0 118148 32 0 0 25 0 4 0 669893089 1447841792 268795 33554432000 4194304 4625164 140735813563152 18446744073709551615 4352192 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1413908 CPUtime=1173.23 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 105127 0 0 0 117300 23 0 0 25 0 4 0 669893089 1447841792 268795 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1413908 CPUtime=1175.3 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 10451585 0 0 0 115951 1579 0 0 25 0 4 0 669893089 1447841792 268795 33554432000 4194304 4625164 140735813563152 18446744073709551615 4335107 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4712.68
Current children cumulated vsize (KiB) 1413908



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.2 s]
/proc/loadavg: 4.29 6.35 7.38 5/396 2433
/proc/meminfo: memFree=11498196/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1413908 CPUtime=4800.03 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 11221155 0 0 0 478290 1713 0 0 25 0 4 0 669893042 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 353477 275086 357 106 0 348980 0
[pid=2366/tid=2368] ppid=2364 vsize=1413908 CPUtime=1203.72 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 159510 0 0 0 120339 33 0 0 25 0 4 0 669893089 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1413908 CPUtime=1194.86 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 105308 0 0 0 119463 23 0 0 25 0 4 0 669893089 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1413908 CPUtime=1197.21 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 10693747 0 0 0 118108 1613 0 0 25 0 4 0 669893089 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 1413908

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.2 s]
/proc/loadavg: 4.29 6.35 7.38 5/396 2433
/proc/meminfo: memFree=11498196/32950928 swapFree=57376972/67111528
[pid=2366] ppid=2364 vsize=1413908 CPUtime=4800.03 cores=0,2,4,6
/proc/2366/stat : 2366 (SArTagnan) R 2364 2366 1658 0 -1 4202496 11221155 0 0 0 478290 1713 0 0 25 0 4 0 669893042 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 4 0 0 0
/proc/2366/statm: 353477 275086 357 106 0 348980 0
[pid=2366/tid=2368] ppid=2364 vsize=1413908 CPUtime=1203.72 cores=0,2,4,6
/proc/2366/task/2368/stat : 2368 (SArTagnan) R 2364 2366 1658 0 -1 4202560 159510 0 0 0 120339 33 0 0 25 0 4 0 669893089 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=2366/tid=2369] ppid=2364 vsize=1413908 CPUtime=1194.86 cores=0,2,4,6
/proc/2366/task/2369/stat : 2369 (SArTagnan) R 2364 2366 1658 0 -1 4202560 105308 0 0 0 119463 23 0 0 25 0 4 0 669893089 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=2366/tid=2370] ppid=2364 vsize=1413908 CPUtime=1197.21 cores=0,2,4,6
/proc/2366/task/2370/stat : 2370 (SArTagnan) R 2364 2366 1658 0 -1 4202560 10693747 0 0 0 118108 1613 0 0 25 0 4 0 669893089 1447841792 275086 33554432000 4194304 4625164 140735813563152 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.03
Current children cumulated vsize (KiB) 1413908

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.28
CPU time (s): 4800.15
CPU user time (s): 4782.96
CPU system time (s): 17.1894
CPU usage (%): 398.592
Max. virtual memory (cumulated for all children) (KiB): 1435928

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4782.96
system time used= 17.1894
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11221157
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3061
involuntary context switches= 21158

runsolver used 4.37933 second user time and 11.0353 second system time

The end

Launcher Data 

Begin job on node127 at 2011-05-16 23:55:34
IDJOB=3386240
IDBENCH=84806
IDSOLVER=1871
FILE ID=node127/3386240-1305582933
RUNJOBID= node127-1305581554-2113
PBS_JOBID= 13350216
Free space on /tmp= 73364 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT04/industrial/vangelder/cnf-color/abb313GPIA-9-c.used-as.sat04-317.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386240-1305582933/watcher-3386240-1305582933 -o /tmp/evaluation-result-3386240-1305582933/solver-3386240-1305582933 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386240-1305582933.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 65c5a1442ec07e466934f093e50229c2
RANDOM SEED=490019913

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12315508 kB
Buffers:         84512 kB
Cached:         494048 kB
SwapCached:     117904 kB
Active:        5857212 kB
Inactive:     14557100 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12315508 kB
SwapTotal:    67111528 kB
SwapFree:     57376972 kB
Dirty:           20920 kB
Writeback:           0 kB
AnonPages:    19723344 kB
Mapped:          27020 kB
Slab:            72836 kB
PageTables:      81208 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 84993948 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73364 MiB
End job on node127 at 2011-05-17 00:15:40