Trace number 3386195

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3891.65 1300.3

General information on the benchmark

NameAPPLICATIONS/diagnosis/
UR-20-10p1.cnf
MD5SUM6ace5cfbe110f1a43049037cb7432998
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables259234
Number of clauses1387934
Sum of the clauses size3351923
Maximum clause length10
Minimum clause length1
Number of clauses of size 113149
Number of clauses of size 2981661
Number of clauses of size 3327764
Number of clauses of size 47260
Number of clauses of size 529040
Number of clauses of size over 529060

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386195-1305577862/watcher-3386195-1305577862 -o /tmp/evaluation-result-3386195-1305577862/solver-3386195-1305577862 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386195-1305577862.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.98 9.24 7.83 8/399 26104
/proc/meminfo: memFree=21786448/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=39812 CPUtime=0 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 4290 0 0 0 0 0 0 0 23 0 1 0 669384469 40767488 4229 33554432000 4194304 4625164 140734653243248 18446744073709551615 4295708 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26104/statm: 9953 4241 291 106 0 5456 0

[startup+0.0170941 s]
/proc/loadavg: 7.98 9.24 7.83 8/399 26104
/proc/meminfo: memFree=21786448/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=72500 CPUtime=0.01 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 5059 0 0 0 1 0 0 0 23 0 1 0 669384469 74240000 4998 33554432000 4194304 4625164 140734653243248 18446744073709551615 232335892224 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26104/statm: 18125 4999 295 106 0 13628 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 72500

[startup+0.101115 s]
/proc/loadavg: 7.98 9.24 7.83 8/399 26104
/proc/meminfo: memFree=21786448/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=81172 CPUtime=0.08 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 9529 0 0 0 8 0 0 0 23 0 1 0 669384469 83120128 6762 33554432000 4194304 4625164 140734653243248 18446744073709551615 232335892224 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26104/statm: 20293 6763 296 106 0 15796 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 81172

[startup+0.301079 s]
/proc/loadavg: 7.98 9.24 7.83 8/399 26104
/proc/meminfo: memFree=21786448/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=99848 CPUtime=0.29 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 15752 0 0 0 27 2 0 0 24 0 1 0 669384469 102244352 11598 33554432000 4194304 4625164 140734653243248 18446744073709551615 232335892224 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26104/statm: 24962 11599 296 106 0 20465 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 99848

[startup+0.701006 s]
/proc/loadavg: 7.98 9.24 7.83 8/399 26104
/proc/meminfo: memFree=21786448/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=256548 CPUtime=0.69 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 53254 0 0 0 63 6 0 0 25 0 1 0 669384469 262705152 43898 33554432000 4194304 4625164 140734653243248 18446744073709551615 4277645 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/26104/statm: 64137 43923 301 106 0 59640 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 256548

[startup+1.50084 s]
/proc/loadavg: 7.98 9.24 7.83 11/403 26108
/proc/meminfo: memFree=21546236/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=474800 CPUtime=2.36 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 71312 0 0 0 228 8 0 0 25 0 4 0 669384469 486195200 61955 33554432000 4194304 4625164 140734653243248 18446744073709551615 4364911 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 118700 61955 335 106 0 114203 0
[pid=26104/tid=26106] ppid=26102 vsize=474800 CPUtime=0.6 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 1964 0 0 0 60 0 0 0 25 0 4 0 669384541 486195200 61955 33554432000 4194304 4625164 140734653243248 18446744073709551615 4334354 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=474800 CPUtime=0.51 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 881 0 0 0 51 0 0 0 25 0 4 0 669384541 486195200 61955 33554432000 4194304 4625164 140734653243248 18446744073709551615 4477961 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=474800 CPUtime=0.3 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 3638 0 0 0 30 0 0 0 25 0 4 0 669384541 486195200 61955 33554432000 4194304 4625164 140734653243248 18446744073709551615 4334910 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2.36
Current children cumulated vsize (KiB) 474800

[startup+3.10055 s]
/proc/loadavg: 7.98 9.24 7.83 11/403 26108
/proc/meminfo: memFree=21540036/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=474800 CPUtime=6.35 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 71552 0 0 0 627 8 0 0 25 0 4 0 669384469 486195200 60971 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390553 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 118700 60971 336 106 0 114203 0
[pid=26104/tid=26106] ppid=26102 vsize=474800 CPUtime=2.18 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 2060 0 0 0 218 0 0 0 25 0 4 0 669384541 486195200 60971 33554432000 4194304 4625164 140734653243248 18446744073709551615 4351752 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=474800 CPUtime=1.31 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 884 0 0 0 131 0 0 0 25 0 4 0 669384541 486195200 60971 33554432000 4194304 4625164 140734653243248 18446744073709551615 4317543 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=474800 CPUtime=1 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 3752 0 0 0 100 0 0 0 25 0 4 0 669384541 486195200 60971 33554432000 4194304 4625164 140734653243248 18446744073709551615 4477913 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.35
Current children cumulated vsize (KiB) 474800

[startup+6.30098 s]
/proc/loadavg: 8.14 9.26 7.84 11/403 26108
/proc/meminfo: memFree=21533120/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=474800 CPUtime=14.31 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 73786 0 0 0 1422 9 0 0 25 0 4 0 669384469 486195200 62752 33554432000 4194304 4625164 140734653243248 18446744073709551615 4278644 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 118700 62752 336 106 0 114203 0
[pid=26104/tid=26106] ppid=26102 vsize=474800 CPUtime=5.34 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 3792 0 0 0 534 0 0 0 25 0 4 0 669384541 486195200 62752 33554432000 4194304 4625164 140734653243248 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=474800 CPUtime=2.91 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 987 0 0 0 291 0 0 0 25 0 4 0 669384541 486195200 62752 33554432000 4194304 4625164 140734653243248 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=474800 CPUtime=2.6 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 3752 0 0 0 260 0 0 0 25 0 4 0 669384541 486195200 62752 33554432000 4194304 4625164 140734653243248 18446744073709551615 4477944 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 14.31
Current children cumulated vsize (KiB) 474800

[startup+12.7008 s]
/proc/loadavg: 7.97 9.20 7.83 11/403 26139
/proc/meminfo: memFree=22313172/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=492584 CPUtime=32.57 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 82142 0 0 0 3246 11 0 0 25 0 4 0 669384469 504406016 70841 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26104/statm: 123146 70841 337 106 0 118649 0
[pid=26104/tid=26106] ppid=26102 vsize=492584 CPUtime=10.93 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 6832 0 0 0 1092 1 0 0 25 0 4 0 669384541 504406016 70841 33554432000 4194304 4625164 140734653243248 18446744073709551615 4288900 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=492584 CPUtime=8.46 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 2106 0 0 0 846 0 0 0 25 0 4 0 669384541 504406016 70841 33554432000 4194304 4625164 140734653243248 18446744073709551615 4352636 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=492584 CPUtime=6.61 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 3752 0 0 0 661 0 0 0 25 0 4 0 669384541 504406016 70841 33554432000 4194304 4625164 140734653243248 18446744073709551615 4477982 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 32.57
Current children cumulated vsize (KiB) 492584

[startup+25.5006 s]
/proc/loadavg: 8.50 9.26 7.87 11/403 26169
/proc/meminfo: memFree=22363552/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=624460 CPUtime=70.79 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 200893 0 0 0 7051 28 0 0 25 0 4 0 669384469 639447040 104048 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390651 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/26104/statm: 156115 104048 337 106 0 151618 0
[pid=26104/tid=26106] ppid=26102 vsize=624460 CPUtime=21.16 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 14131 0 0 0 2114 2 0 0 25 0 4 0 669384541 639447040 104048 33554432000 4194304 4625164 140734653243248 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=624460 CPUtime=19.72 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 10188 0 0 0 1969 3 0 0 25 0 4 0 669384541 639447040 104048 33554432000 4194304 4625164 140734653243248 18446744073709551615 4278488 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=624460 CPUtime=15.19 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 47758 0 0 0 1513 6 0 0 25 0 4 0 669384541 639447040 104048 33554432000 4194304 4625164 140734653243248 18446744073709551615 4340066 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 70.79
Current children cumulated vsize (KiB) 624460

[startup+51.101 s]
/proc/loadavg: 9.09 9.33 7.93 11/403 26170
/proc/meminfo: memFree=22052912/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=907260 CPUtime=147.27 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 347547 0 0 0 14672 55 0 0 25 0 4 0 669384469 929034240 163943 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26104/statm: 226815 163943 337 106 0 222318 0
[pid=26104/tid=26106] ppid=26102 vsize=907260 CPUtime=44.95 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 28154 0 0 0 4488 7 0 0 25 0 4 0 669384541 929034240 163943 33554432000 4194304 4625164 140734653243248 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=907260 CPUtime=45.26 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 34825 0 0 0 4517 9 0 0 25 0 4 0 669384541 929034240 163943 33554432000 4194304 4625164 140734653243248 18446744073709551615 4316669 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=907260 CPUtime=27.91 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 70080 0 0 0 2781 10 0 0 25 0 4 0 669384541 929034240 163943 33554432000 4194304 4625164 140734653243248 18446744073709551615 4469375 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 147.27
Current children cumulated vsize (KiB) 907260

[startup+102.315 s]
/proc/loadavg: 9.71 9.46 8.05 11/403 26171
/proc/meminfo: memFree=21629548/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=1224040 CPUtime=300.22 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 598565 0 0 0 29927 95 0 0 25 0 4 0 669384469 1253416960 245036 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390569 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26104/statm: 306010 245036 337 106 0 301513 0
[pid=26104/tid=26106] ppid=26102 vsize=1224040 CPUtime=87.33 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 44939 0 0 0 8722 11 0 0 25 0 4 0 669384541 1253416960 245036 33554432000 4194304 4625164 140734653243248 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=1224040 CPUtime=81.24 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 52989 0 0 0 8111 13 0 0 25 0 4 0 669384541 1253416960 245036 33554432000 4194304 4625164 140734653243248 18446744073709551615 4278665 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=1224040 CPUtime=70.19 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 180581 0 0 0 6992 27 0 0 25 0 4 0 669384541 1253416960 245036 33554432000 4194304 4625164 140734653243248 18446744073709551615 4334251 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 300.22
Current children cumulated vsize (KiB) 1224040

[startup+162.3 s]
/proc/loadavg: 10.17 9.64 8.20 11/403 26173
/proc/meminfo: memFree=21095572/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=1593604 CPUtime=479.4 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 896309 0 0 0 47800 140 0 0 25 0 4 0 669384469 1631850496 338530 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 398401 338530 337 106 0 393904 0
[pid=26104/tid=26106] ppid=26102 vsize=1593604 CPUtime=141.03 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 77155 0 0 0 14085 18 0 0 25 0 4 0 669384541 1631850496 338530 33554432000 4194304 4625164 140734653243248 18446744073709551615 232335559642 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=1593604 CPUtime=140.58 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 78833 0 0 0 14041 17 0 0 25 0 4 0 669384541 1631850496 338530 33554432000 4194304 4625164 140734653243248 18446744073709551615 4317274 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=1593604 CPUtime=100.75 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 298942 0 0 0 10031 44 0 0 25 0 4 0 669384541 1631850496 338530 33554432000 4194304 4625164 140734653243248 18446744073709551615 4288793 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 479.4
Current children cumulated vsize (KiB) 1593604

[startup+222.301 s]
/proc/loadavg: 10.19 9.73 8.32 11/403 26175
/proc/meminfo: memFree=20588656/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=2097220 CPUtime=658.62 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 1178122 0 0 0 65679 183 0 0 25 0 4 0 669384469 2147553280 444771 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390555 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/26104/statm: 524305 444771 337 106 0 519808 0
[pid=26104/tid=26106] ppid=26102 vsize=2097220 CPUtime=200.25 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 89112 0 0 0 20004 21 0 0 25 0 4 0 669384541 2147553280 444771 33554432000 4194304 4625164 140734653243248 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=2097220 CPUtime=183.02 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 107373 0 0 0 18279 23 0 0 25 0 4 0 669384541 2147553280 444771 33554432000 4194304 4625164 140734653243248 18446744073709551615 4316984 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=2097220 CPUtime=145.13 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 370104 0 0 0 14459 54 0 0 25 0 4 0 669384541 2147553280 444771 33554432000 4194304 4625164 140734653243248 18446744073709551615 4375455 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 658.62
Current children cumulated vsize (KiB) 2097220

[startup+282.301 s]

################
# More data... #
################


[startup+762.316 s]
/proc/loadavg: 9.26 9.69 8.97 10/402 26189
/proc/meminfo: memFree=16771668/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=5645248 CPUtime=2271.68 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 4002163 0 0 0 226549 619 0 0 25 0 4 0 669384469 5780733952 1264498 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390609 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/26104/statm: 1411312 1264498 344 106 0 1406815 0
[pid=26104/tid=26106] ppid=26102 vsize=5645248 CPUtime=636.04 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 113174 0 0 0 63577 27 0 0 25 0 4 0 669384541 5780733952 1264498 33554432000 4194304 4625164 140734653243248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=5645248 CPUtime=586.31 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 224192 0 0 0 58582 49 0 0 25 0 4 0 669384541 5780733952 1264498 33554432000 4194304 4625164 140734653243248 18446744073709551615 4317326 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=5645248 CPUtime=524.32 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 1493590 0 0 0 52212 220 0 0 25 0 4 0 669384541 5780733952 1264498 33554432000 4194304 4625164 140734653243248 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2271.68
Current children cumulated vsize (KiB) 5645248

[startup+822.301 s]
/proc/loadavg: 9.21 9.60 8.99 10/402 26191
/proc/meminfo: memFree=16039320/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=6997020 CPUtime=2450.86 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 4787746 0 0 0 244363 723 0 0 25 0 4 0 669384469 7164948480 1431220 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390638 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/26104/statm: 1749255 1431220 352 106 0 1744758 0
[pid=26104/tid=26106] ppid=26102 vsize=6997020 CPUtime=683.56 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 113776 0 0 0 68328 28 0 0 25 0 4 0 669384541 7164948480 1431220 33554432000 4194304 4625164 140734653243248 18446744073709551615 4330603 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=6997020 CPUtime=645.86 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 232175 0 0 0 64535 51 0 0 25 0 4 0 669384541 7164948480 1431220 33554432000 4194304 4625164 140734653243248 18446744073709551615 4464722 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=6997020 CPUtime=554.88 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 1590555 0 0 0 55255 233 0 0 25 0 4 0 669384541 7164948480 1431220 33554432000 4194304 4625164 140734653243248 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2450.86
Current children cumulated vsize (KiB) 6997020

[startup+882.3 s]
/proc/loadavg: 9.26 9.54 9.00 10/402 26192
/proc/meminfo: memFree=15833956/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=7098924 CPUtime=2630.08 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 4892956 0 0 0 262268 740 0 0 25 0 4 0 669384469 7269298176 1473430 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390540 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/26104/statm: 1774731 1473430 349 106 0 1770234 0
[pid=26104/tid=26106] ppid=26102 vsize=7098924 CPUtime=742.78 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 114461 0 0 0 74250 28 0 0 25 0 4 0 669384541 7269298176 1473430 33554432000 4194304 4625164 140734653243248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=7098924 CPUtime=705.84 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 244491 0 0 0 70530 54 0 0 25 0 4 0 669384541 7269298176 1473430 33554432000 4194304 4625164 140734653243248 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=7098924 CPUtime=584.86 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 1647751 0 0 0 58245 241 0 0 25 0 4 0 669384541 7269298176 1473430 33554432000 4194304 4625164 140734653243248 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2630.08
Current children cumulated vsize (KiB) 7098924

[startup+942.301 s]
/proc/loadavg: 9.27 9.49 9.01 10/402 26194
/proc/meminfo: memFree=15528648/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=7267184 CPUtime=2809.31 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 5045645 0 0 0 280161 770 0 0 25 0 4 0 669384469 7441596416 1540334 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/26104/statm: 1816796 1540334 344 106 0 1812299 0
[pid=26104/tid=26106] ppid=26102 vsize=7267184 CPUtime=802.01 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 114979 0 0 0 80173 28 0 0 25 0 4 0 669384541 7441596416 1540334 33554432000 4194304 4625164 140734653243248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=7267184 CPUtime=764.67 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 258914 0 0 0 76410 57 0 0 25 0 4 0 669384541 7441596416 1540334 33554432000 4194304 4625164 140734653243248 18446744073709551615 4317246 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=7267184 CPUtime=615.1 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 1749016 0 0 0 61253 257 0 0 25 0 4 0 669384541 7441596416 1540334 33554432000 4194304 4625164 140734653243248 18446744073709551615 4339927 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2809.31
Current children cumulated vsize (KiB) 7267184

[startup+1002.3 s]
/proc/loadavg: 9.35 9.46 9.03 10/402 26195
/proc/meminfo: memFree=15283968/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=7465196 CPUtime=2988.54 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 5276792 0 0 0 298046 808 0 0 25 0 4 0 669384469 7644360704 1590142 33554432000 4194304 4625164 140734653243248 18446744073709551615 4390638 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 1866299 1590142 344 106 0 1861802 0
[pid=26104/tid=26106] ppid=26102 vsize=7465196 CPUtime=861.24 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 115376 0 0 0 86096 28 0 0 25 0 4 0 669384541 7644360704 1590142 33554432000 4194304 4625164 140734653243248 18446744073709551615 4330613 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=7465196 CPUtime=796.89 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 265778 0 0 0 79631 58 0 0 25 0 4 0 669384541 7644360704 1590142 33554432000 4194304 4625164 140734653243248 18446744073709551615 4469375 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=7465196 CPUtime=672.83 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 1942523 0 0 0 66995 288 0 0 25 0 4 0 669384541 7644360704 1590142 33554432000 4194304 4625164 140734653243248 18446744073709551615 232335551002 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2988.54
Current children cumulated vsize (KiB) 7465196

[startup+1062.3 s]
/proc/loadavg: 9.25 9.40 9.04 11/402 26197
/proc/meminfo: memFree=15026752/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=7750824 CPUtime=3181.29 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 5565583 0 0 0 317276 853 0 0 25 0 4 0 669384469 7936843776 1641703 33554432000 4194304 4625164 140734653243248 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 1937706 1641703 349 106 0 1933209 0
[pid=26104/tid=26106] ppid=26102 vsize=7750824 CPUtime=904.67 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 127373 0 0 0 90437 30 0 0 25 0 4 0 669384541 7936843776 1641703 33554432000 4194304 4625164 140734653243248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=7750824 CPUtime=840.14 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 284715 0 0 0 83953 61 0 0 25 0 4 0 669384541 7936843776 1641703 33554432000 4194304 4625164 140734653243248 18446744073709551615 4317274 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=7750824 CPUtime=732.69 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 2095250 0 0 0 72958 311 0 0 25 0 4 0 669384541 7936843776 1641703 33554432000 4194304 4625164 140734653243248 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3181.29
Current children cumulated vsize (KiB) 7750824

[startup+1122.3 s]
/proc/loadavg: 9.33 9.40 9.06 10/402 26199
/proc/meminfo: memFree=14743256/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=7839816 CPUtime=3360.5 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 5791075 0 0 0 335162 888 0 0 25 0 4 0 669384469 8027971584 1697793 33554432000 4194304 4625164 140734653243248 18446744073709551615 4360194 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 1959954 1697794 346 106 0 1955457 0
[pid=26104/tid=26106] ppid=26102 vsize=7839816 CPUtime=935.39 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 129117 0 0 0 93508 31 0 0 25 0 4 0 669384541 8027971584 1697794 33554432000 4194304 4625164 140734653243248 18446744073709551615 4330776 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=7839816 CPUtime=870.06 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 289592 0 0 0 86944 62 0 0 25 0 4 0 669384541 8027971584 1697795 33554432000 4194304 4625164 140734653243248 18446744073709551615 4316714 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=7839816 CPUtime=791.27 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 2271105 0 0 0 78789 338 0 0 25 0 4 0 669384541 8027971584 1697795 33554432000 4194304 4625164 140734653243248 18446744073709551615 4334251 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3360.5
Current children cumulated vsize (KiB) 7839816

[startup+1182.3 s]
/proc/loadavg: 9.22 9.36 9.06 10/402 26200
/proc/meminfo: memFree=14418228/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=8032152 CPUtime=3539.74 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 6065457 0 0 0 353036 938 0 0 25 0 4 0 669384469 8224923648 1769070 33554432000 4194304 4625164 140734653243248 18446744073709551615 4509401 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 2008038 1769070 344 106 0 2003541 0
[pid=26104/tid=26106] ppid=26102 vsize=8032152 CPUtime=984.98 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 130087 0 0 0 98467 31 0 0 25 0 4 0 669384541 8224923648 1769070 33554432000 4194304 4625164 140734653243248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=8032152 CPUtime=900.01 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 299468 0 0 0 89936 65 0 0 25 0 4 0 669384541 8224923648 1769070 33554432000 4194304 4625164 140734653243248 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=8032152 CPUtime=849.17 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 2473400 0 0 0 84546 371 0 0 25 0 4 0 669384541 8224923648 1769070 33554432000 4194304 4625164 140734653243248 18446744073709551615 4340066 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3539.74
Current children cumulated vsize (KiB) 8032152

[startup+1242.3 s]
/proc/loadavg: 9.27 9.35 9.08 10/402 26202
/proc/meminfo: memFree=14213484/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=8171492 CPUtime=3718.95 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 6180015 0 0 0 370937 958 0 0 25 0 4 0 669384469 8367607808 1812883 33554432000 4194304 4625164 140734653243248 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 2042873 1812883 344 106 0 2038376 0
[pid=26104/tid=26106] ppid=26102 vsize=8171492 CPUtime=1038.97 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 136940 0 0 0 103865 32 0 0 25 0 4 0 669384541 8367607808 1812883 33554432000 4194304 4625164 140734653243248 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=8171492 CPUtime=943.58 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 307172 0 0 0 94291 67 0 0 25 0 4 0 669384541 8367607808 1812883 33554432000 4194304 4625164 140734653243248 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=8171492 CPUtime=879.07 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 2530776 0 0 0 87526 381 0 0 25 0 4 0 669384541 8367607808 1812883 33554432000 4194304 4625164 140734653243248 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3718.95
Current children cumulated vsize (KiB) 8171492



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.10 9.28 9.07 10/402 26203
/proc/meminfo: memFree=14064804/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=8204320 CPUtime=3891.34 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) R 26102 26104 25968 0 -1 4202496 6324344 0 0 0 388152 982 0 0 25 0 4 0 669384469 8401223680 1840161 33554432000 4194304 4625164 140734653243248 18446744073709551615 4511795 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 2051080 1840161 382 106 0 2046583 0
[pid=26104/tid=26106] ppid=26102 vsize=8204320 CPUtime=1079.67 cores=1,3,5,7
/proc/26104/task/26106/stat : 26106 (SArTagnan) R 26102 26104 25968 0 -1 4202560 137603 0 0 0 107935 32 0 0 25 0 4 0 669384541 8401223680 1840161 33554432000 4194304 4625164 140734653243248 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=8204320 CPUtime=973.66 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4202560 314350 0 0 0 97297 69 0 0 25 0 4 0 669384541 8401223680 1840161 33554432000 4194304 4625164 140734653243248 18446744073709551615 4317329 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=26104/tid=26108] ppid=26102 vsize=8204320 CPUtime=924.34 cores=1,3,5,7
/proc/26104/task/26108/stat : 26108 (SArTagnan) R 26102 26104 25968 0 -1 4202560 2653884 0 0 0 92035 399 0 0 25 0 4 0 669384541 8401223680 1840161 33554432000 4194304 4625164 140734653243248 18446744073709551615 4554639 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3891.34
Current children cumulated vsize (KiB) 8204320

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1300.21 s]
/proc/loadavg: 9.10 9.28 9.07 7/401 26204
/proc/meminfo: memFree=16607292/32951124 swapFree=65173164/67111528
[pid=26104] ppid=26102 vsize=0 CPUtime=3891.56 cores=1,3,5,7
/proc/26104/stat : 26104 (SArTagnan) Z 26102 26104 25968 0 -1 4203548 6324344 0 0 0 388154 1002 0 0 25 0 2 0 669384469 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/26104/statm: 0 0 0 0 0 0 0
[pid=26104/tid=26107] ppid=26102 vsize=0 CPUtime=973.86 cores=1,3,5,7
/proc/26104/task/26107/stat : 26107 (SArTagnan) R 26102 26104 25968 0 -1 4203588 314350 0 0 0 97297 89 0 0 25 0 2 0 669384541 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3891.56
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.3
CPU time (s): 3891.65
CPU user time (s): 3881.54
CPU system time (s): 10.1045
CPU usage (%): 299.288
Max. virtual memory (cumulated for all children) (KiB): 8869412

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3881.54
system time used= 10.1045
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6324344
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10549
involuntary context switches= 32156

runsolver used 4.6223 second user time and 12.1392 second system time

The end

Launcher Data 

Begin job on node132 at 2011-05-16 22:31:03
IDJOB=3386195
IDBENCH=71055
IDSOLVER=1871
FILE ID=node132/3386195-1305577862
RUNJOBID= node132-1305576571-25987
PBS_JOBID= 13350206
Free space on /tmp= 73264 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/APPLICATIONS/diagnosis/UR-20-10p1.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386195-1305577862/watcher-3386195-1305577862 -o /tmp/evaluation-result-3386195-1305577862/solver-3386195-1305577862 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386195-1305577862.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6ace5cfbe110f1a43049037cb7432998
RANDOM SEED=255266195

node132.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.833
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21786728 kB
Buffers:        315560 kB
Cached:        3551804 kB
SwapCached:       9908 kB
Active:        4709280 kB
Inactive:      6123992 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21786728 kB
SwapTotal:    67111528 kB
SwapFree:     65173164 kB
Dirty:           26800 kB
Writeback:           0 kB
AnonPages:     6963436 kB
Mapped:          25216 kB
Slab:           222784 kB
PageTables:      42492 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 79574260 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73264 MiB
End job on node132 at 2011-05-16 22:52:45