Trace number 3386379

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.36 1204.46

General information on the benchmark

Nameindustrial/palacios/hard/
sortnet-7-ipc5-h15-unsat.cnf
MD5SUM0683489092a5eb0c881dd17c2c45d08e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables105623
Number of clauses374254
Sum of the clauses size911890
Maximum clause length43
Minimum clause length1
Number of clauses of size 1128
Number of clauses of size 2269133
Number of clauses of size 399944
Number of clauses of size 4407
Number of clauses of size 5309
Number of clauses of size over 54333

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386379-1305576642/watcher-3386379-1305576642 -o /tmp/evaluation-result-3386379-1305576642/solver-3386379-1305576642 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386379-1305576642.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.88 8.15 8.17 6/427 5321
/proc/meminfo: memFree=19862144/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=20996 CPUtime=0 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 961 0 0 0 0 0 0 0 25 0 1 0 747894933 21499904 900 33554432000 4194304 4625164 140734136296656 18446744073709551615 4295708 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/5321/statm: 5249 910 291 106 0 752 0

[startup+0.102911 s]
/proc/loadavg: 7.88 8.15 8.17 6/427 5321
/proc/meminfo: memFree=19862144/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=45300 CPUtime=0.09 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 7669 0 0 0 9 0 0 0 25 0 1 0 747894933 46387200 4453 33554432000 4194304 4625164 140734136296656 18446744073709551615 260905012736 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/5321/statm: 11325 4453 299 106 0 6828 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 45300

[startup+0.2009 s]
/proc/loadavg: 7.88 8.15 8.17 6/427 5321
/proc/meminfo: memFree=19862144/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=128080 CPUtime=0.21 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 22301 0 0 0 19 2 0 0 25 0 4 0 747894933 131153920 17394 33554432000 4194304 4625164 140734136296656 18446744073709551615 4499327 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 32020 17395 320 106 0 27523 0
Current children cumulated CPU time (s) 0.21
Current children cumulated vsize (KiB) 128080

[startup+0.30088 s]
/proc/loadavg: 7.88 8.15 8.17 6/427 5321
/proc/meminfo: memFree=19862144/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=274136 CPUtime=0.61 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 28967 0 0 0 58 3 0 0 25 0 4 0 747894933 280715264 20614 33554432000 4194304 4625164 140734136296656 18446744073709551615 4276102 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 68534 20614 336 106 0 64037 0
Current children cumulated CPU time (s) 0.61
Current children cumulated vsize (KiB) 274136

[startup+0.700808 s]
/proc/loadavg: 7.88 8.15 8.17 6/427 5321
/proc/meminfo: memFree=19862144/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=281540 CPUtime=2.21 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 34989 0 0 0 217 4 0 0 25 0 4 0 747894933 288296960 22660 33554432000 4194304 4625164 140734136296656 18446744073709551615 4390569 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 70385 22660 336 106 0 65888 0
Current children cumulated CPU time (s) 2.21
Current children cumulated vsize (KiB) 281540

[startup+1.50066 s]
/proc/loadavg: 7.88 8.15 8.17 9/431 5325
/proc/meminfo: memFree=19766640/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=291328 CPUtime=5.39 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 42982 0 0 0 534 5 0 0 25 0 4 0 747894933 298319872 24409 33554432000 4194304 4625164 140734136296656 18446744073709551615 4390569 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 72832 24409 336 106 0 68335 0
[pid=5321/tid=5323] ppid=5319 vsize=291328 CPUtime=1.3 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 5217 0 0 0 130 0 0 0 25 0 4 0 747894952 298319872 24409 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=291328 CPUtime=1.28 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 5084 0 0 0 128 0 0 0 25 0 4 0 747894952 298319872 24409 33554432000 4194304 4625164 140734136296656 18446744073709551615 4317920 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=291328 CPUtime=1.3 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 6889 0 0 0 130 0 0 0 25 0 4 0 747894952 298319872 24409 33554432000 4194304 4625164 140734136296656 18446744073709551615 4335146 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.39
Current children cumulated vsize (KiB) 291328

[startup+3.10037 s]
/proc/loadavg: 7.88 8.15 8.17 9/431 5325
/proc/meminfo: memFree=19760564/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=297372 CPUtime=11.78 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 49757 0 0 0 1171 7 0 0 25 0 4 0 747894933 304508928 26441 33554432000 4194304 4625164 140734136296656 18446744073709551615 4509011 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 74343 26441 341 106 0 69846 0
[pid=5321/tid=5323] ppid=5319 vsize=297372 CPUtime=2.9 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 5554 0 0 0 290 0 0 0 25 0 4 0 747894952 304508928 26441 33554432000 4194304 4625164 140734136296656 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=297372 CPUtime=2.86 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 5518 0 0 0 286 0 0 0 25 0 4 0 747894952 304508928 26441 33554432000 4194304 4625164 140734136296656 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=297372 CPUtime=2.89 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 10549 0 0 0 288 1 0 0 25 0 4 0 747894952 304508928 26441 33554432000 4194304 4625164 140734136296656 18446744073709551615 4551127 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 11.78
Current children cumulated vsize (KiB) 297372

[startup+6.30078 s]
/proc/loadavg: 7.89 8.15 8.17 9/431 5325
/proc/meminfo: memFree=19745724/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=309932 CPUtime=24.54 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 63791 0 0 0 2445 9 0 0 25 0 4 0 747894933 317370368 29592 33554432000 4194304 4625164 140734136296656 18446744073709551615 4390688 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 77483 29592 342 106 0 72986 0
[pid=5321/tid=5323] ppid=5319 vsize=309932 CPUtime=6.1 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 7864 0 0 0 609 1 0 0 25 0 4 0 747894952 317370368 29592 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288734 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=309932 CPUtime=6.02 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 8220 0 0 0 601 1 0 0 25 0 4 0 747894952 317370368 29592 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=309932 CPUtime=6.1 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 19144 0 0 0 607 3 0 0 25 0 4 0 747894952 317370368 29592 33554432000 4194304 4625164 140734136296656 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 24.54
Current children cumulated vsize (KiB) 309932

[startup+12.7006 s]
/proc/loadavg: 7.90 8.14 8.17 9/431 5325
/proc/meminfo: memFree=19726148/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=314984 CPUtime=50.03 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 81896 0 0 0 4992 11 0 0 25 0 4 0 747894933 322543616 32967 33554432000 4194304 4625164 140734136296656 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 78746 32967 342 106 0 74249 0
[pid=5321/tid=5323] ppid=5319 vsize=314984 CPUtime=12.5 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 8493 0 0 0 1249 1 0 0 25 0 4 0 747894952 322543616 32967 33554432000 4194304 4625164 140734136296656 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=314984 CPUtime=12.32 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 11230 0 0 0 1231 1 0 0 25 0 4 0 747894952 322543616 32967 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288883 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=314984 CPUtime=12.5 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 32332 0 0 0 1246 4 0 0 25 0 4 0 747894952 322543616 32967 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.03
Current children cumulated vsize (KiB) 314984

[startup+25.5013 s]
/proc/loadavg: 7.92 8.14 8.16 10/431 5325
/proc/meminfo: memFree=19682136/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=330112 CPUtime=101.06 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 114020 0 0 0 10091 15 0 0 25 0 4 0 747894933 338034688 38041 33554432000 4194304 4625164 140734136296656 18446744073709551615 4512304 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 82528 38041 343 106 0 78031 0
[pid=5321/tid=5323] ppid=5319 vsize=330112 CPUtime=25.3 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 10859 0 0 0 2529 1 0 0 25 0 4 0 747894952 338034688 38041 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=330112 CPUtime=24.94 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 12252 0 0 0 2492 2 0 0 25 0 4 0 747894952 338034688 38041 33554432000 4194304 4625164 140734136296656 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=330112 CPUtime=25.3 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 57926 0 0 0 2523 7 0 0 25 0 4 0 747894952 338034688 38041 33554432000 4194304 4625164 140734136296656 18446744073709551615 4334251 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.06
Current children cumulated vsize (KiB) 330112

[startup+51.1006 s]
/proc/loadavg: 8.03 8.14 8.16 9/431 5326
/proc/meminfo: memFree=19566860/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=361512 CPUtime=203.12 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 171728 0 0 0 20288 24 0 0 25 0 4 0 747894933 370188288 48579 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511795 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/5321/statm: 90378 48579 343 106 0 85881 0
[pid=5321/tid=5323] ppid=5319 vsize=361512 CPUtime=50.9 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 22330 0 0 0 5088 2 0 0 25 0 4 0 747894952 370188288 48579 33554432000 4194304 4625164 140734136296656 18446744073709551615 4353016 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=361512 CPUtime=50.2 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 19290 0 0 0 5017 3 0 0 25 0 4 0 747894952 370188288 48579 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=361512 CPUtime=50.89 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 96136 0 0 0 5077 12 0 0 25 0 4 0 747894952 370188288 48579 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351989 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 203.12
Current children cumulated vsize (KiB) 361512

[startup+102.301 s]
/proc/loadavg: 8.05 8.13 8.16 9/431 5327
/proc/meminfo: memFree=19037336/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=780160 CPUtime=407.23 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 431741 0 0 0 40663 60 0 0 25 0 4 0 747894933 798883840 158651 33554432000 4194304 4625164 140734136296656 18446744073709551615 4390435 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 195040 158651 420 106 0 190543 0
[pid=5321/tid=5323] ppid=5319 vsize=780160 CPUtime=102.12 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 31547 0 0 0 10208 4 0 0 25 0 4 0 747894952 798883840 158651 33554432000 4194304 4625164 140734136296656 18446744073709551615 4477982 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=780160 CPUtime=100.77 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 25569 0 0 0 10072 5 0 0 25 0 4 0 747894952 798883840 158651 33554432000 4194304 4625164 140734136296656 18446744073709551615 4477965 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=780160 CPUtime=102.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 201835 0 0 0 10183 29 0 0 25 0 4 0 747894952 798883840 158651 33554432000 4194304 4625164 140734136296656 18446744073709551615 4477965 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 407.23
Current children cumulated vsize (KiB) 780160

[startup+162.3 s]
/proc/loadavg: 8.14 8.14 8.16 9/431 5329
/proc/meminfo: memFree=18795848/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=996020 CPUtime=646.37 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 514732 0 0 0 64567 70 0 0 25 0 4 0 747894933 1019924480 197672 33554432000 4194304 4625164 140734136296656 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 249005 197672 544 106 0 244508 0
[pid=5321/tid=5323] ppid=5319 vsize=996020 CPUtime=162.1 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 48782 0 0 0 16204 6 0 0 25 0 4 0 747894952 1019924480 197672 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=996020 CPUtime=160.74 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 48947 0 0 0 16067 7 0 0 25 0 4 0 747894952 1019924480 197672 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=996020 CPUtime=162.1 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 223769 0 0 0 16179 31 0 0 25 0 4 0 747894952 1019924480 197672 33554432000 4194304 4625164 140734136296656 18446744073709551615 4334238 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 646.37
Current children cumulated vsize (KiB) 996020

[startup+222.316 s]
/proc/loadavg: 8.05 8.11 8.15 9/431 5331
/proc/meminfo: memFree=18703788/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1023652 CPUtime=885.6 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 521663 0 0 0 88489 71 0 0 25 0 4 0 747894933 1048219648 204557 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 255913 204557 528 106 0 251416 0
[pid=5321/tid=5323] ppid=5319 vsize=1023652 CPUtime=222.11 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 48782 0 0 0 22205 6 0 0 25 0 4 0 747894952 1048219648 204557 33554432000 4194304 4625164 140734136296656 18446744073709551615 4352223 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1023652 CPUtime=220.77 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 49401 0 0 0 22069 8 0 0 25 0 4 0 747894952 1048219648 204557 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1023652 CPUtime=222.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 229016 0 0 0 22180 32 0 0 25 0 4 0 747894952 1048219648 204557 33554432000 4194304 4625164 140734136296656 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 885.6
Current children cumulated vsize (KiB) 1023652

[startup+282.3 s]

################
# More data... #
################

[pid=5321] ppid=5319 vsize=1200608 CPUtime=2798.94 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 914204 0 0 0 279766 128 0 0 25 0 4 0 747894933 1229422592 236260 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511959 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 300152 236260 347 106 0 295655 0
[pid=5321/tid=5323] ppid=5319 vsize=1200608 CPUtime=702.05 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 61493 0 0 0 70197 8 0 0 25 0 4 0 747894952 1229422592 236260 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1200608 CPUtime=700.76 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 58838 0 0 0 70067 9 0 0 25 0 4 0 747894952 1229422592 236260 33554432000 4194304 4625164 140734136296656 18446744073709551615 4317339 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1200608 CPUtime=702.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 544974 0 0 0 70135 77 0 0 25 0 4 0 747894952 1229422592 236260 33554432000 4194304 4625164 140734136296656 18446744073709551615 4579358 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2798.94
Current children cumulated vsize (KiB) 1200608

[startup+762.3 s]
/proc/loadavg: 8.04 8.07 8.09 9/431 5345
/proc/meminfo: memFree=17970944/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1218636 CPUtime=3038.14 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 1002093 0 0 0 303674 140 0 0 25 0 4 0 747894933 1247883264 240561 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 304659 240561 347 106 0 300162 0
[pid=5321/tid=5323] ppid=5319 vsize=1218636 CPUtime=762.05 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 64679 0 0 0 76197 8 0 0 25 0 4 0 747894952 1247883264 240561 33554432000 4194304 4625164 140734136296656 18446744073709551615 4375338 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1218636 CPUtime=760.78 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 58995 0 0 0 76068 10 0 0 25 0 4 0 747894952 1247883264 240561 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1218636 CPUtime=762.13 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 628779 0 0 0 76126 87 0 0 25 0 4 0 747894952 1247883264 240561 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3038.14
Current children cumulated vsize (KiB) 1218636

[startup+822.3 s]
/proc/loadavg: 8.10 8.08 8.09 9/431 5347
/proc/meminfo: memFree=17887556/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1222540 CPUtime=3277.29 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 1210274 0 0 0 327560 169 0 0 25 0 4 0 747894933 1251880960 246184 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 305635 246184 348 106 0 301138 0
[pid=5321/tid=5323] ppid=5319 vsize=1222540 CPUtime=822.03 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 65551 0 0 0 82194 9 0 0 25 0 4 0 747894952 1251880960 246184 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1222540 CPUtime=820.76 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 59185 0 0 0 82066 10 0 0 25 0 4 0 747894952 1251880960 246184 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1222540 CPUtime=822.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 835052 0 0 0 82096 116 0 0 25 0 4 0 747894952 1251880960 246184 33554432000 4194304 4625164 140734136296656 18446744073709551615 4334603 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3277.29
Current children cumulated vsize (KiB) 1222540

[startup+882.316 s]
/proc/loadavg: 8.18 8.11 8.10 9/431 5348
/proc/meminfo: memFree=17806288/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1319496 CPUtime=3516.52 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 1518778 0 0 0 351439 213 0 0 25 0 4 0 747894933 1351163904 251770 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 329874 251770 347 106 0 325377 0
[pid=5321/tid=5323] ppid=5319 vsize=1319496 CPUtime=882.03 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 82731 0 0 0 88192 11 0 0 25 0 4 0 747894952 1351163904 251770 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1319496 CPUtime=880.78 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 59602 0 0 0 88068 10 0 0 25 0 4 0 747894952 1351163904 251770 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351839 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1319496 CPUtime=882.14 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 1125104 0 0 0 88056 158 0 0 25 0 4 0 747894952 1351163904 251770 33554432000 4194304 4625164 140734136296656 18446744073709551615 4335146 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3516.52
Current children cumulated vsize (KiB) 1319496

[startup+942.3 s]
/proc/loadavg: 8.23 8.13 8.10 9/431 5350
/proc/meminfo: memFree=17701692/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1391748 CPUtime=3755.64 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 1714128 0 0 0 375321 243 0 0 25 0 4 0 747894933 1425149952 259178 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 347937 259178 349 106 0 343440 0
[pid=5321/tid=5323] ppid=5319 vsize=1391748 CPUtime=942.01 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 83111 0 0 0 94190 11 0 0 25 0 4 0 747894952 1425149952 259178 33554432000 4194304 4625164 140734136296656 18446744073709551615 4463742 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1391748 CPUtime=940.76 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 59718 0 0 0 94066 10 0 0 25 0 4 0 747894952 1425149952 259178 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1391748 CPUtime=942.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 1318953 0 0 0 94025 187 0 0 25 0 4 0 747894952 1425149952 259178 33554432000 4194304 4625164 140734136296656 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3755.64
Current children cumulated vsize (KiB) 1391748

[startup+1002.3 s]
/proc/loadavg: 8.11 8.12 8.10 9/431 5351
/proc/meminfo: memFree=17537948/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1483344 CPUtime=3994.61 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 1795158 0 0 0 399205 256 0 0 25 0 4 0 747894933 1518944256 279336 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511846 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 370836 279336 348 106 0 366339 0
[pid=5321/tid=5323] ppid=5319 vsize=1483344 CPUtime=1001.96 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 94922 0 0 0 100182 14 0 0 25 0 4 0 747894952 1518944256 279336 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1483344 CPUtime=1000.77 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 60842 0 0 0 100066 11 0 0 25 0 4 0 747894952 1518944256 279336 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1483344 CPUtime=1002.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 1380183 0 0 0 100017 195 0 0 25 0 4 0 747894952 1518944256 279336 33554432000 4194304 4625164 140734136296656 18446744073709551615 4554582 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3994.61
Current children cumulated vsize (KiB) 1483344

[startup+1062.3 s]
/proc/loadavg: 8.12 8.11 8.09 9/431 5353
/proc/meminfo: memFree=17491516/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1483816 CPUtime=4233.8 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 1910528 0 0 0 423107 273 0 0 25 0 4 0 747894933 1519427584 282880 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 370954 282880 347 106 0 366457 0
[pid=5321/tid=5323] ppid=5319 vsize=1483816 CPUtime=1061.95 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 94922 0 0 0 106181 14 0 0 25 0 4 0 747894952 1519427584 282880 33554432000 4194304 4625164 140734136296656 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1483816 CPUtime=1060.77 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 61197 0 0 0 106066 11 0 0 25 0 4 0 747894952 1519427584 282880 33554432000 4194304 4625164 140734136296656 18446744073709551615 4316700 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1483816 CPUtime=1062.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 1494280 0 0 0 106001 211 0 0 25 0 4 0 747894952 1519427584 282880 33554432000 4194304 4625164 140734136296656 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4233.8
Current children cumulated vsize (KiB) 1483816

[startup+1122.3 s]
/proc/loadavg: 8.04 8.09 8.09 9/431 5386
/proc/meminfo: memFree=18771148/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1483816 CPUtime=4472.97 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 2309269 0 0 0 446969 328 0 0 25 0 4 0 747894933 1519427584 287352 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 370954 287352 348 106 0 366457 0
[pid=5321/tid=5323] ppid=5319 vsize=1483816 CPUtime=1121.94 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 95170 0 0 0 112180 14 0 0 25 0 4 0 747894952 1519427584 287352 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1483816 CPUtime=1120.77 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 61322 0 0 0 112066 11 0 0 25 0 4 0 747894952 1519427584 287352 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1483816 CPUtime=1122.12 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 1892369 0 0 0 111946 266 0 0 25 0 4 0 747894952 1519427584 287352 33554432000 4194304 4625164 140734136296656 18446744073709551615 4334441 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4472.97
Current children cumulated vsize (KiB) 1483816

[startup+1182.3 s]
/proc/loadavg: 8.08 8.10 8.09 9/431 5387
/proc/meminfo: memFree=18450568/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1483816 CPUtime=4712.15 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 2703420 0 0 0 470833 382 0 0 25 0 4 0 747894933 1519427584 290096 33554432000 4194304 4625164 140734136296656 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 370954 290096 347 106 0 366457 0
[pid=5321/tid=5323] ppid=5319 vsize=1483816 CPUtime=1181.92 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 95444 0 0 0 118178 14 0 0 25 0 4 0 747894952 1519427584 290096 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1483816 CPUtime=1180.77 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 61504 0 0 0 118066 11 0 0 25 0 4 0 747894952 1519427584 290096 33554432000 4194304 4625164 140734136296656 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1483816 CPUtime=1182.13 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 2285849 0 0 0 117893 320 0 0 25 0 4 0 747894952 1519427584 290096 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4712.15
Current children cumulated vsize (KiB) 1483816



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204.4 s]
/proc/loadavg: 8.12 8.11 8.09 9/431 5418
/proc/meminfo: memFree=18734080/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1504672 CPUtime=4800.26 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 2857793 0 0 0 479621 405 0 0 25 0 4 0 747894933 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4512032 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 376168 292115 347 106 0 371671 0
[pid=5321/tid=5323] ppid=5319 vsize=1504672 CPUtime=1204.04 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 95728 0 0 0 120389 15 0 0 25 0 4 0 747894952 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1504672 CPUtime=1202.88 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 72380 0 0 0 120276 12 0 0 25 0 4 0 747894952 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1504672 CPUtime=1204.24 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 2428935 0 0 0 120083 341 0 0 25 0 4 0 747894952 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1504672

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1204.4 s]
/proc/loadavg: 8.12 8.11 8.09 9/431 5418
/proc/meminfo: memFree=18734080/32950928 swapFree=65730892/67111528
[pid=5321] ppid=5319 vsize=1504672 CPUtime=4800.26 cores=0,2,4,6
/proc/5321/stat : 5321 (SArTagnan) R 5319 5321 5247 0 -1 4202496 2857793 0 0 0 479621 405 0 0 25 0 4 0 747894933 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4512032 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/5321/statm: 376168 292115 347 106 0 371671 0
[pid=5321/tid=5323] ppid=5319 vsize=1504672 CPUtime=1204.04 cores=0,2,4,6
/proc/5321/task/5323/stat : 5323 (SArTagnan) R 5319 5321 5247 0 -1 4202560 95728 0 0 0 120389 15 0 0 25 0 4 0 747894952 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=5321/tid=5324] ppid=5319 vsize=1504672 CPUtime=1202.88 cores=0,2,4,6
/proc/5321/task/5324/stat : 5324 (SArTagnan) R 5319 5321 5247 0 -1 4202560 72380 0 0 0 120276 12 0 0 25 0 4 0 747894952 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=5321/tid=5325] ppid=5319 vsize=1504672 CPUtime=1204.24 cores=0,2,4,6
/proc/5321/task/5325/stat : 5325 (SArTagnan) R 5319 5321 5247 0 -1 4202560 2428935 0 0 0 120083 341 0 0 25 0 4 0 747894952 1540784128 292115 33554432000 4194304 4625164 140734136296656 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1504672

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.46
CPU time (s): 4800.36
CPU user time (s): 4796.27
CPU system time (s): 4.09538
CPU usage (%): 398.548
Max. virtual memory (cumulated for all children) (KiB): 1504672

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.27
system time used= 4.09538
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2857795
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1590
involuntary context switches= 39386

runsolver used 4.66829 second user time and 11.7872 second system time

The end

Launcher Data 

Begin job on node116 at 2011-05-16 22:10:43
IDJOB=3386379
IDBENCH=20406
IDSOLVER=1871
FILE ID=node116/3386379-1305576642
RUNJOBID= node116-1305576531-5265
PBS_JOBID= 13350205
Free space on /tmp= 73024 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT07/industrial/palacios/hard/sortnet-7-ipc5-h15-unsat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386379-1305576642/watcher-3386379-1305576642 -o /tmp/evaluation-result-3386379-1305576642/solver-3386379-1305576642 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386379-1305576642.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0683489092a5eb0c881dd17c2c45d08e
RANDOM SEED=1008302334

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      19862308 kB
Buffers:        182572 kB
Cached:        2339720 kB
SwapCached:      12328 kB
Active:       11648980 kB
Inactive:      1201592 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      19862308 kB
SwapTotal:    67111528 kB
SwapFree:     65730892 kB
Dirty:            6616 kB
Writeback:           0 kB
AnonPages:    10326752 kB
Mapped:          20480 kB
Slab:           117788 kB
PageTables:      53892 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 113785500 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73012 MiB
End job on node116 at 2011-05-16 22:30:49