Trace number 3386091

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.16 1205.07

General information on the benchmark

NameCRAFTED/modcircuits/
mod3block_2vars_11gates_u2_autoenc.cnf
MD5SUM36c3169a5cad0483dd15befcefc4323e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark689.141
Satisfiable
(Un)Satisfiability was proved
Number of variables526
Number of clauses146535
Sum of the clauses size858954
Maximum clause length14
Minimum clause length1
Number of clauses of size 164
Number of clauses of size 22476
Number of clauses of size 34
Number of clauses of size 41387
Number of clauses of size 57328
Number of clauses of size over 5135276

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386091-1305577978/watcher-3386091-1305577978 -o /tmp/evaluation-result-3386091-1305577978/solver-3386091-1305577978 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386091-1305577978.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 8.14 8.16 5/491 1661
/proc/meminfo: memFree=15503584/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=22064 CPUtime=0 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 459 0 0 0 0 0 0 0 25 0 1 0 669395549 22593536 397 33554432000 4194304 4625164 140733632202320 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/1661/statm: 5516 397 295 106 0 1019 0

[startup+0.102593 s]
/proc/loadavg: 8.17 8.14 8.16 5/491 1661
/proc/meminfo: memFree=15503584/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=38844 CPUtime=0.09 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 9604 0 0 0 8 1 0 0 25 0 1 0 669395549 39776256 4993 33554432000 4194304 4625164 140733632202320 18446744073709551615 4361099 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/1661/statm: 9711 4993 299 106 0 5214 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 38844

[startup+0.200543 s]
/proc/loadavg: 8.17 8.14 8.16 5/491 1661
/proc/meminfo: memFree=15503584/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=306168 CPUtime=0.43 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 24664 0 0 0 40 3 0 0 25 0 4 0 669395549 313516032 16399 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511963 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 76542 16399 417 106 0 72045 0
Current children cumulated CPU time (s) 0.43
Current children cumulated vsize (KiB) 306168

[startup+0.300526 s]
/proc/loadavg: 8.17 8.14 8.16 5/491 1661
/proc/meminfo: memFree=15503584/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=309292 CPUtime=0.83 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 27140 0 0 0 79 4 0 0 25 0 4 0 669395549 316715008 17314 33554432000 4194304 4625164 140733632202320 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 77323 17314 417 106 0 72826 0
Current children cumulated CPU time (s) 0.83
Current children cumulated vsize (KiB) 309292

[startup+0.700453 s]
/proc/loadavg: 8.17 8.14 8.16 5/491 1661
/proc/meminfo: memFree=15503584/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=315540 CPUtime=2.43 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 31254 0 0 0 239 4 0 0 25 0 4 0 669395549 323112960 18307 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511973 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 78885 18307 417 106 0 74388 0
Current children cumulated CPU time (s) 2.43
Current children cumulated vsize (KiB) 315540

[startup+1.50031 s]
/proc/loadavg: 8.17 8.14 8.16 9/495 1665
/proc/meminfo: memFree=15422340/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=315540 CPUtime=5.61 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 32727 0 0 0 557 4 0 0 25 0 4 0 669395549 323112960 19778 33554432000 4194304 4625164 140733632202320 18446744073709551615 4329114 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 78885 19778 418 106 0 74388 0
[pid=1661/tid=1663] ppid=1659 vsize=315540 CPUtime=1.35 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 5254 0 0 0 135 0 0 0 25 0 4 0 669395561 323112960 19778 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=315540 CPUtime=1.37 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 4983 0 0 0 137 0 0 0 25 0 4 0 669395561 323112960 19778 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=315540 CPUtime=1.37 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1877 0 0 0 137 0 0 0 25 0 4 0 669395561 323112960 19778 33554432000 4194304 4625164 140733632202320 18446744073709551615 4327908 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 5.61
Current children cumulated vsize (KiB) 315540

[startup+3.10102 s]
/proc/loadavg: 8.16 8.14 8.15 9/495 1665
/proc/meminfo: memFree=15410932/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=315540 CPUtime=12 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 43322 0 0 0 1193 7 0 0 25 0 4 0 669395549 323112960 21324 33554432000 4194304 4625164 140733632202320 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 78885 21324 425 106 0 74388 0
[pid=1661/tid=1663] ppid=1659 vsize=315540 CPUtime=2.93 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 5630 0 0 0 293 0 0 0 25 0 4 0 669395561 323112960 21326 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351998 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=315540 CPUtime=2.97 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 5717 0 0 0 296 1 0 0 25 0 4 0 669395561 323112960 21326 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351918 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=315540 CPUtime=2.97 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 11313 0 0 0 295 2 0 0 25 0 4 0 669395561 323112960 21326 33554432000 4194304 4625164 140733632202320 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12
Current children cumulated vsize (KiB) 315540

[startup+6.30044 s]
/proc/loadavg: 8.16 8.14 8.15 5/489 1716
/proc/meminfo: memFree=15974800/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=320228 CPUtime=24.74 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 83904 0 0 0 2460 14 0 0 25 0 4 0 669395549 327913472 25088 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 80057 25088 427 106 0 75560 0
[pid=1661/tid=1663] ppid=1659 vsize=320228 CPUtime=6.08 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 6180 0 0 0 607 1 0 0 25 0 4 0 669395561 327913472 25088 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=320228 CPUtime=6.17 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 9039 0 0 0 616 1 0 0 25 0 4 0 669395561 327913472 25088 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352072 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=320228 CPUtime=6.17 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 47897 0 0 0 610 7 0 0 25 0 4 0 669395561 327913472 25088 33554432000 4194304 4625164 140733632202320 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 24.74
Current children cumulated vsize (KiB) 320228

[startup+12.7003 s]
/proc/loadavg: 8.13 8.14 8.15 9/495 1725
/proc/meminfo: memFree=15827668/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=332008 CPUtime=50.23 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 153278 0 0 0 4997 26 0 0 25 0 4 0 669395549 339976192 30274 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 83002 30276 425 106 0 78505 0
[pid=1661/tid=1663] ppid=1659 vsize=332008 CPUtime=12.37 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 9942 0 0 0 1235 2 0 0 25 0 4 0 669395561 339976192 30276 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=332008 CPUtime=12.57 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 15046 0 0 0 1254 3 0 0 25 0 4 0 669395561 339976192 30277 33554432000 4194304 4625164 140733632202320 18446744073709551615 218905398274 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=332008 CPUtime=12.57 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 107368 0 0 0 1240 17 0 0 25 0 4 0 669395561 339976192 30279 33554432000 4194304 4625164 140733632202320 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 50.23
Current children cumulated vsize (KiB) 332008

[startup+25.501 s]
/proc/loadavg: 8.19 8.15 8.16 9/495 1725
/proc/meminfo: memFree=15699524/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=346088 CPUtime=101.22 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 278366 0 0 0 10076 46 0 0 25 0 4 0 669395549 354394112 37806 33554432000 4194304 4625164 140733632202320 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 86522 37806 375 106 0 82025 0
[pid=1661/tid=1663] ppid=1659 vsize=346088 CPUtime=24.96 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 10790 0 0 0 2493 3 0 0 25 0 4 0 669395561 354394112 37806 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=346088 CPUtime=25.37 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 23433 0 0 0 2533 4 0 0 25 0 4 0 669395561 354394112 37806 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=346088 CPUtime=25.37 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 220845 0 0 0 2503 34 0 0 25 0 4 0 669395561 354394112 37806 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 101.22
Current children cumulated vsize (KiB) 346088

[startup+51.1013 s]
/proc/loadavg: 8.18 8.15 8.16 9/495 1726
/proc/meminfo: memFree=15477192/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=345360 CPUtime=203.2 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 451494 0 0 0 20246 74 0 0 25 0 4 0 669395549 353648640 55670 33554432000 4194304 4625164 140733632202320 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 86340 55670 620 106 0 81843 0
[pid=1661/tid=1663] ppid=1659 vsize=345360 CPUtime=50.14 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 15796 0 0 0 5011 3 0 0 25 0 4 0 669395561 353648640 55670 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=345360 CPUtime=50.97 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 36041 0 0 0 5089 8 0 0 25 0 4 0 669395561 353648640 55670 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=345360 CPUtime=50.97 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 368398 0 0 0 5040 57 0 0 25 0 4 0 669395561 353648640 55670 33554432000 4194304 4625164 140733632202320 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 203.2
Current children cumulated vsize (KiB) 345360

[startup+102.301 s]
/proc/loadavg: 8.07 8.12 8.15 9/495 1727
/proc/meminfo: memFree=15204860/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=524128 CPUtime=407.18 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 579447 0 0 0 40620 98 0 0 25 0 4 0 669395549 536707072 82306 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 131032 82307 1022 106 0 126535 0
[pid=1661/tid=1663] ppid=1659 vsize=524128 CPUtime=100.51 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 18544 0 0 0 10046 5 0 0 25 0 4 0 669395561 536707072 82541 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=524128 CPUtime=102.18 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 59229 0 0 0 10205 13 0 0 25 0 4 0 669395561 536707072 82541 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=524128 CPUtime=102.19 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 459204 0 0 0 10147 72 0 0 25 0 4 0 669395561 536707072 82541 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 407.18
Current children cumulated vsize (KiB) 524128

[startup+162.301 s]
/proc/loadavg: 8.10 8.11 8.14 9/495 1729
/proc/meminfo: memFree=14836440/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=623336 CPUtime=646.19 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 645555 0 0 0 64510 109 0 0 25 0 4 0 669395549 638296064 108858 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 155834 108858 973 106 0 151337 0
[pid=1661/tid=1663] ppid=1659 vsize=623336 CPUtime=159.52 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 24845 0 0 0 15947 5 0 0 25 0 4 0 669395561 638296064 108858 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=623336 CPUtime=162.18 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 63556 0 0 0 16202 16 0 0 25 0 4 0 669395561 638296064 108858 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=623336 CPUtime=162.18 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 505821 0 0 0 16139 79 0 0 25 0 4 0 669395561 638296064 108858 33554432000 4194304 4625164 140733632202320 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 646.19
Current children cumulated vsize (KiB) 623336

[startup+222.319 s]
/proc/loadavg: 8.08 8.11 8.13 9/495 1731
/proc/meminfo: memFree=14571408/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=751676 CPUtime=885.28 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 688151 0 0 0 88413 115 0 0 25 0 4 0 669395549 769716224 133184 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511950 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 187919 133184 1695 106 0 183422 0
[pid=1661/tid=1663] ppid=1659 vsize=751676 CPUtime=218.55 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 25256 0 0 0 21850 5 0 0 25 0 4 0 669395561 769716224 133184 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=751676 CPUtime=222.19 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 85573 0 0 0 22201 18 0 0 25 0 4 0 669395561 769716224 133184 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=751676 CPUtime=222.2 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 507048 0 0 0 22140 80 0 0 25 0 4 0 669395561 769716224 133184 33554432000 4194304 4625164 140733632202320 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 885.28
Current children cumulated vsize (KiB) 751676

[startup+282.3 s]

################
# More data... #
################

[pid=1661] ppid=1659 vsize=1194088 CPUtime=2797.41 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 927724 0 0 0 279544 197 0 0 25 0 4 0 669395549 1222746112 226133 33554432000 4194304 4625164 140733632202320 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 298522 226133 346 106 0 294025 0
[pid=1661/tid=1663] ppid=1659 vsize=1194088 CPUtime=690.7 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 39073 0 0 0 69058 12 0 0 25 0 4 0 669395561 1222746112 226133 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351824 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1194088 CPUtime=702.18 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 155848 0 0 0 70157 61 0 0 25 0 4 0 669395561 1222746112 226133 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1194088 CPUtime=702.19 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 527406 0 0 0 70134 85 0 0 25 0 4 0 669395561 1222746112 226133 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2797.41
Current children cumulated vsize (KiB) 1194088

[startup+762.301 s]
/proc/loadavg: 8.00 8.04 8.08 9/495 1745
/proc/meminfo: memFree=13212080/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1296588 CPUtime=3036.46 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 966594 0 0 0 303437 209 0 0 25 0 4 0 669395549 1327706112 238041 33554432000 4194304 4625164 140733632202320 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 324147 238041 449 106 0 319650 0
[pid=1661/tid=1663] ppid=1659 vsize=1296588 CPUtime=749.73 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 39559 0 0 0 74960 13 0 0 25 0 4 0 669395561 1327706112 238041 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1296588 CPUtime=762.2 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 158750 0 0 0 76154 66 0 0 25 0 4 0 669395561 1327706112 238041 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1296588 CPUtime=762.21 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 534511 0 0 0 76135 86 0 0 25 0 4 0 669395561 1327706112 238041 33554432000 4194304 4625164 140733632202320 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3036.46
Current children cumulated vsize (KiB) 1296588

[startup+822.301 s]
/proc/loadavg: 8.12 8.06 8.08 9/495 1747
/proc/meminfo: memFree=13114696/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1296588 CPUtime=3275.45 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1328696 0 0 0 327279 266 0 0 25 0 4 0 669395549 1327706112 240521 33554432000 4194304 4625164 140733632202320 18446744073709551615 218905392161 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 324147 240524 449 106 0 319650 0
[pid=1661/tid=1663] ppid=1659 vsize=1296588 CPUtime=808.75 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 39810 0 0 0 80862 13 0 0 25 0 4 0 669395561 1327706112 240524 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1296588 CPUtime=822.19 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 159490 0 0 0 82152 67 0 0 25 0 4 0 669395561 1327706112 240527 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1296588 CPUtime=822.19 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 867967 0 0 0 82083 136 0 0 25 0 4 0 669395561 1327706112 240528 33554432000 4194304 4625164 140733632202320 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3275.45
Current children cumulated vsize (KiB) 1296588

[startup+882.319 s]
/proc/loadavg: 8.22 8.10 8.09 9/495 1748
/proc/meminfo: memFree=13003548/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1296588 CPUtime=3514.54 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1588801 0 0 0 351139 315 0 0 25 0 4 0 669395549 1327706112 246827 33554432000 4194304 4625164 140733632202320 18446744073709551615 4392981 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 324147 246827 449 106 0 319650 0
[pid=1661/tid=1663] ppid=1659 vsize=1296588 CPUtime=867.77 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 42669 0 0 0 86760 17 0 0 25 0 4 0 669395561 1327706112 246827 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1296588 CPUtime=882.21 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 161072 0 0 0 88153 68 0 0 25 0 4 0 669395561 1327706112 246827 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1296588 CPUtime=882.22 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1097215 0 0 0 88046 176 0 0 25 0 4 0 669395561 1327706112 246827 33554432000 4194304 4625164 140733632202320 18446744073709551615 4547221 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3514.54
Current children cumulated vsize (KiB) 1296588

[startup+942.301 s]
/proc/loadavg: 8.18 8.11 8.09 9/495 1750
/proc/meminfo: memFree=12905916/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1296588 CPUtime=3753.51 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1620463 0 0 0 375025 326 0 0 25 0 4 0 669395549 1327706112 253181 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 324147 253181 353 106 0 319650 0
[pid=1661/tid=1663] ppid=1659 vsize=1296588 CPUtime=926.79 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 43365 0 0 0 92661 18 0 0 25 0 4 0 669395561 1327706112 253181 33554432000 4194304 4625164 140733632202320 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1296588 CPUtime=942.19 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 164769 0 0 0 94147 72 0 0 25 0 4 0 669395561 1327706112 253181 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1296588 CPUtime=942.2 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1097468 0 0 0 94044 176 0 0 25 0 4 0 669395561 1327706112 253181 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3753.51
Current children cumulated vsize (KiB) 1296588

[startup+1002.3 s]
/proc/loadavg: 8.11 8.10 8.09 9/495 1751
/proc/meminfo: memFree=12689004/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1297192 CPUtime=3992.53 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1654856 0 0 0 398914 339 0 0 25 0 4 0 669395549 1328324608 259354 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 324298 259354 346 106 0 319801 0
[pid=1661/tid=1663] ppid=1659 vsize=1297192 CPUtime=985.8 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 44017 0 0 0 98561 19 0 0 25 0 4 0 669395561 1328324608 259354 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351897 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1297192 CPUtime=1002.19 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 167621 0 0 0 100144 75 0 0 25 0 4 0 669395561 1328324608 259354 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1297192 CPUtime=1002.2 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1097844 0 0 0 100044 176 0 0 25 0 4 0 669395561 1328324608 259354 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352285 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3992.53
Current children cumulated vsize (KiB) 1297192

[startup+1062.3 s]
/proc/loadavg: 8.08 8.09 8.09 9/495 1753
/proc/meminfo: memFree=12568432/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1387144 CPUtime=4231.56 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1734015 0 0 0 422802 354 0 0 25 0 4 0 669395549 1420435456 269565 33554432000 4194304 4625164 140733632202320 18446744073709551615 4511933 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 346786 269565 346 106 0 342289 0
[pid=1661/tid=1663] ppid=1659 vsize=1387144 CPUtime=1044.83 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 44244 0 0 0 104464 19 0 0 25 0 4 0 669395561 1420435456 269565 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351795 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1387144 CPUtime=1062.2 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 214232 0 0 0 106136 84 0 0 25 0 4 0 669395561 1420435456 269565 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351884 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1387144 CPUtime=1062.19 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1099882 0 0 0 106042 177 0 0 25 0 4 0 669395561 1420435456 269565 33554432000 4194304 4625164 140733632202320 18446744073709551615 4552315 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4231.56
Current children cumulated vsize (KiB) 1387144

[startup+1122.3 s]
/proc/loadavg: 8.11 8.10 8.09 9/495 1755
/proc/meminfo: memFree=12466712/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1444776 CPUtime=4470.57 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1787308 0 0 0 446691 366 0 0 25 0 4 0 669395549 1479450624 280514 33554432000 4194304 4625164 140733632202320 18446744073709551615 4512012 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 361194 280514 346 106 0 356697 0
[pid=1661/tid=1663] ppid=1659 vsize=1444776 CPUtime=1103.84 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 44589 0 0 0 110364 20 0 0 25 0 4 0 669395561 1479450624 280514 33554432000 4194304 4625164 140733632202320 18446744073709551615 4462665 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1444776 CPUtime=1122.2 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 216367 0 0 0 112133 87 0 0 25 0 4 0 669395561 1479450624 280514 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1444776 CPUtime=1122.2 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1102667 0 0 0 112042 178 0 0 25 0 4 0 669395561 1479450624 280514 33554432000 4194304 4625164 140733632202320 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4470.57
Current children cumulated vsize (KiB) 1444776

[startup+1182.3 s]
/proc/loadavg: 8.12 8.11 8.09 9/495 1756
/proc/meminfo: memFree=12330268/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1508692 CPUtime=4709.61 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1851020 0 0 0 470580 381 0 0 25 0 4 0 669395549 1544900608 292100 33554432000 4194304 4625164 140733632202320 18446744073709551615 4512156 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 377173 292100 346 106 0 372676 0
[pid=1661/tid=1663] ppid=1659 vsize=1508692 CPUtime=1162.87 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 45282 0 0 0 116267 20 0 0 25 0 4 0 669395561 1544900608 292100 33554432000 4194304 4625164 140733632202320 18446744073709551615 4464202 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1508692 CPUtime=1182.2 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 221192 0 0 0 118128 92 0 0 25 0 4 0 669395561 1544900608 292100 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1508692 CPUtime=1182.2 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1105130 0 0 0 118041 179 0 0 25 0 4 0 669395561 1544900608 292100 33554432000 4194304 4625164 140733632202320 18446744073709551615 4334503 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4709.61
Current children cumulated vsize (KiB) 1508692



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205 s]
/proc/loadavg: 8.17 8.12 8.09 9/495 1757
/proc/meminfo: memFree=12304840/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1512220 CPUtime=4800.04 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1865547 0 0 0 479618 386 0 0 25 0 4 0 669395549 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 378055 295426 346 106 0 373558 0
[pid=1661/tid=1663] ppid=1659 vsize=1512220 CPUtime=1185.19 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 45408 0 0 0 118499 20 0 0 25 0 4 0 669395561 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1512220 CPUtime=1204.92 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 222662 0 0 0 120398 94 0 0 25 0 4 0 669395561 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1512220 CPUtime=1204.92 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1105985 0 0 0 120313 179 0 0 25 0 4 0 669395561 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4552307 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.04
Current children cumulated vsize (KiB) 1512220

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205 s]
/proc/loadavg: 8.17 8.12 8.09 9/495 1757
/proc/meminfo: memFree=12304840/32951124 swapFree=62248504/67111528
[pid=1661] ppid=1659 vsize=1512220 CPUtime=4800.04 cores=1,3,5,7
/proc/1661/stat : 1661 (SArTagnan) R 1659 1661 1492 0 -1 4202496 1865547 0 0 0 479618 386 0 0 25 0 4 0 669395549 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/1661/statm: 378055 295426 346 106 0 373558 0
[pid=1661/tid=1663] ppid=1659 vsize=1512220 CPUtime=1185.19 cores=1,3,5,7
/proc/1661/task/1663/stat : 1663 (SArTagnan) R 1659 1661 1492 0 -1 4202560 45408 0 0 0 118499 20 0 0 25 0 4 0 669395561 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=1661/tid=1664] ppid=1659 vsize=1512220 CPUtime=1204.92 cores=1,3,5,7
/proc/1661/task/1664/stat : 1664 (SArTagnan) R 1659 1661 1492 0 -1 4202560 222662 0 0 0 120398 94 0 0 25 0 4 0 669395561 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=1661/tid=1665] ppid=1659 vsize=1512220 CPUtime=1204.92 cores=1,3,5,7
/proc/1661/task/1665/stat : 1665 (SArTagnan) R 1659 1661 1492 0 -1 4202560 1105985 0 0 0 120313 179 0 0 25 0 4 0 669395561 1548513280 295426 33554432000 4194304 4625164 140733632202320 18446744073709551615 4552307 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.04
Current children cumulated vsize (KiB) 1512220

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.07
CPU time (s): 4800.16
CPU user time (s): 4796.25
CPU system time (s): 3.91141
CPU usage (%): 398.331
Max. virtual memory (cumulated for all children) (KiB): 1542064

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4796.25
system time used= 3.9114
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1865547
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 628
involuntary context switches= 32583

runsolver used 5.21521 second user time and 14.5288 second system time

The end

Launcher Data 

Begin job on node137 at 2011-05-16 22:32:58
IDJOB=3386091
IDBENCH=71153
IDSOLVER=1871
FILE ID=node137/3386091-1305577978
RUNJOBID= node137-1305576659-1511
PBS_JOBID= 13350207
Free space on /tmp= 73648 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT09/CRAFTED/modcircuits/mod3block_2vars_11gates_u2_autoenc.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386091-1305577978/watcher-3386091-1305577978 -o /tmp/evaluation-result-3386091-1305577978/solver-3386091-1305577978 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386091-1305577978.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 36c3169a5cad0483dd15befcefc4323e
RANDOM SEED=534924389

node137.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.844
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      15503740 kB
Buffers:        329676 kB
Cached:        4375928 kB
SwapCached:      25020 kB
Active:        7470016 kB
Inactive:      9700248 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      15503740 kB
SwapTotal:    67111528 kB
SwapFree:     62248504 kB
Dirty:            4352 kB
Writeback:           0 kB
AnonPages:    12449408 kB
Mapped:          31780 kB
Slab:           137932 kB
PageTables:      69308 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 147604124 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73656 MiB
End job on node137 at 2011-05-16 22:53:05