Trace number 3386412

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.44 1203.98

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-bottom26.cnf
MD5SUM98fee1752ddf8cd7cd77925ecf4bfe6e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables73074
Number of clauses245746
Sum of the clauses size628346
Maximum clause length2232
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2124096
Number of clauses of size 3120415
Number of clauses of size 4350
Number of clauses of size 524
Number of clauses of size over 5860

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386412-1305580013/watcher-3386412-1305580013 -o /tmp/evaluation-result-3386412-1305580013/solver-3386412-1305580013 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386412-1305580013.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.21 8.02 7.98 5/376 5743
/proc/meminfo: memFree=26942652/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=30908 CPUtime=0 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 1921 0 0 0 0 0 0 0 25 0 1 0 669601760 31649792 1859 33554432000 4194304 4625164 140735325985744 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/5743/statm: 7727 1859 299 106 0 3230 0

[startup+0.072332 s]
/proc/loadavg: 8.21 8.02 7.98 5/376 5743
/proc/meminfo: memFree=26942652/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=38488 CPUtime=0.06 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 6332 0 0 0 6 0 0 0 25 0 1 0 669601760 39411712 3922 33554432000 4194304 4625164 140735325985744 18446744073709551615 230809165568 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/5743/statm: 9622 3922 299 106 0 5125 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 38488

[startup+0.100325 s]
/proc/loadavg: 8.21 8.02 7.98 5/376 5743
/proc/meminfo: memFree=26942652/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=41472 CPUtime=0.09 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 7766 0 0 0 9 0 0 0 25 0 1 0 669601760 42467328 4813 33554432000 4194304 4625164 140735325985744 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/5743/statm: 10368 4814 299 106 0 5871 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 41472

[startup+0.300255 s]
/proc/loadavg: 8.21 8.02 7.98 5/376 5743
/proc/meminfo: memFree=26942652/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=318368 CPUtime=0.78 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 25716 0 0 0 76 2 0 0 18 0 4 0 669601760 326008832 18890 33554432000 4194304 4625164 140735325985744 18446744073709551615 4503342 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 79592 18890 336 106 0 75095 0
Current children cumulated CPU time (s) 0.78
Current children cumulated vsize (KiB) 318368

[startup+0.700183 s]
/proc/loadavg: 8.21 8.02 7.98 5/376 5743
/proc/meminfo: memFree=26942652/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=334076 CPUtime=2.39 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 30282 0 0 0 236 3 0 0 18 0 4 0 669601760 342093824 23113 33554432000 4194304 4625164 140735325985744 18446744073709551615 4514338 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 83519 23113 431 106 0 79022 0
Current children cumulated CPU time (s) 2.39
Current children cumulated vsize (KiB) 334076

[startup+1.50104 s]
/proc/loadavg: 8.20 8.02 7.98 9/380 5747
/proc/meminfo: memFree=26850868/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=334076 CPUtime=5.58 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 30553 0 0 0 555 3 0 0 19 0 4 0 669601760 342093824 23384 33554432000 4194304 4625164 140735325985744 18446744073709551615 4508982 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 83519 23384 431 106 0 79022 0
[pid=5743/tid=5745] ppid=5741 vsize=334076 CPUtime=1.36 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 3161 0 0 0 136 0 0 0 25 0 4 0 669601773 342093824 23384 33554432000 4194304 4625164 140735325985744 18446744073709551615 4486954 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=334076 CPUtime=1.35 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 3181 0 0 0 135 0 0 0 25 0 4 0 669601773 342093824 23384 33554432000 4194304 4625164 140735325985744 18446744073709551615 4467206 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=334076 CPUtime=1.36 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 3882 0 0 0 136 0 0 0 25 0 4 0 669601773 342093824 23384 33554432000 4194304 4625164 140735325985744 18446744073709551615 4554564 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.58
Current children cumulated vsize (KiB) 334076

[startup+3.10074 s]
/proc/loadavg: 8.20 8.02 7.98 9/380 5747
/proc/meminfo: memFree=26843676/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=334076 CPUtime=11.96 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 30963 0 0 0 1193 3 0 0 24 0 4 0 669601760 342093824 23794 33554432000 4194304 4625164 140735325985744 18446744073709551615 4528661 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 83519 23794 431 106 0 79022 0
[pid=5743/tid=5745] ppid=5741 vsize=334076 CPUtime=2.96 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 3215 0 0 0 296 0 0 0 25 0 4 0 669601773 342093824 23794 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=334076 CPUtime=2.93 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 3390 0 0 0 293 0 0 0 25 0 4 0 669601773 342093824 23794 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=334076 CPUtime=2.96 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 3940 0 0 0 296 0 0 0 25 0 4 0 669601773 342093824 23794 33554432000 4194304 4625164 140735325985744 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 11.96
Current children cumulated vsize (KiB) 334076

[startup+6.30116 s]
/proc/loadavg: 8.18 8.02 7.98 9/380 5747
/proc/meminfo: memFree=26835976/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=351160 CPUtime=24.72 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 41514 0 0 0 2467 5 0 0 25 0 4 0 669601760 359587840 27064 33554432000 4194304 4625164 140735325985744 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 87790 27064 384 106 0 83293 0
[pid=5743/tid=5745] ppid=5741 vsize=351160 CPUtime=6.16 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 5991 0 0 0 615 1 0 0 25 0 4 0 669601773 359587840 27064 33554432000 4194304 4625164 140735325985744 18446744073709551615 4288789 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=351160 CPUtime=6.09 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 6656 0 0 0 608 1 0 0 25 0 4 0 669601773 359587840 27064 33554432000 4194304 4625164 140735325985744 18446744073709551615 4375439 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=351160 CPUtime=6.16 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 5398 0 0 0 616 0 0 0 25 0 4 0 669601773 359587840 27064 33554432000 4194304 4625164 140735325985744 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 24.72
Current children cumulated vsize (KiB) 351160

[startup+12.701 s]
/proc/loadavg: 8.17 8.02 7.98 9/380 5747
/proc/meminfo: memFree=26612444/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=564524 CPUtime=50.2 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 183524 0 0 0 4992 28 0 0 25 0 4 0 669601760 578072576 80525 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511747 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 141131 80525 359 106 0 136634 0
[pid=5743/tid=5745] ppid=5741 vsize=564524 CPUtime=12.54 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 26285 0 0 0 1250 4 0 0 25 0 4 0 669601773 578072576 80525 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=564524 CPUtime=12.39 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 26803 0 0 0 1236 3 0 0 25 0 4 0 669601773 578072576 80525 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=564524 CPUtime=12.54 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 57344 0 0 0 1246 8 0 0 25 0 4 0 669601773 578072576 80525 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352007 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.2
Current children cumulated vsize (KiB) 564524

[startup+25.5006 s]
/proc/loadavg: 8.21 8.03 7.98 9/380 5747
/proc/meminfo: memFree=26590388/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=576872 CPUtime=101.23 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 288777 0 0 0 10078 45 0 0 25 0 4 0 669601760 590716928 84661 33554432000 4194304 4625164 140735325985744 18446744073709551615 4519268 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 144218 84661 360 106 0 139721 0
[pid=5743/tid=5745] ppid=5741 vsize=576872 CPUtime=25.35 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 28981 0 0 0 2529 6 0 0 25 0 4 0 669601773 590716928 84661 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=576872 CPUtime=25.03 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 26832 0 0 0 2500 3 0 0 25 0 4 0 669601773 590716928 84661 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=576872 CPUtime=25.34 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 153283 0 0 0 2511 23 0 0 25 0 4 0 669601773 590716928 84661 33554432000 4194304 4625164 140735325985744 18446744073709551615 4288925 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.23
Current children cumulated vsize (KiB) 576872

[startup+51.101 s]
/proc/loadavg: 8.13 8.03 7.98 9/380 5748
/proc/meminfo: memFree=26528908/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=589332 CPUtime=203.3 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 493001 0 0 0 20246 84 0 0 25 0 4 0 669601760 603475968 97360 33554432000 4194304 4625164 140735325985744 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 147333 97360 356 106 0 142836 0
[pid=5743/tid=5745] ppid=5741 vsize=589332 CPUtime=50.94 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 41491 0 0 0 5081 13 0 0 25 0 4 0 669601773 603475968 97360 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=589332 CPUtime=50.3 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 27157 0 0 0 5027 3 0 0 25 0 4 0 669601773 603475968 97360 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=589332 CPUtime=50.93 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 343659 0 0 0 5039 54 0 0 25 0 4 0 669601773 603475968 97360 33554432000 4194304 4625164 140735325985744 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.3
Current children cumulated vsize (KiB) 589332

[startup+102.315 s]
/proc/loadavg: 8.18 8.05 8.00 9/380 5749
/proc/meminfo: memFree=26427176/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=745188 CPUtime=407.49 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 903659 0 0 0 40597 152 0 0 25 0 4 0 669601760 763072512 114554 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 186297 114555 347 106 0 181800 0
[pid=5743/tid=5745] ppid=5741 vsize=745188 CPUtime=102.14 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 50432 0 0 0 10191 23 0 0 25 0 4 0 669601773 763072512 114555 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352481 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=745188 CPUtime=100.86 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 34183 0 0 0 10082 4 0 0 25 0 4 0 669601773 763072512 114555 33554432000 4194304 4625164 140735325985744 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=745188 CPUtime=102.15 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 729125 0 0 0 10104 111 0 0 25 0 4 0 669601773 763072512 114556 33554432000 4194304 4625164 140735325985744 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.49
Current children cumulated vsize (KiB) 745188

[startup+162.301 s]
/proc/loadavg: 8.11 8.06 8.00 9/380 5751
/proc/meminfo: memFree=26349884/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=754440 CPUtime=646.67 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 1349366 0 0 0 64444 223 0 0 25 0 4 0 669601760 772546560 125904 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 188610 125904 347 106 0 184113 0
[pid=5743/tid=5745] ppid=5741 vsize=754440 CPUtime=162.13 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 52344 0 0 0 16189 24 0 0 25 0 4 0 669601773 772546560 125904 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=754440 CPUtime=160.09 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 38217 0 0 0 16003 6 0 0 25 0 4 0 669601773 772546560 125904 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=754440 CPUtime=162.14 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 1167921 0 0 0 16036 178 0 0 25 0 4 0 669601773 772546560 125904 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 646.67
Current children cumulated vsize (KiB) 754440

[startup+222.301 s]
/proc/loadavg: 8.14 8.07 8.01 9/380 5753
/proc/meminfo: memFree=26280172/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=846696 CPUtime=885.9 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 1749761 0 0 0 88306 284 0 0 25 0 4 0 669601760 867016704 137840 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 211674 137840 347 106 0 207177 0
[pid=5743/tid=5745] ppid=5741 vsize=846696 CPUtime=222.13 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 67738 0 0 0 22184 29 0 0 25 0 4 0 669601773 867016704 137840 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=846696 CPUtime=219.33 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 38761 0 0 0 21926 7 0 0 25 0 4 0 669601773 867016704 137840 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=846696 CPUtime=222.14 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 1551368 0 0 0 21980 234 0 0 25 0 4 0 669601773 867016704 137840 33554432000 4194304 4625164 140735325985744 18446744073709551615 4288690 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 885.9
Current children cumulated vsize (KiB) 846696

[startup+282.301 s]

################
# More data... #
################

[pid=5743] ppid=5741 vsize=1412804 CPUtime=2800.07 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 5215480 0 0 0 279094 913 0 0 25 0 4 0 669601760 1446711296 272538 33554432000 4194304 4625164 140735325985744 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 353201 272538 347 106 0 348704 0
[pid=5743/tid=5745] ppid=5741 vsize=1412804 CPUtime=702.14 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 163931 0 0 0 70122 92 0 0 25 0 4 0 669601773 1446711296 272538 33554432000 4194304 4625164 140735325985744 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1412804 CPUtime=693.47 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 69381 0 0 0 69306 41 0 0 25 0 4 0 669601773 1446711296 272538 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1412804 CPUtime=702.13 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 4858528 0 0 0 69455 758 0 0 25 0 4 0 669601773 1446711296 272538 33554432000 4194304 4625164 140735325985744 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2800.07
Current children cumulated vsize (KiB) 1412804

[startup+762.315 s]
/proc/loadavg: 4.09 4.85 6.39 5/371 5785
/proc/meminfo: memFree=26724520/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1421872 CPUtime=3039.39 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 5524086 0 0 0 302969 970 0 0 25 0 4 0 669601760 1455996928 285363 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511950 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 355468 285363 347 106 0 350971 0
[pid=5743/tid=5745] ppid=5741 vsize=1421872 CPUtime=762.16 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 170015 0 0 0 76112 104 0 0 25 0 4 0 669601773 1455996928 285363 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352543 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1421872 CPUtime=752.75 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 69624 0 0 0 75234 41 0 0 25 0 4 0 669601773 1455996928 285363 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352005 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1421872 CPUtime=762.15 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 5159714 0 0 0 75411 804 0 0 25 0 4 0 669601773 1455996928 285363 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3039.39
Current children cumulated vsize (KiB) 1421872

[startup+822.301 s]
/proc/loadavg: 4.08 4.71 6.24 5/371 5787
/proc/meminfo: memFree=26667088/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1423448 CPUtime=3278.62 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 5926829 0 0 0 326819 1043 0 0 25 0 4 0 669601760 1457610752 300877 33554432000 4194304 4625164 140735325985744 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 355862 300878 347 106 0 351365 0
[pid=5743/tid=5745] ppid=5741 vsize=1423448 CPUtime=822.14 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 173779 0 0 0 82101 113 0 0 25 0 4 0 669601773 1457610752 300878 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1423448 CPUtime=812.01 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 73633 0 0 0 81157 44 0 0 25 0 4 0 669601773 1457610752 300878 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1423448 CPUtime=822.13 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 5554038 0 0 0 81350 863 0 0 25 0 4 0 669601773 1457610752 300878 33554432000 4194304 4625164 140735325985744 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3278.62
Current children cumulated vsize (KiB) 1423448

[startup+882.301 s]
/proc/loadavg: 4.03 4.58 6.10 5/371 5788
/proc/meminfo: memFree=26608412/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1443812 CPUtime=3517.88 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 6373357 0 0 0 350668 1120 0 0 25 0 4 0 669601760 1478463488 314827 33554432000 4194304 4625164 140735325985744 18446744073709551615 4512869 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 360953 314827 348 106 0 356456 0
[pid=5743/tid=5745] ppid=5741 vsize=1443812 CPUtime=882.14 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 179382 0 0 0 88098 116 0 0 25 0 4 0 669601773 1478463488 314827 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1443812 CPUtime=871.27 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 75356 0 0 0 87078 49 0 0 25 0 4 0 669601773 1478463488 314827 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352056 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1443812 CPUtime=882.13 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 5992667 0 0 0 87281 932 0 0 25 0 4 0 669601773 1478463488 314827 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3517.88
Current children cumulated vsize (KiB) 1443812

[startup+942.301 s]
/proc/loadavg: 4.06 4.49 5.97 5/371 5790
/proc/meminfo: memFree=26555188/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1469024 CPUtime=3757.17 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 6719619 0 0 0 374535 1182 0 0 25 0 4 0 669601760 1504280576 327237 33554432000 4194304 4625164 140735325985744 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 367256 327237 347 106 0 362759 0
[pid=5743/tid=5745] ppid=5741 vsize=1469024 CPUtime=942.14 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 183574 0 0 0 94096 118 0 0 25 0 4 0 669601773 1504280576 327237 33554432000 4194304 4625164 140735325985744 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1469024 CPUtime=930.56 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 77045 0 0 0 93005 51 0 0 25 0 4 0 669601773 1504280576 327237 33554432000 4194304 4625164 140735325985744 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1469024 CPUtime=942.13 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 6332404 0 0 0 93224 989 0 0 25 0 4 0 669601773 1504280576 327237 33554432000 4194304 4625164 140735325985744 18446744073709551615 4328194 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3757.17
Current children cumulated vsize (KiB) 1469024

[startup+1002.3 s]
/proc/loadavg: 4.02 4.39 5.84 5/371 5791
/proc/meminfo: memFree=26521936/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1610476 CPUtime=3996.43 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 7023603 0 0 0 398406 1237 0 0 25 0 4 0 669601760 1649127424 336562 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 402619 336562 347 106 0 398122 0
[pid=5743/tid=5745] ppid=5741 vsize=1610476 CPUtime=1002.14 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 183736 0 0 0 100096 118 0 0 25 0 4 0 669601773 1649127424 336562 33554432000 4194304 4625164 140735325985744 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1610476 CPUtime=989.81 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 78346 0 0 0 98929 52 0 0 25 0 4 0 669601773 1649127424 336562 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1610476 CPUtime=1002.14 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 6633872 0 0 0 99171 1043 0 0 25 0 4 0 669601773 1649127424 336562 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3996.43
Current children cumulated vsize (KiB) 1610476

[startup+1062.3 s]
/proc/loadavg: 4.01 4.32 5.72 5/371 5793
/proc/meminfo: memFree=26482112/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1707752 CPUtime=4235.69 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 7316418 0 0 0 422274 1295 0 0 25 0 4 0 669601760 1748738048 346089 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 426938 346089 347 106 0 422441 0
[pid=5743/tid=5745] ppid=5741 vsize=1707752 CPUtime=1062.14 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 183959 0 0 0 106096 118 0 0 25 0 4 0 669601773 1748738048 346089 33554432000 4194304 4625164 140735325985744 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1707752 CPUtime=1049.06 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 97747 0 0 0 104843 63 0 0 25 0 4 0 669601773 1748738048 346089 33554432000 4194304 4625164 140735325985744 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1707752 CPUtime=1062.14 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 6906485 0 0 0 105125 1089 0 0 25 0 4 0 669601773 1748738048 346089 33554432000 4194304 4625164 140735325985744 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4235.69
Current children cumulated vsize (KiB) 1707752

[startup+1122.3 s]
/proc/loadavg: 4.00 4.26 5.61 5/371 5795
/proc/meminfo: memFree=26452588/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1774020 CPUtime=4474.93 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 7540846 0 0 0 446153 1340 0 0 25 0 4 0 669601760 1816596480 353413 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 443505 353413 347 106 0 439008 0
[pid=5743/tid=5745] ppid=5741 vsize=1774020 CPUtime=1122.15 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 184184 0 0 0 112097 118 0 0 25 0 4 0 669601773 1816596480 353413 33554432000 4194304 4625164 140735325985744 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1774020 CPUtime=1108.31 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 99551 0 0 0 110762 69 0 0 25 0 4 0 669601773 1816596480 353413 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1774020 CPUtime=1122.14 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 7107318 0 0 0 111089 1125 0 0 25 0 4 0 669601773 1816596480 353413 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4474.93
Current children cumulated vsize (KiB) 1774020

[startup+1182.3 s]
/proc/loadavg: 4.04 4.22 5.52 5/371 5796
/proc/meminfo: memFree=26417608/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1784152 CPUtime=4714.19 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 7787841 0 0 0 470037 1382 0 0 25 0 4 0 669601760 1826971648 362761 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 446038 362761 347 106 0 441541 0
[pid=5743/tid=5745] ppid=5741 vsize=1784152 CPUtime=1182.15 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 184503 0 0 0 118097 118 0 0 25 0 4 0 669601773 1826971648 362761 33554432000 4194304 4625164 140735325985744 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1784152 CPUtime=1167.55 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 100293 0 0 0 116684 71 0 0 25 0 4 0 669601773 1826971648 362761 33554432000 4194304 4625164 140735325985744 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1784152 CPUtime=1182.14 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 7352592 0 0 0 117049 1165 0 0 25 0 4 0 669601773 1826971648 362761 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352562 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4714.19
Current children cumulated vsize (KiB) 1784152



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1203.9 s]
/proc/loadavg: 4.09 4.23 5.49 5/371 5797
/proc/meminfo: memFree=26407932/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1784152 CPUtime=4800.35 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 7941129 0 0 0 478628 1407 0 0 25 0 4 0 669601760 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 446038 364459 347 106 0 441541 0
[pid=5743/tid=5745] ppid=5741 vsize=1784152 CPUtime=1203.76 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 184606 0 0 0 120258 118 0 0 25 0 4 0 669601773 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1784152 CPUtime=1188.88 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 100325 0 0 0 118817 71 0 0 25 0 4 0 669601773 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1784152 CPUtime=1203.75 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 7505423 0 0 0 119186 1189 0 0 25 0 4 0 669601773 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 1784152

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1203.9 s]
/proc/loadavg: 4.09 4.23 5.49 5/371 5797
/proc/meminfo: memFree=26407932/32951124 swapFree=37160408/67111528
[pid=5743] ppid=5741 vsize=1784152 CPUtime=4800.35 cores=1,3,5,7
/proc/5743/stat : 5743 (SArTagnan) R 5741 5743 5006 0 -1 4202496 7941129 0 0 0 478628 1407 0 0 25 0 4 0 669601760 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/5743/statm: 446038 364459 347 106 0 441541 0
[pid=5743/tid=5745] ppid=5741 vsize=1784152 CPUtime=1203.76 cores=1,3,5,7
/proc/5743/task/5745/stat : 5745 (SArTagnan) R 5741 5743 5006 0 -1 4202560 184606 0 0 0 120258 118 0 0 25 0 4 0 669601773 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5743/tid=5746] ppid=5741 vsize=1784152 CPUtime=1188.88 cores=1,3,5,7
/proc/5743/task/5746/stat : 5746 (SArTagnan) R 5741 5743 5006 0 -1 4202560 100325 0 0 0 118817 71 0 0 25 0 4 0 669601773 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4352728 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5743/tid=5747] ppid=5741 vsize=1784152 CPUtime=1203.75 cores=1,3,5,7
/proc/5743/task/5747/stat : 5747 (SArTagnan) R 5741 5743 5006 0 -1 4202560 7505423 0 0 0 119186 1189 0 0 25 0 4 0 669601773 1826971648 364459 33554432000 4194304 4625164 140735325985744 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.35
Current children cumulated vsize (KiB) 1784152

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1203.98
CPU time (s): 4800.44
CPU user time (s): 4786.32
CPU system time (s): 14.1269
CPU usage (%): 398.715
Max. virtual memory (cumulated for all children) (KiB): 1784152

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4786.32
system time used= 14.1269
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7941129
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4152
involuntary context switches= 31375

runsolver used 4.10738 second user time and 10.8104 second system time

The end

Launcher Data 

Begin job on node104 at 2011-05-16 23:06:53
IDJOB=3386412
IDBENCH=83107
IDSOLVER=1871
FILE ID=node104/3386412-1305580013
RUNJOBID= node104-1305576965-5025
PBS_JOBID= 13350212
Free space on /tmp= 73268 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-bottom26.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386412-1305580013/watcher-3386412-1305580013 -o /tmp/evaluation-result-3386412-1305580013/solver-3386412-1305580013 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386412-1305580013.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 98fee1752ddf8cd7cd77925ecf4bfe6e
RANDOM SEED=1532792318

node104.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5293.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.855
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26943056 kB
Buffers:        301744 kB
Cached:        2721628 kB
SwapCached:     152312 kB
Active:        2187636 kB
Inactive:      3536780 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26943056 kB
SwapTotal:    67111528 kB
SwapFree:     37160408 kB
Dirty:            4780 kB
Writeback:           0 kB
AnonPages:     2561564 kB
Mapped:          11372 kB
Slab:           127984 kB
PageTables:      90588 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 88918084 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73268 MiB
End job on node104 at 2011-05-16 23:26:59