Trace number 3386336

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 3791.58 1300.1

General information on the benchmark

Nameapplication/jarvisalo/HWMCC10-combination-timeframe-expansion/
hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf
MD5SUM9059f458d76edcc4dc5681746a6de6e5
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark265.638
Satisfiable
(Un)Satisfiability was proved
Number of variables88352
Number of clauses262658
Sum of the clauses size612866
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2175104
Number of clauses of size 387552
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386336-1305579846/watcher-3386336-1305579846 -o /tmp/evaluation-result-3386336-1305579846/solver-3386336-1305579846 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386336-1305579846.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.12 11.11 11.09 9/413 27584
/proc/meminfo: memFree=8231972/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=32996 CPUtime=0.01 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 2335 0 0 0 1 0 0 0 25 0 1 0 669584391 33787904 2236 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/27584/statm: 8249 2236 296 106 0 3752 0

[startup+0.0797189 s]
/proc/loadavg: 11.12 11.11 11.09 9/413 27584
/proc/meminfo: memFree=8231972/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=40692 CPUtime=0.07 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 6854 0 0 0 7 0 0 0 25 0 1 0 669584391 41668608 4065 33554432000 4194304 4625164 140734633615936 18446744073709551615 248089698048 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/27584/statm: 10173 4066 296 106 0 5676 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 40692

[startup+0.100713 s]
/proc/loadavg: 11.12 11.11 11.09 9/413 27584
/proc/meminfo: memFree=8231972/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=41944 CPUtime=0.08 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 7798 0 0 0 8 0 0 0 25 0 1 0 669584391 42950656 4647 33554432000 4194304 4625164 140734633615936 18446744073709551615 248089359045 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/27584/statm: 10486 4649 296 106 0 5989 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 41944

[startup+0.300682 s]
/proc/loadavg: 11.12 11.11 11.09 9/413 27584
/proc/meminfo: memFree=8231972/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=253268 CPUtime=0.44 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 19520 0 0 0 43 1 0 0 25 0 4 0 669584391 259346432 15178 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339447 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 63317 15178 334 106 0 58820 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 253268

[startup+0.70061 s]
/proc/loadavg: 11.12 11.11 11.09 9/413 27584
/proc/meminfo: memFree=8231972/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=253268 CPUtime=1.25 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 20344 0 0 0 123 2 0 0 25 0 4 0 669584391 259346432 16002 33554432000 4194304 4625164 140734633615936 18446744073709551615 4390542 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 63317 16002 336 106 0 58820 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 253268

[startup+1.50047 s]
/proc/loadavg: 11.12 11.11 11.09 12/417 27589
/proc/meminfo: memFree=8167096/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=253268 CPUtime=2.83 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 21810 0 0 0 281 2 0 0 25 0 4 0 669584391 259346432 16942 33554432000 4194304 4625164 140734633615936 18446744073709551615 4519294 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 63317 16942 342 106 0 58820 0
[pid=27584/tid=27586] ppid=27582 vsize=253268 CPUtime=0.63 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 916 0 0 0 63 0 0 0 25 0 4 0 669584404 259346432 16942 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=253268 CPUtime=0.67 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 842 0 0 0 67 0 0 0 25 0 4 0 669584404 259346432 16942 33554432000 4194304 4625164 140734633615936 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=253268 CPUtime=0.68 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 2050 0 0 0 68 0 0 0 25 0 4 0 669584404 259346432 16942 33554432000 4194304 4625164 140734633615936 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2.83
Current children cumulated vsize (KiB) 253268

[startup+3.10119 s]
/proc/loadavg: 11.12 11.11 11.09 13/418 27590
/proc/meminfo: memFree=8157284/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=259792 CPUtime=6.51 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 28775 0 0 0 648 3 0 0 25 0 4 0 669584391 266027008 18842 33554432000 4194304 4625164 140734633615936 18446744073709551615 4509184 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/27584/statm: 64948 18842 342 106 0 60451 0
[pid=27584/tid=27586] ppid=27582 vsize=259792 CPUtime=1.48 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 2182 0 0 0 148 0 0 0 25 0 4 0 669584404 266027008 18842 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=259792 CPUtime=1.98 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 2064 0 0 0 198 0 0 0 25 0 4 0 669584404 266027008 18842 33554432000 4194304 4625164 140734633615936 18446744073709551615 4462504 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=259792 CPUtime=1.49 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 5191 0 0 0 149 0 0 0 25 0 4 0 669584404 266027008 18842 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288883 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.51
Current children cumulated vsize (KiB) 259792

[startup+6.30062 s]
/proc/loadavg: 11.19 11.13 11.09 13/418 27590
/proc/meminfo: memFree=8130876/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=284260 CPUtime=13.81 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 51168 0 0 0 1374 7 0 0 25 0 4 0 669584391 291082240 23950 33554432000 4194304 4625164 140734633615936 18446744073709551615 4509083 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 71065 23950 342 106 0 66568 0
[pid=27584/tid=27586] ppid=27582 vsize=284260 CPUtime=3.02 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 6414 0 0 0 302 0 0 0 25 0 4 0 669584404 291082240 23950 33554432000 4194304 4625164 140734633615936 18446744073709551615 4353037 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=284260 CPUtime=4.51 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 6346 0 0 0 451 0 0 0 25 0 4 0 669584404 291082240 23950 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288883 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=284260 CPUtime=3.18 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 14615 0 0 0 316 2 0 0 25 0 4 0 669584404 291082240 23951 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13.81
Current children cumulated vsize (KiB) 284260

[startup+12.7005 s]
/proc/loadavg: 11.25 11.14 11.10 13/418 27590
/proc/meminfo: memFree=7733220/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=705252 CPUtime=27.4 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 209516 0 0 0 2712 28 0 0 25 0 4 0 669584391 722178048 118114 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512887 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 176313 118114 366 106 0 171816 0
[pid=27584/tid=27586] ppid=27582 vsize=705252 CPUtime=6.12 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 25363 0 0 0 609 3 0 0 25 0 4 0 669584404 722178048 118114 33554432000 4194304 4625164 140734633615936 18446744073709551615 4486993 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=705252 CPUtime=7.56 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 26002 0 0 0 753 3 0 0 25 0 4 0 669584404 722178048 118114 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=705252 CPUtime=6.4 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 34312 0 0 0 636 4 0 0 25 0 4 0 669584404 722178048 118114 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288755 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 27.4
Current children cumulated vsize (KiB) 705252

[startup+25.5012 s]
/proc/loadavg: 11.41 11.18 11.11 12/417 27590
/proc/meminfo: memFree=7758156/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=683228 CPUtime=59.22 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 210699 0 0 0 5893 29 0 0 25 0 4 0 669584391 699625472 113788 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512491 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 170807 113788 364 106 0 166310 0
[pid=27584/tid=27586] ppid=27582 vsize=683228 CPUtime=12.53 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 25642 0 0 0 1249 4 0 0 25 0 4 0 669584404 699625472 113788 33554432000 4194304 4625164 140734633615936 18446744073709551615 4352765 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=683228 CPUtime=13.95 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 26343 0 0 0 1392 3 0 0 25 0 4 0 669584404 699625472 113788 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=683228 CPUtime=12.79 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 34598 0 0 0 1275 4 0 0 25 0 4 0 669584404 699625472 113788 33554432000 4194304 4625164 140734633615936 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 59.22
Current children cumulated vsize (KiB) 683228

[startup+51.1007 s]
/proc/loadavg: 11.27 11.17 11.11 12/417 27591
/proc/meminfo: memFree=7745176/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=661204 CPUtime=122.88 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 226133 0 0 0 12255 33 0 0 25 0 4 0 669584391 677072896 110458 33554432000 4194304 4625164 140734633615936 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 165301 110458 359 106 0 160804 0
[pid=27584/tid=27586] ppid=27582 vsize=661204 CPUtime=25.32 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 26014 0 0 0 2528 4 0 0 25 0 4 0 669584404 677072896 110458 33554432000 4194304 4625164 140734633615936 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=661204 CPUtime=26.85 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 26755 0 0 0 2682 3 0 0 25 0 4 0 669584404 677072896 110458 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=661204 CPUtime=25.49 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 48772 0 0 0 2542 7 0 0 25 0 4 0 669584404 677072896 110458 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 122.88
Current children cumulated vsize (KiB) 661204

[startup+102.316 s]
/proc/loadavg: 11.16 11.16 11.10 12/417 27592
/proc/meminfo: memFree=7614512/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=661204 CPUtime=250.22 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 407158 0 0 0 24960 62 0 0 25 0 4 0 669584391 677072896 117415 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512301 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 165301 117415 358 106 0 160804 0
[pid=27584/tid=27586] ppid=27582 vsize=661204 CPUtime=50.94 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 26856 0 0 0 5089 5 0 0 25 0 4 0 669584404 677072896 117416 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=661204 CPUtime=52.5 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 27595 0 0 0 5246 4 0 0 25 0 4 0 669584404 677072896 117416 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=661204 CPUtime=51.07 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 225817 0 0 0 5073 34 0 0 25 0 4 0 669584404 677072896 117416 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 250.22
Current children cumulated vsize (KiB) 661204

[startup+162.301 s]
/proc/loadavg: 11.16 11.15 11.10 12/417 27594
/proc/meminfo: memFree=6041276/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=738688 CPUtime=420.97 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 502035 0 0 0 42017 80 0 0 25 0 4 0 669584391 756416512 134367 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 184672 134367 357 106 0 180175 0
[pid=27584/tid=27586] ppid=27582 vsize=738688 CPUtime=102.52 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 36916 0 0 0 10244 8 0 0 25 0 4 0 669584404 756416512 134367 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=738688 CPUtime=82.37 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 34838 0 0 0 8232 5 0 0 25 0 4 0 669584404 756416512 134367 33554432000 4194304 4625164 140734633615936 18446744073709551615 4317274 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=738688 CPUtime=81.19 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 289552 0 0 0 8074 45 0 0 25 0 4 0 669584404 756416512 134367 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288731 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 420.97
Current children cumulated vsize (KiB) 738688

[startup+222.301 s]
/proc/loadavg: 11.10 11.14 11.10 12/417 27595
/proc/meminfo: memFree=4348144/32950928 swapFree=64721856/67111528
[pid=27584] ppid=27582 vsize=769424 CPUtime=600.15 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 640068 0 0 0 59916 99 0 0 25 0 4 0 669584391 787890176 143542 33554432000 4194304 4625164 140734633615936 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 192356 143542 357 106 0 187859 0
[pid=27584/tid=27586] ppid=27582 vsize=769424 CPUtime=133.91 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 38021 0 0 0 13382 9 0 0 25 0 4 0 669584404 787890176 143543 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=769424 CPUtime=141.06 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 36234 0 0 0 14100 6 0 0 25 0 4 0 669584404 787890176 143543 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288719 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=769424 CPUtime=111.1 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 406552 0 0 0 11051 59 0 0 25 0 4 0 669584404 787890176 143544 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 600.15
Current children cumulated vsize (KiB) 769424

[startup+282.301 s]

################
# More data... #
################

[pid=27584] ppid=27582 vsize=1225216 CPUtime=2033.64 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 2177987 0 0 0 203015 349 0 0 25 0 4 0 669584391 1254621184 224231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/27584/statm: 306304 224231 355 106 0 301807 0
[pid=27584/tid=27586] ppid=27582 vsize=1225216 CPUtime=433.33 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 80962 0 0 0 43309 24 0 0 25 0 4 0 669584404 1254621184 224231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=27584/tid=27587] ppid=27582 vsize=1225216 CPUtime=509.6 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 59438 0 0 0 50946 14 0 0 25 0 4 0 669584404 1254621184 224231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351804 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=27584/tid=27588] ppid=27582 vsize=1225216 CPUtime=403.14 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 1849191 0 0 0 40035 279 0 0 25 0 4 0 669584404 1254621184 224231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4556928 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2033.64
Current children cumulated vsize (KiB) 1225216

[startup+762.3 s]
/proc/loadavg: 12.01 11.45 11.21 12/417 27611
/proc/meminfo: memFree=3286108/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1237100 CPUtime=2184.84 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 2479535 0 0 0 218031 453 0 0 25 0 4 0 669584391 1266790400 235174 33554432000 4194304 4625164 140734633615936 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 136
/proc/27584/statm: 309275 235174 355 106 0 304778 0
[pid=27584/tid=27586] ppid=27582 vsize=1237100 CPUtime=465.46 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 84721 0 0 0 46508 38 0 0 25 0 4 0 669584404 1266790400 235174 33554432000 4194304 4625164 140734633615936 18446744073709551615 4352044 0 0 4096 2 0 0 0 -1 5 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1237100 CPUtime=561.72 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 62049 0 0 0 56150 22 0 0 25 0 4 0 669584404 1266790400 235175 33554432000 4194304 4625164 140734633615936 18446744073709551615 4463787 0 0 4096 2 0 0 0 -1 7 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1237100 CPUtime=436.8 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 2143171 0 0 0 43329 351 0 0 25 0 4 0 669584404 1266790400 235175 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 3 0 0 1163
Current children cumulated CPU time (s) 2184.84
Current children cumulated vsize (KiB) 1237100

[startup+822.301 s]
/proc/loadavg: 11.53 11.42 11.21 13/417 27642
/proc/meminfo: memFree=13602832/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1292984 CPUtime=2364.04 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 2917710 0 0 0 235878 526 0 0 25 0 4 0 669584391 1324015616 244850 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 136
/proc/27584/statm: 323246 244850 355 106 0 318749 0
[pid=27584/tid=27586] ppid=27582 vsize=1292984 CPUtime=495.45 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 88234 0 0 0 49505 40 0 0 25 0 4 0 669584404 1324015616 244850 33554432000 4194304 4625164 140734633615936 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 5 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1292984 CPUtime=620.91 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 62991 0 0 0 62068 23 0 0 25 0 4 0 669584404 1324015616 244850 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1292984 CPUtime=496.79 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 2552420 0 0 0 49262 417 0 0 25 0 4 0 669584404 1324015616 244850 33554432000 4194304 4625164 140734633615936 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 3 0 0 1163
Current children cumulated CPU time (s) 2364.04
Current children cumulated vsize (KiB) 1292984

[startup+882.301 s]
/proc/loadavg: 11.33 11.39 11.21 12/417 27644
/proc/meminfo: memFree=13483264/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1306976 CPUtime=2543.21 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 3202187 0 0 0 253749 572 0 0 25 0 4 0 669584391 1338343424 254519 33554432000 4194304 4625164 140734633615936 18446744073709551615 4509158 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 136
/proc/27584/statm: 326744 254519 355 106 0 322247 0
[pid=27584/tid=27586] ppid=27582 vsize=1306976 CPUtime=526.35 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 92523 0 0 0 52592 43 0 0 25 0 4 0 669584404 1338343424 254519 33554432000 4194304 4625164 140734633615936 18446744073709551615 4464408 0 0 4096 2 0 0 0 -1 5 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1306976 CPUtime=680.09 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 63382 0 0 0 67986 23 0 0 25 0 4 0 669584404 1338343424 254519 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339591 0 0 4096 2 0 0 0 -1 7 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1306976 CPUtime=539.33 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 2828099 0 0 0 53473 460 0 0 25 0 4 0 669584404 1338343424 254519 33554432000 4194304 4625164 140734633615936 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 1163
Current children cumulated CPU time (s) 2543.21
Current children cumulated vsize (KiB) 1306976

[startup+942.301 s]
/proc/loadavg: 11.21 11.34 11.21 12/417 27646
/proc/meminfo: memFree=13363052/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1325060 CPUtime=2722.4 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 3522438 0 0 0 271608 632 0 0 25 0 4 0 669584391 1356861440 264231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4509196 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 136
/proc/27584/statm: 331265 264231 355 106 0 326768 0
[pid=27584/tid=27586] ppid=27582 vsize=1325060 CPUtime=580.08 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 98163 0 0 0 57961 47 0 0 25 0 4 0 669584404 1356861440 264231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1325060 CPUtime=723.07 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 63766 0 0 0 72284 23 0 0 25 0 4 0 669584404 1356861440 264231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288861 0 0 4096 2 0 0 0 -1 3 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1325060 CPUtime=584.73 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 3140164 0 0 0 57958 515 0 0 25 0 4 0 669584404 1356861440 264231 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351731 0 0 4096 2 0 0 0 -1 7 0 0 1163
Current children cumulated CPU time (s) 2722.4
Current children cumulated vsize (KiB) 1325060

[startup+1002.3 s]
/proc/loadavg: 11.15 11.31 11.20 12/417 27647
/proc/meminfo: memFree=13259980/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1384752 CPUtime=2901.57 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 3758354 0 0 0 289484 673 0 0 25 0 4 0 669584391 1417986048 274759 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 136
/proc/27584/statm: 346188 274759 355 106 0 341691 0
[pid=27584/tid=27586] ppid=27582 vsize=1384752 CPUtime=640.08 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 103664 0 0 0 63957 51 0 0 25 0 4 0 669584404 1417986048 274759 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 5 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1384752 CPUtime=765.41 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 65120 0 0 0 76517 24 0 0 25 0 4 0 669584404 1417986048 274759 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 3 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1384752 CPUtime=615.61 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 3344935 0 0 0 61015 546 0 0 25 0 4 0 669584404 1417986048 274759 33554432000 4194304 4625164 140734633615936 18446744073709551615 4490163 0 0 4096 2 0 0 0 -1 3 0 0 1163
Current children cumulated CPU time (s) 2901.57
Current children cumulated vsize (KiB) 1384752

[startup+1062.3 s]
/proc/loadavg: 11.13 11.28 11.19 12/417 27649
/proc/meminfo: memFree=13167920/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1394740 CPUtime=3080.76 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 3947655 0 0 0 307369 707 0 0 25 0 4 0 669584391 1428213760 284378 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 136
/proc/27584/statm: 348685 284378 355 106 0 344188 0
[pid=27584/tid=27586] ppid=27582 vsize=1394740 CPUtime=686.79 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 107600 0 0 0 68624 55 0 0 25 0 4 0 669584404 1428213760 284378 33554432000 4194304 4625164 140734633615936 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1394740 CPUtime=808.84 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 67834 0 0 0 80859 25 0 0 25 0 4 0 669584404 1428213760 284378 33554432000 4194304 4625164 140734633615936 18446744073709551615 4464324 0 0 4096 2 0 0 0 -1 3 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1394740 CPUtime=645.4 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 3524671 0 0 0 63965 575 0 0 25 0 4 0 669584404 1428213760 284378 33554432000 4194304 4625164 140734633615936 18446744073709551615 4554587 0 0 4096 2 0 0 0 -1 7 0 0 1163
Current children cumulated CPU time (s) 3080.76
Current children cumulated vsize (KiB) 1394740

[startup+1122.3 s]
/proc/loadavg: 11.20 11.27 11.19 12/417 27650
/proc/meminfo: memFree=13113924/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1400968 CPUtime=3260.76 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 4147843 0 0 0 325331 745 0 0 25 0 4 0 669584391 1434591232 293882 33554432000 4194304 4625164 140734633615936 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 136
/proc/27584/statm: 350242 293882 355 106 0 345745 0
[pid=27584/tid=27586] ppid=27582 vsize=1400968 CPUtime=717.62 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 111287 0 0 0 71702 60 0 0 25 0 4 0 669584404 1434591232 293882 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351672 0 0 4096 2 0 0 0 -1 7 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1400968 CPUtime=868.39 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 69590 0 0 0 86813 26 0 0 25 0 4 0 669584404 1434591232 293882 33554432000 4194304 4625164 140734633615936 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 3 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1400968 CPUtime=675.68 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 3716639 0 0 0 66962 606 0 0 25 0 4 0 669584404 1434591232 293882 33554432000 4194304 4625164 140734633615936 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 7 0 0 1163
Current children cumulated CPU time (s) 3260.76
Current children cumulated vsize (KiB) 1400968

[startup+1182.3 s]
/proc/loadavg: 11.25 11.26 11.19 12/417 27652
/proc/meminfo: memFree=13051640/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1511516 CPUtime=3439.97 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 4373293 0 0 0 343211 786 0 0 25 0 4 0 669584391 1547792384 304076 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512046 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 136
/proc/27584/statm: 377879 304076 355 106 0 373382 0
[pid=27584/tid=27586] ppid=27582 vsize=1511516 CPUtime=747.52 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 138086 0 0 0 74683 69 0 0 25 0 4 0 669584404 1547792384 304079 33554432000 4194304 4625164 140734633615936 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 5 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1511516 CPUtime=926.91 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 70028 0 0 0 92665 26 0 0 25 0 4 0 669584404 1547792384 304079 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1511516 CPUtime=706.76 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 3910091 0 0 0 70038 638 0 0 25 0 4 0 669584404 1547792384 304079 33554432000 4194304 4625164 140734633615936 18446744073709551615 4547257 0 0 4096 2 0 0 0 -1 5 0 0 1163
Current children cumulated CPU time (s) 3439.97
Current children cumulated vsize (KiB) 1511516

[startup+1242.3 s]
/proc/loadavg: 11.14 11.23 11.18 12/417 27654
/proc/meminfo: memFree=12932532/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1518808 CPUtime=3619.11 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 4580537 0 0 0 361087 824 0 0 25 0 4 0 669584391 1555259392 313245 33554432000 4194304 4625164 140734633615936 18446744073709551615 4511874 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 136
/proc/27584/statm: 379702 313246 355 106 0 375205 0
[pid=27584/tid=27586] ppid=27582 vsize=1518808 CPUtime=778.31 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 141082 0 0 0 77758 73 0 0 25 0 4 0 669584404 1555259392 313246 33554432000 4194304 4625164 140734633615936 18446744073709551615 4288793 0 0 4096 2 0 0 0 -1 5 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1518808 CPUtime=986.27 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 72160 0 0 0 98600 27 0 0 25 0 4 0 669584404 1555259392 313246 33554432000 4194304 4625164 140734633615936 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 3 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1518808 CPUtime=738.52 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 4108665 0 0 0 73182 670 0 0 25 0 4 0 669584404 1555259392 313247 33554432000 4194304 4625164 140734633615936 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 1163
Current children cumulated CPU time (s) 3619.11
Current children cumulated vsize (KiB) 1518808



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 11.22 11.23 11.18 14/417 27655
/proc/meminfo: memFree=12853244/32950928 swapFree=62427640/67111528
[pid=27584] ppid=27582 vsize=1598616 CPUtime=3791.49 cores=1,3,5,7
/proc/27584/stat : 27584 (SArTagnan) R 27582 27584 27246 0 -1 4202496 4662427 0 0 0 378304 845 0 0 25 0 4 0 669584391 1636982784 328992 33554432000 4194304 4625164 140734633615936 18446744073709551615 4512066 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 136
/proc/27584/statm: 399654 328993 355 106 0 395157 0
[pid=27584/tid=27586] ppid=27582 vsize=1598616 CPUtime=807.83 cores=1,3,5,7
/proc/27584/task/27586/stat : 27586 (SArTagnan) R 27582 27584 27246 0 -1 4202560 143575 0 0 0 80707 76 0 0 25 0 4 0 669584404 1636982784 328993 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 571
[pid=27584/tid=27587] ppid=27582 vsize=1598616 CPUtime=1043.09 cores=1,3,5,7
/proc/27584/task/27587/stat : 27587 (SArTagnan) R 27582 27584 27246 0 -1 4202560 75538 0 0 0 104277 32 0 0 25 0 4 0 669584404 1636982784 328993 33554432000 4194304 4625164 140734633615936 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 371
[pid=27584/tid=27588] ppid=27582 vsize=1598616 CPUtime=767.18 cores=1,3,5,7
/proc/27584/task/27588/stat : 27588 (SArTagnan) R 27582 27584 27246 0 -1 4202560 4179632 0 0 0 76037 681 0 0 25 0 4 0 669584404 1636982784 328993 33554432000 4194304 4625164 140734633615936 18446744073709551615 4554582 0 0 4096 2 0 0 0 -1 3 0 0 1163
Current children cumulated CPU time (s) 3791.49
Current children cumulated vsize (KiB) 1598616

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1300.1
CPU time (s): 3791.58
CPU user time (s): 3783.06
CPU system time (s): 8.5217
CPU usage (%): 291.637
Max. virtual memory (cumulated for all children) (KiB): 1598616

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3783.06
system time used= 8.5217
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4662430
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1499
involuntary context switches= 40680

runsolver used 5.20421 second user time and 12.5071 second system time

The end

Launcher Data 

Begin job on node123 at 2011-05-16 23:04:06
IDJOB=3386336
IDBENCH=82469
IDSOLVER=1871
FILE ID=node123/3386336-1305579846
RUNJOBID= node123-1305577116-27265
PBS_JOBID= 13350215
Free space on /tmp= 73236 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/application/jarvisalo/HWMCC10-combination-timeframe-expansion/hwmcc10-timeframe-expansion-k50-pdtpmsns2-tseitin.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386336-1305579846/watcher-3386336-1305579846 -o /tmp/evaluation-result-3386336-1305579846/solver-3386336-1305579846 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386336-1305579846.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9059f458d76edcc4dc5681746a6de6e5
RANDOM SEED=1587095241

node123.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:       8232252 kB
Buffers:        302620 kB
Cached:        3596096 kB
SwapCached:      10520 kB
Active:       21371860 kB
Inactive:      3030212 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:       8232252 kB
SwapTotal:    67111528 kB
SwapFree:     64721856 kB
Dirty:           12456 kB
Writeback:           0 kB
AnonPages:    20500908 kB
Mapped:          30336 kB
Slab:           178348 kB
PageTables:      71520 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 107384488 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73248 MiB
End job on node123 at 2011-05-16 23:25:48