Trace number 3250342

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.25 1201.95

General information on the benchmark

Namecrafted/kullmann/GreenTao/
GreenTaok1k2/GreenTao_2-4-4_511.cnf
MD5SUM766a362c83d920a8f8dd49df62ed42c9
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.072988
Satisfiable
(Un)Satisfiability was proved
Number of variables509
Number of clauses4478
Sum of the clauses size17912
Maximum clause length4
Minimum clause length4
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 30
Number of clauses of size 44478
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3250342-1304092669/watcher-3250342-1304092669 -o /tmp/evaluation-result-3250342-1304092669/solver-3250342-1304092669 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3250342-1304092669.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.52 7.97 7.98 2/177 5114
/proc/meminfo: memFree=27017128/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=29852 CPUtime=0 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 710 0 0 0 0 0 0 0 24 0 2 0 520865408 30568448 646 33554432000 4194304 4623224 140734689621168 18446744073709551615 210204703729 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 7463 646 302 105 0 2967 0
[pid=5114/tid=5115] ppid=5112 vsize=29852 CPUtime=0 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 2 0 520865409 30568448 646 33554432000 4194304 4623224 140734689621168 18446744073709551615 210199679208 0 0 4096 2 0 0 0 -1 3 0 0 0

[startup+0.102202 s]
/proc/loadavg: 7.52 7.97 7.98 2/177 5114
/proc/meminfo: memFree=27017128/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=249488 CPUtime=0.38 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 2273 0 0 0 38 0 0 0 25 0 4 0 520865408 255475712 1527 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/5114/statm: 62372 1527 342 105 0 57876 0
[pid=5114/tid=5115] ppid=5112 vsize=249488 CPUtime=0.09 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 440 0 0 0 9 0 0 0 18 0 4 0 520865409 255475712 1527 33554432000 4194304 4623224 140734689621168 18446744073709551615 4278624 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 249488

[startup+0.200187 s]
/proc/loadavg: 7.52 7.97 7.98 2/177 5114
/proc/meminfo: memFree=27017128/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=251104 CPUtime=0.77 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 3220 0 0 0 77 0 0 0 25 0 4 0 520865408 257130496 2004 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/5114/statm: 62776 2004 342 105 0 58280 0
[pid=5114/tid=5115] ppid=5112 vsize=251104 CPUtime=0.19 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 737 0 0 0 19 0 0 0 18 0 4 0 520865409 257130496 2004 33554432000 4194304 4623224 140734689621168 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 0.77
Current children cumulated vsize (KiB) 251104

[startup+0.30017 s]
/proc/loadavg: 7.52 7.97 7.98 2/177 5114
/proc/meminfo: memFree=27017128/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=251296 CPUtime=1.16 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 3902 0 0 0 116 0 0 0 25 0 4 0 520865408 257327104 2444 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510226 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/5114/statm: 62824 2444 342 105 0 58328 0
[pid=5114/tid=5115] ppid=5112 vsize=251296 CPUtime=0.29 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 879 0 0 0 29 0 0 0 18 0 4 0 520865409 257327104 2444 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.16
Current children cumulated vsize (KiB) 251296

[startup+0.701105 s]
/proc/loadavg: 7.52 7.97 7.98 2/177 5114
/proc/meminfo: memFree=27017128/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=254836 CPUtime=2.77 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 7042 0 0 0 276 1 0 0 25 0 4 0 520865408 260952064 4091 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/5114/statm: 63709 4091 342 105 0 59213 0
[pid=5114/tid=5115] ppid=5112 vsize=254836 CPUtime=0.69 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 1898 0 0 0 69 0 0 0 18 0 4 0 520865409 260952064 4091 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.77
Current children cumulated vsize (KiB) 254836

[startup+1.50097 s]
/proc/loadavg: 7.52 7.97 7.98 9/184 5121
/proc/meminfo: memFree=26843232/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=258476 CPUtime=5.97 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 10686 0 0 0 595 2 0 0 25 0 4 0 520865408 264679424 6234 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/5114/statm: 64619 6234 342 105 0 60123 0
[pid=5114/tid=5115] ppid=5112 vsize=258476 CPUtime=1.48 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 3181 0 0 0 148 0 0 0 19 0 4 0 520865409 264679424 6234 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=258476 CPUtime=1.48 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 3026 0 0 0 148 0 0 0 25 0 4 0 520865409 264679424 6234 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376617 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=258476 CPUtime=1.48 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 2378 0 0 0 148 0 0 0 25 0 4 0 520865409 264679424 6234 33554432000 4194304 4623224 140734689621168 18446744073709551615 4549309 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 5.97
Current children cumulated vsize (KiB) 258476

[startup+3.10071 s]
/proc/loadavg: 7.52 7.97 7.98 9/184 5121
/proc/meminfo: memFree=26819432/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=264684 CPUtime=12.36 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 16234 0 0 0 1233 3 0 0 25 0 4 0 520865408 271036416 9767 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510105 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/5114/statm: 66171 9767 345 105 0 61675 0
[pid=5114/tid=5115] ppid=5112 vsize=264684 CPUtime=3.09 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 4922 0 0 0 308 1 0 0 25 0 4 0 520865409 271036416 9767 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=264684 CPUtime=3.08 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 4809 0 0 0 307 1 0 0 25 0 4 0 520865409 271036416 9767 33554432000 4194304 4623224 140734689621168 18446744073709551615 210204690615 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=264684 CPUtime=3.08 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 3599 0 0 0 308 0 0 0 25 0 4 0 520865409 271036416 9768 33554432000 4194304 4623224 140734689621168 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 264684

[startup+6.30117 s]
/proc/loadavg: 7.56 7.97 7.98 9/184 5121
/proc/meminfo: memFree=26749868/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=269492 CPUtime=25.14 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 24132 0 0 0 2509 5 0 0 25 0 4 0 520865408 275959808 14611 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/5114/statm: 67373 14611 352 105 0 62877 0
[pid=5114/tid=5115] ppid=5112 vsize=269492 CPUtime=6.29 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 7681 0 0 0 627 2 0 0 25 0 4 0 520865409 275959808 14611 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376981 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=269492 CPUtime=6.28 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 7425 0 0 0 627 1 0 0 25 0 4 0 520865409 275959808 14611 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=269492 CPUtime=6.28 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 4967 0 0 0 628 0 0 0 25 0 4 0 520865409 275959808 14611 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.14
Current children cumulated vsize (KiB) 269492

[startup+12.7011 s]
/proc/loadavg: 7.68 7.99 7.99 9/184 5121
/proc/meminfo: memFree=26624072/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=294560 CPUtime=50.7 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 75065 0 0 0 5056 14 0 0 25 0 4 0 520865408 301629440 21681 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 73640 21681 343 105 0 69144 0
[pid=5114/tid=5115] ppid=5112 vsize=294560 CPUtime=12.66 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 11861 0 0 0 1263 3 0 0 25 0 4 0 520865409 301629440 21681 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=294560 CPUtime=12.68 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 11023 0 0 0 1266 2 0 0 25 0 4 0 520865409 301629440 21681 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377144 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=294560 CPUtime=12.68 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 45624 0 0 0 1262 6 0 0 25 0 4 0 520865409 301629440 21681 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.7
Current children cumulated vsize (KiB) 294560

[startup+25.501 s]
/proc/loadavg: 7.75 7.99 7.99 9/184 5121
/proc/meminfo: memFree=26502680/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=315500 CPUtime=101.82 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 175975 0 0 0 10151 31 0 0 25 0 4 0 520865408 323072000 31054 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510108 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 78875 31054 432 105 0 74379 0
[pid=5114/tid=5115] ppid=5112 vsize=315500 CPUtime=25.4 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 16466 0 0 0 2534 6 0 0 25 0 4 0 520865409 323072000 31054 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376920 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=315500 CPUtime=25.48 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 15814 0 0 0 2544 4 0 0 25 0 4 0 520865409 323072000 31054 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=315500 CPUtime=25.48 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 134144 0 0 0 2529 19 0 0 25 0 4 0 520865409 323072000 31054 33554432000 4194304 4623224 140734689621168 18446744073709551615 47425043607533 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 315500

[startup+51.1007 s]
/proc/loadavg: 7.83 7.99 7.99 9/184 5122
/proc/meminfo: memFree=26244200/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=331604 CPUtime=204.09 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 267931 0 0 0 20358 51 0 0 25 0 4 0 520865408 339562496 48599 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 82901 48599 399 105 0 78405 0
[pid=5114/tid=5115] ppid=5112 vsize=331604 CPUtime=50.85 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 24718 0 0 0 5076 9 0 0 25 0 4 0 520865409 339562496 48599 33554432000 4194304 4623224 140734689621168 18446744073709551615 4464034 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=331604 CPUtime=51.08 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 23455 0 0 0 5102 6 0 0 25 0 4 0 520865409 339562496 48599 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=331604 CPUtime=51.08 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 201972 0 0 0 5076 32 0 0 25 0 4 0 520865409 339562496 48599 33554432000 4194304 4623224 140734689621168 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 204.09
Current children cumulated vsize (KiB) 331604

[startup+102.301 s]
/proc/loadavg: 8.03 8.02 8.00 9/184 5123
/proc/meminfo: memFree=25824312/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=443644 CPUtime=408.63 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 557539 0 0 0 40760 103 0 0 25 0 4 0 520865408 454291456 77370 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 110911 77370 1134 105 0 106415 0
[pid=5114/tid=5115] ppid=5112 vsize=443644 CPUtime=101.78 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 28438 0 0 0 10165 13 0 0 25 0 4 0 520865409 454291456 77370 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=443644 CPUtime=102.29 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 33825 0 0 0 10220 9 0 0 25 0 4 0 520865409 454291456 77370 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=443644 CPUtime=102.29 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 464520 0 0 0 10153 76 0 0 25 0 4 0 520865409 454291456 77370 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 408.63
Current children cumulated vsize (KiB) 443644

[startup+162.301 s]
/proc/loadavg: 8.06 8.03 8.00 9/184 5125
/proc/meminfo: memFree=25503108/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=496236 CPUtime=648.28 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 858380 0 0 0 64676 152 0 0 25 0 4 0 520865408 508145664 98461 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 124059 98461 819 105 0 119563 0
[pid=5114/tid=5115] ppid=5112 vsize=496236 CPUtime=161.44 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 39751 0 0 0 16127 17 0 0 25 0 4 0 520865409 508145664 98461 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=496236 CPUtime=162.29 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 39642 0 0 0 16218 11 0 0 25 0 4 0 520865409 508145664 98461 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=496236 CPUtime=162.27 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 733882 0 0 0 16110 117 0 0 25 0 4 0 520865409 508145664 98461 33554432000 4194304 4623224 140734689621168 18446744073709551615 4550708 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 648.28
Current children cumulated vsize (KiB) 496236

[startup+222.307 s]
/proc/loadavg: 8.07 8.04 8.00 9/184 5136
/proc/meminfo: memFree=25436320/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=668532 CPUtime=887.96 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 886949 0 0 0 88636 160 0 0 25 0 4 0 520865408 684576768 107739 33554432000 4194304 4623224 140734689621168 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 167133 107739 403 105 0 162637 0

################
# More data... #
################

[pid=5114] ppid=5112 vsize=995068 CPUtime=2564.81 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 1319316 0 0 0 256209 272 0 0 25 0 4 0 520865408 1018949632 184399 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 248767 184399 405 105 0 244271 0
[pid=5114/tid=5115] ppid=5112 vsize=995068 CPUtime=638.83 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 86376 0 0 0 63851 32 0 0 25 0 4 0 520865409 1018949632 184399 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=995068 CPUtime=641.44 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 94768 0 0 0 64095 49 0 0 25 0 4 0 520865409 1018949632 184399 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=995068 CPUtime=642.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 1022208 0 0 0 64058 168 0 0 25 0 4 0 520865409 1018949632 184399 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2564.81
Current children cumulated vsize (KiB) 995068

[startup+702.301 s]
/proc/loadavg: 8.03 8.09 8.03 9/184 5151
/proc/meminfo: memFree=24796700/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1124252 CPUtime=2804.47 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 1710084 0 0 0 280106 341 0 0 25 0 4 0 520865408 1151234048 195044 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 281063 195044 416 105 0 276567 0
[pid=5114/tid=5115] ppid=5112 vsize=1124252 CPUtime=698.51 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 86996 0 0 0 69818 33 0 0 25 0 4 0 520865409 1151234048 195044 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377034 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1124252 CPUtime=701.43 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 98004 0 0 0 70091 52 0 0 25 0 4 0 520865409 1151234048 195044 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1124252 CPUtime=702.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 1394819 0 0 0 69995 231 0 0 25 0 4 0 520865409 1151234048 195044 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377056 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2804.47
Current children cumulated vsize (KiB) 1124252

[startup+762.301 s]
/proc/loadavg: 8.01 8.07 8.02 9/184 5153
/proc/meminfo: memFree=24746428/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1126024 CPUtime=3044.17 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 2037406 0 0 0 304018 399 0 0 25 0 4 0 520865408 1153048576 201444 33554432000 4194304 4623224 140734689621168 18446744073709551615 4387999 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 281506 201444 343 105 0 277010 0
[pid=5114/tid=5115] ppid=5112 vsize=1126024 CPUtime=758.18 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 88423 0 0 0 75785 33 0 0 25 0 4 0 520865409 1153048576 201444 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376666 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1126024 CPUtime=761.45 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 100322 0 0 0 76088 57 0 0 25 0 4 0 520865409 1153048576 201444 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1126024 CPUtime=762.27 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 1716547 0 0 0 75943 284 0 0 25 0 4 0 520865409 1153048576 201444 33554432000 4194304 4623224 140734689621168 18446744073709551615 4545438 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3044.17
Current children cumulated vsize (KiB) 1126024

[startup+822.301 s]
/proc/loadavg: 8.00 8.06 8.02 9/184 5155
/proc/meminfo: memFree=24683396/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1217908 CPUtime=3283.82 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 2407657 0 0 0 327920 462 0 0 25 0 4 0 520865408 1247137792 213296 33554432000 4194304 4623224 140734689621168 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 304477 213296 368 105 0 299981 0
[pid=5114/tid=5115] ppid=5112 vsize=1217908 CPUtime=817.85 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 113545 0 0 0 81748 37 0 0 25 0 4 0 520865409 1247137792 213296 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377022 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1217908 CPUtime=821.43 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 124149 0 0 0 82080 63 0 0 25 0 4 0 520865409 1247137792 213296 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1217908 CPUtime=822.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 2036795 0 0 0 81890 336 0 0 25 0 4 0 520865409 1247137792 213296 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3283.82
Current children cumulated vsize (KiB) 1217908

[startup+882.307 s]
/proc/loadavg: 8.00 8.04 8.01 9/184 5156
/proc/meminfo: memFree=24625828/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1224508 CPUtime=3523.52 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 2749219 0 0 0 351831 521 0 0 25 0 4 0 520865408 1253896192 221035 33554432000 4194304 4623224 140734689621168 18446744073709551615 4517551 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 306127 221035 382 105 0 301631 0
[pid=5114/tid=5115] ppid=5112 vsize=1224508 CPUtime=877.53 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 115440 0 0 0 87715 38 0 0 25 0 4 0 520865409 1253896192 221035 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1224508 CPUtime=881.44 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 126974 0 0 0 88077 67 0 0 25 0 4 0 520865409 1253896192 221035 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1224508 CPUtime=882.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 2372178 0 0 0 87836 390 0 0 25 0 4 0 520865409 1253896192 221035 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3523.52
Current children cumulated vsize (KiB) 1224508

[startup+942.301 s]
/proc/loadavg: 8.05 8.05 8.01 9/184 5158
/proc/meminfo: memFree=24563928/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1231372 CPUtime=3763.18 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 3080026 0 0 0 375740 578 0 0 25 0 4 0 520865408 1260924928 230243 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510978 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 307843 230243 388 105 0 303347 0
[pid=5114/tid=5115] ppid=5112 vsize=1231372 CPUtime=937.2 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 119572 0 0 0 93681 39 0 0 25 0 4 0 520865409 1260924928 230243 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1231372 CPUtime=941.43 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 129030 0 0 0 94073 70 0 0 25 0 4 0 520865409 1260924928 230243 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377608 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1231372 CPUtime=942.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 2695131 0 0 0 93785 441 0 0 25 0 4 0 520865409 1260924928 230243 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376726 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 3763.18
Current children cumulated vsize (KiB) 1231372

[startup+1002.3 s]
/proc/loadavg: 8.07 8.05 8.01 9/184 5159
/proc/meminfo: memFree=24518016/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1234840 CPUtime=4002.84 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 3420789 0 0 0 399648 636 0 0 25 0 4 0 520865408 1264476160 235428 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510978 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 308710 235428 388 105 0 304214 0
[pid=5114/tid=5115] ppid=5112 vsize=1234840 CPUtime=996.87 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 121736 0 0 0 99645 42 0 0 25 0 4 0 520865409 1264476160 235428 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1234840 CPUtime=1001.44 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 129948 0 0 0 100072 72 0 0 25 0 4 0 520865409 1264476160 235428 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1234840 CPUtime=1002.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 3031967 0 0 0 99731 495 0 0 25 0 4 0 520865409 1264476160 235428 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377056 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4002.84
Current children cumulated vsize (KiB) 1234840

[startup+1062.3 s]
/proc/loadavg: 8.07 8.06 8.01 9/184 5161
/proc/meminfo: memFree=24455608/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1234840 CPUtime=4242.52 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 3778863 0 0 0 423557 695 0 0 25 0 4 0 520865408 1264476160 243059 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 308710 243059 350 105 0 304214 0
[pid=5114/tid=5115] ppid=5112 vsize=1234840 CPUtime=1056.55 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 124017 0 0 0 105612 43 0 0 25 0 4 0 520865409 1264476160 243059 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1234840 CPUtime=1061.44 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 134726 0 0 0 106069 75 0 0 25 0 4 0 520865409 1264476160 243059 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376649 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1234840 CPUtime=1062.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 3382934 0 0 0 105676 550 0 0 25 0 4 0 520865409 1264476160 243059 33554432000 4194304 4623224 140734689621168 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4242.52
Current children cumulated vsize (KiB) 1234840

[startup+1122.3 s]
/proc/loadavg: 8.06 8.06 8.01 9/184 5163
/proc/meminfo: memFree=24436960/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1235352 CPUtime=4482.19 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 4126647 0 0 0 447462 757 0 0 25 0 4 0 520865408 1265000448 246256 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 308838 246256 357 105 0 304342 0
[pid=5114/tid=5115] ppid=5112 vsize=1235352 CPUtime=1116.22 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 124235 0 0 0 111579 43 0 0 25 0 4 0 520865409 1265000448 246256 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376917 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1235352 CPUtime=1121.44 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 136611 0 0 0 112065 79 0 0 25 0 4 0 520865409 1265000448 246256 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1235352 CPUtime=1122.26 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 3728300 0 0 0 111618 608 0 0 25 0 4 0 520865409 1265000448 246256 33554432000 4194304 4623224 140734689621168 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4482.19
Current children cumulated vsize (KiB) 1235352

[startup+1182.3 s]
/proc/loadavg: 8.09 8.07 8.02 9/184 5164
/proc/meminfo: memFree=24387076/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1275464 CPUtime=4721.87 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 4484549 0 0 0 471365 822 0 0 25 0 4 0 520865408 1306075136 253404 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 318866 253404 425 105 0 314370 0
[pid=5114/tid=5115] ppid=5112 vsize=1275464 CPUtime=1175.9 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 125590 0 0 0 117544 46 0 0 25 0 4 0 520865409 1306075136 253404 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1275464 CPUtime=1181.44 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 138753 0 0 0 118061 83 0 0 25 0 4 0 520865409 1306075136 253404 33554432000 4194304 4623224 140734689621168 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1275464 CPUtime=1182.25 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 4062469 0 0 0 117562 663 0 0 25 0 4 0 520865409 1306075136 253404 33554432000 4194304 4623224 140734689621168 18446744073709551615 4364894 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4721.87
Current children cumulated vsize (KiB) 1275464



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 8.28 8.12 8.03 5/179 5166
/proc/meminfo: memFree=26063212/32951124 swapFree=67088964/67111528
[pid=5114] ppid=5112 vsize=1275464 CPUtime=4800.18 cores=1,3,5,7
/proc/5114/stat : 5114 (SArTagnan) R 5112 5114 4862 0 -1 4202496 4598615 0 0 0 479176 842 0 0 25 0 4 0 520865408 1306075136 255394 33554432000 4194304 4623224 140734689621168 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/5114/statm: 318866 255394 434 105 0 314370 0
[pid=5114/tid=5115] ppid=5112 vsize=1275464 CPUtime=1195.38 cores=1,3,5,7
/proc/5114/task/5115/stat : 5115 (SArTagnan) R 5112 5114 4862 0 -1 4202560 126195 0 0 0 119492 46 0 0 25 0 4 0 520865409 1306075136 255394 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=5114/tid=5117] ppid=5112 vsize=1275464 CPUtime=1201.05 cores=1,3,5,7
/proc/5114/task/5117/stat : 5117 (SArTagnan) R 5112 5114 4862 0 -1 4202560 139362 0 0 0 120021 84 0 0 25 0 4 0 520865409 1306075136 255394 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=5114/tid=5118] ppid=5112 vsize=1275464 CPUtime=1201.86 cores=1,3,5,7
/proc/5114/task/5118/stat : 5118 (SArTagnan) R 5112 5114 4862 0 -1 4202560 4174734 0 0 0 119504 682 0 0 25 0 4 0 520865409 1306075136 255394 33554432000 4194304 4623224 140734689621168 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 1275464

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.95
CPU time (s): 4800.25
CPU user time (s): 4791.78
CPU system time (s): 8.46271
CPU usage (%): 399.371
Max. virtual memory (cumulated for all children) (KiB): 1354404

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4791.78
system time used= 8.46271
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4598615
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 820
involuntary context switches= 33030

runsolver used 1.60875 second user time and 4.95425 second system time

The end

Launcher Data 

Begin job on node130 at 2011-04-29 17:57:49
IDJOB=3250342
IDBENCH=83250
IDSOLVER=1656
FILE ID=node130/3250342-1304092669
RUNJOBID= node130-1304091463-4881
PBS_JOBID= 13170579
Free space on /tmp= 71972 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/kullmann/GreenTao/GreenTaok1k2/GreenTao_2-4-4_511.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3250342-1304092669/watcher-3250342-1304092669 -o /tmp/evaluation-result-3250342-1304092669/solver-3250342-1304092669 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3250342-1304092669.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 766a362c83d920a8f8dd49df62ed42c9
RANDOM SEED=2122690473

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      27019748 kB
Buffers:       1174840 kB
Cached:        4170512 kB
SwapCached:      22432 kB
Active:         580508 kB
Inactive:      4919260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      27019748 kB
SwapTotal:    67111528 kB
SwapFree:     67088964 kB
Dirty:           23724 kB
Writeback:           0 kB
AnonPages:      131980 kB
Mapped:          15452 kB
Slab:           369972 kB
PageTables:       4196 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   286772 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71972 MiB
End job on node130 at 2011-04-29 18:17:53