Trace number 3273923

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.33 1201.86

General information on the benchmark

Namecrafted/spence/sgen/
sgen3-n280-s93756482-sat.cnf
MD5SUMbadb3b4ac12b29ada7dd8ed96ed75c80
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark3.66244
Satisfiable
(Un)Satisfiability was proved
Number of variables280
Number of clauses672
Sum of the clauses size1680
Maximum clause length5
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2560
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 5112
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3273923-1304086395/watcher-3273923-1304086395 -o /tmp/evaluation-result-3273923-1304086395/solver-3273923-1304086395 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3273923-1304086395.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=180568 CPUtime=0 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 564 0 0 0 0 0 0 0 22 0 4 0 501055668 184901632 500 33554432000 4194304 4623224 140734959510112 18446744073709551615 4366247 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 45142 505 333 105 0 40646 0
[pid=12514/tid=12520] ppid=12511 vsize=180568 CPUtime=0 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 2 0 0 0 0 0 0 0 23 0 4 0 501055669 184901632 515 33554432000 4194304 4623224 140734959510112 18446744073709551615 4290235 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=180568 CPUtime=0 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 20 0 0 0 0 0 0 0 18 0 4 0 501055669 184901632 520 33554432000 4194304 4623224 140734959510112 18446744073709551615 255106429637 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=180568 CPUtime=0 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 4 0 0 0 0 0 0 0 22 0 4 0 501055669 184901632 521 33554432000 4194304 4623224 140734959510112 18446744073709551615 4550936 0 0 4096 2 0 0 0 -1 6 0 0 0

[startup+0.429271 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=252708 CPUtime=1.68 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 5177 0 0 0 168 0 0 0 18 0 4 0 501055668 258772992 2995 33554432000 4194304 4623224 140734959510112 18446744073709551615 4414819 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 63177 2995 344 105 0 58681 0
[pid=12514/tid=12520] ppid=12511 vsize=252708 CPUtime=0.41 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1209 0 0 0 41 0 0 0 25 0 4 0 501055669 258772992 2995 33554432000 4194304 4623224 140734959510112 18446744073709551615 255106429985 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=252708 CPUtime=0.42 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1202 0 0 0 42 0 0 0 18 0 4 0 501055669 258772992 2995 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=252708 CPUtime=0.41 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1540 0 0 0 41 0 0 0 18 0 4 0 501055669 258772992 2995 33554432000 4194304 4623224 140734959510112 18446744073709551615 255106466000 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.68
Current children cumulated vsize (KiB) 252708

[startup+0.507705 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=252796 CPUtime=2 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 6286 0 0 0 200 0 0 0 18 0 4 0 501055668 258863104 3285 33554432000 4194304 4623224 140734959510112 18446744073709551615 4511032 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 63199 3285 344 105 0 58703 0
[pid=12514/tid=12520] ppid=12511 vsize=252796 CPUtime=0.49 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1296 0 0 0 49 0 0 0 25 0 4 0 501055669 258863104 3285 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376823 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=252796 CPUtime=0.5 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1592 0 0 0 50 0 0 0 18 0 4 0 501055669 258863104 3285 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376646 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=252796 CPUtime=0.49 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 2152 0 0 0 49 0 0 0 18 0 4 0 501055669 258863104 3285 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2
Current children cumulated vsize (KiB) 252796

[startup+0.600689 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=252504 CPUtime=2.37 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 7244 0 0 0 237 0 0 0 18 0 4 0 501055668 258564096 3674 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 63126 3675 344 105 0 58630 0
[pid=12514/tid=12520] ppid=12511 vsize=252504 CPUtime=0.59 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1433 0 0 0 59 0 0 0 25 0 4 0 501055669 258564096 3676 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=252504 CPUtime=0.59 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1716 0 0 0 59 0 0 0 18 0 4 0 501055669 258564096 3676 33554432000 4194304 4623224 140734959510112 18446744073709551615 255106429637 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=252504 CPUtime=0.59 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 2657 0 0 0 59 0 0 0 18 0 4 0 501055669 258564096 3676 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.37
Current children cumulated vsize (KiB) 252504

[startup+0.700672 s]
/proc/loadavg: 3.72 5.33 6.81 3/176 12516
/proc/meminfo: memFree=24251864/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=254132 CPUtime=2.78 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 8228 0 0 0 277 1 0 0 18 0 4 0 501055668 260231168 4105 33554432000 4194304 4623224 140734959510112 18446744073709551615 4384149 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 63533 4105 344 105 0 59037 0
[pid=12514/tid=12520] ppid=12511 vsize=254132 CPUtime=0.68 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1850 0 0 0 68 0 0 0 25 0 4 0 501055669 260231168 4105 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376766 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=254132 CPUtime=0.69 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 1924 0 0 0 69 0 0 0 18 0 4 0 501055669 260231168 4105 33554432000 4194304 4623224 140734959510112 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=254132 CPUtime=0.69 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 2993 0 0 0 69 0 0 0 18 0 4 0 501055669 260231168 4105 33554432000 4194304 4623224 140734959510112 18446744073709551615 4563992 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.78
Current children cumulated vsize (KiB) 254132

[startup+1.50653 s]
/proc/loadavg: 3.72 5.33 6.81 10/184 12524
/proc/meminfo: memFree=24200056/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=258804 CPUtime=5.99 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 17113 0 0 0 597 2 0 0 20 0 4 0 501055668 265015296 6568 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510907 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 64701 6568 345 105 0 60205 0
[pid=12514/tid=12520] ppid=12511 vsize=258804 CPUtime=1.49 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 3066 0 0 0 148 1 0 0 25 0 4 0 501055669 265015296 6568 33554432000 4194304 4623224 140734959510112 18446744073709551615 4366443 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=258804 CPUtime=1.49 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 3014 0 0 0 149 0 0 0 20 0 4 0 501055669 265015296 6568 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376853 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=258804 CPUtime=1.48 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 9072 0 0 0 148 0 0 0 20 0 4 0 501055669 265015296 6568 33554432000 4194304 4623224 140734959510112 18446744073709551615 4550436 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.99
Current children cumulated vsize (KiB) 258804

[startup+3.10025 s]
/proc/loadavg: 3.72 5.33 6.81 10/184 12524
/proc/meminfo: memFree=24175876/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=268352 CPUtime=12.36 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 28270 0 0 0 1231 5 0 0 25 0 4 0 501055668 274792448 10418 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510932 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 67088 10418 350 105 0 62592 0
[pid=12514/tid=12520] ppid=12511 vsize=268352 CPUtime=3.09 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 4958 0 0 0 308 1 0 0 25 0 4 0 501055669 274792448 10418 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=268352 CPUtime=3.09 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 5475 0 0 0 308 1 0 0 25 0 4 0 501055669 274792448 10418 33554432000 4194304 4623224 140734959510112 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=268352 CPUtime=3.07 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 15129 0 0 0 306 1 0 0 25 0 4 0 501055669 274792448 10418 33554432000 4194304 4623224 140734959510112 18446744073709551615 4365856 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.36
Current children cumulated vsize (KiB) 268352

[startup+6.30069 s]
/proc/loadavg: 4.06 5.37 6.81 10/184 12524
/proc/meminfo: memFree=24131832/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=279724 CPUtime=25.15 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 58153 0 0 0 2505 10 0 0 25 0 4 0 501055668 286437376 15252 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510214 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 69931 15252 358 105 0 65435 0
[pid=12514/tid=12520] ppid=12511 vsize=279724 CPUtime=6.29 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 7574 0 0 0 627 2 0 0 25 0 4 0 501055669 286437376 15252 33554432000 4194304 4623224 140734959510112 18446744073709551615 4377613 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=279724 CPUtime=6.28 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 8072 0 0 0 627 1 0 0 25 0 4 0 501055669 286437376 15252 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=279724 CPUtime=6.26 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 38672 0 0 0 621 5 0 0 25 0 4 0 501055669 286437376 15252 33554432000 4194304 4623224 140734959510112 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.15
Current children cumulated vsize (KiB) 279724

[startup+12.7006 s]
/proc/loadavg: 4.37 5.42 6.82 10/184 12524
/proc/meminfo: memFree=24072852/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=290500 CPUtime=50.72 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 124748 0 0 0 5049 23 0 0 25 0 4 0 501055668 297472000 22899 33554432000 4194304 4623224 140734959510112 18446744073709551615 4511014 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 72625 22899 400 105 0 68129 0
[pid=12514/tid=12520] ppid=12511 vsize=290500 CPUtime=12.68 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 10735 0 0 0 1266 2 0 0 25 0 4 0 501055669 297472000 22899 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=290500 CPUtime=12.68 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 12669 0 0 0 1265 3 0 0 25 0 4 0 501055669 297472000 22899 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376625 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=290500 CPUtime=12.63 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 95680 0 0 0 1248 15 0 0 25 0 4 0 501055669 297472000 22899 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.72
Current children cumulated vsize (KiB) 290500

[startup+25.5003 s]
/proc/loadavg: 5.18 5.54 6.84 10/184 12524
/proc/meminfo: memFree=23984180/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=312808 CPUtime=101.86 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 245484 0 0 0 10142 44 0 0 25 0 4 0 501055668 320315392 34519 33554432000 4194304 4623224 140734959510112 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 78202 34519 468 105 0 73706 0
[pid=12514/tid=12520] ppid=12511 vsize=312808 CPUtime=25.48 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 16944 0 0 0 2544 4 0 0 25 0 4 0 501055669 320315392 34519 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376829 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=312808 CPUtime=25.49 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 18432 0 0 0 2544 5 0 0 25 0 4 0 501055669 320315392 34519 33554432000 4194304 4623224 140734959510112 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=312808 CPUtime=25.38 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 201240 0 0 0 2506 32 0 0 25 0 4 0 501055669 320315392 34519 33554432000 4194304 4623224 140734959510112 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.86
Current children cumulated vsize (KiB) 312808

[startup+51.1008 s]
/proc/loadavg: 6.14 5.74 6.87 10/184 12525
/proc/meminfo: memFree=23849740/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=346432 CPUtime=204.14 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 431816 0 0 0 20337 77 0 0 25 0 4 0 501055668 354746368 52655 33554432000 4194304 4623224 140734959510112 18446744073709551615 4517494 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 86608 52655 621 105 0 82112 0
[pid=12514/tid=12520] ppid=12511 vsize=346432 CPUtime=51.09 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 25252 0 0 0 5101 8 0 0 25 0 4 0 501055669 354746368 52655 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376732 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=346432 CPUtime=51.08 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 25227 0 0 0 5102 6 0 0 25 0 4 0 501055669 354746368 52655 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376675 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=346432 CPUtime=50.85 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 366412 0 0 0 5027 58 0 0 25 0 4 0 501055669 354746368 52655 33554432000 4194304 4623224 140734959510112 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 204.14
Current children cumulated vsize (KiB) 346432

[startup+102.301 s]
/proc/loadavg: 7.19 6.09 6.92 10/184 12526
/proc/meminfo: memFree=23684812/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=454376 CPUtime=408.69 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 812135 0 0 0 40730 139 0 0 25 0 4 0 501055668 465281024 72206 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510298 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 113594 72206 741 105 0 109098 0
[pid=12514/tid=12520] ppid=12511 vsize=454376 CPUtime=102.29 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 35712 0 0 0 10219 10 0 0 25 0 4 0 501055669 465281024 72206 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=454376 CPUtime=102.28 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 38871 0 0 0 10216 12 0 0 25 0 4 0 501055669 465281024 72206 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=454376 CPUtime=101.8 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 717548 0 0 0 10067 113 0 0 25 0 4 0 501055669 465281024 72206 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.69
Current children cumulated vsize (KiB) 454376

[startup+162.3 s]

################
# More data... #
################

[pid=12514] ppid=12511 vsize=1068104 CPUtime=2565.97 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 4049629 0 0 0 255899 698 0 0 25 0 4 0 501055668 1093738496 207570 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 267026 207570 1424 105 0 262530 0
[pid=12514/tid=12520] ppid=12511 vsize=1068104 CPUtime=642.3 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 106855 0 0 0 64194 36 0 0 25 0 4 0 501055669 1093738496 207570 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1068104 CPUtime=640.8 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 132055 0 0 0 64024 56 0 0 25 0 4 0 501055669 1093738496 207570 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1068104 CPUtime=640.54 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 3748794 0 0 0 63460 594 0 0 25 0 4 0 501055669 1093738496 207570 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2565.97
Current children cumulated vsize (KiB) 1068104

[startup+702.3 s]
/proc/loadavg: 8.10 7.82 7.46 9/184 12544
/proc/meminfo: memFree=22614044/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1088756 CPUtime=2805.65 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 4479678 0 0 0 279796 769 0 0 25 0 4 0 501055668 1114886144 215775 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 272189 215775 1408 105 0 267693 0
[pid=12514/tid=12520] ppid=12511 vsize=1088756 CPUtime=702.29 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 110454 0 0 0 70189 40 0 0 25 0 4 0 501055669 1114886144 215775 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1088756 CPUtime=700.49 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 135368 0 0 0 69990 59 0 0 25 0 4 0 501055669 1114886144 215775 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1088756 CPUtime=700.54 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 4171376 0 0 0 69396 658 0 0 25 0 4 0 501055669 1114886144 215775 33554432000 4194304 4623224 140734959510112 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2805.65
Current children cumulated vsize (KiB) 1088756

[startup+762.301 s]
/proc/loadavg: 8.25 7.92 7.52 10/184 12547
/proc/meminfo: memFree=22564996/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1154292 CPUtime=3044.52 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 4871380 0 0 0 303616 836 0 0 25 0 4 0 501055668 1181995008 222622 33554432000 4194304 4623224 140734959510112 18446744073709551615 4517479 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 288573 222622 1416 105 0 284077 0
[pid=12514/tid=12520] ppid=12511 vsize=1154292 CPUtime=762.17 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 113224 0 0 0 76173 44 0 0 25 0 4 0 501055669 1181995008 222622 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1154292 CPUtime=759.5 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 137534 0 0 0 75888 62 0 0 25 0 4 0 501055669 1181995008 222622 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1154292 CPUtime=760.51 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 4557683 0 0 0 75334 717 0 0 25 0 4 0 501055669 1181995008 222622 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3044.52
Current children cumulated vsize (KiB) 1154292

[startup+822.301 s]
/proc/loadavg: 8.18 7.96 7.56 10/184 12548
/proc/meminfo: memFree=22524432/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1121488 CPUtime=3284.22 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 5285967 0 0 0 327522 900 0 0 25 0 4 0 501055668 1148403712 217707 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510066 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 280372 217707 416 105 0 275876 0
[pid=12514/tid=12520] ppid=12511 vsize=1121488 CPUtime=822.17 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 115981 0 0 0 82169 48 0 0 25 0 4 0 501055669 1148403712 217707 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1121488 CPUtime=819.19 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 141237 0 0 0 81855 64 0 0 25 0 4 0 501055669 1148403712 217707 33554432000 4194304 4623224 140734959510112 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1121488 CPUtime=820.51 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 4954891 0 0 0 81278 773 0 0 25 0 4 0 501055669 1148403712 217707 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3284.22
Current children cumulated vsize (KiB) 1121488

[startup+882.301 s]
/proc/loadavg: 8.15 8.00 7.59 10/184 12550
/proc/meminfo: memFree=22393348/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1283032 CPUtime=3523.9 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 5484676 0 0 0 351456 934 0 0 25 0 4 0 501055668 1313824768 233408 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 320758 233408 372 105 0 316262 0
[pid=12514/tid=12520] ppid=12511 vsize=1283032 CPUtime=882.17 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 124650 0 0 0 88166 51 0 0 25 0 4 0 501055669 1313824768 233408 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1283032 CPUtime=878.88 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 148532 0 0 0 87821 67 0 0 25 0 4 0 501055669 1313824768 233408 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1283032 CPUtime=880.5 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 5137169 0 0 0 87249 801 0 0 25 0 4 0 501055669 1313824768 233408 33554432000 4194304 4623224 140734959510112 18446744073709551615 4550519 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3523.9
Current children cumulated vsize (KiB) 1283032

[startup+942.301 s]
/proc/loadavg: 8.18 8.03 7.63 10/184 12552
/proc/meminfo: memFree=22361712/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1283032 CPUtime=3763.58 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 5551614 0 0 0 375414 944 0 0 25 0 4 0 501055668 1313824768 237364 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 320758 237364 363 105 0 316262 0
[pid=12514/tid=12520] ppid=12511 vsize=1283032 CPUtime=942.17 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 125917 0 0 0 94165 52 0 0 25 0 4 0 501055669 1313824768 237364 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376678 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1283032 CPUtime=938.57 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 149592 0 0 0 93790 67 0 0 25 0 4 0 501055669 1313824768 237364 33554432000 4194304 4623224 140734959510112 18446744073709551615 4366428 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1283032 CPUtime=940.5 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 5200421 0 0 0 93240 810 0 0 25 0 4 0 501055669 1313824768 237364 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376687 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3763.58
Current children cumulated vsize (KiB) 1283032

[startup+1002.3 s]
/proc/loadavg: 8.06 8.02 7.65 10/184 12553
/proc/meminfo: memFree=22287416/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1325580 CPUtime=4003.28 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 5697963 0 0 0 399359 969 0 0 25 0 4 0 501055668 1357393920 244363 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 331395 244363 352 105 0 326899 0
[pid=12514/tid=12520] ppid=12511 vsize=1325580 CPUtime=1002.17 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 128258 0 0 0 100163 54 0 0 25 0 4 0 501055669 1357393920 244363 33554432000 4194304 4623224 140734959510112 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1325580 CPUtime=998.26 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 149836 0 0 0 99759 67 0 0 25 0 4 0 501055669 1357393920 244363 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1325580 CPUtime=1000.5 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 5325232 0 0 0 99220 830 0 0 25 0 4 0 501055669 1357393920 244363 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4003.28
Current children cumulated vsize (KiB) 1325580

[startup+1062.3 s]
/proc/loadavg: 8.07 8.03 7.67 10/184 12555
/proc/meminfo: memFree=22230484/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1383216 CPUtime=4242.97 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 5948075 0 0 0 423285 1012 0 0 25 0 4 0 501055668 1416413184 252607 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 345804 252607 346 105 0 341308 0
[pid=12514/tid=12520] ppid=12511 vsize=1383216 CPUtime=1062.17 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 161578 0 0 0 106156 61 0 0 25 0 4 0 501055669 1416413184 252607 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1383216 CPUtime=1057.96 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 150895 0 0 0 105728 68 0 0 25 0 4 0 501055669 1416413184 252607 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376652 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1383216 CPUtime=1060.49 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 5540553 0 0 0 105185 864 0 0 25 0 4 0 501055669 1416413184 252607 33554432000 4194304 4623224 140734959510112 18446744073709551615 4577474 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4242.97
Current children cumulated vsize (KiB) 1383216

[startup+1122.3 s]
/proc/loadavg: 8.07 8.04 7.69 10/184 12556
/proc/meminfo: memFree=22195492/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1383216 CPUtime=4482.67 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 6287598 0 0 0 447200 1067 0 0 25 0 4 0 501055668 1416413184 259533 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510199 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 345804 259533 346 105 0 341308 0
[pid=12514/tid=12520] ppid=12511 vsize=1383216 CPUtime=1122.18 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 164710 0 0 0 112154 64 0 0 25 0 4 0 501055669 1416413184 259533 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1383216 CPUtime=1117.65 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 152946 0 0 0 111695 70 0 0 25 0 4 0 501055669 1416413184 259533 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376649 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1383216 CPUtime=1120.49 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 5873894 0 0 0 111134 915 0 0 25 0 4 0 501055669 1416413184 259533 33554432000 4194304 4623224 140734959510112 18446744073709551615 4377128 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4482.67
Current children cumulated vsize (KiB) 1383216

[startup+1182.3 s]
/proc/loadavg: 8.02 8.03 7.71 10/184 12558
/proc/meminfo: memFree=22135088/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1454864 CPUtime=4722.34 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 6746066 0 0 0 471092 1142 0 0 25 0 4 0 501055668 1489780736 270956 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 363716 270956 348 105 0 359220 0
[pid=12514/tid=12520] ppid=12511 vsize=1454864 CPUtime=1182.17 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 166769 0 0 0 118151 66 0 0 25 0 4 0 501055669 1489780736 270956 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1454864 CPUtime=1177.34 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 195595 0 0 0 117657 77 0 0 25 0 4 0 501055669 1489780736 270956 33554432000 4194304 4623224 140734959510112 18446744073709551615 4366364 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1454864 CPUtime=1180.48 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 6287055 0 0 0 117068 980 0 0 25 0 4 0 501055669 1489780736 270956 33554432000 4194304 4623224 140734959510112 18446744073709551615 4377587 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4722.34
Current children cumulated vsize (KiB) 1454864



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.8 s]
/proc/loadavg: 8.02 8.02 7.72 5/180 12560
/proc/meminfo: memFree=23150428/32951124 swapFree=67111524/67111528
[pid=12514] ppid=12511 vsize=1454864 CPUtime=4800.24 cores=0,2,4,6
/proc/12514/stat : 12514 (SArTagnan) R 12511 12514 12135 0 -1 4202496 6847058 0 0 0 478866 1158 0 0 25 0 4 0 501055668 1489780736 274297 33554432000 4194304 4623224 140734959510112 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/12514/statm: 363716 274297 370 105 0 359220 0
[pid=12514/tid=12520] ppid=12511 vsize=1454864 CPUtime=1201.68 cores=0,2,4,6
/proc/12514/task/12520/stat : 12520 (SArTagnan) R 12511 12514 12135 0 -1 4202560 167377 0 0 0 120100 68 0 0 25 0 4 0 501055669 1489780736 274297 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=12514/tid=12521] ppid=12511 vsize=1454864 CPUtime=1196.73 cores=0,2,4,6
/proc/12514/task/12521/stat : 12521 (SArTagnan) R 12511 12514 12135 0 -1 4202560 197167 0 0 0 119595 78 0 0 25 0 4 0 501055669 1489780736 274297 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=12514/tid=12522] ppid=12511 vsize=1454864 CPUtime=1199.98 cores=0,2,4,6
/proc/12514/task/12522/stat : 12522 (SArTagnan) R 12511 12514 12135 0 -1 4202560 6385578 0 0 0 119004 994 0 0 25 0 4 0 501055669 1489780736 274297 33554432000 4194304 4623224 140734959510112 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 1454864

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.86
CPU time (s): 4800.33
CPU user time (s): 4788.69
CPU system time (s): 11.6402
CPU usage (%): 399.407
Max. virtual memory (cumulated for all children) (KiB): 1596304

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4788.69
system time used= 11.6402
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 6847058
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1715
involuntary context switches= 43041

runsolver used 1.86871 second user time and 4.17936 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-29 16:13:15
IDJOB=3273923
IDBENCH=83149
IDSOLVER=1656
FILE ID=node144/3273923-1304086395
RUNJOBID= node144-1304086395-12497
PBS_JOBID= 13170542
Free space on /tmp= 72412 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/spence/sgen/sgen3-n280-s93756482-sat.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3273923-1304086395/watcher-3273923-1304086395 -o /tmp/evaluation-result-3273923-1304086395/solver-3273923-1304086395 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3273923-1304086395.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= badb3b4ac12b29ada7dd8ed96ed75c80
RANDOM SEED=150406654

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24252020 kB
Buffers:       2122040 kB
Cached:        5964472 kB
SwapCached:          4 kB
Active:         159340 kB
Inactive:      7990612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24252020 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:             796 kB
Writeback:           0 kB
AnonPages:       62368 kB
Mapped:          14480 kB
Slab:           486004 kB
PageTables:       4732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   183492 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72408 MiB
End job on node144 at 2011-04-29 16:33:19