Trace number 3251294

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
priss 1.0? (TO) 4800.24 1201.82

General information on the benchmark

Namecrafted/anton/SRHD-SGI/
srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf
MD5SUMc86ce640ddb0138bf41ccc37bc6fcf28
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark0.84587
Satisfiable
(Un)Satisfiability was proved
Number of variables1295
Number of clauses148400
Sum of the clauses size298025
Maximum clause length37
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2148365
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 535

Solver Data 

0.00/0.00	c *****************************************************
0.00/0.00	c *        riss, Copyright 2009 Norbert Manthey       *
0.00/0.00	c *   This program may be redistributed or modified   *
0.00/0.00	c * under the terms of the GNU General Public License *
0.00/0.00	c *****************************************************
0.00/0.00	c process id: 20430
0.00/0.03	c parsetime: 31194us
0.00/0.03	c parsed 148400 clauses with 1295 variables
0.00/0.04	c NW started thread 0 successfully (1098586432)
0.00/0.05	c NW started thread 1 successfully (1109076288)
0.00/0.07	c NW started thread 2 successfully (1119566144)
0.00/0.09	c NW started thread 3 successfully (1130056000)
26.10/6.67	c preprocessor returned 10005 variables
26.10/6.67	c preprocessing returned UNKNOWN
26.10/6.67	c PP set 0 variables
26.10/6.67	c pp time: 6566194us (6s)
26.10/6.67	c preprocessor returned 10005 variables
26.10/6.67	c preprocessing returned UNKNOWN
26.10/6.67	c PP set 0 variables
26.10/6.67	c pp time: 6583858us (6s)
26.10/6.67	c preprocessor returned 10005 variables
26.10/6.67	c preprocessing returned UNKNOWN
26.10/6.67	c PP set 0 variables
26.10/6.67	c pp time: 6567930us (6s)
51.26/12.93	c preprocessor returned 30022 variables
51.26/12.93	c preprocessing returned UNKNOWN
51.26/12.93	c PP set 0 variables
51.26/12.93	c pp time: 12840625us (12s)

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3251294-1304084865/watcher-3251294-1304084865 -o /tmp/evaluation-result-3251294-1304084865/solver-3251294-1304084865 -C 4800 -W 1300 -M 15500 HOME/priss.sh HOME HOME/instance-3251294-1304084865.cnf 2052076274 4800 15500 4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.17 8.13 8.09 5/182 20429
/proc/meminfo: memFree=30002388/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0

[startup+0.0554721 s]
/proc/loadavg: 8.17 8.13 8.09 5/182 20429
/proc/meminfo: memFree=30002388/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100446 s]
/proc/loadavg: 8.17 8.13 8.09 5/182 20429
/proc/meminfo: memFree=30002388/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.809968 s]
/proc/loadavg: 8.17 8.13 8.09 5/182 20429
/proc/meminfo: memFree=30002388/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.900285 s]
/proc/loadavg: 8.17 8.13 8.09 5/182 20429
/proc/meminfo: memFree=30002388/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50017 s]
/proc/loadavg: 8.17 8.13 8.09 5/182 20429
/proc/meminfo: memFree=30002388/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+3.10088 s]
/proc/loadavg: 8.16 8.12 8.09 9/188 20435
/proc/meminfo: memFree=29953980/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=288420 CPUtime=12.12 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 27316 0 0 0 1205 7 0 0 18 0 5 0 598717042 295342080 11667 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 72105 11667 350 389 0 67855 0
[pid=20430/tid=20432] ppid=20429 vsize=288420 CPUtime=3.02 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 4980 0 0 0 300 2 0 0 25 0 5 0 598717046 295342080 11667 33554432000 4194304 5787044 140736740732672 18446744073709551615 4336763 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=288420 CPUtime=3.01 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 4968 0 0 0 300 1 0 0 24 0 5 0 598717048 295342080 11667 33554432000 4194304 5787044 140736740732672 18446744073709551615 4336688 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=288420 CPUtime=3 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 4947 0 0 0 299 1 0 0 24 0 5 0 598717049 295342080 11667 33554432000 4194304 5787044 140736740732672 18446744073709551615 4336688 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=288420 CPUtime=2.97 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 4854 0 0 0 297 0 0 0 25 0 5 0 598717051 295342080 11667 33554432000 4194304 5787044 140736740732672 18446744073709551615 260020052123 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.12
Current children cumulated vsize (KiB) 297120

[startup+6.30029 s]
/proc/loadavg: 8.16 8.12 8.09 9/188 20435
/proc/meminfo: memFree=29922420/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=317192 CPUtime=24.9 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 35667 0 0 0 2482 8 0 0 18 0 5 0 598717042 324804608 19666 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 79298 19666 355 389 0 75048 0
[pid=20430/tid=20432] ppid=20429 vsize=317192 CPUtime=6.22 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 7948 0 0 0 620 2 0 0 25 0 5 0 598717046 324804608 19666 33554432000 4194304 5787044 140736740732672 18446744073709551615 4359266 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=317192 CPUtime=6.21 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 6615 0 0 0 619 2 0 0 25 0 5 0 598717048 324804608 19666 33554432000 4194304 5787044 140736740732672 18446744073709551615 4359266 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=317192 CPUtime=6.2 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 6588 0 0 0 619 1 0 0 25 0 5 0 598717049 324804608 19666 33554432000 4194304 5787044 140736740732672 18446744073709551615 4359256 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=317192 CPUtime=6.16 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 6949 0 0 0 615 1 0 0 25 0 5 0 598717051 324804608 19666 33554432000 4194304 5787044 140736740732672 18446744073709551615 4359256 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.9
Current children cumulated vsize (KiB) 325892

[startup+12.7071 s]
/proc/loadavg: 8.13 8.12 8.08 9/188 20435
/proc/meminfo: memFree=29899628/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=317192 CPUtime=50.48 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 50266 0 0 0 5037 11 0 0 18 0 5 0 598717042 324804608 24152 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 79298 24152 404 389 0 75048 0
[pid=20430/tid=20432] ppid=20429 vsize=317192 CPUtime=12.63 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 13141 0 0 0 1259 4 0 0 25 0 5 0 598717046 324804608 24152 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591319 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=317192 CPUtime=12.61 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 11240 0 0 0 1259 2 0 0 25 0 5 0 598717048 324804608 24152 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591034 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=317192 CPUtime=12.61 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 11364 0 0 0 1259 2 0 0 25 0 5 0 598717049 324804608 24152 33554432000 4194304 5787044 140736740732672 18446744073709551615 5590832 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=317192 CPUtime=12.53 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 6954 0 0 0 1252 1 0 0 25 0 5 0 598717051 324804608 24152 33554432000 4194304 5787044 140736740732672 18446744073709551615 260020089817 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 50.48
Current children cumulated vsize (KiB) 325892

[startup+25.5007 s]
/proc/loadavg: 8.11 8.12 8.08 9/188 20436
/proc/meminfo: memFree=29869484/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=329936 CPUtime=101.59 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 60866 0 0 0 10144 15 0 0 18 0 5 0 598717042 337854464 31880 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 82484 31880 417 389 0 78234 0
[pid=20430/tid=20432] ppid=20429 vsize=329936 CPUtime=25.42 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 14656 0 0 0 2538 4 0 0 25 0 5 0 598717046 337854464 31880 33554432000 4194304 5787044 140736740732672 18446744073709551615 5576461 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=329936 CPUtime=25.41 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 12887 0 0 0 2538 3 0 0 25 0 5 0 598717048 337854464 31880 33554432000 4194304 5787044 140736740732672 18446744073709551615 5590555 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=329936 CPUtime=25.39 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 12810 0 0 0 2537 2 0 0 25 0 5 0 598717049 337854464 31880 33554432000 4194304 5787044 140736740732672 18446744073709551615 5590442 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=329936 CPUtime=25.25 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 12946 0 0 0 2523 2 0 0 25 0 5 0 598717051 337854464 31880 33554432000 4194304 5787044 140736740732672 18446744073709551615 260020054453 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.59
Current children cumulated vsize (KiB) 338636

[startup+51.101 s]
/proc/loadavg: 8.13 8.12 8.09 9/188 20437
/proc/meminfo: memFree=29818308/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=343576 CPUtime=203.86 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 70186 0 0 0 20364 22 0 0 18 0 5 0 598717042 351821824 41195 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 85894 41195 417 389 0 81644 0
[pid=20430/tid=20432] ppid=20429 vsize=343576 CPUtime=51.02 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 17709 0 0 0 5096 6 0 0 25 0 5 0 598717046 351821824 41195 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591760 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=343576 CPUtime=51.02 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 14827 0 0 0 5096 6 0 0 25 0 5 0 598717048 351821824 41195 33554432000 4194304 5787044 140736740732672 18446744073709551615 47514730803776 0 0 4096 0 0 0 0 -1 0 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=343576 CPUtime=51 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 14794 0 0 0 5096 4 0 0 25 0 5 0 598717049 351821824 41195 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591539 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=343576 CPUtime=50.71 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 15289 0 0 0 5067 4 0 0 25 0 5 0 598717051 351821824 41195 33554432000 4194304 5787044 140736740732672 18446744073709551615 4218732 0 0 4096 0 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.86
Current children cumulated vsize (KiB) 352276

[startup+102.301 s]
/proc/loadavg: 8.12 8.12 8.09 9/188 20438
/proc/meminfo: memFree=29715732/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=366392 CPUtime=408.31 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 86984 0 0 0 40793 38 0 0 18 0 5 0 598717042 375185408 57830 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 91598 57830 417 389 0 87348 0
[pid=20430/tid=20432] ppid=20429 vsize=366392 CPUtime=102.2 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 21336 0 0 0 10211 9 0 0 25 0 5 0 598717046 375185408 57830 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=366392 CPUtime=102.2 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 19452 0 0 0 10210 10 0 0 25 0 5 0 598717048 375185408 57830 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591088 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=366392 CPUtime=101.94 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 18739 0 0 0 10184 10 0 0 25 0 5 0 598717049 375185408 57830 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591088 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=366392 CPUtime=101.86 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 19890 0 0 0 10179 7 0 0 25 0 5 0 598717051 375185408 57830 33554432000 4194304 5787044 140736740732672 18446744073709551615 5524772 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 408.31
Current children cumulated vsize (KiB) 375092

[startup+162.307 s]
/proc/loadavg: 8.04 8.09 8.08 9/188 20439
/proc/meminfo: memFree=29596132/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=385628 CPUtime=647.99 cores=0,2,4,6

################
# More data... #
################

/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 46963 0 0 0 82178 43 0 0 25 0 5 0 598717048 794394624 160416 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591526 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=775776 CPUtime=817.92 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 46300 0 0 0 81741 51 0 0 25 0 5 0 598717049 794394624 160416 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591236 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=775776 CPUtime=821.87 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 43916 0 0 0 82161 26 0 0 25 0 5 0 598717051 794394624 160416 33554432000 4194304 5787044 140736740732672 18446744073709551615 5527218 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3284.32
Current children cumulated vsize (KiB) 784476

[startup+882.301 s]
/proc/loadavg: 8.05 8.08 8.08 9/188 20501
/proc/meminfo: memFree=30022988/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=924636 CPUtime=3523.97 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 202320 0 0 0 352218 179 0 0 18 0 5 0 598717042 946827264 171831 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 231159 171831 417 389 0 226909 0
[pid=20430/tid=20432] ppid=20429 vsize=924636 CPUtime=882.21 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 49638 0 0 0 88175 46 0 0 25 0 5 0 598717046 946827264 171831 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591751 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=924636 CPUtime=882.2 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 50426 0 0 0 88170 50 0 0 25 0 5 0 598717048 946827264 171831 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591236 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=924636 CPUtime=877.58 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 47326 0 0 0 87707 51 0 0 25 0 5 0 598717049 946827264 171831 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591526 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=924636 CPUtime=881.86 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 47363 0 0 0 88157 29 0 0 25 0 5 0 598717051 946827264 171831 33554432000 4194304 5787044 140736740732672 18446744073709551615 5526964 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3523.97
Current children cumulated vsize (KiB) 933336

[startup+942.301 s]
/proc/loadavg: 8.05 8.08 8.08 9/188 20502
/proc/meminfo: memFree=29878712/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=945876 CPUtime=3763.63 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 214316 0 0 0 376172 191 0 0 18 0 5 0 598717042 968577024 183827 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 236469 183827 417 389 0 232219 0
[pid=20430/tid=20432] ppid=20429 vsize=945876 CPUtime=942.21 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 52975 0 0 0 94171 50 0 0 25 0 5 0 598717046 968577024 183827 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=945876 CPUtime=942.2 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 55845 0 0 0 94164 56 0 0 25 0 5 0 598717048 968577024 183827 33554432000 4194304 5787044 140736740732672 18446744073709551615 5590442 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=945876 CPUtime=937.24 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 47330 0 0 0 93673 51 0 0 25 0 5 0 598717049 968577024 183827 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=945876 CPUtime=941.87 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 50599 0 0 0 94155 32 0 0 25 0 5 0 598717051 968577024 183827 33554432000 4194304 5787044 140736740732672 18446744073709551615 5526895 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 3763.63
Current children cumulated vsize (KiB) 954576

[startup+1002.3 s]
/proc/loadavg: 8.05 8.08 8.08 9/188 20504
/proc/meminfo: memFree=29807096/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=949040 CPUtime=4003.29 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 217868 0 0 0 400134 195 0 0 18 0 5 0 598717042 971816960 186929 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 237260 186929 417 389 0 233010 0
[pid=20430/tid=20432] ppid=20429 vsize=949040 CPUtime=1002.2 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 53971 0 0 0 100170 50 0 0 25 0 5 0 598717046 971816960 186929 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591095 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=949040 CPUtime=1002.2 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 57073 0 0 0 100163 57 0 0 25 0 5 0 598717048 971816960 186929 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591236 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=949040 CPUtime=996.9 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 48055 0 0 0 99638 52 0 0 25 0 5 0 598717049 971816960 186929 33554432000 4194304 5787044 140736740732672 18446744073709551615 5590442 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=949040 CPUtime=1001.86 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 51202 0 0 0 100154 32 0 0 25 0 5 0 598717051 971816960 186929 33554432000 4194304 5787044 140736740732672 18446744073709551615 5526895 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4003.29
Current children cumulated vsize (KiB) 957740

[startup+1062.3 s]
/proc/loadavg: 8.09 8.08 8.08 9/188 20505
/proc/meminfo: memFree=29746888/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=953140 CPUtime=4242.96 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 221404 0 0 0 424095 201 0 0 18 0 5 0 598717042 976015360 190465 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 238285 190465 417 389 0 234035 0
[pid=20430/tid=20432] ppid=20429 vsize=953140 CPUtime=1062.2 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 53972 0 0 0 106170 50 0 0 25 0 5 0 598717046 976015360 190465 33554432000 4194304 5787044 140736740732672 18446744073709551615 4661061 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=953140 CPUtime=1062.2 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 57073 0 0 0 106163 57 0 0 25 0 5 0 598717048 976015360 190465 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591197 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=953140 CPUtime=1056.57 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 51589 0 0 0 105599 58 0 0 25 0 5 0 598717049 976015360 190465 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591289 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=953140 CPUtime=1061.86 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 51203 0 0 0 106154 32 0 0 25 0 5 0 598717051 976015360 190465 33554432000 4194304 5787044 140736740732672 18446744073709551615 5527068 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4242.96
Current children cumulated vsize (KiB) 961840

[startup+1122.3 s]
/proc/loadavg: 8.18 8.09 8.09 9/188 20507
/proc/meminfo: memFree=29689144/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=953140 CPUtime=4482.64 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 224740 0 0 0 448056 208 0 0 18 0 5 0 598717042 976015360 193801 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 238285 193801 417 389 0 234035 0
[pid=20430/tid=20432] ppid=20429 vsize=953140 CPUtime=1122.21 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 53973 0 0 0 112171 50 0 0 25 0 5 0 598717046 976015360 193801 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=953140 CPUtime=1122.2 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 57077 0 0 0 112163 57 0 0 25 0 5 0 598717048 976015360 193801 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=953140 CPUtime=1116.25 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 54916 0 0 0 111560 65 0 0 25 0 5 0 598717049 976015360 193801 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591236 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=953140 CPUtime=1121.87 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 51207 0 0 0 112154 33 0 0 25 0 5 0 598717051 976015360 193801 33554432000 4194304 5787044 140736740732672 18446744073709551615 5527140 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4482.64
Current children cumulated vsize (KiB) 961840

[startup+1182.3 s]
/proc/loadavg: 8.14 8.09 8.09 9/188 20509
/proc/meminfo: memFree=29655464/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=953140 CPUtime=4722.3 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 227893 0 0 0 472017 213 0 0 18 0 5 0 598717042 976015360 196954 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 238285 196954 417 389 0 234035 0
[pid=20430/tid=20432] ppid=20429 vsize=953140 CPUtime=1182.21 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 53978 0 0 0 118171 50 0 0 25 0 5 0 598717046 976015360 196954 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591768 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=953140 CPUtime=1182.2 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 57089 0 0 0 118163 57 0 0 25 0 5 0 598717048 976015360 196954 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591568 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=953140 CPUtime=1175.91 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 58045 0 0 0 117521 70 0 0 25 0 5 0 598717049 976015360 196954 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591630 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=953140 CPUtime=1181.87 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 51214 0 0 0 118154 33 0 0 25 0 5 0 598717051 976015360 196954 33554432000 4194304 5787044 140736740732672 18446744073709551615 5527008 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4722.3
Current children cumulated vsize (KiB) 961840



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.81 s]
/proc/loadavg: 8.10 8.08 8.08 9/188 20509
/proc/meminfo: memFree=29629016/32951124 swapFree=67111464/67111528
[pid=20429] ppid=20427 vsize=8700 CPUtime=0 cores=0,2,4,6
/proc/20429/stat : 20429 (priss.sh) S 20427 20429 19459 0 -1 4202496 331 0 0 0 0 0 0 0 25 0 1 0 598717042 8908800 251 33554432000 4194304 4922060 140734420421808 18446744073709551615 260020214917 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/20429/statm: 2175 251 211 178 0 68 0
[pid=20430] ppid=20429 vsize=953140 CPUtime=4800.24 cores=0,2,4,6
/proc/20430/stat : 20430 (priss) S 20429 20429 19459 0 -1 4202496 228959 0 0 0 479809 215 0 0 18 0 5 0 598717042 976015360 198020 33554432000 4194304 5787044 140736740732672 18446744073709551615 260032219569 0 0 4096 0 18446744073709551615 0 0 17 0 0 0 0
/proc/20430/statm: 238285 198020 417 389 0 234035 0
[pid=20430/tid=20432] ppid=20429 vsize=953140 CPUtime=1201.72 cores=0,2,4,6
/proc/20430/task/20432/stat : 20432 (priss) R 20429 20429 19459 0 -1 4202560 53981 0 0 0 120122 50 0 0 25 0 5 0 598717046 976015360 198020 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591284 0 0 4096 0 0 0 0 -1 4 0 0 0
[pid=20430/tid=20433] ppid=20429 vsize=953140 CPUtime=1201.71 cores=0,2,4,6
/proc/20430/task/20433/stat : 20433 (priss) R 20429 20429 19459 0 -1 4202560 57091 0 0 0 120114 57 0 0 25 0 5 0 598717048 976015360 198020 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591095 0 0 4096 0 0 0 0 -1 2 0 0 0
[pid=20430/tid=20434] ppid=20429 vsize=953140 CPUtime=1195.31 cores=0,2,4,6
/proc/20430/task/20434/stat : 20434 (priss) R 20429 20429 19459 0 -1 4202560 59102 0 0 0 119459 72 0 0 25 0 5 0 598717049 976015360 198020 33554432000 4194304 5787044 140736740732672 18446744073709551615 5591526 0 0 4096 0 0 0 0 -1 6 0 0 0
[pid=20430/tid=20435] ppid=20429 vsize=953140 CPUtime=1201.39 cores=0,2,4,6
/proc/20430/task/20435/stat : 20435 (priss) R 20429 20429 19459 0 -1 4202560 51218 0 0 0 120106 33 0 0 25 0 5 0 598717051 976015360 198020 33554432000 4194304 5787044 140736740732672 18446744073709551615 5528390 0 0 4096 0 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4800.24
Current children cumulated vsize (KiB) 961840

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20429 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 4800.24
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.82
CPU time (s): 4800.24
CPU user time (s): 4798.09
CPU system time (s): 2.15
CPU usage (%): 399.413
Max. virtual memory (cumulated for all children) (KiB): 961840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 331
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6
involuntary context switches= 3

runsolver used 1.76473 second user time and 4.80127 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-29 15:47:45
IDJOB=3251294
IDBENCH=88218
IDSOLVER=1603
FILE ID=node110/3251294-1304084865
RUNJOBID= node110-1304082043-20090
PBS_JOBID= 13170503
Free space on /tmp= 72824 MiB

SOLVER NAME= priss 1.0
BENCH NAME= SAT11/crafted/anton/SRHD-SGI/srhd-sgi-m37-q505.75-n35-p30-s59841049.cnf
COMMAND LINE= DIR/priss.sh DIR BENCHNAME RANDOMSEED TIMELIMIT MEMLIMIT NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3251294-1304084865/watcher-3251294-1304084865 -o /tmp/evaluation-result-3251294-1304084865/solver-3251294-1304084865 -C 4800 -W 1300 -M 15500  HOME/priss.sh HOME HOME/instance-3251294-1304084865.cnf 2052076274 4800 15500 4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c86ce640ddb0138bf41ccc37bc6fcf28
RANDOM SEED=2052076274

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30002660 kB
Buffers:        891408 kB
Cached:         707940 kB
SwapCached:         64 kB
Active:        1011772 kB
Inactive:      1529740 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30002660 kB
SwapTotal:    67111528 kB
SwapFree:     67111464 kB
Dirty:            3144 kB
Writeback:           0 kB
AnonPages:      941644 kB
Mapped:          15612 kB
Slab:           341744 kB
PageTables:       6232 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1163744 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72828 MiB
End job on node110 at 2011-04-29 16:07:48