Trace number 3309954

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587UNSAT 13603.3 1701.86

General information on the benchmark

NameSAT03/industrial/goldberg/hard_eq_check/
k2mul.miter.shuffled-as.sat03-355.cnf
MD5SUM77e0700cbaeeb3d63a4820608fc84761
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1129.19
Satisfiable
(Un)Satisfiability was proved
Number of variables11680
Number of clauses74581
Sum of the clauses size252050
Maximum clause length86
Minimum clause length1
Number of clauses of size 14
Number of clauses of size 217176
Number of clauses of size 334696
Number of clauses of size 40
Number of clauses of size 522704
Number of clauses of size over 51

Solver Data 

13603.18/1701.85	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3309954-1304016236/watcher-3309954-1304016236 -o /tmp/evaluation-result-3309954-1304016236/solver-3309954-1304016236 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3309954-1304016236.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.05 7.04 7.00 1/170 3467
/proc/meminfo: memFree=19607776/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=11968 CPUtime=0 cores=0-7
/proc/3467/stat : 3467 (plingeling) R 3465 3467 3001 0 -1 4202496 1086 1255 0 0 0 0 0 0 25 0 1 0 494039756 12255232 1015 33554432000 4194304 4417332 140737484137856 18446744073709551615 255106462686 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/3467/statm: 2992 1015 148 55 0 878 0

[startup+0.032269 s]
/proc/loadavg: 7.05 7.04 7.00 1/170 3467
/proc/meminfo: memFree=19607776/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=21324 CPUtime=0.02 cores=0-7
/proc/3467/stat : 3467 (plingeling) R 3465 3467 3001 0 -1 4202496 3409 1255 0 0 2 0 0 0 25 0 1 0 494039756 21835776 3338 33554432000 4194304 4417332 140737484137856 18446744073709551615 4259140 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/3467/statm: 5331 3338 148 55 0 3217 0
Current children cumulated CPU time (s) 0.02
Current children cumulated vsize (KiB) 21324

[startup+0.100257 s]
/proc/loadavg: 7.05 7.04 7.00 1/170 3467
/proc/meminfo: memFree=19607776/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=29420 CPUtime=0.09 cores=0-7
/proc/3467/stat : 3467 (plingeling) R 3465 3467 3001 0 -1 4202496 5481 1255 0 0 9 0 0 0 25 0 1 0 494039756 30126080 5378 33554432000 4194304 4417332 140737484137856 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/3467/statm: 7355 5378 148 55 0 5241 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 29420

[startup+0.300222 s]
/proc/loadavg: 7.05 7.04 7.00 1/170 3467
/proc/meminfo: memFree=19607776/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=60400 CPUtime=0.29 cores=0-7
/proc/3467/stat : 3467 (plingeling) R 3465 3467 3001 0 -1 4202496 13226 1255 0 0 28 1 0 0 25 0 1 0 494039756 61849600 13123 33554432000 4194304 4417332 140737484137856 18446744073709551615 4259603 0 0 4096 17442 0 0 0 17 4 0 0 0
/proc/3467/statm: 15100 13123 148 55 0 12986 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 60400

[startup+1.107 s]
/proc/loadavg: 7.05 7.04 7.00 1/170 3467
/proc/meminfo: memFree=19607776/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=209920 CPUtime=6.63 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 20694 1255 0 0 661 2 0 0 18 0 9 0 494039756 214958080 13895 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 52480 13895 181 55 0 50366 0
Current children cumulated CPU time (s) 6.63
Current children cumulated vsize (KiB) 209920

[startup+1.50093 s]
/proc/loadavg: 7.05 7.04 7.00 1/170 3467
/proc/meminfo: memFree=19607776/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=209392 CPUtime=9.78 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 21389 1255 0 0 976 2 0 0 18 0 9 0 494039756 214417408 13702 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 52348 13702 181 55 0 50234 0
Current children cumulated CPU time (s) 9.78
Current children cumulated vsize (KiB) 209392

[startup+3.10065 s]
/proc/loadavg: 7.21 7.07 7.01 9/179 3483
/proc/meminfo: memFree=19552180/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=212396 CPUtime=22.57 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 22108 1255 0 0 2255 2 0 0 18 0 9 0 494039756 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 53099 14421 181 55 0 50985 0
[pid=3467/tid=3474] ppid=3465 vsize=212396 CPUtime=2.79 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 1381 1255 0 0 279 0 0 0 23 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=212396 CPUtime=2.79 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 1054 1255 0 0 279 0 0 0 25 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=212396 CPUtime=2.79 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 1191 1255 0 0 279 0 0 0 25 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=212396 CPUtime=2.78 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 1006 1255 0 0 278 0 0 0 23 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=212396 CPUtime=2.79 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 654 1255 0 0 279 0 0 0 23 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4365425 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=212396 CPUtime=2.78 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 1465 1255 0 0 278 0 0 0 25 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4264902 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=212396 CPUtime=2.75 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 1128 1255 0 0 275 0 0 0 25 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4264976 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=212396 CPUtime=2.76 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 986 1255 0 0 276 0 0 0 25 0 9 0 494039787 217493504 14421 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236732 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 22.57
Current children cumulated vsize (KiB) 212396

[startup+6.30109 s]
/proc/loadavg: 7.27 7.09 7.02 9/179 3483
/proc/meminfo: memFree=19545112/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=220472 CPUtime=48.15 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 24000 1255 0 0 4813 2 0 0 18 0 9 0 494039756 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 55118 16313 181 55 0 53004 0
[pid=3467/tid=3474] ppid=3465 vsize=220472 CPUtime=5.99 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 1521 1255 0 0 599 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4265340 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=220472 CPUtime=5.99 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 1098 1255 0 0 599 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=220472 CPUtime=5.99 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 1487 1255 0 0 599 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236874 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=220472 CPUtime=5.96 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 2004 1255 0 0 596 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=220472 CPUtime=5.99 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 788 1255 0 0 599 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4232566 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=220472 CPUtime=5.98 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 1465 1255 0 0 598 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=220472 CPUtime=5.96 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 1274 1255 0 0 596 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=220472 CPUtime=5.96 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 1120 1255 0 0 596 0 0 0 25 0 9 0 494039787 225763328 16313 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 48.15
Current children cumulated vsize (KiB) 220472

[startup+12.701 s]
/proc/loadavg: 7.41 7.12 7.03 9/179 3483
/proc/meminfo: memFree=19535968/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=228260 CPUtime=99.36 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 28499 1255 0 0 9933 3 0 0 18 0 9 0 494039756 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 57065 18387 181 55 0 54951 0
[pid=3467/tid=3474] ppid=3465 vsize=228260 CPUtime=12.39 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 2033 1255 0 0 1239 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=228260 CPUtime=12.4 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 1098 1255 0 0 1240 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=228260 CPUtime=12.39 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 1487 1255 0 0 1239 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=228260 CPUtime=12.32 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 5612 1255 0 0 1232 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=228260 CPUtime=12.39 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 1101 1255 0 0 1239 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=228260 CPUtime=12.39 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 1465 1255 0 0 1239 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4232801 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=228260 CPUtime=12.36 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 1340 1255 0 0 1236 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=228260 CPUtime=12.37 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 1120 1255 0 0 1237 0 0 0 25 0 9 0 494039787 233738240 18387 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 99.36
Current children cumulated vsize (KiB) 228260

[startup+25.5007 s]
/proc/loadavg: 7.50 7.15 7.04 9/179 3483
/proc/meminfo: memFree=19520052/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=246612 CPUtime=201.65 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 41710 1255 0 0 20160 5 0 0 18 0 9 0 494039756 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 61653 22981 181 55 0 59539 0
[pid=3467/tid=3474] ppid=3465 vsize=246612 CPUtime=25.19 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 2680 1255 0 0 2519 0 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=246612 CPUtime=25.19 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 1242 1255 0 0 2519 0 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=246612 CPUtime=25.18 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 3580 1255 0 0 2518 0 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4253395 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=246612 CPUtime=25.05 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 14617 1255 0 0 2503 2 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4356899 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=246612 CPUtime=25.19 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 1671 1255 0 0 2519 0 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=246612 CPUtime=25.18 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 1465 1255 0 0 2518 0 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364519 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=246612 CPUtime=25.15 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 1667 1255 0 0 2515 0 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4305855 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=246612 CPUtime=25.16 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 1545 1255 0 0 2516 0 0 0 25 0 9 0 494039787 252530688 22981 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 201.65
Current children cumulated vsize (KiB) 246612

[startup+51.1012 s]
/proc/loadavg: 7.67 7.22 7.06 9/179 3484
/proc/meminfo: memFree=19467372/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=302276 CPUtime=406.32 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 91458 1255 0 0 40615 17 0 0 18 0 9 0 494039756 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 75569 36903 181 55 0 73455 0
[pid=3467/tid=3474] ppid=3465 vsize=302276 CPUtime=50.79 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 5949 1255 0 0 5078 1 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4365026 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=302276 CPUtime=50.78 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 5708 1255 0 0 5078 0 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=302276 CPUtime=50.78 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 9539 1255 0 0 5077 1 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364526 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=302276 CPUtime=50.52 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 34884 1255 0 0 5045 7 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236689 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=302276 CPUtime=50.79 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 5535 1255 0 0 5078 1 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=302276 CPUtime=50.79 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 5450 1255 0 0 5078 1 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=302276 CPUtime=50.74 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 5978 1255 0 0 5074 0 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4265429 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=302276 CPUtime=50.75 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 5172 1255 0 0 5075 0 0 0 25 0 9 0 494039787 309530624 36903 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 406.32
Current children cumulated vsize (KiB) 302276

[startup+102.301 s]
/proc/loadavg: 7.91 7.36 7.12 9/179 3485

################
# More data... #
################

/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 493983 1255 0 0 166333 95 0 0 25 0 9 0 494039787 639709184 117520 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13305.9
Current children cumulated vsize (KiB) 624716

[startup+1677.4 s]
/proc/loadavg: 8.04 8.02 7.83 9/179 3543
/proc/meminfo: memFree=19096128/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=668824 CPUtime=13408.2 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 4439213 1255 0 0 1339956 865 0 0 18 0 9 0 494039756 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 167206 128547 181 55 0 165092 0
[pid=3467/tid=3474] ppid=3465 vsize=668824 CPUtime=1677.1 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 521609 1255 0 0 167608 102 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4366468 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=668824 CPUtime=1677.11 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 504827 1255 0 0 167612 99 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=668824 CPUtime=1677.07 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 506077 1255 0 0 167609 98 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=668824 CPUtime=1668.32 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 844436 1255 0 0 166666 166 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236544 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=668824 CPUtime=1677.11 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 524541 1255 0 0 167605 106 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=668824 CPUtime=1677.11 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 525795 1255 0 0 167612 99 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4366384 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=668824 CPUtime=1676.93 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 502835 1255 0 0 167599 94 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4353476 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=668824 CPUtime=1677.09 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 495850 1255 0 0 167613 96 0 0 25 0 9 0 494039787 684875776 128547 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13408.2
Current children cumulated vsize (KiB) 668824

[startup+1690.2 s]
/proc/loadavg: 8.03 8.02 7.83 9/179 3544
/proc/meminfo: memFree=19085604/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=679300 CPUtime=13510.6 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 4474776 1255 0 0 1350186 871 0 0 18 0 9 0 494039756 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 169825 131166 181 55 0 167711 0
[pid=3467/tid=3474] ppid=3465 vsize=679300 CPUtime=1689.91 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 525175 1255 0 0 168888 103 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=679300 CPUtime=1689.92 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 507682 1255 0 0 168892 100 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4264937 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=679300 CPUtime=1689.87 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 509010 1255 0 0 168889 98 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=679300 CPUtime=1681.05 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 847946 1255 0 0 167939 166 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=679300 CPUtime=1689.92 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 528104 1255 0 0 168886 106 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=679300 CPUtime=1689.91 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 527082 1255 0 0 168892 99 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=679300 CPUtime=1689.73 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 513949 1255 0 0 168877 96 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=679300 CPUtime=1689.9 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 502585 1255 0 0 168892 98 0 0 25 0 9 0 494039787 695603200 131166 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13510.6
Current children cumulated vsize (KiB) 679300

[startup+1696.6 s]
/proc/loadavg: 8.10 8.03 7.84 9/179 3544
/proc/meminfo: memFree=19092796/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=688176 CPUtime=13561.7 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 4488524 1255 0 0 1355297 874 0 0 18 0 9 0 494039756 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 172044 133385 181 55 0 169930 0
[pid=3467/tid=3474] ppid=3465 vsize=688176 CPUtime=1696.31 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 525275 1255 0 0 169528 103 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4356756 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=688176 CPUtime=1696.31 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 511008 1255 0 0 169531 100 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364541 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=688176 CPUtime=1696.27 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 512576 1255 0 0 169528 99 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=688176 CPUtime=1687.42 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 847946 1255 0 0 168576 166 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=688176 CPUtime=1696.31 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 528104 1255 0 0 169525 106 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=688176 CPUtime=1696.31 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 531178 1255 0 0 169531 100 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=688176 CPUtime=1696.12 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 516455 1255 0 0 169516 96 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=688176 CPUtime=1696.29 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 502739 1255 0 0 169531 98 0 0 25 0 9 0 494039787 704692224 133385 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13561.7
Current children cumulated vsize (KiB) 688176

[startup+1699.8 s]
/proc/loadavg: 8.10 8.03 7.84 9/179 3544
/proc/meminfo: memFree=19085480/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=687136 CPUtime=13587.3 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 4496890 1255 0 0 1357854 875 0 0 18 0 9 0 494039756 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 171784 133125 181 55 0 169670 0
[pid=3467/tid=3474] ppid=3465 vsize=687136 CPUtime=1699.5 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 526742 1255 0 0 169847 103 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364671 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=687136 CPUtime=1699.51 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 511008 1255 0 0 169851 100 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=687136 CPUtime=1699.47 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 512576 1255 0 0 169848 99 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4365975 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=687136 CPUtime=1690.6 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 852042 1255 0 0 168893 167 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=687136 CPUtime=1699.51 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 530662 1255 0 0 169844 107 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=687136 CPUtime=1699.51 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 531178 1255 0 0 169851 100 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=687136 CPUtime=1699.32 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 516455 1255 0 0 169836 96 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=687136 CPUtime=1699.49 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 502984 1255 0 0 169851 98 0 0 25 0 9 0 494039787 703627264 133125 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13587.3
Current children cumulated vsize (KiB) 687136

[startup+1700.6 s]
/proc/loadavg: 8.10 8.03 7.84 9/179 3544
/proc/meminfo: memFree=19138552/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=618080 CPUtime=13593.7 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 4502712 1255 0 0 1358492 876 0 0 18 0 9 0 494039756 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 154520 115854 181 55 0 152406 0
[pid=3467/tid=3474] ppid=3465 vsize=618080 CPUtime=1700.3 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 526742 1255 0 0 169927 103 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=618080 CPUtime=1700.31 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 511008 1255 0 0 169931 100 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=618080 CPUtime=1700.27 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 512576 1255 0 0 169928 99 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=618080 CPUtime=1691.4 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 856945 1255 0 0 168972 168 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=618080 CPUtime=1700.31 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 530662 1255 0 0 169924 107 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364479 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=618080 CPUtime=1700.31 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 532097 1255 0 0 169931 100 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364899 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=618080 CPUtime=1700.12 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 516455 1255 0 0 169916 96 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4357458 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=618080 CPUtime=1700.29 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 502984 1255 0 0 169931 98 0 0 25 0 9 0 494039787 632913920 115854 33554432000 4194304 4417332 140737484137856 18446744073709551615 4232804 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13593.7
Current children cumulated vsize (KiB) 618080

[startup+1701.4 s]
/proc/loadavg: 8.09 8.03 7.84 9/179 3544
/proc/meminfo: memFree=19141528/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=624436 CPUtime=13600.1 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 4504301 1255 0 0 1359131 876 0 0 18 0 9 0 494039756 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 156109 117443 181 55 0 153995 0
[pid=3467/tid=3474] ppid=3465 vsize=624436 CPUtime=1701.1 cores=0-7
/proc/3467/task/3474/stat : 3474 (plingeling) R 3465 3467 3001 0 -1 4202560 526742 1255 0 0 170007 103 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3475] ppid=3465 vsize=624436 CPUtime=1701.11 cores=0-7
/proc/3467/task/3475/stat : 3475 (plingeling) R 3465 3467 3001 0 -1 4202560 511008 1255 0 0 170011 100 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364502 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=3467/tid=3476] ppid=3465 vsize=624436 CPUtime=1701.07 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 512576 1255 0 0 170008 99 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4357187 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=3467/tid=3477] ppid=3465 vsize=624436 CPUtime=1692.19 cores=0-7
/proc/3467/task/3477/stat : 3477 (plingeling) R 3465 3467 3001 0 -1 4202560 857028 1255 0 0 169051 168 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4236644 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=624436 CPUtime=1701.11 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 530662 1255 0 0 170004 107 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=624436 CPUtime=1701.11 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 533603 1255 0 0 170011 100 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4358377 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=624436 CPUtime=1700.92 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 516455 1255 0 0 169996 96 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4352440 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=3467/tid=3483] ppid=3465 vsize=624436 CPUtime=1701.09 cores=0-7
/proc/3467/task/3483/stat : 3483 (plingeling) R 3465 3467 3001 0 -1 4202560 502984 1255 0 0 170011 98 0 0 25 0 9 0 494039787 639422464 117443 33554432000 4194304 4417332 140737484137856 18446744073709551615 4357798 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 13600.1
Current children cumulated vsize (KiB) 624436

[startup+1701.8 s]
/proc/loadavg: 8.09 8.03 7.84 9/179 3544
/proc/meminfo: memFree=19141528/32951124 swapFree=67111524/67111528
[pid=3467] ppid=3465 vsize=624436 CPUtime=13603.2 cores=0-7
/proc/3467/stat : 3467 (plingeling) S 3465 3467 3001 0 -1 4202496 4504302 1255 0 0 1359442 876 0 0 18 0 5 0 494039756 639422464 117444 33554432000 4194304 4417332 140737484137856 18446744073709551615 255118571493 0 0 4096 17442 18446744073709551615 0 0 17 6 0 0 0
/proc/3467/statm: 156109 117444 182 55 0 153995 0
[pid=3467/tid=3476] ppid=3465 vsize=624436 CPUtime=1701.46 cores=0-7
/proc/3467/task/3476/stat : 3476 (plingeling) R 3465 3467 3001 0 -1 4202560 512576 1255 0 0 170047 99 0 0 25 0 5 0 494039787 639422464 117444 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=3467/tid=3478] ppid=3465 vsize=624436 CPUtime=1701.51 cores=0-7
/proc/3467/task/3478/stat : 3478 (plingeling) R 3465 3467 3001 0 -1 4202560 530662 1255 0 0 170044 107 0 0 25 0 5 0 494039787 639422464 117444 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=3467/tid=3481] ppid=3465 vsize=624436 CPUtime=1701.51 cores=0-7
/proc/3467/task/3481/stat : 3481 (plingeling) R 3465 3467 3001 0 -1 4202560 533603 1255 0 0 170051 100 0 0 25 0 5 0 494039787 639422464 117444 33554432000 4194304 4417332 140737484137856 18446744073709551615 4366006 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=3467/tid=3482] ppid=3465 vsize=624436 CPUtime=1701.32 cores=0-7
/proc/3467/task/3482/stat : 3482 (plingeling) R 3465 3467 3001 0 -1 4202560 516455 1255 0 0 170036 96 0 0 25 0 5 0 494039787 639422464 117444 33554432000 4194304 4417332 140737484137856 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 13603.2
Current children cumulated vsize (KiB) 624436

Child status: 20
Real time (s): 1701.86
CPU time (s): 13603.3
CPU user time (s): 13594.5
CPU system time (s): 8.79466
CPU usage (%): 799.319
Max. virtual memory (cumulated for all children) (KiB): 743872

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 13594.5
system time used= 8.79466
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4505560
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 319
involuntary context switches= 63918

runsolver used 2.76958 second user time and 6.17106 second system time

The end

Launcher Data 

Begin job on node144 at 2011-04-28 20:43:56
IDJOB=3309954
IDBENCH=84215
IDSOLVER=1695
FILE ID=node144/3309954-1304016236
RUNJOBID= node144-1304009411-3015
PBS_JOBID= 13168853
Free space on /tmp= 72408 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT03/industrial/goldberg/hard_eq_check/k2mul.miter.shuffled-as.sat03-355.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3309954-1304016236/watcher-3309954-1304016236 -o /tmp/evaluation-result-3309954-1304016236/solver-3309954-1304016236 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3309954-1304016236.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 77e0700cbaeeb3d63a4820608fc84761
RANDOM SEED=1902008317

node144.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.850
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19607684 kB
Buffers:       2201976 kB
Cached:       10511692 kB
SwapCached:          4 kB
Active:        4540900 kB
Inactive:      8236936 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19607684 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            1592 kB
Writeback:           0 kB
AnonPages:       63956 kB
Mapped:          14696 kB
Slab:           498516 kB
PageTables:       4276 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   185628 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72408 MiB
End job on node144 at 2011-04-28 21:12:18