Trace number 3372824

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587f (fixed)UNSAT 16885.7 2113.55

General information on the benchmark

NameSAT03/industrial/maris/CNF/
gripper13u.shuffled-as.sat03-395.cnf
MD5SUM3889b7ed90cc1fbe8bc8d140a1763832
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark1519.95
Satisfiable
(Un)Satisfiability was proved
Number of variables4268
Number of clauses38965
Sum of the clauses size86077
Maximum clause length28
Minimum clause length1
Number of clauses of size 169
Number of clauses of size 235984
Number of clauses of size 3104
Number of clauses of size 42704
Number of clauses of size 50
Number of clauses of size over 5104

Solver Data 

16885.66/2113.54	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3372824-1305442506/watcher-3372824-1305442506 -o /tmp/evaluation-result-3372824-1305442506/solver-3372824-1305442506 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3372824-1305442506.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.32 7.78 7.90 2/265 4357
/proc/meminfo: memFree=20829372/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=11944 CPUtime=0 cores=0-7
/proc/4357/stat : 4357 (plingeling) R 4355 4357 3701 0 -1 4202496 1059 1253 0 0 0 0 0 0 25 0 1 0 655850334 12230656 990 33554432000 4194304 4417452 140733481442736 18446744073709551615 237278573549 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/4357/statm: 3019 998 148 55 0 905 0

[startup+0.054724 s]
/proc/loadavg: 7.32 7.78 7.90 2/265 4357
/proc/meminfo: memFree=20829372/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=18608 CPUtime=0.04 cores=0-7
/proc/4357/stat : 4357 (plingeling) R 4355 4357 3701 0 -1 4202496 2746 1253 0 0 4 0 0 0 25 0 1 0 655850334 19054592 2676 33554432000 4194304 4417452 140733481442736 18446744073709551615 4262065 0 0 4096 17442 0 0 0 17 3 0 0 0
/proc/4357/statm: 4652 2676 149 55 0 2538 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 18608

[startup+0.1877 s]
/proc/loadavg: 7.32 7.78 7.90 2/265 4357
/proc/meminfo: memFree=20829372/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=170108 CPUtime=0.89 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 4635 1253 0 0 89 0 0 0 25 0 9 0 655850334 174190592 3818 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 42527 3818 176 55 0 40413 0
Current children cumulated CPU time (s) 0.89
Current children cumulated vsize (KiB) 170108

[startup+0.300678 s]
/proc/loadavg: 7.32 7.78 7.90 2/265 4357
/proc/meminfo: memFree=20829372/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=171652 CPUtime=1.79 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 5022 1253 0 0 179 0 0 0 25 0 9 0 655850334 175771648 4205 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 42913 4205 177 55 0 40799 0
Current children cumulated CPU time (s) 1.79
Current children cumulated vsize (KiB) 171652

[startup+0.700609 s]
/proc/loadavg: 7.32 7.78 7.90 2/265 4357
/proc/meminfo: memFree=20829372/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=183212 CPUtime=4.99 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 9751 1253 0 0 499 0 0 0 25 0 9 0 655850334 187609088 7097 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 45803 7097 180 55 0 43689 0
Current children cumulated CPU time (s) 4.99
Current children cumulated vsize (KiB) 183212

[startup+1.50047 s]
/proc/loadavg: 7.32 7.78 7.90 9/274 4371
/proc/meminfo: memFree=20799176/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=191512 CPUtime=11.38 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 14681 1253 0 0 1137 1 0 0 25 0 9 0 655850334 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 47878 9515 180 55 0 45764 0
[pid=4357/tid=4364] ppid=4355 vsize=191512 CPUtime=1.41 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 927 1253 0 0 141 0 0 0 25 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=191512 CPUtime=1.41 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 1004 1253 0 0 141 0 0 0 25 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364533 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=191512 CPUtime=1.41 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 962 1253 0 0 141 0 0 0 25 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=191512 CPUtime=1.4 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 3593 1253 0 0 140 0 0 0 25 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=191512 CPUtime=1.41 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 796 1253 0 0 141 0 0 0 25 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=191512 CPUtime=1.41 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 1114 1253 0 0 141 0 0 0 20 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4366113 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=191512 CPUtime=1.41 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 1002 1253 0 0 141 0 0 0 19 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4232656 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=191512 CPUtime=1.4 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 1496 1253 0 0 140 0 0 0 25 0 9 0 655850342 196108288 9515 33554432000 4194304 4417452 140733481442736 18446744073709551615 4236601 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 11.38
Current children cumulated vsize (KiB) 191512

[startup+3.10118 s]
/proc/loadavg: 7.32 7.78 7.90 9/274 4371
/proc/meminfo: memFree=20782932/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=208212 CPUtime=24.18 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 24897 1253 0 0 2415 3 0 0 25 0 9 0 655850334 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 52053 13661 180 55 0 49939 0
[pid=4357/tid=4364] ppid=4355 vsize=208212 CPUtime=3.01 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 1644 1253 0 0 301 0 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4232651 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=208212 CPUtime=3.01 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 2000 1253 0 0 301 0 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4232666 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=208212 CPUtime=3.01 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 1659 1253 0 0 301 0 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364650 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=208212 CPUtime=2.99 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 9112 1253 0 0 298 1 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364819 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=208212 CPUtime=3.01 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 932 1253 0 0 301 0 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4300576 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=208212 CPUtime=3.01 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 1669 1253 0 0 301 0 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4236906 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=208212 CPUtime=3.01 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 1659 1253 0 0 301 0 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364604 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=208212 CPUtime=3 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 2435 1253 0 0 300 0 0 0 25 0 9 0 655850342 213209088 13661 33554432000 4194304 4417452 140733481442736 18446744073709551615 4357087 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 24.18
Current children cumulated vsize (KiB) 208212

[startup+6.30062 s]
/proc/loadavg: 7.37 7.79 7.90 9/274 4372
/proc/meminfo: memFree=20765968/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=229480 CPUtime=49.75 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 48480 1253 0 0 4967 8 0 0 25 0 9 0 655850334 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 57370 18931 180 55 0 55256 0
[pid=4357/tid=4364] ppid=4355 vsize=229480 CPUtime=6.2 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 4347 1253 0 0 620 0 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364420 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=229480 CPUtime=6.21 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 4866 1253 0 0 621 0 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364780 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=229480 CPUtime=6.21 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 3595 1253 0 0 621 0 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=229480 CPUtime=6.16 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 16254 1253 0 0 613 3 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=229480 CPUtime=6.2 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 3897 1253 0 0 620 0 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4365973 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=229480 CPUtime=6.21 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 3890 1253 0 0 621 0 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=229480 CPUtime=6.21 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 2848 1253 0 0 621 0 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4366048 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=229480 CPUtime=6.2 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 4996 1253 0 0 620 0 0 0 25 0 9 0 655850342 234987520 18931 33554432000 4194304 4417452 140733481442736 18446744073709551615 4365135 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 49.75
Current children cumulated vsize (KiB) 229480

[startup+12.7005 s]
/proc/loadavg: 7.42 7.79 7.90 9/274 4372
/proc/meminfo: memFree=20696552/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=307344 CPUtime=100.88 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 105666 1253 0 0 10067 21 0 0 25 0 9 0 655850334 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 76836 38397 180 55 0 74722 0
[pid=4357/tid=4364] ppid=4355 vsize=307344 CPUtime=12.6 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 9838 1253 0 0 1259 1 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=307344 CPUtime=12.6 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 9759 1253 0 0 1259 1 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4264869 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=307344 CPUtime=12.61 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 9575 1253 0 0 1259 2 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364838 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=307344 CPUtime=12.51 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 33679 1253 0 0 1243 8 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4357826 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=307344 CPUtime=12.6 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 9954 1253 0 0 1259 1 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4366657 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=307344 CPUtime=12.6 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 10046 1253 0 0 1259 1 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4356960 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=307344 CPUtime=12.61 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 8858 1253 0 0 1260 1 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4259997 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=307344 CPUtime=12.6 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 10170 1253 0 0 1258 2 0 0 25 0 9 0 655850342 314720256 38397 33554432000 4194304 4417452 140733481442736 18446744073709551615 4237371 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 100.88
Current children cumulated vsize (KiB) 307344

[startup+25.5012 s]
/proc/loadavg: 7.55 7.80 7.90 9/274 4372
/proc/meminfo: memFree=20683748/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=307820 CPUtime=203.18 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 200810 1253 0 0 20276 42 0 0 25 0 9 0 655850334 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 76955 38484 180 55 0 74841 0
[pid=4357/tid=4364] ppid=4355 vsize=307820 CPUtime=25.41 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 19069 1253 0 0 2538 3 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4232654 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=307820 CPUtime=25.41 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 17426 1253 0 0 2538 3 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4365976 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=307820 CPUtime=25.4 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 16867 1253 0 0 2537 3 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4346484 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=307820 CPUtime=25.19 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 70404 1253 0 0 2503 16 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364550 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=307820 CPUtime=25.4 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 17970 1253 0 0 2538 2 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=307820 CPUtime=25.41 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 19008 1253 0 0 2538 3 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=307820 CPUtime=25.4 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 16852 1253 0 0 2536 4 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4310402 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=307820 CPUtime=25.4 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 19427 1253 0 0 2537 3 0 0 25 0 9 0 655850342 315207680 38484 33554432000 4194304 4417452 140733481442736 18446744073709551615 4277567 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.18
Current children cumulated vsize (KiB) 307820

[startup+51.1007 s]
/proc/loadavg: 7.70 7.81 7.90 9/274 4373
/proc/meminfo: memFree=20581176/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=410920 CPUtime=407.77 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 375017 1253 0 0 40700 77 0 0 25 0 9 0 655850334 420782080 64259 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 102730 64259 180 55 0 100616 0
[pid=4357/tid=4364] ppid=4355 vsize=410920 CPUtime=51.01 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 35469 1253 0 0 5095 6 0 0 25 0 9 0 655850342 420782080 64259 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364821 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=410920 CPUtime=51.01 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 31133 1253 0 0 5095 6 0 0 25 0 9 0 655850342 420782080 64259 33554432000 4194304 4417452 140733481442736 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=410920 CPUtime=51 cores=0-7

################
# More data... #
################

/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 361000 1253 0 0 208156 64 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=2014176 CPUtime=2082.26 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 332958 1253 0 0 208166 60 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=2014176 CPUtime=2082.27 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 362471 1253 0 0 208162 65 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=2014176 CPUtime=2065.12 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 1404116 1253 0 0 206224 288 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364784 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=2014176 CPUtime=2082.25 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 387337 1253 0 0 208159 66 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=2014176 CPUtime=2082.25 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 414926 1253 0 0 208153 72 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4365023 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=2014176 CPUtime=2081.37 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 294951 1253 0 0 208086 51 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=2014176 CPUtime=2082.08 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 475717 1253 0 0 208128 80 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16639.9
Current children cumulated vsize (KiB) 2014176

Solver just ended. Dumping a history of the last processes samples

[startup+2099.1 s]
/proc/loadavg: 8.06 8.04 8.00 9/274 4439
/proc/meminfo: memFree=18970176/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=2014176 CPUtime=16774.1 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 4045455 1253 0 0 1676662 751 0 0 25 0 9 0 655850334 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 503544 465158 180 55 0 501430 0
[pid=4357/tid=4364] ppid=4355 vsize=2014176 CPUtime=2098.99 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 361000 1253 0 0 209835 64 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=2014176 CPUtime=2099.05 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 332958 1253 0 0 209845 60 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=2014176 CPUtime=2099.06 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 362471 1253 0 0 209841 65 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=2014176 CPUtime=2081.78 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 1404116 1253 0 0 207890 288 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=2014176 CPUtime=2099.05 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 395529 1253 0 0 209838 67 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=2014176 CPUtime=2099.04 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 414926 1253 0 0 209832 72 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=2014176 CPUtime=2098.15 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 294951 1253 0 0 209764 51 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4247533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=2014176 CPUtime=2098.87 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 475717 1253 0 0 209807 80 0 0 25 0 9 0 655850342 2062516224 465158 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364765 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16774.1
Current children cumulated vsize (KiB) 2014176

[startup+2105.5 s]
/proc/loadavg: 8.05 8.04 8.00 9/274 4440
/proc/meminfo: memFree=19012584/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=1816988 CPUtime=16825.3 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 4091984 1253 0 0 1681768 759 0 0 25 0 9 0 655850334 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 454247 415850 180 55 0 452133 0
[pid=4357/tid=4364] ppid=4355 vsize=1816988 CPUtime=2105.39 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 361000 1253 0 0 210475 64 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 4366385 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=1816988 CPUtime=2105.45 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 332958 1253 0 0 210485 60 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 4366051 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=1816988 CPUtime=2105.46 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 362471 1253 0 0 210481 65 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364724 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=1816988 CPUtime=2088.12 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 1446192 1253 0 0 208517 295 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 237278937514 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=1816988 CPUtime=2105.45 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 395529 1253 0 0 210478 67 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=1816988 CPUtime=2105.44 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 414926 1253 0 0 210472 72 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364558 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=1816988 CPUtime=2104.55 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 299404 1253 0 0 210404 51 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=1816988 CPUtime=2105.27 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 475717 1253 0 0 210447 80 0 0 25 0 9 0 655850342 1860595712 415850 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16825.3
Current children cumulated vsize (KiB) 1816988

[startup+2108.71 s]
/proc/loadavg: 8.05 8.03 8.00 9/274 4440
/proc/meminfo: memFree=18836008/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=2148220 CPUtime=16850.9 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 4174792 1253 0 0 1684318 774 0 0 25 0 9 0 655850334 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 537055 498658 180 55 0 534941 0
[pid=4357/tid=4364] ppid=4355 vsize=2148220 CPUtime=2108.6 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 361000 1253 0 0 210796 64 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364907 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=2148220 CPUtime=2108.66 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 332958 1253 0 0 210806 60 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364885 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=2148220 CPUtime=2108.67 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 362471 1253 0 0 210802 65 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364564 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=2148220 CPUtime=2091.31 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 1520690 1253 0 0 208822 309 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364579 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=2148220 CPUtime=2108.66 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 403721 1253 0 0 210798 68 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=2148220 CPUtime=2108.65 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 414926 1253 0 0 210793 72 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=2148220 CPUtime=2107.76 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 299522 1253 0 0 210725 51 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=2148220 CPUtime=2108.48 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 475717 1253 0 0 210768 80 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16850.9
Current children cumulated vsize (KiB) 2148220

[startup+2111.9 s]
/proc/loadavg: 8.05 8.03 8.00 9/274 4440
/proc/meminfo: memFree=18836008/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=2148220 CPUtime=16876.5 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 4174792 1253 0 0 1686875 774 0 0 25 0 9 0 655850334 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 537055 498658 180 55 0 534941 0
[pid=4357/tid=4364] ppid=4355 vsize=2148220 CPUtime=2111.8 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 361000 1253 0 0 211116 64 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364626 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=2148220 CPUtime=2111.86 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 332958 1253 0 0 211126 60 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=2148220 CPUtime=2111.87 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 362471 1253 0 0 211122 65 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364634 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=2148220 CPUtime=2094.48 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 1520690 1253 0 0 209139 309 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=2148220 CPUtime=2111.86 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 403721 1253 0 0 211118 68 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=2148220 CPUtime=2111.85 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 414926 1253 0 0 211113 72 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364984 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=2148220 CPUtime=2110.96 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 299522 1253 0 0 211045 51 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=2148220 CPUtime=2111.68 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 475717 1253 0 0 211088 80 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364587 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16876.5
Current children cumulated vsize (KiB) 2148220

[startup+2112.7 s]
/proc/loadavg: 8.05 8.03 8.00 9/274 4440
/proc/meminfo: memFree=18836008/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=2148220 CPUtime=16882.8 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 4174792 1253 0 0 1687509 774 0 0 25 0 9 0 655850334 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 537055 498658 180 55 0 534941 0
[pid=4357/tid=4364] ppid=4355 vsize=2148220 CPUtime=2112.59 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 361000 1253 0 0 211195 64 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364594 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=2148220 CPUtime=2112.65 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 332958 1253 0 0 211205 60 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364653 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=2148220 CPUtime=2112.66 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 362471 1253 0 0 211201 65 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4367] ppid=4355 vsize=2148220 CPUtime=2095.27 cores=0-7
/proc/4357/task/4367/stat : 4367 (plingeling) R 4355 4357 3701 0 -1 4202560 1520690 1253 0 0 209218 309 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=4357/tid=4368] ppid=4355 vsize=2148220 CPUtime=2112.65 cores=0-7
/proc/4357/task/4368/stat : 4368 (plingeling) R 4355 4357 3701 0 -1 4202560 403721 1253 0 0 211197 68 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364641 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=2148220 CPUtime=2112.64 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 414926 1253 0 0 211192 72 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4250602 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=4357/tid=4370] ppid=4355 vsize=2148220 CPUtime=2111.75 cores=0-7
/proc/4357/task/4370/stat : 4370 (plingeling) R 4355 4357 3701 0 -1 4202560 299522 1253 0 0 211124 51 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364399 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=4357/tid=4371] ppid=4355 vsize=2148220 CPUtime=2112.47 cores=0-7
/proc/4357/task/4371/stat : 4371 (plingeling) R 4355 4357 3701 0 -1 4202560 475717 1253 0 0 211167 80 0 0 25 0 9 0 655850342 2199777280 498658 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364827 0 0 4096 17442 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 16882.8
Current children cumulated vsize (KiB) 2148220

[startup+2113.11 s]
/proc/loadavg: 8.04 8.03 8.00 5/270 4440
/proc/meminfo: memFree=18836040/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=2148220 CPUtime=16884.9 cores=0-7
/proc/4357/stat : 4357 (plingeling) S 4355 4357 3701 0 -1 4202496 4174793 1253 0 0 1687715 774 0 0 25 0 5 0 655850334 2199777280 498659 33554432000 4194304 4417452 140733481442736 18446744073709551615 237290682341 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/4357/statm: 537055 498659 181 55 0 534941 0
[pid=4357/tid=4364] ppid=4355 vsize=2148220 CPUtime=2113 cores=0-7
/proc/4357/task/4364/stat : 4364 (plingeling) R 4355 4357 3701 0 -1 4202560 361000 1253 0 0 211236 64 0 0 25 0 5 0 655850342 2199777280 498659 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=4357/tid=4365] ppid=4355 vsize=2148220 CPUtime=2113.06 cores=0-7
/proc/4357/task/4365/stat : 4365 (plingeling) R 4355 4357 3701 0 -1 4202560 332958 1253 0 0 211246 60 0 0 25 0 5 0 655850342 2199777280 498659 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364727 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=4357/tid=4366] ppid=4355 vsize=2148220 CPUtime=2113.07 cores=0-7
/proc/4357/task/4366/stat : 4366 (plingeling) R 4355 4357 3701 0 -1 4202560 362471 1253 0 0 211242 65 0 0 25 0 5 0 655850342 2199777280 498659 33554432000 4194304 4417452 140733481442736 18446744073709551615 4364817 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=4357/tid=4369] ppid=4355 vsize=2148220 CPUtime=2113.05 cores=0-7
/proc/4357/task/4369/stat : 4369 (plingeling) R 4355 4357 3701 0 -1 4202560 414926 1253 0 0 211233 72 0 0 25 0 5 0 655850342 2199777280 498659 33554432000 4194304 4417452 140733481442736 18446744073709551615 4365058 0 0 4096 17442 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 16884.9
Current children cumulated vsize (KiB) 2148220

[startup+2113.5 s]
/proc/loadavg: 8.04 8.03 8.00 5/270 4440
/proc/meminfo: memFree=18836040/32950904 swapFree=67057400/67111528
[pid=4357] ppid=4355 vsize=1000164 CPUtime=16885.7 cores=0-7
/proc/4357/stat : 4357 (plingeling) R 4355 4357 3701 0 -1 4202496 4174793 1253 0 0 1687787 779 0 0 16 0 1 0 655850334 1024167936 197210 33554432000 4194304 4417452 140733481442736 18446744073709551615 237278922887 0 0 4096 0 0 0 0 17 5 0 0 0
/proc/4357/statm: 250041 196698 181 55 0 247927 0
Current children cumulated CPU time (s) 16885.7
Current children cumulated vsize (KiB) 1000164

Child status: 20
Real time (s): 2113.55
CPU time (s): 16885.7
CPU user time (s): 16877.9
CPU system time (s): 7.84281
CPU usage (%): 798.928
Max. virtual memory (cumulated for all children) (KiB): 2501772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 16877.9
system time used= 7.84281
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4176049
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 338
involuntary context switches= 81632

runsolver used 4.76328 second user time and 12.6261 second system time

The end

Launcher Data 

Begin job on node121 at 2011-05-15 08:55:06
IDJOB=3372824
IDBENCH=84180
IDSOLVER=1851
FILE ID=node121/3372824-1305442506
RUNJOBID= node121-1305437356-3715
PBS_JOBID= 13324770
Free space on /tmp= 73496 MiB

SOLVER NAME= Plingeling 587f (fixed)
BENCH NAME= SAT03/industrial/maris/CNF/gripper13u.shuffled-as.sat03-395.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3372824-1305442506/watcher-3372824-1305442506 -o /tmp/evaluation-result-3372824-1305442506/solver-3372824-1305442506 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3372824-1305442506.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3889b7ed90cc1fbe8bc8d140a1763832
RANDOM SEED=1333107171

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20829528 kB
Buffers:        308624 kB
Cached:        6087252 kB
SwapCached:       7656 kB
Active:        6445560 kB
Inactive:      5319880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20829528 kB
SwapTotal:    67111528 kB
SwapFree:     67057400 kB
Dirty:            1128 kB
Writeback:           0 kB
AnonPages:     5367984 kB
Mapped:          21712 kB
Slab:           265044 kB
PageTables:      23168 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS: 30643504 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73492 MiB
End job on node121 at 2011-05-15 09:30:19