Trace number 3310041

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587UNSAT 2448.08 309.957

General information on the benchmark

NameSAT02/industrial/aloul/
Homer/homer14.shuffled.cnf
MD5SUM1d9569aa70fee033c68469753053c259
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark71.3432
Satisfiable
(Un)Satisfiability was proved
Number of variables300
Number of clauses2130
Sum of the clauses size4500
Maximum clause length10
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22100
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 530

Solver Data 

2448.02/309.95	s UNSATISFIABLE

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3310041-1304019074/watcher-3310041-1304019074 -o /tmp/evaluation-result-3310041-1304019074/solver-3310041-1304019074 -C 40000 -W 5100 -M 31000 plingeling -t 8 HOME/instance-3310041-1304019074.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 29566
/proc/meminfo: memFree=23730472/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=9436 CPUtime=0 cores=0-7
/proc/29566/stat : 29566 (plingeling) R 29564 29566 29499 0 -1 4202496 421 1260 0 0 0 0 0 0 18 0 1 0 592138054 9662464 349 33554432000 4194304 4417332 140734360736448 18446744073709551615 260905393920 0 0 4096 17442 0 0 0 17 2 0 0 0
/proc/29566/statm: 2359 349 146 55 0 245 0

[startup+0.13218 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 29566
/proc/meminfo: memFree=23730472/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=228452 CPUtime=0.96 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 2501 1260 0 0 96 0 0 0 19 0 9 0 592138054 233934848 1950 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 57113 1950 181 55 0 54999 0
Current children cumulated CPU time (s) 0.96
Current children cumulated vsize (KiB) 228452

[startup+0.232161 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 29566
/proc/meminfo: memFree=23730472/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=232108 CPUtime=1.76 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 4443 1260 0 0 175 1 0 0 19 0 9 0 592138054 237678592 2868 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 58027 2868 181 55 0 55913 0
Current children cumulated CPU time (s) 1.76
Current children cumulated vsize (KiB) 232108

[startup+0.332144 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 29566
/proc/meminfo: memFree=23730472/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=234308 CPUtime=2.56 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 5881 1260 0 0 255 1 0 0 19 0 9 0 592138054 239931392 3418 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 58572 3413 181 55 0 56458 0
Current children cumulated CPU time (s) 2.56
Current children cumulated vsize (KiB) 234308

[startup+0.701077 s]
/proc/loadavg: 0.00 0.00 0.00 2/170 29566
/proc/meminfo: memFree=23730472/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=238924 CPUtime=5.51 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 11871 1260 0 0 549 2 0 0 19 0 9 0 592138054 244658176 4572 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 59731 4572 181 55 0 57617 0
Current children cumulated CPU time (s) 5.51
Current children cumulated vsize (KiB) 238924

[startup+1.50093 s]
/proc/loadavg: 0.00 0.00 0.00 9/179 29580
/proc/meminfo: memFree=23703748/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=248232 CPUtime=11.9 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 27862 1260 0 0 1185 5 0 0 19 0 9 0 592138054 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 62058 6899 181 55 0 59944 0
[pid=29566/tid=29573] ppid=29564 vsize=248232 CPUtime=1.48 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 2968 1260 0 0 148 0 0 0 23 0 9 0 592138054 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=248232 CPUtime=1.48 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 3462 1260 0 0 148 0 0 0 23 0 9 0 592138054 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4246428 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=248232 CPUtime=1.46 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 3397 1260 0 0 146 0 0 0 23 0 9 0 592138054 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=248232 CPUtime=1.49 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 3804 1260 0 0 148 1 0 0 25 0 9 0 592138054 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=248232 CPUtime=1.48 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 3248 1260 0 0 148 0 0 0 25 0 9 0 592138054 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=248232 CPUtime=1.48 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 3455 1260 0 0 148 0 0 0 25 0 9 0 592138055 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364536 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=248232 CPUtime=1.47 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 3746 1260 0 0 147 0 0 0 25 0 9 0 592138055 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4307452 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=248232 CPUtime=1.48 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 3343 1260 0 0 148 0 0 0 25 0 9 0 592138055 254189568 6899 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 11.9
Current children cumulated vsize (KiB) 248232

[startup+3.10064 s]
/proc/loadavg: 0.64 0.13 0.04 9/179 29580
/proc/meminfo: memFree=23692216/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=261804 CPUtime=24.69 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 53359 1260 0 0 2459 10 0 0 19 0 9 0 592138054 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 65451 10291 181 55 0 63337 0
[pid=29566/tid=29573] ppid=29564 vsize=261804 CPUtime=3.08 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 5782 1260 0 0 307 1 0 0 25 0 9 0 592138054 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364938 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=261804 CPUtime=3.08 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 6776 1260 0 0 307 1 0 0 25 0 9 0 592138054 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4307420 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=261804 CPUtime=3.06 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 6027 1260 0 0 305 1 0 0 25 0 9 0 592138054 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=261804 CPUtime=3.08 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 6212 1260 0 0 307 1 0 0 25 0 9 0 592138054 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=261804 CPUtime=3.09 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 7094 1260 0 0 308 1 0 0 25 0 9 0 592138054 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=261804 CPUtime=3.08 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 7087 1260 0 0 308 0 0 0 25 0 9 0 592138055 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4365003 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=261804 CPUtime=3.08 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 7920 1260 0 0 307 1 0 0 25 0 9 0 592138055 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4353424 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=261804 CPUtime=3.08 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 6022 1260 0 0 308 0 0 0 25 0 9 0 592138055 268087296 10291 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364990 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 24.69
Current children cumulated vsize (KiB) 261804

[startup+6.30106 s]
/proc/loadavg: 0.64 0.13 0.04 9/179 29580
/proc/meminfo: memFree=23678624/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=287904 CPUtime=50.28 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 105962 1260 0 0 5008 20 0 0 19 0 9 0 592138054 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 71976 16785 181 55 0 69862 0
[pid=29566/tid=29573] ppid=29564 vsize=287904 CPUtime=6.28 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 12843 1260 0 0 626 2 0 0 25 0 9 0 592138054 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=287904 CPUtime=6.27 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 14890 1260 0 0 625 2 0 0 25 0 9 0 592138054 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=287904 CPUtime=6.23 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 13949 1260 0 0 621 2 0 0 25 0 9 0 592138054 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=287904 CPUtime=6.28 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 10584 1260 0 0 626 2 0 0 25 0 9 0 592138054 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=287904 CPUtime=6.28 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 13587 1260 0 0 626 2 0 0 25 0 9 0 592138054 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=287904 CPUtime=6.28 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 15219 1260 0 0 626 2 0 0 25 0 9 0 592138055 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 260905451946 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=287904 CPUtime=6.28 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 13907 1260 0 0 626 2 0 0 25 0 9 0 592138055 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=287904 CPUtime=6.28 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 10544 1260 0 0 627 1 0 0 25 0 9 0 592138055 294813696 16785 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364590 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 50.28
Current children cumulated vsize (KiB) 287904

[startup+12.7009 s]
/proc/loadavg: 1.77 0.39 0.13 9/179 29580
/proc/meminfo: memFree=23645684/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=305616 CPUtime=101.43 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 184248 1260 0 0 10110 33 0 0 19 0 9 0 592138054 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 76404 21213 181 55 0 74290 0
[pid=29566/tid=29573] ppid=29564 vsize=305616 CPUtime=12.68 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 22497 1260 0 0 1264 4 0 0 25 0 9 0 592138054 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4366025 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=305616 CPUtime=12.68 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 29105 1260 0 0 1263 5 0 0 25 0 9 0 592138054 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=305616 CPUtime=12.6 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 21836 1260 0 0 1256 4 0 0 25 0 9 0 592138054 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4311334 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=305616 CPUtime=12.68 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 14273 1260 0 0 1265 3 0 0 25 0 9 0 592138054 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=305616 CPUtime=12.68 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 25680 1260 0 0 1264 4 0 0 25 0 9 0 592138054 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4366297 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=305616 CPUtime=12.68 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 25964 1260 0 0 1264 4 0 0 25 0 9 0 592138055 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4366558 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=305616 CPUtime=12.67 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 24058 1260 0 0 1264 3 0 0 25 0 9 0 592138055 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=305616 CPUtime=12.68 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 20396 1260 0 0 1266 2 0 0 25 0 9 0 592138055 312950784 21213 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 101.43
Current children cumulated vsize (KiB) 305616

[startup+25.5005 s]
/proc/loadavg: 2.73 0.64 0.21 9/179 29580
/proc/meminfo: memFree=23562036/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=400584 CPUtime=203.76 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 307635 1260 0 0 20321 55 0 0 19 0 9 0 592138054 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 100146 44955 181 55 0 98032 0
[pid=29566/tid=29573] ppid=29564 vsize=400584 CPUtime=25.48 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 39765 1260 0 0 2541 7 0 0 25 0 9 0 592138054 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364713 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=400584 CPUtime=25.47 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 53426 1260 0 0 2538 9 0 0 25 0 9 0 592138054 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364753 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=400584 CPUtime=25.32 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 41021 1260 0 0 2526 6 0 0 25 0 9 0 592138054 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=400584 CPUtime=25.49 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 23652 1260 0 0 2543 6 0 0 25 0 9 0 592138054 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 4199435 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=400584 CPUtime=25.48 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 36779 1260 0 0 2542 6 0 0 25 0 9 0 592138054 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 4366025 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=400584 CPUtime=25.48 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 36835 1260 0 0 2541 7 0 0 25 0 9 0 592138055 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=400584 CPUtime=25.48 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 39868 1260 0 0 2542 6 0 0 25 0 9 0 592138055 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364463 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=400584 CPUtime=25.48 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 35850 1260 0 0 2544 4 0 0 25 0 9 0 592138055 410198016 44955 33554432000 4194304 4417332 140734360736448 18446744073709551615 260905156496 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 203.76
Current children cumulated vsize (KiB) 400584

[startup+51.1009 s]
/proc/loadavg: 4.53 1.23 0.42 9/179 29581
/proc/meminfo: memFree=23450584/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=504740 CPUtime=408.43 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 504891 1260 0 0 40756 87 0 0 19 0 9 0 592138054 516853760 70993 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 126185 70993 181 55 0 124071 0
[pid=29566/tid=29573] ppid=29564 vsize=504740 CPUtime=51.09 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 65052 1260 0 0 5097 12 0 0 25 0 9 0 592138054 516853760 70993 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364473 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=504740 CPUtime=51.08 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 88901 1260 0 0 5094 14 0 0 25 0 9 0 592138054 516853760 70993 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364734 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=504740 CPUtime=50.79 cores=0-7

################
# More data... #
################

/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 90601 1260 0 0 22208 22 0 0 25 0 9 0 592138054 792756224 138353 33554432000 4194304 4417332 140734360736448 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=774176 CPUtime=222.3 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 180158 1260 0 0 22198 32 0 0 25 0 9 0 592138054 792756224 138353 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=774176 CPUtime=222.28 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 268497 1260 0 0 22189 39 0 0 25 0 9 0 592138055 792756224 138353 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=774176 CPUtime=222.29 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 268741 1260 0 0 22190 39 0 0 25 0 9 0 592138055 792756224 138353 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=774176 CPUtime=222.29 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 182523 1260 0 0 22199 30 0 0 25 0 9 0 592138055 792756224 138353 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1777.14
Current children cumulated vsize (KiB) 774176

[startup+282.301 s]
/proc/loadavg: 8.04 4.95 2.12 9/179 29587
/proc/meminfo: memFree=23080944/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=872576 CPUtime=2256.78 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1819088 1260 0 0 225376 302 0 0 19 0 9 0 592138054 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 218144 162953 181 55 0 216030 0
[pid=29566/tid=29573] ppid=29564 vsize=872576 CPUtime=282.29 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 197051 1260 0 0 28194 35 0 0 25 0 9 0 592138054 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=872576 CPUtime=282.25 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 387656 1260 0 0 28164 61 0 0 25 0 9 0 592138054 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364873 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=872576 CPUtime=280.74 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 214464 1260 0 0 28038 36 0 0 25 0 9 0 592138054 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=872576 CPUtime=282.29 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 103644 1260 0 0 28204 25 0 0 25 0 9 0 592138054 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364611 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=872576 CPUtime=282.29 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 184254 1260 0 0 28196 33 0 0 25 0 9 0 592138054 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=872576 CPUtime=282.28 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 274458 1260 0 0 28188 40 0 0 25 0 9 0 592138055 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=872576 CPUtime=282.28 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 274599 1260 0 0 28189 39 0 0 25 0 9 0 592138055 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=872576 CPUtime=282.29 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 182523 1260 0 0 28199 30 0 0 25 0 9 0 592138055 893517824 162953 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2256.78
Current children cumulated vsize (KiB) 872576

Solver just ended. Dumping a history of the last processes samples

[startup+294.401 s]
/proc/loadavg: 8.04 5.05 2.18 9/179 29587
/proc/meminfo: memFree=23129664/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=831408 CPUtime=2353.52 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1840311 1260 0 0 235047 305 0 0 19 0 9 0 592138054 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 207852 152661 181 55 0 205738 0
[pid=29566/tid=29573] ppid=29564 vsize=831408 CPUtime=294.39 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 197051 1260 0 0 29404 35 0 0 25 0 9 0 592138054 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=831408 CPUtime=294.35 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 400687 1260 0 0 29372 63 0 0 25 0 9 0 592138054 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=831408 CPUtime=292.77 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 222656 1260 0 0 29240 37 0 0 25 0 9 0 592138054 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=831408 CPUtime=294.39 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 103644 1260 0 0 29414 25 0 0 25 0 9 0 592138054 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364652 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=831408 CPUtime=294.39 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 184254 1260 0 0 29406 33 0 0 25 0 9 0 592138054 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=831408 CPUtime=294.38 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 274458 1260 0 0 29398 40 0 0 25 0 9 0 592138055 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=831408 CPUtime=294.38 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 274599 1260 0 0 29399 39 0 0 25 0 9 0 592138055 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364796 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=831408 CPUtime=294.39 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 182523 1260 0 0 29409 30 0 0 25 0 9 0 592138055 851361792 152661 33554432000 4194304 4417332 140734360736448 18446744073709551615 4343906 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2353.52
Current children cumulated vsize (KiB) 831408

[startup+300.801 s]
/proc/loadavg: 8.03 5.10 2.21 9/179 29588
/proc/meminfo: memFree=23121980/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=847792 CPUtime=2404.68 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1854647 1260 0 0 240161 307 0 0 19 0 9 0 592138054 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 211948 156757 181 55 0 209834 0
[pid=29566/tid=29573] ppid=29564 vsize=847792 CPUtime=300.79 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 197051 1260 0 0 30044 35 0 0 25 0 9 0 592138054 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29574] ppid=29564 vsize=847792 CPUtime=300.75 cores=0-7
/proc/29566/task/29574/stat : 29574 (plingeling) R 29564 29566 29499 0 -1 4202560 406831 1260 0 0 30011 64 0 0 25 0 9 0 592138054 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364720 0 0 4096 17442 0 0 0 -1 2 0 0 0
[pid=29566/tid=29575] ppid=29564 vsize=847792 CPUtime=299.13 cores=0-7
/proc/29566/task/29575/stat : 29575 (plingeling) R 29564 29566 29499 0 -1 4202560 226752 1260 0 0 29876 37 0 0 25 0 9 0 592138054 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=847792 CPUtime=300.79 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 103644 1260 0 0 30054 25 0 0 25 0 9 0 592138054 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29577] ppid=29564 vsize=847792 CPUtime=300.79 cores=0-7
/proc/29566/task/29577/stat : 29577 (plingeling) R 29564 29566 29499 0 -1 4202560 188350 1260 0 0 30045 34 0 0 25 0 9 0 592138054 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 0 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=847792 CPUtime=300.78 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 274458 1260 0 0 30038 40 0 0 25 0 9 0 592138055 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=847792 CPUtime=300.78 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 274599 1260 0 0 30039 39 0 0 25 0 9 0 592138055 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=847792 CPUtime=300.79 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 182523 1260 0 0 30049 30 0 0 25 0 9 0 592138055 868139008 156757 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2404.68
Current children cumulated vsize (KiB) 847792

[startup+304.001 s]
/proc/loadavg: 8.03 5.15 2.24 6/176 29588
/proc/meminfo: memFree=23115180/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=838936 CPUtime=2428.26 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1860434 1260 0 0 242517 309 0 0 19 0 6 0 592138054 859070464 154544 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 209734 154544 182 55 0 207620 0
[pid=29566/tid=29573] ppid=29564 vsize=838936 CPUtime=303.99 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 197051 1260 0 0 30364 35 0 0 25 0 6 0 592138054 859070464 154544 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=838936 CPUtime=303.99 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 103644 1260 0 0 30374 25 0 0 25 0 6 0 592138054 859070464 154544 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364973 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29578] ppid=29564 vsize=838936 CPUtime=303.97 cores=0-7
/proc/29566/task/29578/stat : 29578 (plingeling) R 29564 29566 29499 0 -1 4202560 274458 1260 0 0 30357 40 0 0 25 0 6 0 592138055 859070464 154544 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=838936 CPUtime=303.98 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 274599 1260 0 0 30359 39 0 0 25 0 6 0 592138055 859070464 154544 33554432000 4194304 4417332 140734360736448 18446744073709551615 4365960 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=838936 CPUtime=303.98 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 186619 1260 0 0 30367 31 0 0 25 0 6 0 592138055 859070464 154544 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364683 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2428.26
Current children cumulated vsize (KiB) 838936

[startup+307.201 s]
/proc/loadavg: 7.71 5.13 2.25 5/175 29588
/proc/meminfo: memFree=23130944/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=822552 CPUtime=2441.26 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1860434 1260 0 0 243817 309 0 0 19 0 5 0 592138054 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 205638 150448 182 55 0 203524 0
[pid=29566/tid=29573] ppid=29564 vsize=822552 CPUtime=307.19 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 197051 1260 0 0 30684 35 0 0 25 0 5 0 592138054 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364742 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29576] ppid=29564 vsize=822552 CPUtime=307.19 cores=0-7
/proc/29566/task/29576/stat : 29576 (plingeling) R 29564 29566 29499 0 -1 4202560 103644 1260 0 0 30694 25 0 0 25 0 5 0 592138054 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=29566/tid=29579] ppid=29564 vsize=822552 CPUtime=307.18 cores=0-7
/proc/29566/task/29579/stat : 29579 (plingeling) R 29564 29566 29499 0 -1 4202560 274599 1260 0 0 30679 39 0 0 25 0 5 0 592138055 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364811 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=822552 CPUtime=307.18 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 186619 1260 0 0 30687 31 0 0 25 0 5 0 592138055 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2441.26
Current children cumulated vsize (KiB) 822552

[startup+308.801 s]
/proc/loadavg: 7.71 5.13 2.25 5/175 29588
/proc/meminfo: memFree=23130944/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=822552 CPUtime=2446.21 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1860434 1260 0 0 244312 309 0 0 19 0 3 0 592138054 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 205638 150448 182 55 0 203524 0
[pid=29566/tid=29573] ppid=29564 vsize=822552 CPUtime=308.79 cores=0-7
/proc/29566/task/29573/stat : 29573 (plingeling) R 29564 29566 29499 0 -1 4202560 197051 1260 0 0 30844 35 0 0 25 0 3 0 592138054 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=29566/tid=29580] ppid=29564 vsize=822552 CPUtime=308.78 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 186619 1260 0 0 30847 31 0 0 25 0 3 0 592138055 842293248 150448 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2446.21
Current children cumulated vsize (KiB) 822552

[startup+309.601 s]
/proc/loadavg: 7.71 5.13 2.25 3/173 29588
/proc/meminfo: memFree=23130960/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=781576 CPUtime=2447.72 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1860434 1260 0 0 244463 309 0 0 18 0 2 0 592138054 800333824 150440 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 195394 150440 182 55 0 193280 0
[pid=29566/tid=29580] ppid=29564 vsize=781576 CPUtime=309.58 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 186619 1260 0 0 30927 31 0 0 25 0 2 0 592138055 800333824 150440 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2447.72
Current children cumulated vsize (KiB) 781576

[startup+309.801 s]
/proc/loadavg: 7.71 5.13 2.25 3/173 29588
/proc/meminfo: memFree=23130960/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=781576 CPUtime=2447.92 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1860434 1260 0 0 244483 309 0 0 18 0 2 0 592138054 800333824 150440 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 195394 150440 182 55 0 193280 0
[pid=29566/tid=29580] ppid=29564 vsize=781576 CPUtime=309.78 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 186619 1260 0 0 30947 31 0 0 25 0 2 0 592138055 800333824 150440 33554432000 4194304 4417332 140734360736448 18446744073709551615 4251008 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2447.92
Current children cumulated vsize (KiB) 781576

[startup+309.9 s]
/proc/loadavg: 7.71 5.13 2.25 3/173 29588
/proc/meminfo: memFree=23130960/32950928 swapFree=67071984/67111528
[pid=29566] ppid=29564 vsize=781576 CPUtime=2448.02 cores=0-7
/proc/29566/stat : 29566 (plingeling) S 29564 29566 29499 0 -1 4202496 1860434 1260 0 0 244493 309 0 0 18 0 2 0 592138054 800333824 150440 33554432000 4194304 4417332 140734360736448 18446744073709551615 260917196773 0 0 4096 17442 18446744073709551615 0 0 17 4 0 0 0
/proc/29566/statm: 195394 150440 182 55 0 193280 0
[pid=29566/tid=29580] ppid=29564 vsize=781576 CPUtime=309.88 cores=0-7
/proc/29566/task/29580/stat : 29580 (plingeling) R 29564 29566 29499 0 -1 4202560 186619 1260 0 0 30957 31 0 0 25 0 2 0 592138055 800333824 150440 33554432000 4194304 4417332 140734360736448 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 2448.02
Current children cumulated vsize (KiB) 781576

Child status: 20
Real time (s): 309.957
CPU time (s): 2448.08
CPU user time (s): 2444.96
CPU system time (s): 3.12552
CPU usage (%): 789.813
Max. virtual memory (cumulated for all children) (KiB): 888960

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2444.96
system time used= 3.12552
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1861697
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 350
involuntary context switches= 11431

runsolver used 0.471928 second user time and 1.21281 second system time

The end

Launcher Data 

Begin job on node116 at 2011-04-28 21:31:14
IDJOB=3310041
IDBENCH=87935
IDSOLVER=1695
FILE ID=node116/3310041-1304019074
RUNJOBID= node116-1304019070-29513
PBS_JOBID= 13170294
Free space on /tmp= 72516 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT02/industrial/aloul/Homer/homer14.shuffled.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3310041-1304019074/watcher-3310041-1304019074 -o /tmp/evaluation-result-3310041-1304019074/solver-3310041-1304019074 -C 40000 -W 5100 -M 31000  plingeling -t 8 HOME/instance-3310041-1304019074.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1d9569aa70fee033c68469753053c259
RANDOM SEED=1374974932

node116.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.826
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23730504 kB
Buffers:       1890492 kB
Cached:        6866544 kB
SwapCached:       9732 kB
Active:        4108592 kB
Inactive:      4687016 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23730504 kB
SwapTotal:    67111528 kB
SwapFree:     67071984 kB
Dirty:             268 kB
Writeback:           0 kB
AnonPages:       31936 kB
Mapped:          13244 kB
Slab:           358612 kB
PageTables:       4200 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   187180 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72516 MiB
End job on node116 at 2011-04-28 21:36:24