Trace number 3280283

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
Plingeling 587? (TO) 4800.27 1204.03

General information on the benchmark

Nameindustrial/anbulagan/
hard-unsat/total-10-17-u.cnf
MD5SUM9ce7c48a28ddd5790e38607bb893dd38
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables293864
Number of clauses1370917
Sum of the clauses size3163902
Maximum clause length10
Minimum clause length1
Number of clauses of size 124516
Number of clauses of size 21065117
Number of clauses of size 3226184
Number of clauses of size 46120
Number of clauses of size 524480
Number of clauses of size over 524500

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3280283-1304036666/watcher-3280283-1304036666 -o /tmp/evaluation-result-3280283-1304036666/solver-3280283-1304036666 -C 4800 -W 1300 -M 15500 plingeling -t 4 HOME/instance-3280283-1304036666.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.63 7.74 7.66 3/175 1768
/proc/meminfo: memFree=16776956/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=8724 CPUtime=0 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) R 1766 1768 1725 0 -1 4202496 232 1259 0 0 0 0 0 0 23 0 1 0 515266351 8933376 160 33554432000 4194304 4417332 140734852457792 18446744073709551615 4218880 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/1768/statm: 2181 165 135 55 0 67 0

[startup+0.0179421 s]
/proc/loadavg: 6.63 7.74 7.66 3/175 1768
/proc/meminfo: memFree=16776956/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=17816 CPUtime=0.01 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) R 1766 1768 1725 0 -1 4202496 2548 1259 0 0 1 0 0 0 23 0 1 0 515266351 18243584 2476 33554432000 4194304 4417332 140734852457792 18446744073709551615 4323180 0 0 4096 17442 0 0 0 17 1 0 0 0
/proc/1768/statm: 4454 2476 147 55 0 2340 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 17816

[startup+0.100917 s]
/proc/loadavg: 6.63 7.74 7.66 3/175 1768
/proc/meminfo: memFree=16776956/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=40716 CPUtime=0.09 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) R 1766 1768 1725 0 -1 4202496 8289 1259 0 0 8 1 0 0 23 0 1 0 515266351 41693184 8201 33554432000 4194304 4417332 140734852457792 18446744073709551615 4198200 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/1768/statm: 10179 8201 147 55 0 8065 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 40716

[startup+0.300884 s]
/proc/loadavg: 6.63 7.74 7.66 3/175 1768
/proc/meminfo: memFree=16776956/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=104720 CPUtime=0.29 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) R 1766 1768 1725 0 -1 4202496 24356 1259 0 0 26 3 0 0 24 0 1 0 515266351 107233280 24202 33554432000 4194304 4417332 140734852457792 18446744073709551615 210647146240 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/1768/statm: 26180 24202 147 55 0 24066 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 104720

[startup+0.700819 s]
/proc/loadavg: 6.63 7.74 7.66 3/175 1768
/proc/meminfo: memFree=16776956/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=195644 CPUtime=0.69 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) R 1766 1768 1725 0 -1 4202496 47335 1259 0 0 64 5 0 0 25 0 1 0 515266351 200339456 46933 33554432000 4194304 4417332 140734852457792 18446744073709551615 4231321 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/1768/statm: 48911 46933 147 55 0 46797 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 195644

[startup+1.50068 s]
/proc/loadavg: 6.63 7.74 7.66 3/176 1774
/proc/meminfo: memFree=16413908/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=302700 CPUtime=1.49 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) R 1766 1768 1725 0 -1 4202496 74068 1259 0 0 140 9 0 0 25 0 1 0 515266351 309964800 73666 33554432000 4194304 4417332 140734852457792 18446744073709551615 210647146240 0 0 4096 17442 0 0 0 17 5 0 0 0
/proc/1768/statm: 75675 73666 148 55 0 73561 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 302700

[startup+3.10037 s]
/proc/loadavg: 7.06 7.81 7.68 11/184 1782
/proc/meminfo: memFree=16304932/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=409976 CPUtime=7.2 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 102380 1259 0 0 707 13 0 0 25 0 5 0 515266351 419815424 62969 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 102494 62969 174 55 0 100380 0
[pid=1768/tid=1779] ppid=1766 vsize=409976 CPUtime=1.37 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 6917 1259 0 0 136 1 0 0 25 0 5 0 515266523 419815424 62969 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=409976 CPUtime=1.36 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 6851 1259 0 0 136 0 0 0 25 0 5 0 515266523 419815424 62969 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281683 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=409976 CPUtime=1.37 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 9013 1259 0 0 136 1 0 0 25 0 5 0 515266523 419815424 62969 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=409976 CPUtime=1.36 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 5519 1259 0 0 135 1 0 0 25 0 5 0 515266523 419815424 62969 33554432000 4194304 4417332 140734852457792 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 7.2
Current children cumulated vsize (KiB) 409976

[startup+6.30083 s]
/proc/loadavg: 7.06 7.81 7.68 11/184 1782
/proc/meminfo: memFree=16349696/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=391300 CPUtime=19.99 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 103805 1259 0 0 1984 15 0 0 25 0 5 0 515266351 400691200 57631 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 97825 57631 181 55 0 95711 0
[pid=1768/tid=1779] ppid=1766 vsize=391300 CPUtime=4.57 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 7058 1259 0 0 456 1 0 0 25 0 5 0 515266523 400691200 57631 33554432000 4194304 4417332 140734852457792 18446744073709551615 4253179 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=391300 CPUtime=4.57 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 6989 1259 0 0 456 1 0 0 25 0 5 0 515266523 400691200 57631 33554432000 4194304 4417332 140734852457792 18446744073709551615 4252919 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=391300 CPUtime=4.56 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 10156 1259 0 0 455 1 0 0 25 0 5 0 515266523 400691200 57631 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364565 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=391300 CPUtime=4.54 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 5522 1259 0 0 453 1 0 0 25 0 5 0 515266523 400691200 57631 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 19.99
Current children cumulated vsize (KiB) 391300

[startup+12.7008 s]
/proc/loadavg: 7.36 7.85 7.69 9/184 1782
/proc/meminfo: memFree=16478472/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=341336 CPUtime=41.51 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 103817 1259 0 0 4092 59 0 0 25 0 5 0 515266351 349528064 43376 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 85334 43376 181 55 0 83220 0
[pid=1768/tid=1779] ppid=1766 vsize=341336 CPUtime=10.88 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 7068 1259 0 0 1086 2 0 0 25 0 5 0 515266523 349528064 43376 33554432000 4194304 4417332 140734852457792 18446744073709551615 4275646 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=341336 CPUtime=8.91 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 6989 1259 0 0 864 27 0 0 25 0 5 0 515266523 349528064 43376 33554432000 4194304 4417332 140734852457792 18446744073709551615 4250936 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=341336 CPUtime=9.06 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 10156 1259 0 0 890 16 0 0 25 0 5 0 515266523 349528064 43376 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=341336 CPUtime=10.91 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 5524 1259 0 0 1088 3 0 0 25 0 5 0 515266523 349528064 43376 33554432000 4194304 4417332 140734852457792 18446744073709551615 4236910 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 41.51
Current children cumulated vsize (KiB) 341336

[startup+25.5006 s]
/proc/loadavg: 7.46 7.85 7.70 9/184 1782
/proc/meminfo: memFree=16571060/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=293292 CPUtime=92.33 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 104871 1259 0 0 9167 66 0 0 25 0 5 0 515266351 300331008 31365 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 73323 31365 181 55 0 71209 0
[pid=1768/tid=1779] ppid=1766 vsize=293292 CPUtime=23.56 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 8096 1259 0 0 2353 3 0 0 25 0 5 0 515266523 300331008 31365 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=293292 CPUtime=21.52 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 7001 1259 0 0 2119 33 0 0 25 0 5 0 515266523 300331008 31365 33554432000 4194304 4417332 140734852457792 18446744073709551615 4353461 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=293292 CPUtime=21.86 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 10170 1259 0 0 2170 16 0 0 25 0 5 0 515266523 300331008 31365 33554432000 4194304 4417332 140734852457792 18446744073709551615 18446744073699065939 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=293292 CPUtime=23.64 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 5524 1259 0 0 2361 3 0 0 25 0 5 0 515266523 300331008 31365 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364375 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 92.33
Current children cumulated vsize (KiB) 293292

[startup+51.1003 s]
/proc/loadavg: 7.64 7.86 7.70 9/184 1783
/proc/meminfo: memFree=16539568/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=305336 CPUtime=194.58 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 113670 1259 0 0 19390 68 0 0 25 0 5 0 515266351 312664064 34364 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 76334 34364 181 55 0 74220 0
[pid=1768/tid=1779] ppid=1766 vsize=305336 CPUtime=49.13 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 11872 1259 0 0 4910 3 0 0 25 0 5 0 515266523 312664064 34364 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=305336 CPUtime=47.11 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 9509 1259 0 0 4678 33 0 0 25 0 5 0 515266523 312664064 34364 33554432000 4194304 4417332 140734852457792 18446744073709551615 4366558 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=305336 CPUtime=47.45 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 12346 1259 0 0 4729 16 0 0 25 0 5 0 515266523 312664064 34364 33554432000 4194304 4417332 140734852457792 18446744073709551615 4308368 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=305336 CPUtime=49.12 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 5863 1259 0 0 4908 4 0 0 25 0 5 0 515266523 312664064 34364 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281863 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 194.58
Current children cumulated vsize (KiB) 305336

[startup+102.307 s]
/proc/loadavg: 7.97 7.91 7.73 9/184 1784
/proc/meminfo: memFree=16476892/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=341248 CPUtime=399.11 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 137054 1259 0 0 39839 72 0 0 25 0 5 0 515266351 349437952 43342 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 85312 43342 181 55 0 83198 0
[pid=1768/tid=1779] ppid=1766 vsize=341248 CPUtime=100.32 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 20292 1259 0 0 10028 4 0 0 25 0 5 0 515266523 349437952 43342 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=341248 CPUtime=98.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 17509 1259 0 0 9795 36 0 0 25 0 5 0 515266523 349437952 43342 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=341248 CPUtime=98.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 15791 1259 0 0 9849 17 0 0 25 0 5 0 515266523 349437952 43342 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=341248 CPUtime=100.06 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 9382 1259 0 0 10002 4 0 0 25 0 5 0 515266523 349437952 43342 33554432000 4194304 4417332 140734852457792 18446744073709551615 4264940 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 399.11
Current children cumulated vsize (KiB) 341248

[startup+162.301 s]
/proc/loadavg: 8.06 7.94 7.75 9/184 1786
/proc/meminfo: memFree=16398256/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=382556 CPUtime=638.76 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 161763 1259 0 0 63801 75 0 0 25 0 5 0 515266351 391737344 53669 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 95639 53669 181 55 0 93525 0
[pid=1768/tid=1779] ppid=1766 vsize=382556 CPUtime=160.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 27680 1259 0 0 16025 5 0 0 25 0 5 0 515266523 391737344 53669 33554432000 4194304 4417332 140734852457792 18446744073709551615 4366011 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=382556 CPUtime=158.3 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 25722 1259 0 0 15793 37 0 0 25 0 5 0 515266523 391737344 53669 33554432000 4194304 4417332 140734852457792 18446744073709551615 4354410 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=382556 CPUtime=158.65 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 22926 1259 0 0 15847 18 0 0 25 0 5 0 515266523 391737344 53669 33554432000 4194304 4417332 140734852457792 18446744073709551615 4366109 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=382556 CPUtime=159.75 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 11355 1259 0 0 15971 4 0 0 25 0 5 0 515266523 391737344 53669 33554432000 4194304 4417332 140734852457792 18446744073709551615 4353463 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 638.76
Current children cumulated vsize (KiB) 382556

[startup+222.301 s]
/proc/loadavg: 8.06 7.96 7.76 9/184 1788
/proc/meminfo: memFree=16359180/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=409896 CPUtime=878.44 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 181935 1259 0 0 87767 77 0 0 25 0 5 0 515266351 419733504 60504 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 102474 60504 181 55 0 100360 0
[pid=1768/tid=1779] ppid=1766 vsize=409896 CPUtime=220.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 34460 1259 0 0 22024 6 0 0 25 0 5 0 515266523 419733504 60504 33554432000 4194304 4417332 140734852457792 18446744073709551615 4277864 0 0 4096 17442 0 0 0 -1 5 0 0 0

################
# More data... #
################

[pid=1768/tid=1780] ppid=1766 vsize=507092 CPUtime=698.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 61410 1259 0 0 69790 41 0 0 25 0 5 0 515266523 519262208 84805 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364465 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=507092 CPUtime=698.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 50619 1259 0 0 69846 20 0 0 25 0 5 0 515266523 519262208 84805 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=507092 CPUtime=697 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 145925 1259 0 0 69677 23 0 0 25 0 5 0 515266523 519262208 84805 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2796.01
Current children cumulated vsize (KiB) 507092

[startup+762.307 s]
/proc/loadavg: 8.08 8.06 7.89 9/184 1802
/proc/meminfo: memFree=16157308/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=525192 CPUtime=3035.73 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 496632 1259 0 0 303455 118 0 0 25 0 5 0 515266351 537796608 89330 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 131298 89330 181 55 0 129184 0
[pid=1768/tid=1779] ppid=1766 vsize=525192 CPUtime=760.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 124878 1259 0 0 76014 16 0 0 25 0 5 0 515266523 537796608 89330 33554432000 4194304 4417332 140734852457792 18446744073709551615 4236649 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=525192 CPUtime=758.32 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 79707 1259 0 0 75788 44 0 0 25 0 5 0 515266523 537796608 89330 33554432000 4194304 4417332 140734852457792 18446744073709551615 4237011 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=525192 CPUtime=758.67 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 54715 1259 0 0 75846 21 0 0 25 0 5 0 515266523 537796608 89330 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364732 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=525192 CPUtime=756.7 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 163252 1259 0 0 75643 27 0 0 25 0 5 0 515266523 537796608 89330 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364289 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3035.73
Current children cumulated vsize (KiB) 525192

[startup+822.301 s]
/proc/loadavg: 8.12 8.08 7.91 9/184 1804
/proc/meminfo: memFree=16125420/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=559932 CPUtime=3275.4 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 546480 1259 0 0 327416 124 0 0 25 0 5 0 515266351 573370368 98045 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 139983 98045 181 55 0 137869 0
[pid=1768/tid=1779] ppid=1766 vsize=559932 CPUtime=820.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 139804 1259 0 0 82012 18 0 0 25 0 5 0 515266523 573370368 98045 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=559932 CPUtime=818.3 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 92233 1259 0 0 81785 45 0 0 25 0 5 0 515266523 573370368 98045 33554432000 4194304 4417332 140734852457792 18446744073709551615 4237221 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=559932 CPUtime=818.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 60862 1259 0 0 81845 21 0 0 25 0 5 0 515266523 573370368 98045 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=559932 CPUtime=816.38 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 179501 1259 0 0 81610 28 0 0 25 0 5 0 515266523 573370368 98045 33554432000 4194304 4417332 140734852457792 18446744073709551615 4237211 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3275.4
Current children cumulated vsize (KiB) 559932

[startup+882.301 s]
/proc/loadavg: 8.19 8.10 7.92 9/184 1805
/proc/meminfo: memFree=16137560/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=517752 CPUtime=3515.07 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 590793 1259 0 0 351377 130 0 0 25 0 5 0 515266351 530178048 87500 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 129438 87500 181 55 0 127324 0
[pid=1768/tid=1779] ppid=1766 vsize=517752 CPUtime=880.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 149926 1259 0 0 88010 20 0 0 25 0 5 0 515266523 530178048 87500 33554432000 4194304 4417332 140734852457792 18446744073709551615 4365021 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=517752 CPUtime=878.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 108525 1259 0 0 87783 48 0 0 25 0 5 0 515266523 530178048 87500 33554432000 4194304 4417332 140734852457792 18446744073709551615 4365963 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=517752 CPUtime=878.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 60862 1259 0 0 87845 21 0 0 25 0 5 0 515266523 530178048 87500 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364494 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=517752 CPUtime=876.06 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 197400 1259 0 0 87575 31 0 0 25 0 5 0 515266523 530178048 87500 33554432000 4194304 4417332 140734852457792 18446744073709551615 4366319 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3515.07
Current children cumulated vsize (KiB) 517752

[startup+942.301 s]
/proc/loadavg: 8.15 8.10 7.93 9/184 1807
/proc/meminfo: memFree=16125904/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=539652 CPUtime=3754.77 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 625983 1259 0 0 375342 135 0 0 25 0 5 0 515266351 552603648 92975 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 134913 92975 181 55 0 132799 0
[pid=1768/tid=1779] ppid=1766 vsize=539652 CPUtime=940.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 160053 1259 0 0 94009 21 0 0 25 0 5 0 515266523 552603648 92975 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=539652 CPUtime=938.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 117958 1259 0 0 93781 50 0 0 25 0 5 0 515266523 552603648 92975 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364722 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=539652 CPUtime=938.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 64961 1259 0 0 93845 21 0 0 25 0 5 0 515266523 552603648 92975 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=539652 CPUtime=935.75 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 208931 1259 0 0 93543 32 0 0 25 0 5 0 515266523 552603648 92975 33554432000 4194304 4417332 140734852457792 18446744073709551615 4236778 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3754.77
Current children cumulated vsize (KiB) 539652

[startup+1002.3 s]
/proc/loadavg: 8.11 8.09 7.93 9/184 1808
/proc/meminfo: memFree=16112624/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=539596 CPUtime=3994.46 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 677362 1259 0 0 399304 142 0 0 25 0 5 0 515266351 552546304 92961 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 134899 92961 181 55 0 132785 0
[pid=1768/tid=1779] ppid=1766 vsize=539596 CPUtime=1000.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 174086 1259 0 0 100007 23 0 0 25 0 5 0 515266523 552546304 92961 33554432000 4194304 4417332 140734852457792 18446744073709551615 4366558 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=539596 CPUtime=998.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 133766 1259 0 0 99780 51 0 0 25 0 5 0 515266523 552546304 92961 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364509 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=539596 CPUtime=998.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 67009 1259 0 0 99844 22 0 0 25 0 5 0 515266523 552546304 92961 33554432000 4194304 4417332 140734852457792 18446744073709551615 4250447 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=539596 CPUtime=995.44 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 228421 1259 0 0 99509 35 0 0 25 0 5 0 515266523 552546304 92961 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364470 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3994.46
Current children cumulated vsize (KiB) 539596

[startup+1062.3 s]
/proc/loadavg: 8.10 8.09 7.94 9/184 1810
/proc/meminfo: memFree=16123640/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=534272 CPUtime=4234.15 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 720302 1259 0 0 423267 148 0 0 25 0 5 0 515266351 547094528 91630 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 133568 91630 181 55 0 131454 0
[pid=1768/tid=1779] ppid=1766 vsize=534272 CPUtime=1060.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 184668 1259 0 0 106006 24 0 0 25 0 5 0 515266523 547094528 91630 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=534272 CPUtime=1058.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 148468 1259 0 0 105778 53 0 0 25 0 5 0 515266523 547094528 91630 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364448 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=534272 CPUtime=1058.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 71108 1259 0 0 105844 22 0 0 25 0 5 0 515266523 547094528 91630 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364556 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=534272 CPUtime=1055.13 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 241978 1259 0 0 105475 38 0 0 25 0 5 0 515266523 547094528 91630 33554432000 4194304 4417332 140734852457792 18446744073709551615 4236827 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4234.15
Current children cumulated vsize (KiB) 534272

[startup+1122.3 s]
/proc/loadavg: 8.07 8.08 7.94 9/184 1812
/proc/meminfo: memFree=16108624/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=508476 CPUtime=4473.83 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 755321 1259 0 0 447231 152 0 0 25 0 5 0 515266351 520679424 85181 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 127119 85181 181 55 0 125005 0
[pid=1768/tid=1779] ppid=1766 vsize=508476 CPUtime=1120.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 191061 1259 0 0 112005 25 0 0 25 0 5 0 515266523 520679424 85181 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=508476 CPUtime=1118.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 163208 1259 0 0 111776 55 0 0 25 0 5 0 515266523 520679424 85181 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364560 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=508476 CPUtime=1118.66 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 71117 1259 0 0 111844 22 0 0 25 0 5 0 515266523 520679424 85181 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364581 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=508476 CPUtime=1114.81 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 255855 1259 0 0 111442 39 0 0 25 0 5 0 515266523 520679424 85181 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4473.83
Current children cumulated vsize (KiB) 508476

[startup+1182.3 s]
/proc/loadavg: 8.03 8.07 7.94 9/184 1813
/proc/meminfo: memFree=16101672/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=554016 CPUtime=4713.52 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 802077 1259 0 0 471194 158 0 0 25 0 5 0 515266351 567312384 96566 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 138504 96566 181 55 0 136390 0
[pid=1768/tid=1779] ppid=1766 vsize=554016 CPUtime=1180.3 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 202159 1259 0 0 118004 26 0 0 25 0 5 0 515266523 567312384 96566 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364547 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=554016 CPUtime=1178.31 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 174094 1259 0 0 117775 56 0 0 25 0 5 0 515266523 567312384 96566 33554432000 4194304 4417332 140734852457792 18446744073709551615 4236986 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=554016 CPUtime=1178.67 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 79312 1259 0 0 117843 24 0 0 25 0 5 0 515266523 567312384 96566 33554432000 4194304 4417332 140734852457792 18446744073709551615 4281668 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=554016 CPUtime=1174.49 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 272432 1259 0 0 117408 41 0 0 25 0 5 0 515266523 567312384 96566 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4713.52
Current children cumulated vsize (KiB) 554016



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1204 s]
/proc/loadavg: 8.02 8.06 7.94 9/184 1814
/proc/meminfo: memFree=16097816/32951132 swapFree=67111524/67111528
[pid=1768] ppid=1766 vsize=544016 CPUtime=4800.21 cores=1,3,5,7
/proc/1768/stat : 1768 (plingeling) S 1766 1768 1725 0 -1 4202496 819320 1259 0 0 479861 160 0 0 25 0 5 0 515266351 557072384 94066 33554432000 4194304 4417332 140734852457792 18446744073709551615 210658949093 0 0 4096 17442 18446744073709551615 0 0 17 5 0 0 0
/proc/1768/statm: 136004 94066 181 55 0 133890 0
[pid=1768/tid=1779] ppid=1766 vsize=544016 CPUtime=1202 cores=1,3,5,7
/proc/1768/task/1779/stat : 1779 (plingeling) R 1766 1768 1725 0 -1 4202560 207355 1259 0 0 120173 27 0 0 25 0 5 0 515266523 557072384 94066 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364750 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1768/tid=1780] ppid=1766 vsize=544016 CPUtime=1200.02 cores=1,3,5,7
/proc/1768/task/1780/stat : 1780 (plingeling) R 1766 1768 1725 0 -1 4202560 180908 1259 0 0 119945 57 0 0 25 0 5 0 515266523 557072384 94066 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364642 0 0 4096 17442 0 0 0 -1 1 0 0 0
[pid=1768/tid=1781] ppid=1766 vsize=544016 CPUtime=1200.37 cores=1,3,5,7
/proc/1768/task/1781/stat : 1781 (plingeling) R 1766 1768 1725 0 -1 4202560 79312 1259 0 0 120013 24 0 0 25 0 5 0 515266523 557072384 94066 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364549 0 0 4096 17442 0 0 0 -1 3 0 0 0
[pid=1768/tid=1782] ppid=1766 vsize=544016 CPUtime=1196.07 cores=1,3,5,7
/proc/1768/task/1782/stat : 1782 (plingeling) R 1766 1768 1725 0 -1 4202560 277665 1259 0 0 119565 42 0 0 25 0 5 0 515266523 557072384 94066 33554432000 4194304 4417332 140734852457792 18446744073709551615 4364822 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 544016

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1204.03
CPU time (s): 4800.27
CPU user time (s): 4798.64
CPU system time (s): 1.62375
CPU usage (%): 398.684
Max. virtual memory (cumulated for all children) (KiB): 576052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4798.64
system time used= 1.62375
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 820579
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 200
involuntary context switches= 35363

runsolver used 1.77373 second user time and 4.43532 second system time

The end

Launcher Data 

Begin job on node129 at 2011-04-29 02:24:27
IDJOB=3280283
IDBENCH=20365
IDSOLVER=1605
FILE ID=node129/3280283-1304036666
RUNJOBID= node129-1304036666-1744
PBS_JOBID= 13170362
Free space on /tmp= 66328 MiB

SOLVER NAME= Plingeling 587
BENCH NAME= SAT07/industrial/anbulagan/hard-unsat/total-10-17-u.cnf
COMMAND LINE= plingeling -t NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3280283-1304036666/watcher-3280283-1304036666 -o /tmp/evaluation-result-3280283-1304036666/solver-3280283-1304036666 -C 4800 -W 1300 -M 15500  plingeling -t 4 HOME/instance-3280283-1304036666.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9ce7c48a28ddd5790e38607bb893dd38
RANDOM SEED=449549834

node129.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.831
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      16777244 kB
Buffers:       1276424 kB
Cached:       14146976 kB
SwapCached:          4 kB
Active:        3793424 kB
Inactive:     11711320 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      16777244 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           44432 kB
Writeback:           4 kB
AnonPages:       80944 kB
Mapped:          14980 kB
Slab:           604476 kB
PageTables:       4936 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS:   221308 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66328 MiB
End job on node129 at 2011-04-29 02:44:33