Trace number 3322748

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
claspmt 2.0-R4095UNSAT 7575.47 1603.92

General information on the benchmark

NameSAT-Race-2010-CNF/hardware-verification/
velev/1dlx_c_iq57_a.cnf
MD5SUM953b9cb99bfd26cff0e1ac65be1241f6
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark552.98
Satisfiable
(Un)Satisfiability was proved
Number of variables569795
Number of clauses8562505
Sum of the clauses size24843745
Maximum clause length186
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 27567948
Number of clauses of size 3724416
Number of clauses of size 49898
Number of clauses of size 560873
Number of clauses of size over 5199369

Solver Data 

0.00/0.00	c clasp version 2.0.0-RC2
0.00/0.00	c Reading from ...393503/instance-3322748-1304393503.cnf
2.89/2.91	c Solving...
7575.34/1603.89	s UNSATISFIABLE
7575.34/1603.89	
7575.34/1603.89	c Models        : 0     
7575.34/1603.89	c Time          : 1602.873s (Solving: 1599.96s 1st Model: 0.00s Unsat: 1599.96s)
7575.34/1603.89	c CPU Time      : 7574.420s

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3322748-1304393503/watcher-3322748-1304393503 -o /tmp/evaluation-result-3322748-1304393503/solver-3322748-1304393503 -C 40000 -W 5100 -M 31000 HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322748-1304393503.cnf 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.44 8.93 8.96 3/349 29222
/proc/meminfo: memFree=24988324/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=93224 CPUtime=0 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 2679 0 0 0 0 0 0 0 22 0 1 0 531766617 95461376 2609 33554432000 4194304 4964704 140735253367024 18446744073709551615 4700332 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29222/statm: 23306 2615 376 189 0 18180 0

[startup+0.112699 s]
/proc/loadavg: 8.44 8.93 8.96 3/349 29222
/proc/meminfo: memFree=24988324/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=134928 CPUtime=0.1 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 32917 0 0 0 7 3 0 0 22 0 1 0 531766617 138166272 28396 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095111877 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29222/statm: 33732 28396 388 189 0 28606 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 134928

[startup+0.200683 s]
/proc/loadavg: 8.44 8.93 8.96 3/349 29222
/proc/meminfo: memFree=24988324/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=140936 CPUtime=0.19 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 34452 0 0 0 15 4 0 0 22 0 1 0 531766617 144318464 29898 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095111877 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29222/statm: 35234 29898 388 189 0 30108 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 140936

[startup+0.300653 s]
/proc/loadavg: 8.44 8.93 8.96 3/349 29222
/proc/meminfo: memFree=24988324/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=147152 CPUtime=0.29 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 36071 0 0 0 25 4 0 0 23 0 1 0 531766617 150683648 31467 33554432000 4194304 4964704 140735253367024 18446744073709551615 4646074 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29222/statm: 36788 31468 388 189 0 31662 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 147152

[startup+0.700579 s]
/proc/loadavg: 8.44 8.93 8.96 3/349 29222
/proc/meminfo: memFree=24988324/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=169564 CPUtime=0.69 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 41860 0 0 0 63 6 0 0 25 0 1 0 531766617 173633536 37069 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095450880 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29222/statm: 42391 37069 388 189 0 37265 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 169564

[startup+1.75039 s]
/proc/loadavg: 8.44 8.93 8.96 3/349 29222
/proc/meminfo: memFree=24988324/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=224040 CPUtime=1.73 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 55839 0 0 0 163 10 0 0 25 0 1 0 531766617 229416960 50630 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095450880 0 0 4096 18946 0 0 0 17 4 0 0 0
/proc/29222/statm: 56010 50630 388 189 0 50884 0
Current children cumulated CPU time (s) 1.73
Current children cumulated vsize (KiB) 224040

[startup+3.1001 s]
/proc/loadavg: 8.01 8.83 8.93 3/357 29230
/proc/meminfo: memFree=24394452/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1035072 CPUtime=3.56 cores=0-7
/proc/29222/stat : 29222 (claspmt) S 29220 29222 28725 0 -1 4202496 198475 0 0 0 301 55 0 0 18 0 8 0 531766617 1059913728 150462 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 258768 150465 431 189 0 253117 0
[pid=29222/tid=29224] ppid=29220 vsize=1035072 CPUtime=0.09 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) R 29220 29222 28725 0 -1 4202560 16081 0 0 0 4 5 0 0 17 0 8 0 531766908 1059913728 150481 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095109686 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1035072 CPUtime=0.07 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) S 29220 29222 28725 0 -1 4202560 16998 0 0 0 3 4 0 0 17 0 8 0 531766908 1059913728 150486 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095556078 0 0 4096 18946 18446604440827498688 0 0 -1 5 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1035072 CPUtime=0.09 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) R 29220 29222 28725 0 -1 4202560 17419 0 0 0 3 6 0 0 17 0 8 0 531766908 1059913728 150490 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095494327 0 0 4096 18946 799707328 0 0 -1 0 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1035072 CPUtime=0.07 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) S 29220 29222 28725 0 -1 4202560 15334 0 0 0 2 5 0 0 17 0 8 0 531766908 1059913728 150491 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095556078 0 0 4096 18946 18446604440827498688 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1035072 CPUtime=0.07 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) D 29220 29222 28725 0 -1 4202560 15139 0 0 0 3 4 0 0 17 0 8 0 531766908 1059913728 150501 33554432000 4194304 4964704 140735253367024 18446744073709551615 4685494 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1035072 CPUtime=0.09 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) D 29220 29222 28725 0 -1 4202560 17240 0 0 0 4 5 0 0 17 0 8 0 531766908 1059913728 150504 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095494327 0 0 4096 18946 0 0 0 -1 5 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1035072 CPUtime=0.09 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 18123 0 0 0 3 6 0 0 17 0 8 0 531766908 1059913728 150508 33554432000 4194304 4964704 140735253367024 18446744073709551615 4697673 0 0 4096 18946 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.56
Current children cumulated vsize (KiB) 1035072

[startup+6.30055 s]
/proc/loadavg: 7.53 8.72 8.89 3/357 29230
/proc/meminfo: memFree=24098832/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1148068 CPUtime=8.23 cores=0-7
/proc/29222/stat : 29222 (claspmt) S 29220 29222 28725 0 -1 4202496 270951 0 0 0 718 105 0 0 18 0 8 0 531766617 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 287017 222674 436 189 0 281366 0
[pid=29222/tid=29224] ppid=29220 vsize=1148068 CPUtime=0.17 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) S 29220 29222 28725 0 -1 4202560 22549 0 0 0 7 10 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1148068 CPUtime=0.42 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) S 29220 29222 28725 0 -1 4202560 27884 0 0 0 31 11 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 7 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1148068 CPUtime=0.44 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) S 29220 29222 28725 0 -1 4202560 27999 0 0 0 31 13 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 0 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1148068 CPUtime=0.16 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) S 29220 29222 28725 0 -1 4202560 22548 0 0 0 5 11 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1148068 CPUtime=3 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 30992 0 0 0 288 12 0 0 22 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668904 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1148068 CPUtime=0.41 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) S 29220 29222 28725 0 -1 4202560 28170 0 0 0 32 9 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 5 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1148068 CPUtime=0.64 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) S 29220 29222 28725 0 -1 4202560 28631 0 0 0 44 20 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 8.23
Current children cumulated vsize (KiB) 1148068

[startup+12.7004 s]
/proc/loadavg: 7.08 8.61 8.86 3/357 29230
/proc/meminfo: memFree=24098212/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1148068 CPUtime=14.63 cores=0-7
/proc/29222/stat : 29222 (claspmt) S 29220 29222 28725 0 -1 4202496 270951 0 0 0 1358 105 0 0 18 0 8 0 531766617 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 287017 222674 436 189 0 281366 0
[pid=29222/tid=29224] ppid=29220 vsize=1148068 CPUtime=0.17 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) S 29220 29222 28725 0 -1 4202560 22549 0 0 0 7 10 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1148068 CPUtime=0.42 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) S 29220 29222 28725 0 -1 4202560 27884 0 0 0 31 11 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 7 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1148068 CPUtime=0.44 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) S 29220 29222 28725 0 -1 4202560 27999 0 0 0 31 13 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 0 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1148068 CPUtime=0.16 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) S 29220 29222 28725 0 -1 4202560 22548 0 0 0 5 11 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1148068 CPUtime=9.4 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 30992 0 0 0 928 12 0 0 25 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1148068 CPUtime=0.41 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) S 29220 29222 28725 0 -1 4202560 28170 0 0 0 32 9 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 5 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1148068 CPUtime=0.64 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) S 29220 29222 28725 0 -1 4202560 28631 0 0 0 44 20 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 14.63
Current children cumulated vsize (KiB) 1148068

[startup+25.501 s]
/proc/loadavg: 5.96 8.28 8.74 3/357 29230
/proc/meminfo: memFree=24099456/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1148068 CPUtime=27.43 cores=0-7
/proc/29222/stat : 29222 (claspmt) S 29220 29222 28725 0 -1 4202496 270951 0 0 0 2638 105 0 0 18 0 8 0 531766617 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 287017 222674 436 189 0 281366 0
[pid=29222/tid=29224] ppid=29220 vsize=1148068 CPUtime=0.17 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) S 29220 29222 28725 0 -1 4202560 22549 0 0 0 7 10 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1148068 CPUtime=0.42 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) S 29220 29222 28725 0 -1 4202560 27884 0 0 0 31 11 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 7 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1148068 CPUtime=0.44 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) S 29220 29222 28725 0 -1 4202560 27999 0 0 0 31 13 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 0 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1148068 CPUtime=0.16 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) S 29220 29222 28725 0 -1 4202560 22548 0 0 0 5 11 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1148068 CPUtime=22.21 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 30992 0 0 0 2209 12 0 0 25 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668693 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1148068 CPUtime=0.41 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) S 29220 29222 28725 0 -1 4202560 28170 0 0 0 32 9 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 5 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1148068 CPUtime=0.64 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) S 29220 29222 28725 0 -1 4202560 28631 0 0 0 44 20 0 0 17 0 8 0 531766908 1175621632 222674 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 27.43
Current children cumulated vsize (KiB) 1148068

[startup+51.1003 s]
/proc/loadavg: 4.67 7.79 8.57 3/357 29231
/proc/meminfo: memFree=24099052/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1148068 CPUtime=53.03 cores=0-7
/proc/29222/stat : 29222 (claspmt) S 29220 29222 28725 0 -1 4202496 271029 0 0 0 5198 105 0 0 18 0 8 0 531766617 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 287017 222752 436 189 0 281366 0
[pid=29222/tid=29224] ppid=29220 vsize=1148068 CPUtime=0.17 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) S 29220 29222 28725 0 -1 4202560 22549 0 0 0 7 10 0 0 17 0 8 0 531766908 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1148068 CPUtime=0.42 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) S 29220 29222 28725 0 -1 4202560 27884 0 0 0 31 11 0 0 17 0 8 0 531766908 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 7 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1148068 CPUtime=0.44 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) S 29220 29222 28725 0 -1 4202560 27999 0 0 0 31 13 0 0 17 0 8 0 531766908 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 0 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1148068 CPUtime=0.16 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) S 29220 29222 28725 0 -1 4202560 22548 0 0 0 5 11 0 0 17 0 8 0 531766908 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1148068 CPUtime=47.81 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 31070 0 0 0 4769 12 0 0 25 0 8 0 531766908 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1148068 CPUtime=0.41 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) S 29220 29222 28725 0 -1 4202560 28170 0 0 0 32 9 0 0 17 0 8 0 531766908 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 5 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1148068 CPUtime=0.64 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) S 29220 29222 28725 0 -1 4202560 28631 0 0 0 44 20 0 0 17 0 8 0 531766908 1175621632 222752 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 53.03
Current children cumulated vsize (KiB) 1148068

[startup+102.301 s]
/proc/loadavg: 3.16 6.90 8.22 3/357 29232
/proc/meminfo: memFree=24094548/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1148068 CPUtime=104.23 cores=0-7
/proc/29222/stat : 29222 (claspmt) S 29220 29222 28725 0 -1 4202496 272091 0 0 0 10317 106 0 0 18 0 8 0 531766617 1175621632 223814 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 287017 223814 436 189 0 281366 0
[pid=29222/tid=29224] ppid=29220 vsize=1148068 CPUtime=0.17 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) S 29220 29222 28725 0 -1 4202560 22549 0 0 0 7 10 0 0 17 0 8 0 531766908 1175621632 223814 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 4 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1148068 CPUtime=0.42 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) S 29220 29222 28725 0 -1 4202560 27884 0 0 0 31 11 0 0 17 0 8 0 531766908 1175621632 223814 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 7 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1148068 CPUtime=0.44 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) S 29220 29222 28725 0 -1 4202560 27999 0 0 0 31 13 0 0 17 0 8 0 531766908 1175621632 223814 33554432000 4194304 4964704 140735253367024 18446744073709551615 228107266969 0 0 4096 18946 18446604440827498688 0 0 -1 0 0 0 0

################
# More data... #
################

/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 39394 0 0 0 62648 37 0 0 25 0 8 0 531766908 1828225024 370642 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670219 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5474.79
Current children cumulated vsize (KiB) 1785376

[startup+1362.3 s]
/proc/loadavg: 9.07 8.57 7.51 10/357 29266
/proc/meminfo: memFree=23466496/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1860152 CPUtime=5893.86 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 429243 0 0 0 589081 305 0 0 25 0 8 0 531766617 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670219 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 465038 380966 460 189 0 459387 0
[pid=29222/tid=29224] ppid=29220 vsize=1860152 CPUtime=702.7 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) R 29220 29222 28725 0 -1 4202560 28541 0 0 0 70250 20 0 0 25 0 8 0 531766908 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1860152 CPUtime=572.94 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) R 29220 29222 28725 0 -1 4202560 100092 0 0 0 57200 94 0 0 25 0 8 0 531766908 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1860152 CPUtime=619.51 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) R 29220 29222 28725 0 -1 4202560 44058 0 0 0 61927 24 0 0 25 0 8 0 531766908 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668512 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1860152 CPUtime=644.02 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) R 29220 29222 28725 0 -1 4202560 35054 0 0 0 64371 31 0 0 25 0 8 0 531766908 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669429 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1860152 CPUtime=1352.97 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 36503 0 0 0 135279 18 0 0 25 0 8 0 531766908 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669051 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1860152 CPUtime=567.26 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) R 29220 29222 28725 0 -1 4202560 56602 0 0 0 56671 55 0 0 25 0 8 0 531766908 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1860152 CPUtime=686.83 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 39452 0 0 0 68646 37 0 0 25 0 8 0 531766908 1904795648 380966 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 5893.86
Current children cumulated vsize (KiB) 1860152

[startup+1422.3 s]
/proc/loadavg: 9.08 8.66 7.61 10/357 29267
/proc/meminfo: memFree=23410668/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1871156 CPUtime=6312.82 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 443238 0 0 0 630956 326 0 0 25 0 8 0 531766617 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670100 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 467789 394961 460 189 0 462138 0
[pid=29222/tid=29224] ppid=29220 vsize=1871156 CPUtime=762.7 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) R 29220 29222 28725 0 -1 4202560 28541 0 0 0 76250 20 0 0 25 0 8 0 531766908 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1871156 CPUtime=618.62 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) R 29220 29222 28725 0 -1 4202560 108154 0 0 0 61754 108 0 0 25 0 8 0 531766908 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1871156 CPUtime=676.28 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) R 29220 29222 28725 0 -1 4202560 46705 0 0 0 67602 26 0 0 25 0 8 0 531766908 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1871156 CPUtime=688.6 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) R 29220 29222 28725 0 -1 4202560 35381 0 0 0 68828 32 0 0 25 0 8 0 531766908 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4652108 0 0 4096 18946 0 0 0 -1 4 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1871156 CPUtime=1412.97 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 36503 0 0 0 141279 18 0 0 25 0 8 0 531766908 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1871156 CPUtime=599.27 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) R 29220 29222 28725 0 -1 4202560 59073 0 0 0 59868 59 0 0 25 0 8 0 531766908 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668635 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1871156 CPUtime=746.75 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 39940 0 0 0 74638 37 0 0 25 0 8 0 531766908 1916063744 394961 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670100 0 0 4096 18946 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6312.82
Current children cumulated vsize (KiB) 1871156

[startup+1482.3 s]
/proc/loadavg: 9.03 8.72 7.69 10/357 29269
/proc/meminfo: memFree=23346420/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1885864 CPUtime=6732.01 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 459460 0 0 0 672855 346 0 0 25 0 8 0 531766617 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669051 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 471466 411183 460 189 0 465815 0
[pid=29222/tid=29224] ppid=29220 vsize=1885864 CPUtime=817.55 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) R 29220 29222 28725 0 -1 4202560 28541 0 0 0 81735 20 0 0 25 0 8 0 531766908 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4370259 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1885864 CPUtime=664.56 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) R 29220 29222 28725 0 -1 4202560 116296 0 0 0 66338 118 0 0 25 0 8 0 531766908 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670228 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1885864 CPUtime=728.72 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) R 29220 29222 28725 0 -1 4202560 50394 0 0 0 72844 28 0 0 25 0 8 0 531766908 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670248 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1885864 CPUtime=736.39 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) R 29220 29222 28725 0 -1 4202560 36054 0 0 0 73605 34 0 0 25 0 8 0 531766908 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669929 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1885864 CPUtime=1472.97 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 36503 0 0 0 147279 18 0 0 25 0 8 0 531766908 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668632 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1885864 CPUtime=646.47 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) R 29220 29222 28725 0 -1 4202560 61586 0 0 0 64584 63 0 0 25 0 8 0 531766908 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4627204 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1885864 CPUtime=806.75 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 41144 0 0 0 80636 39 0 0 25 0 8 0 531766908 1931124736 411183 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670020 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6732.01
Current children cumulated vsize (KiB) 1885864

[startup+1542.3 s]
/proc/loadavg: 9.01 8.77 7.77 10/357 29271
/proc/meminfo: memFree=23287752/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1970184 CPUtime=7151.31 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 473838 0 0 0 714767 364 0 0 25 0 8 0 531766617 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4670228 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 492546 425561 460 189 0 486895 0
[pid=29222/tid=29224] ppid=29220 vsize=1970184 CPUtime=877.54 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) R 29220 29222 28725 0 -1 4202560 29010 0 0 0 87733 21 0 0 25 0 8 0 531766908 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4370264 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1970184 CPUtime=705.05 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) R 29220 29222 28725 0 -1 4202560 122465 0 0 0 70380 125 0 0 25 0 8 0 531766908 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1970184 CPUtime=777.15 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) R 29220 29222 28725 0 -1 4202560 55108 0 0 0 77683 32 0 0 25 0 8 0 531766908 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668488 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1970184 CPUtime=782.08 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) R 29220 29222 28725 0 -1 4202560 36673 0 0 0 78173 35 0 0 25 0 8 0 531766908 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4652110 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1970184 CPUtime=1532.97 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 36503 0 0 0 153279 18 0 0 25 0 8 0 531766908 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1970184 CPUtime=691.16 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) R 29220 29222 28725 0 -1 4202560 63954 0 0 0 69048 68 0 0 25 0 8 0 531766908 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668618 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1970184 CPUtime=866.75 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 41144 0 0 0 86636 39 0 0 25 0 8 0 531766908 2017468416 425561 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669051 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7151.31
Current children cumulated vsize (KiB) 1970184

[startup+1602.3 s]
/proc/loadavg: 9.00 8.81 7.84 10/357 29272
/proc/meminfo: memFree=23253716/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1992416 CPUtime=7570.65 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 482376 0 0 0 756691 374 0 0 25 0 8 0 531766617 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4370066 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 498104 434099 460 189 0 492453 0
[pid=29222/tid=29224] ppid=29220 vsize=1992416 CPUtime=937.55 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) R 29220 29222 28725 0 -1 4202560 29010 0 0 0 93734 21 0 0 25 0 8 0 531766908 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1992416 CPUtime=735.1 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) R 29220 29222 28725 0 -1 4202560 123769 0 0 0 73383 127 0 0 25 0 8 0 531766908 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4313835 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1992416 CPUtime=836.49 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) R 29220 29222 28725 0 -1 4202560 60742 0 0 0 83613 36 0 0 25 0 8 0 531766908 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1992416 CPUtime=812.02 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) R 29220 29222 28725 0 -1 4202560 36982 0 0 0 81167 35 0 0 25 0 8 0 531766908 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669270 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1992416 CPUtime=1592.97 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 36503 0 0 0 159279 18 0 0 25 0 8 0 531766908 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4669051 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1992416 CPUtime=751.16 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) R 29220 29222 28725 0 -1 4202560 64592 0 0 0 75047 69 0 0 25 0 8 0 531766908 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668931 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1992416 CPUtime=926.73 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 41797 0 0 0 92633 40 0 0 25 0 8 0 531766908 2040233984 434099 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7570.65
Current children cumulated vsize (KiB) 1992416

Solver just ended. Dumping a history of the last processes samples

[startup+1602.5 s]
/proc/loadavg: 9.00 8.81 7.84 10/357 29272
/proc/meminfo: memFree=23253592/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1992416 CPUtime=7572.13 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 482378 0 0 0 756839 374 0 0 25 0 8 0 531766617 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4652130 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 498104 434101 460 189 0 492453 0
[pid=29222/tid=29224] ppid=29220 vsize=1992416 CPUtime=937.76 cores=0-7
/proc/29222/task/29224/stat : 29224 (claspmt) R 29220 29222 28725 0 -1 4202560 29010 0 0 0 93755 21 0 0 25 0 8 0 531766908 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4364621 0 0 4096 18946 0 0 0 -1 1 0 0 0
[pid=29222/tid=29225] ppid=29220 vsize=1992416 CPUtime=735.2 cores=0-7
/proc/29222/task/29225/stat : 29225 (claspmt) R 29220 29222 28725 0 -1 4202560 123769 0 0 0 73393 127 0 0 25 0 8 0 531766908 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4313751 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29222/tid=29226] ppid=29220 vsize=1992416 CPUtime=836.69 cores=0-7
/proc/29222/task/29226/stat : 29226 (claspmt) R 29220 29222 28725 0 -1 4202560 60744 0 0 0 83633 36 0 0 25 0 8 0 531766908 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4320955 0 0 4096 18946 0 0 0 -1 7 0 0 0
[pid=29222/tid=29227] ppid=29220 vsize=1992416 CPUtime=812.13 cores=0-7
/proc/29222/task/29227/stat : 29227 (claspmt) R 29220 29222 28725 0 -1 4202560 36982 0 0 0 81178 35 0 0 25 0 8 0 531766908 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4342208 0 0 4096 18946 0 0 0 -1 2 0 0 0
[pid=29222/tid=29228] ppid=29220 vsize=1992416 CPUtime=1593.19 cores=0-7
/proc/29222/task/29228/stat : 29228 (claspmt) R 29220 29222 28725 0 -1 4202560 36503 0 0 0 159301 18 0 0 25 0 8 0 531766908 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4677956 0 0 4096 18946 0 0 0 -1 6 0 0 0
[pid=29222/tid=29229] ppid=29220 vsize=1992416 CPUtime=751.37 cores=0-7
/proc/29222/task/29229/stat : 29229 (claspmt) R 29220 29222 28725 0 -1 4202560 64592 0 0 0 75068 69 0 0 25 0 8 0 531766908 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4629954 0 0 4096 18946 0 0 0 -1 0 0 0 0
[pid=29222/tid=29230] ppid=29220 vsize=1992416 CPUtime=926.95 cores=0-7
/proc/29222/task/29230/stat : 29230 (claspmt) R 29220 29222 28725 0 -1 4202560 41797 0 0 0 92655 40 0 0 25 0 8 0 531766908 2040233984 434101 33554432000 4194304 4964704 140735253367024 18446744073709551615 4668654 0 0 4096 18946 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 7572.13
Current children cumulated vsize (KiB) 1992416

[startup+1603.3 s]
/proc/loadavg: 9.00 8.81 7.84 10/357 29272
/proc/meminfo: memFree=23253592/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1867204 CPUtime=7574.84 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 482391 0 0 0 757109 375 0 0 25 0 1 0 531766617 1912016896 400157 33554432000 4194304 4964704 140735253367024 18446744073709551615 47658505425472 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/29222/statm: 466801 400157 470 189 0 461150 0
Current children cumulated CPU time (s) 7574.84
Current children cumulated vsize (KiB) 1867204

[startup+1603.71 s]
/proc/loadavg: 9.00 8.81 7.84 3/350 29272
/proc/meminfo: memFree=23495076/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=1760356 CPUtime=7575.25 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202496 482391 0 0 0 757149 376 0 0 25 0 1 0 531766617 1802604544 360491 33554432000 4194304 4964704 140735253367024 18446744073709551615 228095099855 0 0 4096 18946 0 0 0 17 5 0 0 0
/proc/29222/statm: 440089 360491 470 189 0 434438 0
Current children cumulated CPU time (s) 7575.25
Current children cumulated vsize (KiB) 1760356

[startup+1603.9 s]
/proc/loadavg: 9.00 8.81 7.84 3/350 29272
/proc/meminfo: memFree=23495076/32951124 swapFree=67091720/67111528
[pid=29222] ppid=29220 vsize=0 CPUtime=7575.44 cores=0-7
/proc/29222/stat : 29222 (claspmt) R 29220 29222 28725 0 -1 4202500 482392 0 0 0 757163 381 0 0 25 0 1 0 531766617 0 0 33554432000 0 0 0 0 0 0 0 4096 18946 18446744073709551615 0 0 17 5 0 0 0
/proc/29222/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 7575.44
Current children cumulated vsize (KiB) 0

Child status: 20
Real time (s): 1603.92
CPU time (s): 7575.47
CPU user time (s): 7571.64
CPU system time (s): 3.83442
CPU usage (%): 472.309
Max. virtual memory (cumulated for all children) (KiB): 1992416

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 7571.64
system time used= 3.83442
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 482392
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 98488
involuntary context switches= 44260

runsolver used 4.6073 second user time and 12.6441 second system time

The end

Launcher Data 

Begin job on node142 at 2011-05-03 05:31:51
IDJOB=3322748
IDBENCH=88159
IDSOLVER=1711
FILE ID=node142/3322748-1304393503
RUNJOBID= node142-1304390297-28739
PBS_JOBID= 13181831
Free space on /tmp= 73288 MiB

SOLVER NAME= claspmt 2.0-R4095
BENCH NAME= SAT-Race-2010-CNF/hardware-verification/velev/1dlx_c_iq57_a.cnf
COMMAND LINE= HOME/claspmt -tNBCORE -p HOME/sat11-port.txt --distribute=all,2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3322748-1304393503/watcher-3322748-1304393503 -o /tmp/evaluation-result-3322748-1304393503/solver-3322748-1304393503 -C 40000 -W 5100 -M 31000  HOME/claspmt -t8 -p HOME/sat11-port.txt --distribute=all,2 HOME/instance-3322748-1304393503.cnf

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 953b9cb99bfd26cff0e1ac65be1241f6
RANDOM SEED=426084951

node142.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5131.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      24988852 kB
Buffers:        364540 kB
Cached:        1873108 kB
SwapCached:       3844 kB
Active:        4670720 kB
Inactive:      2883700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      24988852 kB
SwapTotal:    67111528 kB
SwapFree:     67091720 kB
Dirty:          194216 kB
Writeback:           0 kB
AnonPages:     5313860 kB
Mapped:          28328 kB
Slab:           313452 kB
PageTables:      31568 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 77192776 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73288 MiB
End job on node142 at 2011-05-03 05:58:35