Trace number 3385972

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.39 1205.24

General information on the benchmark

NameSAT03/handmade/anton/UNSAT/
SGI_30_70_20_70_1-dir.shuffled-as.sat03-146.cnf
MD5SUM7ef2b563e57ba91e22d23e55abe69485
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of clauses46988
Sum of the clauses size94536
Maximum clause length30
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 246968
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 520

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3385972-1305582246/watcher-3385972-1305582246 -o /tmp/evaluation-result-3385972-1305582246/solver-3385972-1305582246 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3385972-1305582246.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 6.95 2.64 2.55 5/493 31633
/proc/meminfo: memFree=19431708/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=52936 CPUtime=0.01 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 1295 0 0 0 1 0 0 0 25 0 4 0 650640847 54206464 982 33554432000 4194304 4625164 140735207057392 18446744073709551615 46968004310956 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 13234 982 301 106 0 8737 0
[pid=31633/tid=31634] ppid=31631 vsize=52936 CPUtime=0 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650640848 54206464 982 33554432000 4194304 4625164 140735207057392 18446744073709551615 212039711729 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=52936 CPUtime=0 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 650640848 54206464 982 33554432000 4194304 4625164 140735207057392 18446744073709551615 212039711729 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=52936 CPUtime=0 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 650640848 54206464 982 33554432000 4194304 4625164 140735207057392 18446744073709551615 46968004310962 0 0 4096 2 0 0 0 -1 1 0 0 0

[startup+0.633211 s]
/proc/loadavg: 6.95 2.64 2.55 5/493 31633
/proc/meminfo: memFree=19431708/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=257972 CPUtime=3.3 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 10975 0 0 0 329 1 0 0 25 0 4 0 650640847 264163328 8050 33554432000 4194304 4625164 140735207057392 18446744073709551615 4512007 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 64493 8050 352 106 0 59996 0
[pid=31633/tid=31634] ppid=31631 vsize=257972 CPUtime=0.81 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2150 0 0 0 81 0 0 0 25 0 4 0 650640848 264163328 8050 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=257972 CPUtime=0.81 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2425 0 0 0 81 0 0 0 19 0 4 0 650640848 264163328 8050 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=257972 CPUtime=0.82 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 1813 0 0 0 82 0 0 0 19 0 4 0 650640848 264163328 8050 33554432000 4194304 4625164 140735207057392 18446744073709551615 4547280 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.3
Current children cumulated vsize (KiB) 257972

[startup+0.941948 s]
/proc/loadavg: 6.95 2.64 2.55 5/493 31633
/proc/meminfo: memFree=19431708/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=257972 CPUtime=3.7 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 11194 0 0 0 369 1 0 0 25 0 4 0 650640847 264163328 8262 33554432000 4194304 4625164 140735207057392 18446744073709551615 4512312 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 64493 8263 345 106 0 59996 0
[pid=31633/tid=31634] ppid=31631 vsize=257972 CPUtime=0.91 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2192 0 0 0 91 0 0 0 25 0 4 0 650640848 264163328 8263 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=257972 CPUtime=0.91 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2577 0 0 0 91 0 0 0 19 0 4 0 650640848 264163328 8263 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352609 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=257972 CPUtime=0.92 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 1839 0 0 0 92 0 0 0 19 0 4 0 650640848 264163328 8263 33554432000 4194304 4625164 140735207057392 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3.7
Current children cumulated vsize (KiB) 257972

[startup+1.04193 s]
/proc/loadavg: 6.95 2.64 2.55 5/493 31633
/proc/meminfo: memFree=19431708/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=257972 CPUtime=4.1 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 11552 0 0 0 408 2 0 0 25 0 4 0 650640847 264163328 8620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4512326 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 64493 8620 345 106 0 59996 0
[pid=31633/tid=31634] ppid=31631 vsize=257972 CPUtime=1.01 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2350 0 0 0 101 0 0 0 25 0 4 0 650640848 264163328 8620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=257972 CPUtime=1.01 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2713 0 0 0 101 0 0 0 19 0 4 0 650640848 264163328 8620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352296 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=257972 CPUtime=1.02 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 1896 0 0 0 102 0 0 0 19 0 4 0 650640848 264163328 8620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4552354 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.1
Current children cumulated vsize (KiB) 257972

[startup+1.14191 s]
/proc/loadavg: 6.95 2.64 2.55 5/493 31633
/proc/meminfo: memFree=19431708/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=257972 CPUtime=4.5 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 12053 0 0 0 448 2 0 0 25 0 4 0 650640847 264163328 9043 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 64493 9043 345 106 0 59996 0
[pid=31633/tid=31634] ppid=31631 vsize=257972 CPUtime=1.11 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2519 0 0 0 111 0 0 0 25 0 4 0 650640848 264163328 9043 33554432000 4194304 4625164 140735207057392 18446744073709551615 212039316513 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=257972 CPUtime=1.11 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2949 0 0 0 111 0 0 0 19 0 4 0 650640848 264163328 9043 33554432000 4194304 4625164 140735207057392 18446744073709551615 4317920 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=257972 CPUtime=1.12 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 1989 0 0 0 112 0 0 0 19 0 4 0 650640848 264163328 9043 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352010 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4.5
Current children cumulated vsize (KiB) 257972

[startup+1.50085 s]
/proc/loadavg: 6.95 2.64 2.55 5/493 31633
/proc/meminfo: memFree=19431708/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=264104 CPUtime=5.94 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 15643 0 0 0 591 3 0 0 25 0 4 0 650640847 270442496 11099 33554432000 4194304 4625164 140735207057392 18446744073709551615 4393003 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 66026 11099 353 106 0 61529 0
[pid=31633/tid=31634] ppid=31631 vsize=264104 CPUtime=1.47 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 3268 0 0 0 147 0 0 0 25 0 4 0 650640848 270442496 11099 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352170 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=264104 CPUtime=1.47 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 4233 0 0 0 147 0 0 0 20 0 4 0 650640848 270442496 11099 33554432000 4194304 4625164 140735207057392 18446744073709551615 4317923 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=264104 CPUtime=1.48 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2588 0 0 0 148 0 0 0 20 0 4 0 650640848 270442496 11099 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351792 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 264104

[startup+3.10057 s]
/proc/loadavg: 6.95 2.64 2.55 9/497 31637
/proc/meminfo: memFree=19350220/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=276104 CPUtime=12.3 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 27119 0 0 0 1225 5 0 0 25 0 4 0 650640847 282730496 16362 33554432000 4194304 4625164 140735207057392 18446744073709551615 4360561 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 69026 16362 346 106 0 64529 0
[pid=31633/tid=31634] ppid=31631 vsize=276104 CPUtime=3.07 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 5655 0 0 0 306 1 0 0 25 0 4 0 650640848 282730496 16362 33554432000 4194304 4625164 140735207057392 18446744073709551615 4465746 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=276104 CPUtime=3.04 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 6388 0 0 0 303 1 0 0 25 0 4 0 650640848 282730496 16362 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=276104 CPUtime=3.07 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 7249 0 0 0 306 1 0 0 25 0 4 0 650640848 282730496 16362 33554432000 4194304 4625164 140735207057392 18446744073709551615 4288686 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.3
Current children cumulated vsize (KiB) 276104

[startup+6.31899 s]
/proc/loadavg: 7.11 2.74 2.59 9/497 31637
/proc/meminfo: memFree=19317980/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=292012 CPUtime=25.12 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 50659 0 0 0 2502 10 0 0 25 0 4 0 650640847 299020288 24083 33554432000 4194304 4625164 140735207057392 18446744073709551615 4329208 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 73003 24083 346 106 0 68506 0
[pid=31633/tid=31634] ppid=31631 vsize=292012 CPUtime=6.29 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 10865 0 0 0 627 2 0 0 25 0 4 0 650640848 299020288 24083 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=292012 CPUtime=6.2 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 10414 0 0 0 619 1 0 0 25 0 4 0 650640848 299020288 24083 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=292012 CPUtime=6.29 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 21068 0 0 0 625 4 0 0 25 0 4 0 650640848 299020288 24083 33554432000 4194304 4625164 140735207057392 18446744073709551615 4326648 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 292012

[startup+12.7009 s]
/proc/loadavg: 7.18 2.83 2.62 9/497 31638
/proc/meminfo: memFree=19263892/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=316788 CPUtime=50.55 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 105280 0 0 0 5034 21 0 0 25 0 4 0 650640847 324390912 36051 33554432000 4194304 4625164 140735207057392 18446744073709551615 4512869 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 79197 36051 347 106 0 74700 0
[pid=31633/tid=31634] ppid=31631 vsize=316788 CPUtime=12.67 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 16515 0 0 0 1262 5 0 0 25 0 4 0 650640848 324390912 36051 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=316788 CPUtime=12.49 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 16497 0 0 0 1246 3 0 0 23 0 4 0 650640848 324390912 36051 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=316788 CPUtime=12.68 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 59409 0 0 0 1258 10 0 0 25 0 4 0 650640848 324390912 36051 33554432000 4194304 4625164 140735207057392 18446744073709551615 4334466 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 50.55
Current children cumulated vsize (KiB) 316788

[startup+25.5006 s]
/proc/loadavg: 7.36 3.08 2.70 9/497 31638
/proc/meminfo: memFree=19154660/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=380688 CPUtime=101.54 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 214891 0 0 0 10113 41 0 0 25 0 4 0 650640847 389824512 57739 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511747 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 95172 57739 352 106 0 90675 0
[pid=31633/tid=31634] ppid=31631 vsize=380688 CPUtime=25.47 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 31805 0 0 0 2539 8 0 0 25 0 4 0 650640848 389824512 57739 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=380688 CPUtime=25.07 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 26157 0 0 0 2499 8 0 0 25 0 4 0 650640848 389824512 57739 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352032 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=380688 CPUtime=25.48 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 122486 0 0 0 2530 18 0 0 25 0 4 0 650640848 389824512 57739 33554432000 4194304 4625164 140735207057392 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 101.54
Current children cumulated vsize (KiB) 380688

[startup+51.101 s]
/proc/loadavg: 7.65 3.49 2.85 9/497 31639
/proc/meminfo: memFree=18930084/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=733600 CPUtime=203.53 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 354954 0 0 0 20283 70 0 0 25 0 4 0 650640847 751206400 106557 33554432000 4194304 4625164 140735207057392 18446744073709551615 4393127 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 183400 106557 421 106 0 178903 0
[pid=31633/tid=31634] ppid=31631 vsize=733600 CPUtime=51.07 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 49280 0 0 0 5092 15 0 0 25 0 4 0 650640848 751206400 106557 33554432000 4194304 4625164 140735207057392 18446744073709551615 4464333 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=733600 CPUtime=50.26 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 39870 0 0 0 5011 15 0 0 25 0 4 0 650640848 751206400 106557 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=733600 CPUtime=51.08 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 158928 0 0 0 5085 23 0 0 25 0 4 0 650640848 751206400 106557 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 203.53
Current children cumulated vsize (KiB) 733600

[startup+102.301 s]
/proc/loadavg: 7.92 4.20 3.12 9/497 31640
/proc/meminfo: memFree=18623152/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=914748 CPUtime=407.47 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 638351 0 0 0 40632 115 0 0 25 0 4 0 650640847 936701952 161643 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511933 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 228687 161643 750 106 0 224190 0
[pid=31633/tid=31634] ppid=31631 vsize=914748 CPUtime=102.27 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 69335 0 0 0 10207 20 0 0 25 0 4 0 650640848 936701952 161643 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=914748 CPUtime=100.61 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 53502 0 0 0 10042 19 0 0 25 0 4 0 650640848 936701952 161643 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=914748 CPUtime=102.27 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 335898 0 0 0 10178 49 0 0 25 0 4 0 650640848 936701952 161643 33554432000 4194304 4625164 140735207057392 18446744073709551615 4552388 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 407.47
Current children cumulated vsize (KiB) 914748

[startup+162.301 s]

################
# More data... #
################


[startup+702.301 s]
/proc/loadavg: 8.08 7.61 5.50 9/497 31656
/proc/meminfo: memFree=14519624/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=5225028 CPUtime=2797.52 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 5230196 0 0 0 278896 856 0 0 25 0 4 0 650640847 5350428672 1069955 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1306257 1069955 356 106 0 1301760 0
[pid=31633/tid=31634] ppid=31631 vsize=5225028 CPUtime=702.19 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 165237 0 0 0 70163 56 0 0 25 0 4 0 650640848 5350428672 1069955 33554432000 4194304 4625164 140735207057392 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=5225028 CPUtime=690.78 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 172119 0 0 0 68990 88 0 0 25 0 4 0 650640848 5350428672 1069955 33554432000 4194304 4625164 140735207057392 18446744073709551615 4339569 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=5225028 CPUtime=702.23 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 2551072 0 0 0 69839 384 0 0 25 0 4 0 650640848 5350428672 1069955 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 2797.52
Current children cumulated vsize (KiB) 5225028

[startup+762.301 s]
/proc/loadavg: 8.19 7.73 5.67 9/497 31658
/proc/meminfo: memFree=14421248/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=5225028 CPUtime=3036.53 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 5694311 0 0 0 302723 930 0 0 25 0 4 0 650640847 5350428672 1082620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1306257 1082620 362 106 0 1301760 0
[pid=31633/tid=31634] ppid=31631 vsize=5225028 CPUtime=762.19 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 165298 0 0 0 76163 56 0 0 25 0 4 0 650640848 5350428672 1082620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=5225028 CPUtime=749.79 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 176186 0 0 0 74885 94 0 0 25 0 4 0 650640848 5350428672 1082620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=5225028 CPUtime=762.23 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 3003254 0 0 0 75772 451 0 0 25 0 4 0 650640848 5350428672 1082620 33554432000 4194304 4625164 140735207057392 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3036.53
Current children cumulated vsize (KiB) 5225028

[startup+822.3 s]
/proc/loadavg: 8.19 7.83 5.83 9/497 31659
/proc/meminfo: memFree=14247984/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=5404104 CPUtime=3275.57 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 6212007 0 0 0 326543 1014 0 0 25 0 4 0 650640847 5533802496 1121041 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1351026 1121041 346 106 0 1346529 0
[pid=31633/tid=31634] ppid=31631 vsize=5404104 CPUtime=822.19 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 171765 0 0 0 82162 57 0 0 25 0 4 0 650640848 5533802496 1121041 33554432000 4194304 4625164 140735207057392 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=5404104 CPUtime=808.81 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 178669 0 0 0 80783 98 0 0 25 0 4 0 650640848 5533802496 1121041 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=5404104 CPUtime=822.23 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 3478861 0 0 0 81701 522 0 0 25 0 4 0 650640848 5533802496 1121041 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3275.57
Current children cumulated vsize (KiB) 5404104

[startup+882.301 s]
/proc/loadavg: 8.15 7.88 5.97 9/497 31661
/proc/meminfo: memFree=14170188/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=5418076 CPUtime=3514.58 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 6622207 0 0 0 350382 1076 0 0 25 0 4 0 650640847 5548109824 1132284 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1354519 1132284 346 106 0 1350022 0
[pid=31633/tid=31634] ppid=31631 vsize=5418076 CPUtime=882.19 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 171803 0 0 0 88162 57 0 0 25 0 4 0 650640848 5548109824 1132284 33554432000 4194304 4625164 140735207057392 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=5418076 CPUtime=867.83 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 180102 0 0 0 86684 99 0 0 25 0 4 0 650640848 5548109824 1132284 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=5418076 CPUtime=882.24 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 3878341 0 0 0 87641 583 0 0 25 0 4 0 650640848 5548109824 1132284 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3514.58
Current children cumulated vsize (KiB) 5418076

[startup+942.301 s]
/proc/loadavg: 8.21 7.95 6.11 9/497 31662
/proc/meminfo: memFree=13964448/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=5423756 CPUtime=3753.67 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 6803955 0 0 0 374255 1112 0 0 25 0 4 0 650640847 5553926144 1179635 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1355939 1179635 360 106 0 1351442 0
[pid=31633/tid=31634] ppid=31631 vsize=5423756 CPUtime=942.21 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 172408 0 0 0 94164 57 0 0 25 0 4 0 650640848 5553926144 1179635 33554432000 4194304 4625164 140735207057392 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=5423756 CPUtime=926.86 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 186522 0 0 0 92579 107 0 0 25 0 4 0 650640848 5553926144 1179635 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=5423756 CPUtime=942.26 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 4010202 0 0 0 93623 603 0 0 25 0 4 0 650640848 5553926144 1179635 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3753.67
Current children cumulated vsize (KiB) 5423756

[startup+1002.3 s]
/proc/loadavg: 8.19 7.99 6.24 9/497 31664
/proc/meminfo: memFree=13290472/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=6779808 CPUtime=3992.61 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 7987528 0 0 0 397988 1273 0 0 25 0 4 0 650640847 6942523392 1336603 33554432000 4194304 4625164 140735207057392 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1694952 1336603 351 106 0 1690455 0
[pid=31633/tid=31634] ppid=31631 vsize=6779808 CPUtime=1002.19 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 173106 0 0 0 100162 57 0 0 25 0 4 0 650640848 6942523392 1336603 33554432000 4194304 4625164 140735207057392 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=6779808 CPUtime=985.87 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 189413 0 0 0 98476 111 0 0 25 0 4 0 650640848 6942523392 1336603 33554432000 4194304 4625164 140735207057392 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=6779808 CPUtime=1002.22 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 4456780 0 0 0 99551 671 0 0 25 0 4 0 650640848 6942523392 1336603 33554432000 4194304 4625164 140735207057392 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 3992.61
Current children cumulated vsize (KiB) 6779808

[startup+1062.32 s]
/proc/loadavg: 8.17 8.02 6.36 9/497 31675
/proc/meminfo: memFree=13210956/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=6779808 CPUtime=4231.69 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 8509226 0 0 0 421817 1352 0 0 25 0 4 0 650640847 6942523392 1349966 33554432000 4194304 4625164 140735207057392 18446744073709551615 4519334 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1694952 1349966 379 106 0 1690455 0
[pid=31633/tid=31634] ppid=31631 vsize=6779808 CPUtime=1062.21 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 173363 0 0 0 106164 57 0 0 25 0 4 0 650640848 6942523392 1349966 33554432000 4194304 4625164 140735207057392 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=6779808 CPUtime=1044.9 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 193071 0 0 0 104374 116 0 0 25 0 4 0 650640848 6942523392 1349966 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=6779808 CPUtime=1062.24 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 4967746 0 0 0 105480 744 0 0 25 0 4 0 650640848 6942523392 1349966 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4231.69
Current children cumulated vsize (KiB) 6779808

[startup+1122.3 s]
/proc/loadavg: 8.10 8.03 6.46 10/497 31707
/proc/meminfo: memFree=13792020/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=7366620 CPUtime=4470.64 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 9291908 0 0 0 445588 1476 0 0 25 0 4 0 650640847 7543418880 1467131 33554432000 4194304 4625164 140735207057392 18446744073709551615 212039316513 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1841655 1467133 353 106 0 1837158 0
[pid=31633/tid=31634] ppid=31631 vsize=7366620 CPUtime=1122.2 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 174116 0 0 0 112162 58 0 0 25 0 4 0 650640848 7543418880 1467134 33554432000 4194304 4625164 140735207057392 18446744073709551615 4469395 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=7366620 CPUtime=1103.9 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 194231 0 0 0 110274 116 0 0 25 0 4 0 650640848 7543418880 1467135 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=7366620 CPUtime=1122.22 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 5492894 0 0 0 111398 824 0 0 25 0 4 0 650640848 7543418880 1467135 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4470.64
Current children cumulated vsize (KiB) 7366620

[startup+1182.3 s]
/proc/loadavg: 8.10 8.05 6.57 9/497 31709
/proc/meminfo: memFree=13361564/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=7540872 CPUtime=4709.65 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 9847659 0 0 0 469403 1562 0 0 25 0 4 0 650640847 7721852928 1527256 33554432000 4194304 4625164 140735207057392 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1885218 1527256 355 106 0 1880721 0
[pid=31633/tid=31634] ppid=31631 vsize=7540872 CPUtime=1182.19 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 225613 0 0 0 118156 63 0 0 25 0 4 0 650640848 7721852928 1527256 33554432000 4194304 4625164 140735207057392 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=7540872 CPUtime=1162.92 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 196644 0 0 0 116174 118 0 0 25 0 4 0 650640848 7721852928 1527256 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=7540872 CPUtime=1182.22 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 5921088 0 0 0 117332 890 0 0 25 0 4 0 650640848 7721852928 1527256 33554432000 4194304 4625164 140735207057392 18446744073709551615 4334485 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4709.65
Current children cumulated vsize (KiB) 7540872



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1205 s]
/proc/loadavg: 8.13 8.06 6.61 9/497 31709
/proc/meminfo: memFree=13304252/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=7550244 CPUtime=4800.14 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) R 31631 31633 31559 0 -1 4202496 10010000 0 0 0 478426 1588 0 0 25 0 4 0 650640847 7731449856 1533787 33554432000 4194304 4625164 140735207057392 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 1887561 1533787 356 106 0 1883064 0
[pid=31633/tid=31634] ppid=31631 vsize=7550244 CPUtime=1204.91 cores=1,3,5,7
/proc/31633/task/31634/stat : 31634 (SArTagnan) R 31631 31633 31559 0 -1 4202560 225631 0 0 0 120428 63 0 0 25 0 4 0 650640848 7731449856 1533787 33554432000 4194304 4625164 140735207057392 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=7550244 CPUtime=1185.26 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4202560 198989 0 0 0 118406 120 0 0 25 0 4 0 650640848 7731449856 1533787 33554432000 4194304 4625164 140735207057392 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=31633/tid=31636] ppid=31631 vsize=7550244 CPUtime=1204.94 cores=1,3,5,7
/proc/31633/task/31636/stat : 31636 (SArTagnan) R 31631 31633 31559 0 -1 4202560 6067437 0 0 0 119582 912 0 0 25 0 4 0 650640848 7731449856 1533787 33554432000 4194304 4625164 140735207057392 18446744073709551615 4339564 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 4800.14
Current children cumulated vsize (KiB) 7550244

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1205.2 s]
/proc/loadavg: 8.13 8.06 6.61 6/496 31710
/proc/meminfo: memFree=18480392/32951124 swapFree=51873468/67111528
[pid=31633] ppid=31631 vsize=0 CPUtime=4800.36 cores=1,3,5,7
/proc/31633/stat : 31633 (SArTagnan) Z 31631 31633 31559 0 -1 4203548 10010000 0 0 0 478428 1608 0 0 25 0 2 0 650640847 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 3 0 0 0
/proc/31633/statm: 0 0 0 0 0 0 0
[pid=31633/tid=31635] ppid=31631 vsize=0 CPUtime=1185.46 cores=1,3,5,7
/proc/31633/task/31635/stat : 31635 (SArTagnan) R 31631 31633 31559 0 -1 4203588 198989 0 0 0 118407 139 0 0 25 0 2 0 650640848 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1205.24
CPU time (s): 4800.39
CPU user time (s): 4784.29
CPU system time (s): 16.1056
CPU usage (%): 398.293
Max. virtual memory (cumulated for all children) (KiB): 8954796

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4784.29
system time used= 16.1056
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10010000
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5861
involuntary context switches= 18106

runsolver used 5.2702 second user time and 14.4868 second system time

The end

Launcher Data 

Begin job on node146 at 2011-05-16 23:44:06
IDJOB=3385972
IDBENCH=83952
IDSOLVER=1871
FILE ID=node146/3385972-1305582246
RUNJOBID= node146-1305582130-31578
PBS_JOBID= 13350290
Free space on /tmp= 73204 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT03/handmade/anton/UNSAT/SGI_30_70_20_70_1-dir.shuffled-as.sat03-146.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3385972-1305582246/watcher-3385972-1305582246 -o /tmp/evaluation-result-3385972-1305582246/solver-3385972-1305582246 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3385972-1305582246.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7ef2b563e57ba91e22d23e55abe69485
RANDOM SEED=1666624095

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19431988 kB
Buffers:        221476 kB
Cached:        1420272 kB
SwapCached:      56140 kB
Active:       10402248 kB
Inactive:      2841624 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19431988 kB
SwapTotal:    67111528 kB
SwapFree:     51873468 kB
Dirty:             800 kB
Writeback:           0 kB
AnonPages:    11553492 kB
Mapped:          26436 kB
Slab:           114900 kB
PageTables:      92084 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 140156840 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73204 MiB
End job on node146 at 2011-05-17 00:04:13