Trace number 3386087

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 4800.44 1228.1

General information on the benchmark

NameSAT05/crafted/sabharwal05/counting/php/unsat/
easier/php-045-035.shuffled-as.sat05-1181.cnf
MD5SUM057b78ff24cc0773c9c67e770a7b9de2
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark44.4072
Satisfiable
(Un)Satisfiability was proved
Number of variables1575
Number of clauses34695
Sum of the clauses size70875
Maximum clause length35
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 234650
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 545

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3386087-1305583052/watcher-3386087-1305583052 -o /tmp/evaluation-result-3386087-1305583052/solver-3386087-1305583052 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3386087-1305583052.cnf -threads=4 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.14 9.06 8.43 7/502 23732
/proc/meminfo: memFree=23147628/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=52136 CPUtime=0.01 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 1091 0 0 0 1 0 0 0 25 0 4 0 669906107 53387264 888 33554432000 4194304 4625164 140735862712112 18446744073709551615 47895740581804 0 0 4096 2 18446744073709551615 0 0 17 1 0 0 0
/proc/23732/statm: 13034 888 301 106 0 8537 0
[pid=23732/tid=23733] ppid=23730 vsize=52136 CPUtime=0 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669906108 53387264 888 33554432000 4194304 4625164 140735862712112 18446744073709551615 270613167089 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=52136 CPUtime=0 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 0 0 0 0 0 0 0 0 25 0 4 0 669906108 53387264 888 33554432000 4194304 4625164 140735862712112 18446744073709551615 270613167089 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=52136 CPUtime=0 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 4 0 669906108 53387264 888 33554432000 4194304 4625164 140735862712112 18446744073709551615 47895740581814 0 0 4096 2 0 0 0 -1 5 0 0 0

[startup+0.130364 s]
/proc/loadavg: 9.14 9.06 8.43 7/502 23732
/proc/meminfo: memFree=23147628/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=252604 CPUtime=0.34 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 4124 0 0 0 34 0 0 0 25 0 4 0 669906107 258666496 3917 33554432000 4194304 4625164 140735862712112 18446744073709551615 270612807888 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/23732/statm: 63151 3917 339 106 0 58654 0
[pid=23732/tid=23733] ppid=23730 vsize=252604 CPUtime=0.1 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 919 0 0 0 10 0 0 0 25 0 4 0 669906108 258666496 3917 33554432000 4194304 4625164 140735862712112 18446744073709551615 4352014 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=252604 CPUtime=0.1 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) D 23730 23732 22974 0 -1 4202560 1813 0 0 0 10 0 0 0 18 0 4 0 669906108 258666496 3917 33554432000 4194304 4625164 140735862712112 18446744073709551615 270613153975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=252604 CPUtime=0.11 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 271 0 0 0 11 0 0 0 25 0 4 0 669906108 258666496 3917 33554432000 4194304 4625164 140735862712112 18446744073709551615 47895740582438 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.34
Current children cumulated vsize (KiB) 252604

[startup+0.204396 s]
/proc/loadavg: 9.14 9.06 8.43 7/502 23732
/proc/meminfo: memFree=23147628/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=255088 CPUtime=0.56 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 5677 0 0 0 56 0 0 0 25 0 4 0 669906107 261210112 5381 33554432000 4194304 4625164 140735862712112 18446744073709551615 4360320 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 63772 5381 339 106 0 59275 0
[pid=23732/tid=23733] ppid=23730 vsize=255088 CPUtime=0.17 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 1423 0 0 0 17 0 0 0 18 0 4 0 669906108 261210112 5381 33554432000 4194304 4625164 140735862712112 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=255088 CPUtime=0.17 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 2746 0 0 0 17 0 0 0 18 0 4 0 669906108 261210112 5381 33554432000 4194304 4625164 140735862712112 18446744073709551615 270612771873 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=255088 CPUtime=0.18 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 384 0 0 0 18 0 0 0 25 0 4 0 669906108 261210112 5381 33554432000 4194304 4625164 140735862712112 18446744073709551615 270613153975 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.56
Current children cumulated vsize (KiB) 255088

[startup+0.300777 s]
/proc/loadavg: 9.14 9.06 8.43 7/502 23732
/proc/meminfo: memFree=23147628/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=263988 CPUtime=0.85 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 13603 0 0 0 83 2 0 0 25 0 4 0 669906107 270323712 9507 33554432000 4194304 4625164 140735862712112 18446744073709551615 4360168 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 65997 9507 345 106 0 61500 0
[pid=23732/tid=23733] ppid=23730 vsize=263988 CPUtime=0.26 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 1870 0 0 0 26 0 0 0 18 0 4 0 669906108 270323712 9507 33554432000 4194304 4625164 140735862712112 18446744073709551615 4352002 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=263988 CPUtime=0.26 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 4140 0 0 0 26 0 0 0 18 0 4 0 669906108 270323712 9507 33554432000 4194304 4625164 140735862712112 18446744073709551615 270612771873 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=263988 CPUtime=0.18 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 387 0 0 0 18 0 0 0 25 0 4 0 669906108 270323712 9507 33554432000 4194304 4625164 140735862712112 18446744073709551615 4563374 0 0 4096 2 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 0.85
Current children cumulated vsize (KiB) 263988

[startup+0.700706 s]
/proc/loadavg: 9.14 9.06 8.43 7/502 23732
/proc/meminfo: memFree=23147628/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=263988 CPUtime=2.05 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 17059 0 0 0 201 4 0 0 25 0 4 0 669906107 270323712 12959 33554432000 4194304 4625164 140735862712112 18446744073709551615 4291783 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 65997 12959 345 106 0 61500 0
[pid=23732/tid=23733] ppid=23730 vsize=263988 CPUtime=0.67 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 2907 0 0 0 66 1 0 0 18 0 4 0 669906108 270323712 12959 33554432000 4194304 4625164 140735862712112 18446744073709551615 4352035 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=263988 CPUtime=0.66 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 6015 0 0 0 65 1 0 0 18 0 4 0 669906108 270323712 12959 33554432000 4194304 4625164 140735862712112 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=263988 CPUtime=0.18 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 387 0 0 0 18 0 0 0 25 0 4 0 669906108 270323712 12959 33554432000 4194304 4625164 140735862712112 18446744073709551615 270613215726 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.05
Current children cumulated vsize (KiB) 263988

[startup+1.50057 s]
/proc/loadavg: 9.14 9.06 8.43 10/506 23736
/proc/meminfo: memFree=23076384/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=265108 CPUtime=4.43 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 25959 0 0 0 437 6 0 0 25 0 4 0 669906107 271470592 21843 33554432000 4194304 4625164 140735862712112 18446744073709551615 270613215775 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 66277 21843 361 106 0 61780 0
[pid=23732/tid=23733] ppid=23730 vsize=265108 CPUtime=1.46 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 4211 0 0 0 145 1 0 0 19 0 4 0 669906108 271470592 21843 33554432000 4194304 4625164 140735862712112 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=265108 CPUtime=1.46 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 13339 0 0 0 143 3 0 0 19 0 4 0 669906108 271470592 21843 33554432000 4194304 4625164 140735862712112 18446744073709551615 4351987 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=265108 CPUtime=0.6 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 529 0 0 0 60 0 0 0 18 0 4 0 669906108 271470592 21843 33554432000 4194304 4625164 140735862712112 18446744073709551615 4559735 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 4.43
Current children cumulated vsize (KiB) 265108

[startup+3.10029 s]
/proc/loadavg: 9.14 9.06 8.43 10/506 23736
/proc/meminfo: memFree=23027912/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=280068 CPUtime=9.2 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 47640 0 0 0 910 10 0 0 25 0 4 0 669906107 286789632 36890 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/23732/statm: 70017 36890 364 106 0 65520 0
[pid=23732/tid=23733] ppid=23730 vsize=280068 CPUtime=3 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 7168 0 0 0 299 1 0 0 24 0 4 0 669906108 286789632 36890 33554432000 4194304 4625164 140735862712112 18446744073709551615 4351996 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=280068 CPUtime=2.61 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 22005 0 0 0 256 5 0 0 22 0 4 0 669906108 286789632 36890 33554432000 4194304 4625164 140735862712112 18446744073709551615 4352800 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=280068 CPUtime=2.18 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 4085 0 0 0 217 1 0 0 21 0 4 0 669906108 286789632 36890 33554432000 4194304 4625164 140735862712112 18446744073709551615 4335165 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 9.2
Current children cumulated vsize (KiB) 280068

[startup+6.30072 s]
/proc/loadavg: 9.13 9.06 8.43 10/506 23736
/proc/meminfo: memFree=22933800/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=376368 CPUtime=18.7 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 84274 0 0 0 1853 17 0 0 25 0 4 0 669906107 385400832 55730 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/23732/statm: 94092 55730 482 106 0 89595 0
[pid=23732/tid=23733] ppid=23730 vsize=376368 CPUtime=5.89 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 12756 0 0 0 587 2 0 0 25 0 4 0 669906108 385400832 55730 33554432000 4194304 4625164 140735862712112 18446744073709551615 4467266 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=376368 CPUtime=4.15 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 31860 0 0 0 407 8 0 0 25 0 4 0 669906108 385400832 55730 33554432000 4194304 4625164 140735862712112 18446744073709551615 270613153975 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=376368 CPUtime=4.72 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 20171 0 0 0 469 3 0 0 18 0 4 0 669906108 385400832 55730 33554432000 4194304 4625164 140735862712112 18446744073709551615 4547216 0 0 4096 2 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 18.7
Current children cumulated vsize (KiB) 376368

[startup+12.7006 s]
/proc/loadavg: 9.12 9.06 8.43 10/506 23737
/proc/meminfo: memFree=22797376/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=500204 CPUtime=37.77 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 140275 0 0 0 3750 27 0 0 25 0 4 0 669906107 512208896 85114 33554432000 4194304 4625164 140735862712112 18446744073709551615 4396555 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/23732/statm: 125051 85114 347 106 0 120554 0
[pid=23732/tid=23733] ppid=23730 vsize=500204 CPUtime=10.99 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 20309 0 0 0 1094 5 0 0 21 0 4 0 669906108 512208896 85114 33554432000 4194304 4625164 140735862712112 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=500204 CPUtime=7.56 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 47595 0 0 0 744 12 0 0 20 0 4 0 669906108 512208896 85114 33554432000 4194304 4625164 140735862712112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=500204 CPUtime=8.9 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 51096 0 0 0 883 7 0 0 25 0 4 0 669906108 512208896 85114 33554432000 4194304 4625164 140735862712112 18446744073709551615 4334261 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 37.77
Current children cumulated vsize (KiB) 500204

[startup+25.5013 s]
/proc/loadavg: 9.09 9.06 8.44 10/506 23737
/proc/meminfo: memFree=22564884/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=721116 CPUtime=75.93 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 202556 0 0 0 7545 48 0 0 25 0 4 0 669906107 738422784 139038 33554432000 4194304 4625164 140735862712112 18446744073709551615 4338055 0 0 4096 2 18446744073709551615 0 0 17 5 0 0 0
/proc/23732/statm: 180279 139038 1052 106 0 175782 0
[pid=23732/tid=23733] ppid=23730 vsize=721116 CPUtime=20.68 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 36249 0 0 0 2055 13 0 0 25 0 4 0 669906108 738422784 139038 33554432000 4194304 4625164 140735862712112 18446744073709551615 4464328 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=721116 CPUtime=14.11 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 79627 0 0 0 1389 22 0 0 25 0 4 0 669906108 738422784 139038 33554432000 4194304 4625164 140735862712112 18446744073709551615 4464392 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=721116 CPUtime=18.01 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 55925 0 0 0 1793 8 0 0 25 0 4 0 669906108 738422784 139038 33554432000 4194304 4625164 140735862712112 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 75.93
Current children cumulated vsize (KiB) 721116

[startup+51.1008 s]
/proc/loadavg: 9.14 9.07 8.46 10/506 23738
/proc/meminfo: memFree=22384892/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=953856 CPUtime=152.3 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 253965 0 0 0 15169 61 0 0 25 0 4 0 669906107 976748544 178948 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 238464 178948 464 106 0 233967 0
[pid=23732/tid=23733] ppid=23730 vsize=953856 CPUtime=43.35 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 47585 0 0 0 4318 17 0 0 21 0 4 0 669906108 976748544 178948 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331081 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=953856 CPUtime=27.31 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 100700 0 0 0 2704 27 0 0 19 0 4 0 669906108 976748544 178948 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=953856 CPUtime=36.02 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 59889 0 0 0 3593 9 0 0 25 0 4 0 669906108 976748544 178948 33554432000 4194304 4625164 140735862712112 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 152.3
Current children cumulated vsize (KiB) 953856

[startup+102.301 s]
/proc/loadavg: 9.10 9.07 8.49 10/506 23770
/proc/meminfo: memFree=23247260/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=1014368 CPUtime=317.76 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 285927 0 0 0 31710 66 0 0 25 0 4 0 669906107 1038712832 195857 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 253592 195857 630 106 0 249095 0
[pid=23732/tid=23733] ppid=23730 vsize=1014368 CPUtime=94.56 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 49467 0 0 0 9439 17 0 0 25 0 4 0 669906108 1038712832 195857 33554432000 4194304 4625164 140735862712112 18446744073709551615 4469354 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=1014368 CPUtime=59.25 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 101869 0 0 0 5898 27 0 0 25 0 4 0 669906108 1038712832 195857 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=1014368 CPUtime=68.01 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 66295 0 0 0 6791 10 0 0 25 0 4 0 669906108 1038712832 195857 33554432000 4194304 4625164 140735862712112 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 317.76
Current children cumulated vsize (KiB) 1014368

[startup+162.301 s]

################
# More data... #
################

[pid=23732] ppid=23730 vsize=1645368 CPUtime=2706.5 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 4444299 0 0 0 269870 780 0 0 25 0 4 0 669906107 1684856832 351101 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 411342 351101 536 106 0 406845 0
[pid=23732/tid=23733] ppid=23730 vsize=1645368 CPUtime=694.53 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 66523 0 0 0 69429 24 0 0 25 0 4 0 669906108 1684856832 351101 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=1645368 CPUtime=658.38 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 119440 0 0 0 65806 32 0 0 25 0 4 0 669906108 1684856832 351101 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=1645368 CPUtime=668 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 3891305 0 0 0 66139 661 0 0 25 0 4 0 669906108 1684856832 351101 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2706.5
Current children cumulated vsize (KiB) 1645368

[startup+762.301 s]
/proc/loadavg: 9.16 9.13 8.81 10/506 23800
/proc/meminfo: memFree=21259924/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=1995504 CPUtime=2945.54 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 5186914 0 0 0 293645 909 0 0 25 0 4 0 669906107 2043396096 379257 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393091 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 498876 379257 887 106 0 494379 0
[pid=23732/tid=23733] ppid=23730 vsize=1995504 CPUtime=754.56 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 67065 0 0 0 75431 25 0 0 25 0 4 0 669906108 2043396096 379257 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330839 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=1995504 CPUtime=718.4 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 120975 0 0 0 71807 33 0 0 25 0 4 0 669906108 2043396096 379257 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=1995504 CPUtime=728.02 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 4500448 0 0 0 72032 770 0 0 25 0 4 0 669906108 2043396096 379257 33554432000 4194304 4625164 140735862712112 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2945.54
Current children cumulated vsize (KiB) 1995504

[startup+822.301 s]
/proc/loadavg: 9.22 9.15 8.84 10/506 23801
/proc/meminfo: memFree=21212984/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2075536 CPUtime=3184.44 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 5783055 0 0 0 317435 1009 0 0 25 0 4 0 669906107 2125348864 391042 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 518884 391064 886 106 0 514387 0
[pid=23732/tid=23733] ppid=23730 vsize=2075536 CPUtime=814.54 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 67735 0 0 0 81428 26 0 0 25 0 4 0 669906108 2125348864 391074 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2075536 CPUtime=778.38 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 122212 0 0 0 77805 33 0 0 25 0 4 0 669906108 2125348864 391086 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2075536 CPUtime=787.99 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 5090909 0 0 0 77932 867 0 0 25 0 4 0 669906108 2125348864 391097 33554432000 4194304 4625164 140735862712112 18446744073709551615 270612808077 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3184.44
Current children cumulated vsize (KiB) 2075536

[startup+882.32 s]
/proc/loadavg: 9.13 9.14 8.85 10/506 23803
/proc/meminfo: memFree=21172112/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2052592 CPUtime=3423.48 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 6443833 0 0 0 341225 1123 0 0 25 0 4 0 669906107 2101854208 397572 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393061 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 513148 397572 881 106 0 508651 0
[pid=23732/tid=23733] ppid=23730 vsize=2052592 CPUtime=874.57 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 68514 0 0 0 87430 27 0 0 25 0 4 0 669906108 2101854208 397572 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330968 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2052592 CPUtime=838.4 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 122604 0 0 0 83807 33 0 0 25 0 4 0 669906108 2101854208 397572 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2052592 CPUtime=848.02 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 5738903 0 0 0 83825 977 0 0 25 0 4 0 669906108 2101854208 397572 33554432000 4194304 4625164 140735862712112 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3423.48
Current children cumulated vsize (KiB) 2052592

[startup+942.3 s]
/proc/loadavg: 9.15 9.14 8.86 10/506 23804
/proc/meminfo: memFree=21139680/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2052592 CPUtime=3662.38 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 7032204 0 0 0 365012 1226 0 0 25 0 4 0 669906107 2101854208 406997 33554432000 4194304 4625164 140735862712112 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 513148 406997 826 106 0 508651 0
[pid=23732/tid=23733] ppid=23730 vsize=2052592 CPUtime=934.54 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 69116 0 0 0 93427 27 0 0 25 0 4 0 669906108 2101854208 406998 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330502 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2052592 CPUtime=898.39 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 123150 0 0 0 89805 34 0 0 25 0 4 0 669906108 2101854208 407000 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2052592 CPUtime=908 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 6321877 0 0 0 89722 1078 0 0 25 0 4 0 669906108 2101854208 407000 33554432000 4194304 4625164 140735862712112 18446744073709551615 4579598 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3662.38
Current children cumulated vsize (KiB) 2052592

[startup+1002.3 s]
/proc/loadavg: 9.11 9.13 8.87 10/506 23806
/proc/meminfo: memFree=21092980/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2057212 CPUtime=3901.35 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 7627647 0 0 0 388806 1329 0 0 25 0 4 0 669906107 2106585088 416806 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393097 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 514303 416806 837 106 0 509806 0
[pid=23732/tid=23733] ppid=23730 vsize=2057212 CPUtime=994.54 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 69759 0 0 0 99426 28 0 0 25 0 4 0 669906108 2106585088 416806 33554432000 4194304 4625164 140735862712112 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2057212 CPUtime=958.38 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 124477 0 0 0 95804 34 0 0 25 0 4 0 669906108 2106585088 416806 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330859 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2057212 CPUtime=968 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 6910996 0 0 0 95622 1178 0 0 25 0 4 0 669906108 2106585088 416806 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3901.35
Current children cumulated vsize (KiB) 2057212

[startup+1062.3 s]
/proc/loadavg: 9.27 9.16 8.90 10/506 23808
/proc/meminfo: memFree=21053960/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2061172 CPUtime=4140.32 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 8233023 0 0 0 412601 1431 0 0 25 0 4 0 669906107 2110640128 424995 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393094 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 515293 424995 854 106 0 510796 0
[pid=23732/tid=23733] ppid=23730 vsize=2061172 CPUtime=1054.55 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 70362 0 0 0 105426 29 0 0 25 0 4 0 669906108 2110640128 424995 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331081 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2061172 CPUtime=1018.39 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 125596 0 0 0 101804 35 0 0 25 0 4 0 669906108 2110640128 424995 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2061172 CPUtime=1028.01 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 7510752 0 0 0 101522 1279 0 0 25 0 4 0 669906108 2110640128 424995 33554432000 4194304 4625164 140735862712112 18446744073709551615 4578811 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4140.32
Current children cumulated vsize (KiB) 2061172

[startup+1122.3 s]
/proc/loadavg: 9.17 9.15 8.91 10/506 23809
/proc/meminfo: memFree=21017420/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2065264 CPUtime=4379.29 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 8608047 0 0 0 436435 1494 0 0 25 0 4 0 669906107 2114830336 432766 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393101 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 516316 432766 822 106 0 511819 0
[pid=23732/tid=23733] ppid=23730 vsize=2065264 CPUtime=1114.54 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 73987 0 0 0 111424 30 0 0 25 0 4 0 669906108 2114830336 432766 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2065264 CPUtime=1078.38 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 126746 0 0 0 107803 35 0 0 25 0 4 0 669906108 2114830336 432766 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2065264 CPUtime=1088 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 7876710 0 0 0 107462 1338 0 0 25 0 4 0 669906108 2114830336 432766 33554432000 4194304 4625164 140735862712112 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4379.29
Current children cumulated vsize (KiB) 2065264

[startup+1182.3 s]
/proc/loadavg: 9.13 9.14 8.92 10/506 23811
/proc/meminfo: memFree=20977544/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2069752 CPUtime=4618.27 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 9185386 0 0 0 460237 1590 0 0 25 0 4 0 669906107 2119426048 442705 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 517438 442705 871 106 0 512941 0
[pid=23732/tid=23733] ppid=23730 vsize=2069752 CPUtime=1174.55 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 74499 0 0 0 117424 31 0 0 25 0 4 0 669906108 2119426048 442705 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2069752 CPUtime=1138.39 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 128041 0 0 0 113803 36 0 0 25 0 4 0 669906108 2119426048 442705 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2069752 CPUtime=1148 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 8447293 0 0 0 113369 1431 0 0 25 0 4 0 669906108 2119426048 442705 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4618.27
Current children cumulated vsize (KiB) 2069752



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1228 s]
/proc/loadavg: 9.18 9.14 8.93 10/506 23812
/proc/meminfo: memFree=20948104/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2138192 CPUtime=4800.33 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 9628776 0 0 0 478367 1666 0 0 25 0 4 0 669906107 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 534548 448553 838 106 0 530051 0
[pid=23732/tid=23733] ppid=23730 vsize=2138192 CPUtime=1220.26 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 74850 0 0 0 121995 31 0 0 25 0 4 0 669906108 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330958 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2138192 CPUtime=1184.11 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 128931 0 0 0 118374 37 0 0 25 0 4 0 669906108 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2138192 CPUtime=1193.72 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 8885814 0 0 0 117867 1505 0 0 25 0 4 0 669906108 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 2138192

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1228 s]
/proc/loadavg: 9.18 9.14 8.93 10/506 23812
/proc/meminfo: memFree=20948104/32951124 swapFree=60609076/67111528
[pid=23732] ppid=23730 vsize=2138192 CPUtime=4800.33 cores=1,3,5,7
/proc/23732/stat : 23732 (SArTagnan) R 23730 23732 22974 0 -1 4202496 9628776 0 0 0 478367 1666 0 0 25 0 4 0 669906107 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4393110 0 0 4096 2 18446744073709551615 0 0 17 7 0 0 0
/proc/23732/statm: 534548 448553 838 106 0 530051 0
[pid=23732/tid=23733] ppid=23730 vsize=2138192 CPUtime=1220.26 cores=1,3,5,7
/proc/23732/task/23733/stat : 23733 (SArTagnan) R 23730 23732 22974 0 -1 4202560 74850 0 0 0 121995 31 0 0 25 0 4 0 669906108 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330958 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=23732/tid=23734] ppid=23730 vsize=2138192 CPUtime=1184.11 cores=1,3,5,7
/proc/23732/task/23734/stat : 23734 (SArTagnan) R 23730 23732 22974 0 -1 4202560 128931 0 0 0 118374 37 0 0 25 0 4 0 669906108 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=23732/tid=23735] ppid=23730 vsize=2138192 CPUtime=1193.72 cores=1,3,5,7
/proc/23732/task/23735/stat : 23735 (SArTagnan) R 23730 23732 22974 0 -1 4202560 8885814 0 0 0 117867 1505 0 0 25 0 4 0 669906108 2189508608 448553 33554432000 4194304 4625164 140735862712112 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 4800.33
Current children cumulated vsize (KiB) 2138192

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1228.1
CPU time (s): 4800.44
CPU user time (s): 4783.7
CPU system time (s): 16.7345
CPU usage (%): 390.884
Max. virtual memory (cumulated for all children) (KiB): 2353544

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4783.7
system time used= 16.7345
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 9628776
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6390
involuntary context switches= 30783

runsolver used 5.47617 second user time and 15.7186 second system time

The end

Launcher Data 

Begin job on node108 at 2011-05-16 23:57:32
IDJOB=3386087
IDBENCH=85438
IDSOLVER=1871
FILE ID=node108/3386087-1305583052
RUNJOBID= node108-1305581841-23617
PBS_JOBID= 13350217
Free space on /tmp= 73452 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT05/crafted/sabharwal05/counting/php/unsat/easier/php-045-035.shuffled-as.sat05-1181.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3386087-1305583052/watcher-3386087-1305583052 -o /tmp/evaluation-result-3386087-1305583052/solver-3386087-1305583052 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3386087-1305583052.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 057b78ff24cc0773c9c67e770a7b9de2
RANDOM SEED=1230616685

node108.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.820
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      23147660 kB
Buffers:         72376 kB
Cached:         734856 kB
SwapCached:      25796 kB
Active:        2218388 kB
Inactive:      7366084 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      23147660 kB
SwapTotal:    67111528 kB
SwapFree:     60609076 kB
Dirty:             788 kB
Writeback:           0 kB
AnonPages:     8760288 kB
Mapped:          29200 kB
Slab:            81872 kB
PageTables:      67684 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 136045380 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73452 MiB
End job on node108 at 2011-05-17 00:18:02