Trace number 3262708

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.28 1201.8

General information on the benchmark

NameSAT03/handmade/gomes/bqwh/
bqwh.50.825.shuffled-as.sat03-1648.cnf
MD5SUM05a191325d89de504821b55dea51ca7f
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark19.758
Satisfiable
(Un)Satisfiability was proved
Number of variables4979
Number of clauses43754
Sum of the clauses size97507
Maximum clause length12
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 241316
Number of clauses of size 3117
Number of clauses of size 4287
Number of clauses of size 5525
Number of clauses of size over 51509

Solver Data


Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3262708-1304098835/watcher-3262708-1304098835 -o /tmp/evaluation-result-3262708-1304098835/solver-3262708-1304098835 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3262708-1304098835.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.86 8.01 7.98 6/180 1547
/proc/meminfo: memFree=29236124/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=19968 CPUtime=0 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 535 0 0 0 0 0 0 0 25 0 1 0 600114209 20447232 473 33554432000 4194304 4623224 140736736406096 18446744073709551615 218880564992 0 0 4096 2 0 0 0 17 2 0 0 0
/proc/1547/statm: 4992 473 296 105 0 496 0

[startup+0.0386691 s]
/proc/loadavg: 7.86 8.01 7.98 6/180 1547
/proc/meminfo: memFree=29236124/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=251608 CPUtime=0.08 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 2529 0 0 0 8 0 0 0 25 0 4 0 600114209 257646592 2223 33554432000 4194304 4623224 140736736406096 18446744073709551615 218880262336 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 62902 2251 341 105 0 58406 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 251608

[startup+0.165798 s]
/proc/loadavg: 7.86 8.01 7.98 6/180 1547
/proc/meminfo: memFree=29236124/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=261404 CPUtime=0.59 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 9630 0 0 0 59 0 0 0 25 0 4 0 600114209 267677696 6182 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510252 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 65351 6183 343 105 0 60855 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 261404

[startup+0.300775 s]
/proc/loadavg: 7.86 8.01 7.98 6/180 1547
/proc/meminfo: memFree=29236124/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=263848 CPUtime=1.13 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 10335 0 0 0 112 1 0 0 25 0 4 0 600114209 270180352 6016 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510086 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 65962 6016 343 105 0 61466 0
Current children cumulated CPU time (s) 1.13
Current children cumulated vsize (KiB) 263848

[startup+0.700705 s]
/proc/loadavg: 7.86 8.01 7.98 6/180 1547
/proc/meminfo: memFree=29236124/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=265760 CPUtime=2.73 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 12161 0 0 0 272 1 0 0 25 0 4 0 600114209 272138240 6685 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510599 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 66440 6685 343 105 0 61944 0
Current children cumulated CPU time (s) 2.73
Current children cumulated vsize (KiB) 265760

[startup+1.50057 s]
/proc/loadavg: 7.87 8.01 7.98 9/184 1551
/proc/meminfo: memFree=29194516/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=269516 CPUtime=5.93 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 17496 0 0 0 591 2 0 0 25 0 4 0 600114209 275984384 8400 33554432000 4194304 4623224 140736736406096 18446744073709551615 4384389 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 67379 8400 344 105 0 62883 0
[pid=1547/tid=1549] ppid=1545 vsize=269516 CPUtime=1.46 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 3276 0 0 0 146 0 0 0 25 0 4 0 600114211 275984384 8400 33554432000 4194304 4623224 140736736406096 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=269516 CPUtime=1.47 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 2289 0 0 0 147 0 0 0 25 0 4 0 600114211 275984384 8400 33554432000 4194304 4623224 140736736406096 18446744073709551615 4465909 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=269516 CPUtime=1.47 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 5654 0 0 0 147 0 0 0 25 0 4 0 600114211 275984384 8400 33554432000 4194304 4623224 140736736406096 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 5.93
Current children cumulated vsize (KiB) 269516

[startup+3.10029 s]
/proc/loadavg: 7.87 8.01 7.98 9/184 1551
/proc/meminfo: memFree=29158928/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=275344 CPUtime=12.32 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 23595 0 0 0 1227 5 0 0 25 0 4 0 600114209 281952256 12817 33554432000 4194304 4623224 140736736406096 18446744073709551615 4415933 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 68836 12817 344 105 0 64340 0
[pid=1547/tid=1549] ppid=1545 vsize=275344 CPUtime=3.06 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 4875 0 0 0 305 1 0 0 25 0 4 0 600114211 281952256 12817 33554432000 4194304 4623224 140736736406096 18446744073709551615 4377689 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=275344 CPUtime=3.06 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 4129 0 0 0 306 0 0 0 25 0 4 0 600114211 281952256 12817 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=275344 CPUtime=3.08 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 6767 0 0 0 307 1 0 0 25 0 4 0 600114211 281952256 12817 33554432000 4194304 4623224 140736736406096 18446744073709551615 4377252 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.32
Current children cumulated vsize (KiB) 275344

[startup+6.30073 s]
/proc/loadavg: 7.87 8.01 7.98 9/184 1551
/proc/meminfo: memFree=29142104/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=284972 CPUtime=25.1 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 35482 0 0 0 2501 9 0 0 25 0 4 0 600114209 291811328 21054 33554432000 4194304 4623224 140736736406096 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 71243 21054 344 105 0 66747 0
[pid=1547/tid=1549] ppid=1545 vsize=284972 CPUtime=6.23 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 8991 0 0 0 620 3 0 0 25 0 4 0 600114211 291811328 21054 33554432000 4194304 4623224 140736736406096 18446744073709551615 4377133 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=284972 CPUtime=6.27 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 7635 0 0 0 625 2 0 0 25 0 4 0 600114211 291811328 21054 33554432000 4194304 4623224 140736736406096 18446744073709551615 4463064 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=284972 CPUtime=6.27 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 8430 0 0 0 626 1 0 0 25 0 4 0 600114211 291811328 21054 33554432000 4194304 4623224 140736736406096 18446744073709551615 4577456 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 284972

[startup+12.7006 s]
/proc/loadavg: 7.96 8.02 7.99 9/184 1551
/proc/meminfo: memFree=29077528/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=299452 CPUtime=50.66 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 54202 0 0 0 5050 16 0 0 25 0 4 0 600114209 306638848 34134 33554432000 4194304 4623224 140736736406096 18446744073709551615 4384357 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 74863 34134 344 105 0 70367 0
[pid=1547/tid=1549] ppid=1545 vsize=299452 CPUtime=12.6 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 15107 0 0 0 1254 6 0 0 25 0 4 0 600114211 306638848 34134 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=299452 CPUtime=12.67 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 13502 0 0 0 1262 5 0 0 25 0 4 0 600114211 306638848 34134 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=299452 CPUtime=12.67 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 11093 0 0 0 1266 1 0 0 25 0 4 0 600114211 306638848 34134 33554432000 4194304 4623224 140736736406096 18446744073709551615 4571914 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 299452

[startup+25.5004 s]
/proc/loadavg: 8.04 8.04 7.99 9/184 1552
/proc/meminfo: memFree=28967532/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=318480 CPUtime=101.79 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 136042 0 0 0 10143 36 0 0 25 0 4 0 600114209 326123520 58902 33554432000 4194304 4623224 140736736406096 18446744073709551615 4488828 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 79620 58902 344 105 0 75124 0
[pid=1547/tid=1549] ppid=1545 vsize=318480 CPUtime=25.33 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 26757 0 0 0 2521 12 0 0 25 0 4 0 600114211 326123520 58902 33554432000 4194304 4623224 140736736406096 18446744073709551615 4289775 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=318480 CPUtime=25.47 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 22971 0 0 0 2538 9 0 0 25 0 4 0 600114211 326123520 58902 33554432000 4194304 4623224 140736736406096 18446744073709551615 4463936 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=318480 CPUtime=25.47 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 66707 0 0 0 2537 10 0 0 25 0 4 0 600114211 326123520 58902 33554432000 4194304 4623224 140736736406096 18446744073709551615 4364669 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 318480

[startup+51.1009 s]
/proc/loadavg: 8.02 8.03 7.99 9/184 1552
/proc/meminfo: memFree=28767340/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=561848 CPUtime=204.05 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 282262 0 0 0 20337 68 0 0 25 0 4 0 600114209 575332352 95223 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510285 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 140462 95224 345 105 0 135966 0
[pid=1547/tid=1549] ppid=1545 vsize=561848 CPUtime=50.79 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 47649 0 0 0 5059 20 0 0 25 0 4 0 600114211 575332352 95224 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=561848 CPUtime=51.07 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 37236 0 0 0 5091 16 0 0 25 0 4 0 600114211 575332352 95225 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=561848 CPUtime=51.06 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 169297 0 0 0 5082 24 0 0 25 0 4 0 600114211 575332352 95225 33554432000 4194304 4623224 140736736406096 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 204.05
Current children cumulated vsize (KiB) 561848

[startup+102.307 s]
/proc/loadavg: 8.13 8.06 8.00 9/184 1554
/proc/meminfo: memFree=28389988/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=807276 CPUtime=408.59 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 566005 0 0 0 40728 131 0 0 25 0 4 0 600114209 826650624 153968 33554432000 4194304 4623224 140736736406096 18446744073709551615 4414993 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 201819 153968 345 105 0 197323 0
[pid=1547/tid=1549] ppid=1545 vsize=807276 CPUtime=101.72 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 71643 0 0 0 10137 35 0 0 25 0 4 0 600114211 826650624 153968 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=807276 CPUtime=102.28 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 59635 0 0 0 10199 29 0 0 25 0 4 0 600114211 826650624 153968 33554432000 4194304 4623224 140736736406096 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=807276 CPUtime=102.26 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 380983 0 0 0 10170 56 0 0 25 0 4 0 600114211 826650624 153968 33554432000 4194304 4623224 140736736406096 18446744073709551615 4550465 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 408.59
Current children cumulated vsize (KiB) 807276

[startup+162.301 s]
/proc/loadavg: 8.08 8.06 8.00 9/184 1555
/proc/meminfo: memFree=28113568/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=1015016 CPUtime=648.24 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 888939 0 0 0 64620 204 0 0 25 0 4 0 600114209 1039376384 213159 33554432000 4194304 4623224 140736736406096 18446744073709551615 4414965 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 253754 213159 345 105 0 249258 0
[pid=1547/tid=1549] ppid=1545 vsize=1015016 CPUtime=161.39 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 89471 0 0 0 16088 51 0 0 25 0 4 0 600114211 1039376384 213159 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=1015016 CPUtime=162.27 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 84216 0 0 0 16186 41 0 0 25 0 4 0 600114211 1039376384 213159 33554432000 4194304 4623224 140736736406096 18446744073709551615 4289723 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=1015016 CPUtime=162.25 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 636181 0 0 0 16129 96 0 0 25 0 4 0 600114211 1039376384 213159 33554432000 4194304 4623224 140736736406096 18446744073709551615 4366866 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 648.24
Current children cumulated vsize (KiB) 1015016

[startup+222.301 s]
/proc/loadavg: 8.03 8.05 8.00 9/184 1557
/proc/meminfo: memFree=27839376/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=1277508 CPUtime=887.9 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1070000 0 0 0 88534 256 0 0 25 0 4 0 600114209 1308168192 263835 33554432000 4194304 4623224 140736736406096 18446744073709551615 4414978 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 319377 263835 345 105 0 314881 0
[pid=1547/tid=1549] ppid=1545 vsize=1277508 CPUtime=221.06 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 116136 0 0 0 22040 66 0 0 25 0 4 0 600114211 1308168192 263835 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=1277508 CPUtime=222.27 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 109630 0 0 0 22172 55 0 0 25 0 4 0 600114211 1308168192 263835 33554432000 4194304 4623224 140736736406096 18446744073709551615 4366412 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=1277508 CPUtime=222.24 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 760003 0 0 0 22106 118 0 0 25 0 4 0 600114211 1308168192 263835 33554432000 4194304 4623224 140736736406096 18446744073709551615 4377576 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 887.9
Current children cumulated vsize (KiB) 1277508

[startup+282.301 s]

################
# More data... #
################

[pid=1547] ppid=1545 vsize=1788212 CPUtime=2805.28 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1732690 0 0 0 280120 408 0 0 25 0 4 0 600114209 1831129088 379249 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 447053 379249 345 105 0 442557 0
[pid=1547/tid=1549] ppid=1545 vsize=1788212 CPUtime=698.45 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 120746 0 0 0 69775 70 0 0 25 0 4 0 600114211 1831129088 379249 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357622 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=1788212 CPUtime=702.28 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 121747 0 0 0 70160 68 0 0 25 0 4 0 600114211 1831129088 379249 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=1788212 CPUtime=702.22 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1293047 0 0 0 69996 226 0 0 25 0 4 0 600114211 1831129088 379249 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2805.28
Current children cumulated vsize (KiB) 1788212

[startup+762.307 s]
/proc/loadavg: 8.18 8.14 8.04 9/184 1571
/proc/meminfo: memFree=26973224/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=1816940 CPUtime=3044.98 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1743910 0 0 0 304086 412 0 0 25 0 4 0 600114209 1860546560 389946 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 454235 389946 345 105 0 449739 0
[pid=1547/tid=1549] ppid=1545 vsize=1816940 CPUtime=758.14 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 120981 0 0 0 75743 71 0 0 25 0 4 0 600114211 1860546560 389946 33554432000 4194304 4623224 140736736406096 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=1816940 CPUtime=762.28 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 121919 0 0 0 76160 68 0 0 25 0 4 0 600114211 1860546560 389946 33554432000 4194304 4623224 140736736406096 18446744073709551615 4358011 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=1816940 CPUtime=762.22 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1300340 0 0 0 75994 228 0 0 25 0 4 0 600114211 1860546560 389946 33554432000 4194304 4623224 140736736406096 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3044.98
Current children cumulated vsize (KiB) 1816940

[startup+822.3 s]
/proc/loadavg: 8.11 8.13 8.04 9/184 1573
/proc/meminfo: memFree=26916528/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=1929184 CPUtime=3284.62 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1815162 0 0 0 328039 423 0 0 25 0 4 0 600114209 1975484416 403080 33554432000 4194304 4623224 140736736406096 18446744073709551615 4414993 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 482296 403080 345 105 0 477800 0
[pid=1547/tid=1549] ppid=1545 vsize=1929184 CPUtime=817.81 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 121196 0 0 0 81710 71 0 0 25 0 4 0 600114211 1975484416 403080 33554432000 4194304 4623224 140736736406096 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=1929184 CPUtime=822.28 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122105 0 0 0 82160 68 0 0 25 0 4 0 600114211 1975484416 403080 33554432000 4194304 4623224 140736736406096 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=1929184 CPUtime=822.2 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1315994 0 0 0 81989 231 0 0 25 0 4 0 600114211 1975484416 403080 33554432000 4194304 4623224 140736736406096 18446744073709551615 4577438 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3284.62
Current children cumulated vsize (KiB) 1929184

[startup+882.301 s]
/proc/loadavg: 8.08 8.12 8.04 9/184 1575
/proc/meminfo: memFree=26851392/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2023112 CPUtime=3524.29 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1826062 0 0 0 352002 427 0 0 25 0 4 0 600114209 2071666688 413912 33554432000 4194304 4623224 140736736406096 18446744073709551615 4415014 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 505778 413912 345 105 0 501282 0
[pid=1547/tid=1549] ppid=1545 vsize=2023112 CPUtime=877.48 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 121418 0 0 0 87677 71 0 0 25 0 4 0 600114211 2071666688 413912 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2023112 CPUtime=882.28 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122290 0 0 0 88160 68 0 0 25 0 4 0 600114211 2071666688 413912 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2023112 CPUtime=882.2 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1323050 0 0 0 87987 233 0 0 25 0 4 0 600114211 2071666688 413912 33554432000 4194304 4623224 140736736406096 18446744073709551615 218880221141 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3524.29
Current children cumulated vsize (KiB) 2023112

[startup+942.301 s]
/proc/loadavg: 8.03 8.09 8.03 9/184 1576
/proc/meminfo: memFree=26833244/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2052668 CPUtime=3763.96 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1838967 0 0 0 375964 432 0 0 25 0 4 0 600114209 2101932032 426682 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510202 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 513167 426682 345 105 0 508671 0
[pid=1547/tid=1549] ppid=1545 vsize=2052668 CPUtime=937.15 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 121621 0 0 0 93644 71 0 0 25 0 4 0 600114211 2101932032 426682 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2052668 CPUtime=942.29 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122469 0 0 0 94160 69 0 0 25 0 4 0 600114211 2101932032 426682 33554432000 4194304 4623224 140736736406096 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2052668 CPUtime=942.19 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1330391 0 0 0 93984 235 0 0 25 0 4 0 600114211 2101932032 426682 33554432000 4194304 4623224 140736736406096 18446744073709551615 218880261899 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3763.96
Current children cumulated vsize (KiB) 2052668

[startup+1002.3 s]
/proc/loadavg: 8.01 8.07 8.03 9/184 1578
/proc/meminfo: memFree=26750008/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2082212 CPUtime=4003.64 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1854062 0 0 0 399927 437 0 0 25 0 4 0 600114209 2132185088 441395 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 520553 441396 345 105 0 516057 0
[pid=1547/tid=1549] ppid=1545 vsize=2082212 CPUtime=996.83 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 121852 0 0 0 99612 71 0 0 25 0 4 0 600114211 2132185088 441396 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2082212 CPUtime=1002.29 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122644 0 0 0 100160 69 0 0 25 0 4 0 600114211 2132185088 441396 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2082212 CPUtime=1002.18 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1337771 0 0 0 99981 237 0 0 25 0 4 0 600114211 2132185088 441396 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4003.64
Current children cumulated vsize (KiB) 2082212

[startup+1062.3 s]
/proc/loadavg: 7.71 7.99 8.00 9/184 1610
/proc/meminfo: memFree=28976676/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2174892 CPUtime=4243.31 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1870439 0 0 0 423888 443 0 0 25 0 4 0 600114209 2227089408 457354 33554432000 4194304 4623224 140736736406096 18446744073709551615 4414984 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 543723 457354 345 105 0 539227 0
[pid=1547/tid=1549] ppid=1545 vsize=2174892 CPUtime=1056.5 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122106 0 0 0 105579 71 0 0 25 0 4 0 600114211 2227089408 457354 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2174892 CPUtime=1062.29 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122832 0 0 0 106160 69 0 0 25 0 4 0 600114211 2227089408 457354 33554432000 4194304 4623224 140736736406096 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2174892 CPUtime=1062.18 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1344580 0 0 0 105979 239 0 0 25 0 4 0 600114211 2227089408 457354 33554432000 4194304 4623224 140736736406096 18446744073709551615 4577438 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4243.31
Current children cumulated vsize (KiB) 2174892

[startup+1122.3 s]
/proc/loadavg: 7.97 8.02 8.01 9/184 1612
/proc/meminfo: memFree=28754168/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2201784 CPUtime=4482.98 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1883194 0 0 0 447850 448 0 0 25 0 4 0 600114209 2254626816 469596 33554432000 4194304 4623224 140736736406096 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 550446 469596 345 105 0 545950 0
[pid=1547/tid=1549] ppid=1545 vsize=2201784 CPUtime=1116.17 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122332 0 0 0 111546 71 0 0 25 0 4 0 600114211 2254626816 469596 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376640 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2201784 CPUtime=1122.29 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 123361 0 0 0 112159 70 0 0 25 0 4 0 600114211 2254626816 469596 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2201784 CPUtime=1122.18 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1351458 0 0 0 111977 241 0 0 25 0 4 0 600114211 2254626816 469596 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4482.98
Current children cumulated vsize (KiB) 2201784

[startup+1182.3 s]
/proc/loadavg: 8.14 8.06 8.02 9/184 1614
/proc/meminfo: memFree=28610144/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2257308 CPUtime=4722.66 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1909746 0 0 0 471811 455 0 0 25 0 4 0 600114209 2311483392 481637 33554432000 4194304 4623224 140736736406096 18446744073709551615 4414880 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 564327 481637 345 105 0 559831 0
[pid=1547/tid=1549] ppid=1545 vsize=2257308 CPUtime=1175.86 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122558 0 0 0 117514 72 0 0 25 0 4 0 600114211 2311483392 481637 33554432000 4194304 4623224 140736736406096 18446744073709551615 4486238 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2257308 CPUtime=1182.29 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 123623 0 0 0 118159 70 0 0 25 0 4 0 600114211 2311483392 481637 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2257308 CPUtime=1182.17 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1358384 0 0 0 117975 242 0 0 25 0 4 0 600114211 2311483392 481637 33554432000 4194304 4623224 140736736406096 18446744073709551615 4545471 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4722.66
Current children cumulated vsize (KiB) 2257308



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 8.10 8.05 8.01 9/184 1614
/proc/meminfo: memFree=28568968/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2266176 CPUtime=4800.16 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1913990 0 0 0 479560 456 0 0 25 0 4 0 600114209 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4415172 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 566544 485658 345 105 0 562048 0
[pid=1547/tid=1549] ppid=1545 vsize=2266176 CPUtime=1195.15 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122625 0 0 0 119443 72 0 0 25 0 4 0 600114211 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2266176 CPUtime=1201.7 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 123677 0 0 0 120100 70 0 0 25 0 4 0 600114211 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357673 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2266176 CPUtime=1201.58 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1360686 0 0 0 119915 243 0 0 25 0 4 0 600114211 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 2266176

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 8.10 8.05 8.01 9/184 1614
/proc/meminfo: memFree=28568968/32950928 swapFree=67111524/67111528
[pid=1547] ppid=1545 vsize=2266176 CPUtime=4800.16 cores=0,2,4,6
/proc/1547/stat : 1547 (SArTagnan) R 1545 1547 1141 0 -1 4202496 1913990 0 0 0 479560 456 0 0 25 0 4 0 600114209 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4415172 0 0 4096 2 18446744073709551615 0 0 17 2 0 0 0
/proc/1547/statm: 566544 485658 345 105 0 562048 0
[pid=1547/tid=1549] ppid=1545 vsize=2266176 CPUtime=1195.15 cores=0,2,4,6
/proc/1547/task/1549/stat : 1549 (SArTagnan) R 1545 1547 1141 0 -1 4202560 122625 0 0 0 119443 72 0 0 25 0 4 0 600114211 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357901 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1547/tid=1550] ppid=1545 vsize=2266176 CPUtime=1201.7 cores=0,2,4,6
/proc/1547/task/1550/stat : 1550 (SArTagnan) R 1545 1547 1141 0 -1 4202560 123677 0 0 0 120100 70 0 0 25 0 4 0 600114211 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4357673 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=1547/tid=1551] ppid=1545 vsize=2266176 CPUtime=1201.58 cores=0,2,4,6
/proc/1547/task/1551/stat : 1551 (SArTagnan) R 1545 1547 1141 0 -1 4202560 1360686 0 0 0 119915 243 0 0 25 0 4 0 600114211 2320564224 485658 33554432000 4194304 4623224 140736736406096 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.16
Current children cumulated vsize (KiB) 2266176

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1201.8
CPU time (s): 4800.28
CPU user time (s): 4795.63
CPU system time (s): 4.64929
CPU usage (%): 399.425
Max. virtual memory (cumulated for all children) (KiB): 2285524

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4795.63
system time used= 4.64929
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1913990
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2437
involuntary context switches= 22537

runsolver used 1.92471 second user time and 4.63129 second system time

The end

Launcher Data

Begin job on node112 at 2011-04-29 19:40:36
IDJOB=3262708
IDBENCH=83796
IDSOLVER=1656
FILE ID=node112/3262708-1304098835
RUNJOBID= node112-1304097479-1159
PBS_JOBID= 13170614
Free space on /tmp= 72452 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT03/handmade/gomes/bqwh/bqwh.50.825.shuffled-as.sat03-1648.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3262708-1304098835/watcher-3262708-1304098835 -o /tmp/evaluation-result-3262708-1304098835/solver-3262708-1304098835 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3262708-1304098835.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 05a191325d89de504821b55dea51ca7f
RANDOM SEED=1708299240

node112.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5261.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29236280 kB
Buffers:        443496 kB
Cached:        1287556 kB
SwapCached:          4 kB
Active:        1764952 kB
Inactive:      1546512 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29236280 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:            1080 kB
Writeback:           0 kB
AnonPages:     1579692 kB
Mapped:          15396 kB
Slab:           334840 kB
PageTables:       8048 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2076152 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72564 MiB
End job on node112 at 2011-04-29 20:00:39