Trace number 3439131

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-05-15 (fixed)? (TO) 40001 5011.95

General information on the benchmark

Namecrafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/
VanDerWaerden_pd_2-3-23_506.cnf
MD5SUM3c65ff80757b12edd41f8ee6da874877
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark77.5062
Satisfiable
(Un)Satisfiability was proved
Number of variables253
Number of clauses34386
Sum of the clauses size155873
Maximum clause length23
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 284
Number of clauses of size 331656
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 52646

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3439131-1306960404/watcher-3439131-1306960404 -o /tmp/evaluation-result-3439131-1306960404/solver-3439131-1306960404 -C 40000 -W 5100 -M 31000 SArTagnan HOME/instance-3439131-1306960404.cnf -threads=8 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 40000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 40030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/528 626
/proc/meminfo: memFree=21795544/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=19448 CPUtime=0 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 476 0 0 0 0 0 0 0 18 0 1 0 788456724 19914752 413 33554432000 4194304 4625164 140734405159584 18446744073709551615 4339447 0 0 4096 2 0 0 0 17 6 0 0 0
/proc/626/statm: 4862 414 295 106 0 365 0

[startup+0.05978 s]
/proc/loadavg: 0.00 0.00 0.00 2/528 626
/proc/meminfo: memFree=21795544/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=239808 CPUtime=0.18 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 5067 0 0 0 18 0 0 0 18 0 8 0 788456724 245563392 3926 33554432000 4194304 4625164 140734405159584 18446744073709551615 4391821 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 60220 3937 327 106 0 55723 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 239808

[startup+0.959086 s]
/proc/loadavg: 0.00 0.00 0.00 2/528 626
/proc/meminfo: memFree=21795544/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=318416 CPUtime=7.26 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 19385 0 0 0 724 2 0 0 20 0 8 0 788456724 326057984 9684 33554432000 4194304 4625164 140734405159584 18446744073709551615 4512029 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 79604 9684 345 106 0 75107 0
Current children cumulated CPU time (s) 7.26
Current children cumulated vsize (KiB) 318416

[startup+1.05907 s]
/proc/loadavg: 0.00 0.00 0.00 2/528 626
/proc/meminfo: memFree=21795544/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=318936 CPUtime=8.05 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 20386 0 0 0 803 2 0 0 20 0 8 0 788456724 326590464 10203 33554432000 4194304 4625164 140734405159584 18446744073709551615 4280397 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 79734 10203 345 106 0 75237 0
Current children cumulated CPU time (s) 8.05
Current children cumulated vsize (KiB) 318936

[startup+1.10106 s]
/proc/loadavg: 0.00 0.00 0.00 2/528 626
/proc/meminfo: memFree=21795544/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=319220 CPUtime=8.39 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 20701 0 0 0 837 2 0 0 20 0 8 0 788456724 326881280 10327 33554432000 4194304 4625164 140734405159584 18446744073709551615 4393074 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 79805 10327 345 106 0 75308 0
Current children cumulated CPU time (s) 8.39
Current children cumulated vsize (KiB) 319220

[startup+1.50099 s]
/proc/loadavg: 0.00 0.00 0.00 2/528 626
/proc/meminfo: memFree=21795544/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=325660 CPUtime=11.59 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 26747 0 0 0 1156 3 0 0 21 0 8 0 788456724 333475840 12226 33554432000 4194304 4625164 140734405159584 18446744073709551615 212039760415 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 81415 12226 345 106 0 76918 0
Current children cumulated CPU time (s) 11.59
Current children cumulated vsize (KiB) 325660

[startup+3.10071 s]
/proc/loadavg: 0.64 0.13 0.04 9/536 634
/proc/meminfo: memFree=21718824/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=334200 CPUtime=24.35 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 46029 0 0 0 2428 7 0 0 25 0 8 0 788456724 342220800 18971 33554432000 4194304 4625164 140734405159584 18446744073709551615 4338085 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 83550 18971 348 106 0 79053 0
[pid=626/tid=628] ppid=624 vsize=334200 CPUtime=3.06 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 3651 0 0 0 306 0 0 0 25 0 8 0 788456726 342220800 18971 33554432000 4194304 4625164 140734405159584 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=334200 CPUtime=3.03 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 2504 0 0 0 303 0 0 0 25 0 8 0 788456726 342220800 18971 33554432000 4194304 4625164 140734405159584 18446744073709551615 4339569 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=334200 CPUtime=3.03 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 21006 0 0 0 300 3 0 0 24 0 8 0 788456726 342220800 18971 33554432000 4194304 4625164 140734405159584 18446744073709551615 212039352075 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=631] ppid=624 vsize=334200 CPUtime=3 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 3366 0 0 0 300 0 0 0 25 0 8 0 788456726 342220800 18972 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=632] ppid=624 vsize=334200 CPUtime=2.95 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 2496 0 0 0 295 0 0 0 25 0 8 0 788456726 342220800 18972 33554432000 4194304 4625164 140734405159584 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=633] ppid=624 vsize=334200 CPUtime=3.06 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 3597 0 0 0 306 0 0 0 25 0 8 0 788456726 342220800 18972 33554432000 4194304 4625164 140734405159584 18446744073709551615 4352021 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=334200 CPUtime=3.06 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 3634 0 0 0 306 0 0 0 25 0 8 0 788456726 342220800 18972 33554432000 4194304 4625164 140734405159584 18446744073709551615 4352047 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 24.35
Current children cumulated vsize (KiB) 334200

[startup+6.32013 s]
/proc/loadavg: 0.64 0.13 0.04 9/536 634
/proc/meminfo: memFree=21676820/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=353848 CPUtime=50.04 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 75341 0 0 0 4993 11 0 0 25 0 8 0 788456724 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4511857 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 88462 29622 348 106 0 83965 0
[pid=626/tid=628] ppid=624 vsize=353848 CPUtime=6.29 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 5961 0 0 0 628 1 0 0 25 0 8 0 788456726 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4352280 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=353848 CPUtime=6.25 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 3906 0 0 0 625 0 0 0 25 0 8 0 788456726 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4353065 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=353848 CPUtime=6.25 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 37145 0 0 0 620 5 0 0 25 0 8 0 788456726 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4548720 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=631] ppid=624 vsize=353848 CPUtime=6.16 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 5690 0 0 0 616 0 0 0 25 0 8 0 788456726 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=632] ppid=624 vsize=353848 CPUtime=6.16 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 4062 0 0 0 616 0 0 0 25 0 8 0 788456726 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4349201 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=633] ppid=624 vsize=353848 CPUtime=6.28 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 5822 0 0 0 627 1 0 0 25 0 8 0 788456726 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=353848 CPUtime=6.28 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 5966 0 0 0 628 0 0 0 25 0 8 0 788456726 362340352 29622 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.04
Current children cumulated vsize (KiB) 353848

[startup+12.701 s]
/proc/loadavg: 1.23 0.26 0.09 9/536 634
/proc/meminfo: memFree=21614088/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=398064 CPUtime=100.99 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 115110 0 0 0 10081 18 0 0 25 0 8 0 788456724 407617536 46399 33554432000 4194304 4625164 140734405159584 18446744073709551615 4511967 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 99516 46399 348 106 0 95019 0
[pid=626/tid=628] ppid=624 vsize=398064 CPUtime=12.66 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 9516 0 0 0 1265 1 0 0 25 0 8 0 788456726 407617536 46400 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351777 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=398064 CPUtime=12.63 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 6669 0 0 0 1263 0 0 0 25 0 8 0 788456726 407617536 46401 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351830 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=398064 CPUtime=12.63 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 55782 0 0 0 1255 8 0 0 25 0 8 0 788456726 407617536 46401 33554432000 4194304 4625164 140734405159584 18446744073709551615 4339447 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=631] ppid=624 vsize=398064 CPUtime=12.44 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 9350 0 0 0 1243 1 0 0 25 0 8 0 788456726 407617536 46401 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=632] ppid=624 vsize=398064 CPUtime=12.55 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 6773 0 0 0 1254 1 0 0 25 0 8 0 788456726 407617536 46401 33554432000 4194304 4625164 140734405159584 18446744073709551615 4349320 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=633] ppid=624 vsize=398064 CPUtime=12.67 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 9657 0 0 0 1265 2 0 0 25 0 8 0 788456726 407617536 46402 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=398064 CPUtime=12.66 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 9538 0 0 0 1265 1 0 0 25 0 8 0 788456726 407617536 46402 33554432000 4194304 4625164 140734405159584 18446744073709551615 4352089 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 100.99
Current children cumulated vsize (KiB) 398064

[startup+25.5007 s]
/proc/loadavg: 2.73 0.64 0.21 9/536 635
/proc/meminfo: memFree=21516316/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=447624 CPUtime=203.15 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 191139 0 0 0 20283 32 0 0 25 0 8 0 788456724 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 111906 70651 348 106 0 107409 0
[pid=626/tid=628] ppid=624 vsize=447624 CPUtime=25.46 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 14307 0 0 0 2544 2 0 0 25 0 8 0 788456726 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=447624 CPUtime=25.44 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 9984 0 0 0 2543 1 0 0 25 0 8 0 788456726 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=447624 CPUtime=25.43 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 103541 0 0 0 2527 16 0 0 25 0 8 0 788456726 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4552410 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=631] ppid=624 vsize=447624 CPUtime=25.01 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 14045 0 0 0 2499 2 0 0 25 0 8 0 788456726 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=632] ppid=624 vsize=447624 CPUtime=25.34 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 10276 0 0 0 2532 2 0 0 25 0 8 0 788456726 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=633] ppid=624 vsize=447624 CPUtime=25.46 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 14862 0 0 0 2544 2 0 0 25 0 8 0 788456726 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=447624 CPUtime=25.46 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 14170 0 0 0 2544 2 0 0 25 0 8 0 788456726 458366976 70651 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351906 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 203.15
Current children cumulated vsize (KiB) 447624

[startup+51.1011 s]
/proc/loadavg: 4.65 1.26 0.43 9/536 635
/proc/meminfo: memFree=21367164/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=637912 CPUtime=407.49 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 308844 0 0 0 40697 52 0 0 25 0 8 0 788456724 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4511930 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 159478 107924 353 106 0 154981 0
[pid=626/tid=628] ppid=624 vsize=637912 CPUtime=51.07 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 22486 0 0 0 5103 4 0 0 25 0 8 0 788456726 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=637912 CPUtime=51.03 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 15486 0 0 0 5102 1 0 0 25 0 8 0 788456726 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=637912 CPUtime=51.03 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 174275 0 0 0 5075 28 0 0 25 0 8 0 788456726 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=631] ppid=624 vsize=637912 CPUtime=50.15 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 22471 0 0 0 5012 3 0 0 25 0 8 0 788456726 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4464310 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=632] ppid=624 vsize=637912 CPUtime=50.94 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 16024 0 0 0 5091 3 0 0 25 0 8 0 788456726 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4435104 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=633] ppid=624 vsize=637912 CPUtime=51.06 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 23361 0 0 0 5102 4 0 0 25 0 8 0 788456726 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351863 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=637912 CPUtime=51.06 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 22676 0 0 0 5103 3 0 0 25 0 8 0 788456726 653221888 107924 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 407.49
Current children cumulated vsize (KiB) 637912

[startup+102.301 s]
/proc/loadavg: 6.54 2.30 0.82 9/536 637
/proc/meminfo: memFree=21152896/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=843896 CPUtime=816.15 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 555893 0 0 0 81517 98 0 0 25 0 8 0 788456724 864149504 160774 33554432000 4194304 4625164 140734405159584 18446744073709551615 4396709 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 210974 160774 368 106 0 206477 0
[pid=626/tid=628] ppid=624 vsize=843896 CPUtime=102.27 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 33809 0 0 0 10221 6 0 0 25 0 8 0 788456726 864149504 160774 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=843896 CPUtime=102.23 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 23037 0 0 0 10220 3 0 0 25 0 8 0 788456726 864149504 160774 33554432000 4194304 4625164 140734405159584 18446744073709551615 4352739 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=843896 CPUtime=102.23 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 358449 0 0 0 10164 59 0 0 25 0 8 0 788456726 864149504 160774 33554432000 4194304 4625164 140734405159584 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 5 0 0 0

################
# More data... #
################

Current children cumulated vsize (KiB) 6117588

[startup+4722.3 s]
/proc/loadavg: 8.08 8.10 8.01 9/536 774
/proc/meminfo: memFree=16816928/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=6052052 CPUtime=37690.7 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 20034596 0 0 0 3765764 3302 0 0 25 0 8 0 788456724 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4511986 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 1513013 1241284 348 106 0 1508516 0
[pid=626/tid=628] ppid=624 vsize=6052052 CPUtime=4721.73 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 266677 0 0 0 472118 55 0 0 25 0 8 0 788456726 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=6052052 CPUtime=4722.32 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 281975 0 0 0 472175 57 0 0 25 0 8 0 788456726 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351818 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=6052052 CPUtime=4713.07 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 17291745 0 0 0 468538 2769 0 0 25 0 8 0 788456726 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4335552 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=631] ppid=624 vsize=6052052 CPUtime=4667.98 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 280464 0 0 0 466742 56 0 0 25 0 8 0 788456726 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4488056 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=632] ppid=624 vsize=6052052 CPUtime=4699.75 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 195279 0 0 0 469930 45 0 0 25 0 8 0 788456726 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=633] ppid=624 vsize=6052052 CPUtime=4722.37 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 385785 0 0 0 472155 82 0 0 25 0 8 0 788456726 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=6052052 CPUtime=4722.38 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 276197 0 0 0 472187 51 0 0 25 0 8 0 788456726 6197301248 1241284 33554432000 4194304 4625164 140734405159584 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 37690.7
Current children cumulated vsize (KiB) 6052052

[startup+4782.3 s]
/proc/loadavg: 8.07 8.09 8.01 9/536 776
/proc/meminfo: memFree=16797784/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=6053068 CPUtime=38169.6 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 20230222 0 0 0 3813623 3335 0 0 25 0 8 0 788456724 6198341632 1244998 33554432000 4194304 4625164 140734405159584 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 1513267 1244998 387 106 0 1508770 0
[pid=626/tid=628] ppid=624 vsize=6053068 CPUtime=4781.73 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 266692 0 0 0 478118 55 0 0 25 0 8 0 788456726 6198341632 1244998 33554432000 4194304 4625164 140734405159584 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=6053068 CPUtime=4782.32 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 282075 0 0 0 478175 57 0 0 25 0 8 0 788456726 6198341632 1244998 33554432000 4194304 4625164 140734405159584 18446744073709551615 4339612 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=6053068 CPUtime=4773.07 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 17468831 0 0 0 474508 2799 0 0 25 0 8 0 788456726 6198341632 1244998 33554432000 4194304 4625164 140734405159584 18446744073709551615 4579396 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=631] ppid=624 vsize=6053068 CPUtime=4727.98 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 280489 0 0 0 472742 56 0 0 25 0 8 0 788456726 6198341632 1244998 33554432000 4194304 4625164 140734405159584 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=632] ppid=624 vsize=6053068 CPUtime=4758.67 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 195371 0 0 0 475822 45 0 0 25 0 8 0 788456726 6198341632 1245001 33554432000 4194304 4625164 140734405159584 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=633] ppid=624 vsize=6053068 CPUtime=4782.37 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 385805 0 0 0 478155 82 0 0 25 0 8 0 788456726 6198341632 1245002 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=6053068 CPUtime=4782.38 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 276212 0 0 0 478187 51 0 0 25 0 8 0 788456726 6198341632 1245002 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38169.6
Current children cumulated vsize (KiB) 6053068

[startup+4842.3 s]
/proc/loadavg: 8.06 8.08 8.01 9/536 777
/proc/meminfo: memFree=16793332/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=6059072 CPUtime=38648.5 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 20544492 0 0 0 3861456 3390 0 0 25 0 8 0 788456724 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4512009 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 1514768 1247304 359 106 0 1510271 0
[pid=626/tid=628] ppid=624 vsize=6059072 CPUtime=4841.73 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 266707 0 0 0 484118 55 0 0 25 0 8 0 788456726 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4488056 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=6059072 CPUtime=4842.32 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 282303 0 0 0 484175 57 0 0 25 0 8 0 788456726 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351764 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=6059072 CPUtime=4833.08 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 17752733 0 0 0 480460 2848 0 0 25 0 8 0 788456726 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4552369 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=631] ppid=624 vsize=6059072 CPUtime=4787.98 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 280516 0 0 0 478742 56 0 0 25 0 8 0 788456726 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=632] ppid=624 vsize=6059072 CPUtime=4817.57 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 195412 0 0 0 481712 45 0 0 25 0 8 0 788456726 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4348844 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=633] ppid=624 vsize=6059072 CPUtime=4842.37 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 385826 0 0 0 484155 82 0 0 25 0 8 0 788456726 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=6059072 CPUtime=4842.38 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 276234 0 0 0 484187 51 0 0 25 0 8 0 788456726 6204489728 1247304 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 38648.5
Current children cumulated vsize (KiB) 6059072

[startup+4902.3 s]
/proc/loadavg: 8.06 8.08 8.00 9/536 779
/proc/meminfo: memFree=16788404/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=6124608 CPUtime=39127.4 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 20878206 0 0 0 3909293 3446 0 0 25 0 8 0 788456724 6271598592 1248833 33554432000 4194304 4625164 140734405159584 18446744073709551615 4329151 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 1531152 1248833 349 106 0 1526655 0
[pid=626/tid=628] ppid=624 vsize=6124608 CPUtime=4901.75 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 266726 0 0 0 490120 55 0 0 25 0 8 0 788456726 6271598592 1249916 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=6124608 CPUtime=4902.34 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 282400 0 0 0 490177 57 0 0 25 0 8 0 788456726 6271598592 1249930 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=6124608 CPUtime=4893.1 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 18044854 0 0 0 486414 2896 0 0 25 0 8 0 788456726 6271598592 1249948 33554432000 4194304 4625164 140734405159584 18446744073709551615 212039352769 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=631] ppid=624 vsize=6124608 CPUtime=4848 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 280546 0 0 0 484744 56 0 0 25 0 8 0 788456726 6271598592 1249960 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=632] ppid=624 vsize=6124608 CPUtime=4876.49 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 195413 0 0 0 487604 45 0 0 25 0 8 0 788456726 6271598592 1249978 33554432000 4194304 4625164 140734405159584 18446744073709551615 4348854 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=633] ppid=624 vsize=6124608 CPUtime=4902.39 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 385850 0 0 0 490157 82 0 0 25 0 8 0 788456726 6271598592 1249990 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=6124608 CPUtime=4902.4 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 276248 0 0 0 490189 51 0 0 25 0 8 0 788456726 6271598592 1250002 33554432000 4194304 4625164 140734405159584 18446744073709551615 4330841 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39127.4
Current children cumulated vsize (KiB) 6124608

[startup+4962.3 s]
/proc/loadavg: 8.06 8.08 8.00 9/536 780
/proc/meminfo: memFree=16773204/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=6059572 CPUtime=39606.3 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 21075264 0 0 0 3957145 3482 0 0 25 0 8 0 788456724 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4512818 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 1514893 1250029 348 106 0 1510396 0
[pid=626/tid=628] ppid=624 vsize=6059572 CPUtime=4961.73 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 266738 0 0 0 496118 55 0 0 25 0 8 0 788456726 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=6059572 CPUtime=4962.32 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 282541 0 0 0 496175 57 0 0 25 0 8 0 788456726 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351781 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=6059572 CPUtime=4953.07 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 18198905 0 0 0 492385 2922 0 0 25 0 8 0 788456726 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4334728 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=631] ppid=624 vsize=6059572 CPUtime=4907.98 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 280569 0 0 0 490742 56 0 0 25 0 8 0 788456726 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=632] ppid=624 vsize=6059572 CPUtime=4935.39 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 195799 0 0 0 493494 45 0 0 25 0 8 0 788456726 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4349779 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=633] ppid=624 vsize=6059572 CPUtime=4962.37 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 385868 0 0 0 496155 82 0 0 25 0 8 0 788456726 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=6059572 CPUtime=4962.38 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 276265 0 0 0 496187 51 0 0 25 0 8 0 788456726 6205001728 1250029 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 39606.3
Current children cumulated vsize (KiB) 6059572



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5011.7 s]
/proc/loadavg: 8.06 8.08 8.01 9/536 782
/proc/meminfo: memFree=16758048/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=6129036 CPUtime=40000.6 cores=0-7
/proc/626/stat : 626 (SArTagnan) R 624 626 590 0 -1 4202496 21366251 0 0 0 3996523 3535 0 0 25 0 8 0 788456724 6276132864 1256561 33554432000 4194304 4625164 140734405159584 18446744073709551615 4511904 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 1532259 1256561 439 106 0 1527762 0
[pid=626/tid=628] ppid=624 vsize=6129036 CPUtime=5011.16 cores=0-7
/proc/626/task/628/stat : 628 (SArTagnan) R 624 626 590 0 -1 4202560 266797 0 0 0 501061 55 0 0 25 0 8 0 788456726 6276132864 1256562 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 1 0 0 0
[pid=626/tid=629] ppid=624 vsize=6129036 CPUtime=5011.74 cores=0-7
/proc/626/task/629/stat : 629 (SArTagnan) R 624 626 590 0 -1 4202560 282760 0 0 0 501117 57 0 0 25 0 8 0 788456726 6276132864 1256562 33554432000 4194304 4625164 140734405159584 18446744073709551615 4351979 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=626/tid=630] ppid=624 vsize=6129036 CPUtime=5002.5 cores=0-7
/proc/626/task/630/stat : 630 (SArTagnan) R 624 626 590 0 -1 4202560 18479974 0 0 0 497277 2973 0 0 25 0 8 0 788456726 6276132864 1256562 33554432000 4194304 4625164 140734405159584 18446744073709551615 4335407 0 0 4096 2 0 0 0 -1 3 0 0 0
[pid=626/tid=631] ppid=624 vsize=6129036 CPUtime=4957.4 cores=0-7
/proc/626/task/631/stat : 631 (SArTagnan) R 624 626 590 0 -1 4202560 280622 0 0 0 495684 56 0 0 25 0 8 0 788456726 6276132864 1256562 33554432000 4194304 4625164 140734405159584 18446744073709551615 4488027 0 0 4096 2 0 0 0 -1 5 0 0 0
[pid=626/tid=632] ppid=624 vsize=6129036 CPUtime=4983.89 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4202560 196727 0 0 0 498343 46 0 0 25 0 8 0 788456726 6276132864 1256562 33554432000 4194304 4625164 140734405159584 18446744073709551615 4349019 0 0 4096 2 0 0 0 -1 7 0 0 0
[pid=626/tid=633] ppid=624 vsize=6129036 CPUtime=5011.8 cores=0-7
/proc/626/task/633/stat : 633 (SArTagnan) R 624 626 590 0 -1 4202560 385922 0 0 0 501097 83 0 0 25 0 8 0 788456726 6276132864 1256562 33554432000 4194304 4625164 140734405159584 18446744073709551615 4331101 0 0 4096 2 0 0 0 -1 0 0 0 0
[pid=626/tid=634] ppid=624 vsize=6129036 CPUtime=5011.81 cores=0-7
/proc/626/task/634/stat : 634 (SArTagnan) R 624 626 590 0 -1 4202560 276325 0 0 0 501130 51 0 0 25 0 8 0 788456726 6276132864 1256562 33554432000 4194304 4625164 140734405159584 18446744073709551615 4488046 0 0 4096 2 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 40000.6
Current children cumulated vsize (KiB) 6129036

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+5011.83 s]
/proc/loadavg: 8.06 8.08 8.01 9/536 782
/proc/meminfo: memFree=16758048/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=0 CPUtime=40000.9 cores=0-7
/proc/626/stat : 626 (SArTagnan) Z 624 626 590 0 -1 4203548 21366252 0 0 0 3996540 3545 0 0 25 0 2 0 788456724 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 0 0 0 0 0 0 0
[pid=626/tid=632] ppid=624 vsize=0 CPUtime=4983.99 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4203588 196727 0 0 0 498343 56 0 0 25 0 2 0 788456726 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.8
Current children cumulated vsize (KiB) 0

[startup+5011.9 s]
/proc/loadavg: 8.06 8.08 8.01 9/536 782
/proc/meminfo: memFree=16758048/32951124 swapFree=50328308/67111528
[pid=626] ppid=624 vsize=0 CPUtime=40000.9 cores=0-7
/proc/626/stat : 626 (SArTagnan) Z 624 626 590 0 -1 4203548 21366252 0 0 0 3996540 3553 0 0 25 0 2 0 788456724 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/626/statm: 0 0 0 0 0 0 0
[pid=626/tid=632] ppid=624 vsize=0 CPUtime=4984.07 cores=0-7
/proc/626/task/632/stat : 632 (SArTagnan) R 624 626 590 0 -1 4203588 196727 0 0 0 498343 64 0 0 25 0 2 0 788456726 0 0 33554432000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 40000.9
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 5011.95
CPU time (s): 40001
CPU user time (s): 39965.4
CPU system time (s): 35.5826
CPU usage (%): 798.112
Max. virtual memory (cumulated for all children) (KiB): 6278904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 39965.4
system time used= 35.5826
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21366252
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 5730
involuntary context switches= 171136

runsolver used 24.9282 second user time and 66.009 second system time

The end

Launcher Data 

Begin job on node146 at 2011-06-01 22:33:25
IDJOB=3439131
IDBENCH=83280
IDSOLVER=1936
FILE ID=node146/3439131-1306960404
RUNJOBID= node146-1306960404-614
PBS_JOBID= 13497605
Free space on /tmp= 73640 MiB

SOLVER NAME= SArTagnan 2011-05-15 (fixed)
BENCH NAME= SAT11/crafted/kullmann/VanDerWaerden/VanderWaerden_pd_3k/VanDerWaerden_pd_2-3-23_506.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3439131-1306960404/watcher-3439131-1306960404 -o /tmp/evaluation-result-3439131-1306960404/solver-3439131-1306960404 -C 40000 -W 5100 -M 31000  SArTagnan HOME/instance-3439131-1306960404.cnf -threads=8

TIME LIMIT= 40000 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 3c65ff80757b12edd41f8ee6da874877
RANDOM SEED=1261788837

node146.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21795816 kB
Buffers:        159444 kB
Cached:         261868 kB
SwapCached:       9256 kB
Active:       10607492 kB
Inactive:       252588 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21795816 kB
SwapTotal:    67111528 kB
SwapFree:     50328308 kB
Dirty:            1196 kB
Writeback:           0 kB
AnonPages:    10437324 kB
Mapped:          26588 kB
Slab:           125964 kB
PageTables:      98068 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 160668908 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73640 MiB
End job on node146 at 2011-06-01 23:56:58