Trace number 3249946

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
SArTagnan 2011-03-24? (TO) 4800.49 1202.11

General information on the benchmark

Namecrafted/skvortsov/automata-synchronization/
crn_40_1520_u.cnf
MD5SUMac02a3a5c06227748ecf75dd451ebb7e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables63840
Number of clauses123900
Sum of the clauses size369320
Maximum clause length3
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 22380
Number of clauses of size 3121520
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data


Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3249946-1304089882/watcher-3249946-1304089882 -o /tmp/evaluation-result-3249946-1304089882/solver-3249946-1304089882 -C 4800 -W 1300 -M 15500 SArTagnan HOME/instance-3249946-1304089882.cnf -threads=4 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.06 6.66 7.10 5/180 1593
/proc/meminfo: memFree=30489452/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=19348 CPUtime=0 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 617 0 0 0 0 0 0 0 25 0 1 0 501404168 19812352 554 33554432000 4194304 4623224 140735477603328 18446744073709551615 4315013 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/1593/statm: 4837 556 290 105 0 341 0

[startup+0.062133 s]
/proc/loadavg: 8.06 6.66 7.10 5/180 1593
/proc/meminfo: memFree=30489452/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=36684 CPUtime=0.05 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 7384 0 0 0 5 0 0 0 25 0 1 0 501404168 37564416 4100 33554432000 4194304 4623224 140735477603328 18446744073709551615 4366247 0 0 4096 2 0 0 0 17 4 0 0 0
/proc/1593/statm: 9171 4101 297 105 0 4675 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 36684

[startup+0.147955 s]
/proc/loadavg: 8.06 6.66 7.10 5/180 1593
/proc/meminfo: memFree=30489452/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=251220 CPUtime=0.3 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 22230 0 0 0 28 2 0 0 25 0 4 0 501404168 257249280 15226 33554432000 4194304 4623224 140735477603328 18446744073709551615 4366247 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 62805 15227 338 105 0 58309 0
Current children cumulated CPU time (s) 0.3
Current children cumulated vsize (KiB) 251220

[startup+0.310197 s]
/proc/loadavg: 8.06 6.66 7.10 5/180 1593
/proc/meminfo: memFree=30489452/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=345736 CPUtime=1 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) D 1591 1593 32751 0 -1 4202496 41419 0 0 0 96 4 0 0 18 0 4 0 501404168 354033664 24936 33554432000 4194304 4623224 140735477603328 18446744073709551615 4279912 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 86434 24862 340 105 0 81938 0
Current children cumulated CPU time (s) 1
Current children cumulated vsize (KiB) 345736

[startup+1.50382 s]
/proc/loadavg: 8.06 6.66 7.10 5/180 1593
/proc/meminfo: memFree=30489452/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=456096 CPUtime=5.68 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 117889 0 0 0 552 16 0 0 19 0 4 0 501404168 467042304 56232 33554432000 4194304 4623224 140735477603328 18446744073709551615 220815903706 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 114024 56232 344 105 0 109528 0
Current children cumulated CPU time (s) 5.68
Current children cumulated vsize (KiB) 456096

[startup+1.60081 s]
/proc/loadavg: 8.06 6.66 7.10 5/180 1593
/proc/meminfo: memFree=30489452/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=456096 CPUtime=6.07 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 118367 0 0 0 591 16 0 0 19 0 4 0 501404168 467042304 56300 33554432000 4194304 4623224 140735477603328 18446744073709551615 4414508 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 114024 56300 344 105 0 109528 0
Current children cumulated CPU time (s) 6.07
Current children cumulated vsize (KiB) 456096

[startup+3.10053 s]
/proc/loadavg: 8.06 6.66 7.10 9/184 1597
/proc/meminfo: memFree=30261880/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=456096 CPUtime=12.06 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 129818 0 0 0 1188 18 0 0 22 0 4 0 501404168 467042304 58623 33554432000 4194304 4623224 140735477603328 18446744073709551615 4360030 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 114024 58623 344 105 0 109528 0
[pid=1593/tid=1595] ppid=1591 vsize=456096 CPUtime=2.98 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 18352 0 0 0 297 1 0 0 23 0 4 0 501404177 467042304 58623 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=456096 CPUtime=2.98 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 18314 0 0 0 297 1 0 0 23 0 4 0 501404177 467042304 58623 33554432000 4194304 4623224 140735477603328 18446744073709551615 4462398 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=456096 CPUtime=2.99 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 30021 0 0 0 295 4 0 0 23 0 4 0 501404177 467042304 58623 33554432000 4194304 4623224 140735477603328 18446744073709551615 4550548 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.06
Current children cumulated vsize (KiB) 456096

[startup+6.30694 s]
/proc/loadavg: 8.06 6.68 7.11 9/184 1597
/proc/meminfo: memFree=30250408/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=476800 CPUtime=24.86 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 158177 0 0 0 2464 22 0 0 25 0 4 0 501404168 488243200 60621 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 119200 60621 344 105 0 114704 0
[pid=1593/tid=1595] ppid=1591 vsize=476800 CPUtime=6.19 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 24161 0 0 0 617 2 0 0 25 0 4 0 501404177 488243200 60621 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=476800 CPUtime=6.19 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 24198 0 0 0 617 2 0 0 25 0 4 0 501404177 488243200 60621 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=476800 CPUtime=6.19 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 46131 0 0 0 613 6 0 0 25 0 4 0 501404177 488243200 60621 33554432000 4194304 4623224 140735477603328 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 24.86
Current children cumulated vsize (KiB) 476800

[startup+12.7008 s]
/proc/loadavg: 8.05 6.71 7.11 9/184 1598
/proc/meminfo: memFree=30221040/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=487156 CPUtime=50.41 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 218404 0 0 0 5009 32 0 0 25 0 4 0 501404168 498847744 66295 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510680 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 121789 66295 344 105 0 117293 0
[pid=1593/tid=1595] ppid=1591 vsize=487156 CPUtime=12.59 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 25436 0 0 0 1256 3 0 0 25 0 4 0 501404177 498847744 66295 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=487156 CPUtime=12.58 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 25352 0 0 0 1256 2 0 0 25 0 4 0 501404177 498847744 66295 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=487156 CPUtime=12.59 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 96640 0 0 0 1245 14 0 0 25 0 4 0 501404177 498847744 66295 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.41
Current children cumulated vsize (KiB) 487156

[startup+25.5004 s]
/proc/loadavg: 8.04 6.77 7.12 9/184 1598
/proc/meminfo: memFree=30157416/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=544120 CPUtime=101.52 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 381943 0 0 0 10097 55 0 0 25 0 4 0 501404168 557178880 78804 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 136030 78804 344 105 0 131534 0
[pid=1593/tid=1595] ppid=1591 vsize=544120 CPUtime=25.39 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 35054 0 0 0 2535 4 0 0 25 0 4 0 501404177 557178880 78804 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=544120 CPUtime=25.38 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 35555 0 0 0 2534 4 0 0 25 0 4 0 501404177 557178880 78804 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=544120 CPUtime=25.36 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 229200 0 0 0 2503 33 0 0 25 0 4 0 501404177 557178880 78804 33554432000 4194304 4623224 140735477603328 18446744073709551615 4545674 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 101.52
Current children cumulated vsize (KiB) 544120

[startup+51.1007 s]
/proc/loadavg: 8.15 6.90 7.16 9/184 1599
/proc/meminfo: memFree=30055828/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=585216 CPUtime=203.79 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 589209 0 0 0 20291 88 0 0 25 0 4 0 501404168 599261184 97847 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 146304 97847 344 105 0 141808 0
[pid=1593/tid=1595] ppid=1591 vsize=585216 CPUtime=50.99 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 38028 0 0 0 5094 5 0 0 25 0 4 0 501404177 599261184 97847 33554432000 4194304 4623224 140735477603328 18446744073709551615 4377652 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=585216 CPUtime=50.97 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 39783 0 0 0 5092 5 0 0 25 0 4 0 501404177 599261184 97847 33554432000 4194304 4623224 140735477603328 18446744073709551615 220815894957 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=585216 CPUtime=50.82 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 417669 0 0 0 5021 61 0 0 25 0 4 0 501404177 599261184 97847 33554432000 4194304 4623224 140735477603328 18446744073709551615 4565982 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 203.79
Current children cumulated vsize (KiB) 585216

[startup+102.3 s]
/proc/loadavg: 8.19 7.10 7.21 9/184 1600
/proc/meminfo: memFree=29896084/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=666068 CPUtime=408.29 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 1134714 0 0 0 40660 169 0 0 25 0 4 0 501404168 682053632 129015 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510034 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 166517 129015 344 105 0 162021 0
[pid=1593/tid=1595] ppid=1591 vsize=666068 CPUtime=102.19 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 54875 0 0 0 10210 9 0 0 25 0 4 0 501404177 682053632 129015 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=666068 CPUtime=102.16 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 57200 0 0 0 10208 8 0 0 25 0 4 0 501404177 682053632 129015 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=666068 CPUtime=101.73 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 909530 0 0 0 10041 132 0 0 25 0 4 0 501404177 682053632 129015 33554432000 4194304 4623224 140735477603328 18446744073709551615 4577415 0 0 4096 2 0 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 408.29
Current children cumulated vsize (KiB) 666068

[startup+162.301 s]
/proc/loadavg: 8.13 7.27 7.26 9/184 1602
/proc/meminfo: memFree=29746764/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=956404 CPUtime=647.97 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 1683449 0 0 0 64545 252 0 0 25 0 4 0 501404168 979357696 159940 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510316 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 239101 159941 344 105 0 234605 0
[pid=1593/tid=1595] ppid=1591 vsize=956404 CPUtime=162.19 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 78738 0 0 0 16207 12 0 0 25 0 4 0 501404177 979357696 159941 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=956404 CPUtime=162.16 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 86779 0 0 0 16203 13 0 0 25 0 4 0 501404177 979357696 159941 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376672 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=956404 CPUtime=161.71 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 1371165 0 0 0 15969 202 0 0 25 0 4 0 501404177 979357696 159941 33554432000 4194304 4623224 140735477603328 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 647.97
Current children cumulated vsize (KiB) 956404

[startup+222.301 s]
/proc/loadavg: 8.10 7.42 7.31 9/184 1603
/proc/meminfo: memFree=29539908/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=1118224 CPUtime=887.63 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 2037193 0 0 0 88453 310 0 0 25 0 4 0 501404168 1145061376 197213 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510090 0 0 4096 2 18446744073709551615 0 0 17 6 0 0 0
/proc/1593/statm: 279556 197214 344 105 0 275060 0
[pid=1593/tid=1595] ppid=1591 vsize=1118224 CPUtime=222.19 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 84831 0 0 0 22205 14 0 0 25 0 4 0 501404177 1145061376 197214 33554432000 4194304 4623224 140735477603328 18446744073709551615 4366381 0 0 4096 2 0 0 0 -1 4 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=1118224 CPUtime=222.16 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 92528 0 0 0 22201 15 0 0 25 0 4 0 501404177 1145061376 197214 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=1118224 CPUtime=221.71 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 1699657 0 0 0 21917 254 0 0 25 0 4 0 501404177 1145061376 197215 33554432000 4194304 4623224 140735477603328 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 887.63
Current children cumulated vsize (KiB) 1118224

[startup+282.301 s]
/proc/loadavg: 8.08 7.54 7.36 9/184 1605
/proc/meminfo: memFree=29357848/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=1260456 CPUtime=1127.32 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 2790182 0 0 0 112312 420 0 0 25 0 4 0 501404168 1290706944 229863 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 315114 229863 344 105 0 310618 0
[pid=1593/tid=1595] ppid=1591 vsize=1260456 CPUtime=282.19 cores=0,2,4,6

################
# More data... #
################

[pid=1593] ppid=1591 vsize=1851184 CPUtime=2565.29 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 5516266 0 0 0 255701 828 0 0 25 0 4 0 501404168 1895612416 362199 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 462796 362199 344 105 0 458300 0
[pid=1593/tid=1595] ppid=1591 vsize=1851184 CPUtime=640.33 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 147765 0 0 0 64003 30 0 0 25 0 4 0 501404177 1895612416 362199 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=1851184 CPUtime=642.13 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 143455 0 0 0 64189 24 0 0 25 0 4 0 501404177 1895612416 362199 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=1851184 CPUtime=641.47 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 4939986 0 0 0 63425 722 0 0 25 0 4 0 501404177 1895612416 362199 33554432000 4194304 4623224 140735477603328 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2565.29
Current children cumulated vsize (KiB) 1851184

[startup+702.301 s]
/proc/loadavg: 8.02 7.90 7.58 9/184 1616
/proc/meminfo: memFree=28354344/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2042108 CPUtime=2804.96 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 5933321 0 0 0 279608 888 0 0 25 0 4 0 501404168 2091118592 382997 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510206 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 510527 382997 344 105 0 506031 0
[pid=1593/tid=1595] ppid=1591 vsize=2042108 CPUtime=700.02 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 192764 0 0 0 69964 38 0 0 25 0 4 0 501404177 2091118592 382997 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376629 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2042108 CPUtime=702.13 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 144552 0 0 0 70188 25 0 0 25 0 4 0 501404177 2091118592 382997 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2042108 CPUtime=701.48 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 5273501 0 0 0 69379 769 0 0 25 0 4 0 501404177 2091118592 382997 33554432000 4194304 4623224 140735477603328 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 2804.96
Current children cumulated vsize (KiB) 2042108

[startup+762.301 s]
/proc/loadavg: 8.00 7.92 7.61 9/184 1618
/proc/meminfo: memFree=28291936/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2043168 CPUtime=3044.63 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 6151393 0 0 0 303537 926 0 0 25 0 4 0 501404168 2092204032 394386 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510627 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 510792 394386 344 105 0 506296 0
[pid=1593/tid=1595] ppid=1591 vsize=2043168 CPUtime=759.68 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 197746 0 0 0 75927 41 0 0 25 0 4 0 501404177 2092204032 394386 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2043168 CPUtime=762.12 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 145243 0 0 0 76187 25 0 0 25 0 4 0 501404177 2092204032 394386 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2043168 CPUtime=761.47 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 5482068 0 0 0 75346 801 0 0 25 0 4 0 501404177 2092204032 394386 33554432000 4194304 4623224 140735477603328 18446744073709551615 4545353 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3044.63
Current children cumulated vsize (KiB) 2043168

[startup+822.3 s]
/proc/loadavg: 8.00 7.93 7.63 10/185 1622
/proc/meminfo: memFree=28172244/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2105740 CPUtime=3284.22 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 6406001 0 0 0 327461 961 0 0 25 0 4 0 501404168 2156277760 411605 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 526435 411605 344 105 0 521939 0
[pid=1593/tid=1595] ppid=1591 vsize=2105740 CPUtime=819.35 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 203049 0 0 0 81892 43 0 0 25 0 4 0 501404177 2156277760 411605 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2105740 CPUtime=822.04 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 146367 0 0 0 82178 26 0 0 25 0 4 0 501404177 2156277760 411605 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376745 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2105740 CPUtime=821.48 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 5725937 0 0 0 81314 834 0 0 25 0 4 0 501404177 2156277760 411605 33554432000 4194304 4623224 140735477603328 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3284.22
Current children cumulated vsize (KiB) 2105740

[startup+882.3 s]
/proc/loadavg: 8.24 8.02 7.68 9/184 1624
/proc/meminfo: memFree=28041768/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2171276 CPUtime=3523.16 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 6927963 0 0 0 351281 1035 0 0 25 0 4 0 501404168 2223386624 431890 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 542819 431890 344 105 0 538323 0
[pid=1593/tid=1595] ppid=1591 vsize=2171276 CPUtime=879.01 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 210010 0 0 0 87856 45 0 0 25 0 4 0 501404177 2223386624 431890 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376766 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2171276 CPUtime=881.4 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 147817 0 0 0 88114 26 0 0 25 0 4 0 501404177 2223386624 431890 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376895 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2171276 CPUtime=881.39 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 6234778 0 0 0 87236 903 0 0 25 0 4 0 501404177 2223386624 431890 33554432000 4194304 4623224 140735477603328 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3523.16
Current children cumulated vsize (KiB) 2171276

[startup+942.3 s]
/proc/loadavg: 8.09 8.02 7.70 9/184 1625
/proc/meminfo: memFree=27972164/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2171276 CPUtime=3762.84 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 7733469 0 0 0 375136 1148 0 0 25 0 4 0 501404168 2223386624 440277 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510064 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 542819 440277 344 105 0 538323 0
[pid=1593/tid=1595] ppid=1591 vsize=2171276 CPUtime=938.68 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 214303 0 0 0 93821 47 0 0 25 0 4 0 501404177 2223386624 440277 33554432000 4194304 4623224 140735477603328 18446744073709551615 4366381 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2171276 CPUtime=941.4 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 148924 0 0 0 94113 27 0 0 25 0 4 0 501404177 2223386624 440277 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2171276 CPUtime=941.4 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 7032034 0 0 0 93127 1013 0 0 25 0 4 0 501404177 2223386624 440277 33554432000 4194304 4623224 140735477603328 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3762.84
Current children cumulated vsize (KiB) 2171276

[startup+1002.3 s]
/proc/loadavg: 8.03 8.01 7.72 9/184 1627
/proc/meminfo: memFree=27858796/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2310780 CPUtime=4002.49 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 8762434 0 0 0 398956 1293 0 0 25 0 4 0 501404168 2366238720 455019 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 577695 455020 345 105 0 573199 0
[pid=1593/tid=1595] ppid=1591 vsize=2310780 CPUtime=998.35 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 218250 0 0 0 99787 48 0 0 25 0 4 0 501404177 2366238720 455020 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2310780 CPUtime=1001.39 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 191764 0 0 0 100107 32 0 0 25 0 4 0 501404177 2366238720 455020 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376612 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2310780 CPUtime=1001.39 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 8011397 0 0 0 98988 1151 0 0 25 0 4 0 501404177 2366238720 455020 33554432000 4194304 4623224 140735477603328 18446744073709551615 4366247 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4002.49
Current children cumulated vsize (KiB) 2310780

[startup+1062.31 s]
/proc/loadavg: 6.71 7.70 7.63 5/175 1647
/proc/meminfo: memFree=29069344/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2428960 CPUtime=4242.2 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 9776884 0 0 0 422774 1446 0 0 25 0 4 0 501404168 2487255040 463427 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 607240 463427 344 105 0 602744 0
[pid=1593/tid=1595] ppid=1591 vsize=2428960 CPUtime=1058.05 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 220605 0 0 0 105756 49 0 0 25 0 4 0 501404177 2487255040 463427 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2428960 CPUtime=1061.4 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 193010 0 0 0 106107 33 0 0 25 0 4 0 501404177 2487255040 463427 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376892 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2428960 CPUtime=1061.39 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 8960139 0 0 0 104844 1295 0 0 25 0 4 0 501404177 2487255040 463427 33554432000 4194304 4623224 140735477603328 18446744073709551615 4545376 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4242.2
Current children cumulated vsize (KiB) 2428960

[startup+1122.3 s]
/proc/loadavg: 5.05 7.04 7.41 5/175 1648
/proc/meminfo: memFree=29022172/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2546980 CPUtime=4481.9 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 10437356 0 0 0 446646 1544 0 0 25 0 4 0 501404168 2608107520 475430 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510169 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 636745 475430 344 105 0 632249 0
[pid=1593/tid=1595] ppid=1591 vsize=2546980 CPUtime=1117.77 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 283144 0 0 0 111720 57 0 0 25 0 4 0 501404177 2608107520 475430 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2546980 CPUtime=1121.38 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 193908 0 0 0 112105 33 0 0 25 0 4 0 501404177 2608107520 475430 33554432000 4194304 4623224 140735477603328 18446744073709551615 4357655 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2546980 CPUtime=1121.38 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 9553461 0 0 0 110755 1383 0 0 25 0 4 0 501404177 2608107520 475430 33554432000 4194304 4623224 140735477603328 18446744073709551615 4363989 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4481.9
Current children cumulated vsize (KiB) 2546980

[startup+1182.3 s]
/proc/loadavg: 4.38 6.49 7.19 5/175 1650
/proc/meminfo: memFree=28986400/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2546980 CPUtime=4721.63 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 11124145 0 0 0 470518 1645 0 0 25 0 4 0 501404168 2608107520 479052 33554432000 4194304 4623224 140735477603328 18446744073709551615 4511029 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 636745 479052 344 105 0 632249 0
[pid=1593/tid=1595] ppid=1591 vsize=2546980 CPUtime=1177.5 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 285680 0 0 0 117692 58 0 0 25 0 4 0 501404177 2608107520 479052 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376827 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2546980 CPUtime=1181.38 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 194396 0 0 0 118105 33 0 0 25 0 4 0 501404177 2608107520 479052 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376869 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2546980 CPUtime=1181.38 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 10234482 0 0 0 116657 1481 0 0 25 0 4 0 501404177 2608107520 479052 33554432000 4194304 4623224 140735477603328 18446744073709551615 4545431 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4721.63
Current children cumulated vsize (KiB) 2546980



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1202.01 s]
/proc/loadavg: 4.27 6.32 7.12 6/175 1650
/proc/meminfo: memFree=28975476/32951124 swapFree=67105204/67111528
[pid=1593] ppid=1591 vsize=2546980 CPUtime=4800.36 cores=0,2,4,6
/proc/1593/stat : 1593 (SArTagnan) R 1591 1593 32751 0 -1 4202496 11318466 0 0 0 478362 1674 0 0 25 0 4 0 501404168 2608107520 486902 33554432000 4194304 4623224 140735477603328 18446744073709551615 4510472 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/1593/statm: 636745 486902 344 105 0 632249 0
[pid=1593/tid=1595] ppid=1591 vsize=2546980 CPUtime=1197.11 cores=0,2,4,6
/proc/1593/task/1595/stat : 1595 (SArTagnan) R 1591 1593 32751 0 -1 4202560 286654 0 0 0 119653 58 0 0 25 0 4 0 501404177 2608107520 486902 33554432000 4194304 4623224 140735477603328 18446744073709551615 4377786 0 0 4096 2 0 0 0 -1 6 0 0 0
[pid=1593/tid=1596] ppid=1591 vsize=2546980 CPUtime=1201.09 cores=0,2,4,6
/proc/1593/task/1596/stat : 1596 (SArTagnan) R 1591 1593 32751 0 -1 4202560 194517 0 0 0 120076 33 0 0 25 0 4 0 501404177 2608107520 486902 33554432000 4194304 4623224 140735477603328 18446744073709551615 4376711 0 0 4096 2 0 0 0 -1 2 0 0 0
[pid=1593/tid=1597] ppid=1591 vsize=2546980 CPUtime=1201.1 cores=0,2,4,6
/proc/1593/task/1597/stat : 1597 (SArTagnan) R 1591 1593 32751 0 -1 4202560 10426776 0 0 0 118600 1510 0 0 25 0 4 0 501404177 2608107520 486902 33554432000 4194304 4623224 140735477603328 18446744073709551615 4364232 0 0 4096 2 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 4800.36
Current children cumulated vsize (KiB) 2546980

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)
Real time (s): 1202.11
CPU time (s): 4800.49
CPU user time (s): 4783.66
CPU system time (s): 16.8314
CPU usage (%): 399.34
Max. virtual memory (cumulated for all children) (KiB): 2782976

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 4783.66
system time used= 16.8314
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11318466
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2796
involuntary context switches= 22878

runsolver used 2.04169 second user time and 4.36534 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 17:11:23
IDJOB=3249946
IDBENCH=83198
IDSOLVER=1656
FILE ID=node147/3249946-1304089882
RUNJOBID= node147-1304089710-1416
PBS_JOBID= 13170522
Free space on /tmp= 72656 MiB

SOLVER NAME= SArTagnan 2011-03-24
BENCH NAME= SAT11/crafted/skvortsov/automata-synchronization/crn_40_1520_u.cnf
COMMAND LINE= SArTagnan BENCHNAME -threads=NBCORE
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3249946-1304089882/watcher-3249946-1304089882 -o /tmp/evaluation-result-3249946-1304089882/solver-3249946-1304089882 -C 4800 -W 1300 -M 15500  SArTagnan HOME/instance-3249946-1304089882.cnf -threads=4

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac02a3a5c06227748ecf75dd451ebb7e
RANDOM SEED=320110319

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30489608 kB
Buffers:        272444 kB
Cached:        1367696 kB
SwapCached:       2936 kB
Active:         564064 kB
Inactive:      1573564 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30489608 kB
SwapTotal:    67111528 kB
SwapFree:     67105204 kB
Dirty:            3248 kB
Writeback:           0 kB
AnonPages:      495840 kB
Mapped:          15316 kB
Slab:           260388 kB
PageTables:       5252 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   756516 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72656 MiB
End job on node147 at 2011-04-29 17:31:27