Trace number 4103581

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 194.083 194.126

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-agg2.opb
MD5SUMba775969fc3da5c6701f023896ca8f88
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables9060
Total number of constraints429
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints429
Minimum length of a constraint30
Maximum length of a constraint1440
Number of terms in the objective function 6930
Biggest coefficient in the objective function 53730040872960
Number of bits for the biggest coefficient in the objective function 46
Sum of the numbers in the objective function 8516865379203027
Number of bits of the sum of numbers in the objective function 53
Biggest number in a constraint 22763326668800000
Number of bits of the biggest number in a constraint 55
Biggest sum of numbers in a constraint 46271983665442689
Number of bits of the biggest sum of numbers56
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c 2016-06-18T10:18:19+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103581-1466237899.opb"]
0.00/0.01	c use --random-gen="1184323747 446603208 3674124493 2472401096 329613328 3110127942 3455579929 225138342 50955802 2205009887 3916497271 2991520155 3136715468 4157336492 1521576666 1881482495 1446093105 1671255051 543516016 308632317 768367267 1656786638 2294544635 1087595475 2946155066 3323272702 3309613074 525427192 2510206892 1349162707 531149416 480379283 2704465951 3956731333 491921356 2142338432 439195705 155528946 2990807778 3443436515 372333502 2464570485 2561824898 2628743752 927641962 654916216 2497379562 3645778318 3895090772 328965590 113764799 1325554156 1826672491 3529994075 2004092541 1394938354 3680056395 3605762645 2581556097 519447033 4275762092 645258734 520411476 343098804 4173293469 142505262 3730216696 2484042587 4117650953 97592526 1258004 3867891811 392230633 4186660227 2630906742 2209351744 978303823 550869180 1659146291 1119130837 3739011193 218581968 3377277413 2344029212 3053993095 592349787 166612792 2484269950 4256353619 1052160985 1596642966 3882639494 2355997866 2003285962 1561879506 117381077 696592045 1400300877 4063980421 3462281122 4279255960 368666424 3769766668 683915117 1675203184 3121272865 3360777704 3211524080 2074166853 2944532912 3877063253 306528942 2159135420 2945910077 3539015249 1857564802 837232772 1773243465 2987444082 314914083 2009986694 3322153631 2016000201 2230652389 819641008 2911291989 2766117282 3656068063 343087894 4285297545 1915477611 938067623 2849723595 580808247 2849915859 3259595729 3621276555 1410597936 1211217836 3040713605 384762281 3738917198 4011132618 722965545 1304623411 3564801451 2599187569 3942030184 865554740 3236579772 572207383 2105644949 564823098 154837641 2460608365 1369216327 910891954 1553029061 2422495904 777617498 248655650 3804564532 2704093631 1123966699 2432964706 2004206570 64541915 3312768468 413051448 2073371547 3141553704 1393994771 275676826 3805339972 187531404 686614052 4255176884 4172713285 3944693694 10189581 1719403450 4282765349 299198397 869417988 2176182690 1507058405 2571832127 177158367 3666490044 3832134889 1042916418 336851272 573079942 3917792299 998922199 2002929756 396931705 1770057016 1177570352 11531768 3095974401 3630945065 2801312352 283273274 2118383483 2478745438 1067608960 4105658166 3114139219 4174018331 3610006681 2155803572 2631521846 330566210 1192363807 801724090 2975538299 504435675 3849994430 3998557186 686292757 2353421238 2817681419 3886222084 3474907621 2635796607 1443333458 3910893891 1163055904 4189948921 3480857307 3703253438 1808188953 929795040 1155243254 3519460495 1967557843 706610591 2671744294 4082310630 725726858 986422007 625878484 227628702 817900957 842002276 3867859232 3063231224 2428439993 456693033 3126791084 3350023583 298321392 2634470320 2110531474 1011428537 255 362436" option to reproduce the execution
0.19/0.21	c #vars 9060
0.19/0.21	c #constraints 429

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103581-1466237899/watcher-4103581-1466237899 -o /tmp/evaluation-result-4103581-1466237899/solver-4103581-1466237899 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103581-1466237899.opb 

pid=15737
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.17 2.10 2.05 3/179 15740
/proc/meminfo: memFree=29704204/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=715196 CPUtime=0 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 2664 0 0 0 0 0 0 0 20 0 4 0 25840327 732360704 3537 33554432000 4194304 16246674 140734703426464 140734703425888 13880264 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 179311 3545 441 2943 0 176205 0
[pid=15740/tid=15741] ppid=15737 vsize=732604 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 750186496 3603 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=736700 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 754380800 3621 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=740796 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 758575104 3636 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100178 s]
/proc/loadavg: 2.17 2.10 2.05 3/179 15740
/proc/meminfo: memFree=29704204/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=1303108 CPUtime=0.09 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 30731 0 0 0 6 3 0 0 20 0 4 0 25840327 1334382592 31542 33554432000 4194304 16246674 140734703426464 140734703425776 8058796 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 325777 31557 800 2943 0 322671 0
[pid=15740/tid=15741] ppid=15737 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 1334382592 31568 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 1334382592 31579 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 1334382592 31589 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200586 s]
/proc/loadavg: 2.17 2.10 2.05 3/179 15740
/proc/meminfo: memFree=29704204/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=1311300 CPUtime=0.19 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 40820 0 0 0 14 5 0 0 20 0 4 0 25840327 1342771200 42141 33554432000 4194304 16246674 140734703426464 140734703425776 7440106 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 327825 42141 801 2943 0 324719 0
[pid=15740/tid=15741] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 42141 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 42141 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 42141 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1311300

[startup+0.300456 s]
/proc/loadavg: 2.17 2.10 2.05 3/179 15740
/proc/meminfo: memFree=29704204/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=1311300 CPUtime=0.29 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 55014 0 0 0 23 6 0 0 20 0 4 0 25840327 1342771200 56338 33554432000 4194304 16246674 140734703426464 140734703425776 12449273 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 327825 56353 821 2943 0 324719 0
[pid=15740/tid=15741] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 56361 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 56370 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 56380 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1311300

[startup+0.700423 s]
/proc/loadavg: 2.17 2.10 2.05 3/179 15740
/proc/meminfo: memFree=29704204/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=1311300 CPUtime=0.68 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 148422 0 0 0 50 18 0 0 20 0 4 0 25840327 1342771200 149743 33554432000 4194304 16246674 140734703426464 140734703408384 12429797 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 327825 149750 821 2943 0 324719 0
[pid=15740/tid=15741] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 149754 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 149758 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=1311300 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 1342771200 149761 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 1311300

[startup+1.50043 s]
/proc/loadavg: 2.17 2.10 2.05 3/183 15744
/proc/meminfo: memFree=28677152/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=1359428 CPUtime=1.49 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 280256 0 0 0 114 35 0 0 20 0 4 0 25840327 1392054272 281577 33554432000 4194304 16246674 140734703426464 140734703408384 12371280 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 339857 281577 833 2943 0 336751 0
[pid=15740/tid=15741] ppid=15737 vsize=1359428 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 1392054272 281577 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=1359428 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 1392054272 281577 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=1359428 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 1392054272 281577 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1359428

[startup+3.10044 s]
/proc/loadavg: 2.17 2.10 2.05 3/183 15744
/proc/meminfo: memFree=28572852/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=1474116 CPUtime=3.09 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 308901 0 0 0 270 39 0 0 20 0 4 0 25840327 1509494784 310222 33554432000 4194304 16246674 140734703426464 140734703425776 12449269 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 368529 310222 833 2943 0 365423 0
[pid=15740/tid=15741] ppid=15737 vsize=1474116 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 1509494784 310222 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=1474116 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 1509494784 310222 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=1474116 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 1509494784 310222 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1474116

[startup+6.30042 s]
/proc/loadavg: 2.16 2.10 2.05 3/183 15744
/proc/meminfo: memFree=28340276/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=1618500 CPUtime=6.29 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 345240 0 0 0 586 43 0 0 20 0 4 0 25840327 1657344000 346561 33554432000 4194304 16246674 140734703426464 140734703425776 4220888 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 404625 346561 833 2943 0 401519 0
[pid=15740/tid=15741] ppid=15737 vsize=1618500 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 1657344000 346561 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=1618500 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 1657344000 346561 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=1618500 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 1657344000 346561 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1618500

[startup+12.7005 s]
/proc/loadavg: 2.14 2.10 2.05 3/183 15744
/proc/meminfo: memFree=27127100/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=2786884 CPUtime=12.69 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 637338 0 0 0 1191 78 0 0 20 0 4 0 25840327 2853769216 638659 33554432000 4194304 16246674 140734703426464 140734703425560 4220543 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 696721 638659 834 2943 0 693615 0
[pid=15740/tid=15741] ppid=15737 vsize=2786884 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 2853769216 638659 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=2786884 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 2853769216 638659 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=2786884 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 2853769216 638659 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 2786884

[startup+25.5005 s]
/proc/loadavg: 2.18 2.11 2.05 3/183 15744
/proc/meminfo: memFree=25191832/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=4690500 CPUtime=25.49 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 1113242 0 0 0 2405 144 0 0 20 0 4 0 25840327 4803072000 1114563 33554432000 4194304 16246674 140734703426464 140734703424320 4220850 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 1172625 1114563 834 2943 0 1169519 0
[pid=15740/tid=15741] ppid=15737 vsize=4690500 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 4803072000 1114563 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=4690500 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 4803072000 1114563 33554432000 4194304 16246674 140734703426464 139957670747152 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=4690500 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 4803072000 1114563 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 4690500

[startup+51.1005 s]
/proc/loadavg: 2.25 2.13 2.06 4/183 15744
/proc/meminfo: memFree=20730016/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=9089604 CPUtime=51.08 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 2213020 0 0 0 4814 294 0 0 20 0 4 0 25840327 9307754496 2214341 33554432000 4194304 16246674 140734703426464 140734703425560 4220850 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 2272401 2214341 834 2943 0 2269295 0
[pid=15740/tid=15741] ppid=15737 vsize=9089604 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 9307754496 2214341 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=9089604 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 9307754496 2214341 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=9089604 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 9307754496 2214341 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9089604

[startup+102.301 s]
/proc/loadavg: 2.18 2.12 2.06 3/184 15748
/proc/meminfo: memFree=18093304/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=11608644 CPUtime=102.28 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 2842786 0 0 0 9848 380 0 0 20 0 4 0 25840327 11887251456 2844107 33554432000 4194304 16246674 140734703426464 140734703425640 4220921 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 2902161 2844107 839 2943 0 2899055 0
[pid=15740/tid=15741] ppid=15737 vsize=11608644 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 11887251456 2844107 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=11608644 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 11887251456 2844107 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=11608644 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 11887251456 2844107 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 11608644

[startup+162.3 s]
/proc/loadavg: 2.12 2.11 2.06 3/184 15750
/proc/meminfo: memFree=16546844/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=13021764 CPUtime=162.27 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 3102506 0 0 0 15804 423 0 0 20 0 4 0 25840327 13334286336 3197340 33554432000 4194304 16246674 140734703426464 140734703424384 14006494 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 3255441 3197340 839 2943 0 3252335 0
[pid=15740/tid=15741] ppid=15737 vsize=13021764 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 13334286336 3197340 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=13021764 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 13334286336 3197340 33554432000 4194304 16246674 140734703426464 139957670747152 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=13021764 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 13334286336 3197340 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 13021764



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+193.3 s]
/proc/loadavg: 2.32 2.16 2.08 3/183 15751
/proc/meminfo: memFree=13976404/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=15877700 CPUtime=193.26 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) R 15737 15740 11324 0 -1 4202496 3816399 0 0 0 18808 518 0 0 20 0 4 0 25840327 16258764800 3911233 33554432000 4194304 16246674 140734703426464 140734703425560 4225154 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 3969425 3911242 839 2943 0 3966319 0
[pid=15740/tid=15741] ppid=15737 vsize=15877700 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15741/stat : 15741 (toysat) S 15737 15740 11324 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 4 0 25840327 16258764800 3911249 33554432000 4194304 16246674 140734703426464 139957681237232 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=15877700 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) S 15737 15740 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25840327 16258764800 3911253 33554432000 4194304 16246674 140734703426464 139957670747376 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=15740/tid=15743] ppid=15737 vsize=15877700 CPUtime=0 cores=1,3,5,7
/proc/15740/task/15743/stat : 15743 (toysat) S 15737 15740 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25840327 16258764800 3911259 33554432000 4194304 16246674 140734703426464 139957549132976 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 193.26
Current children cumulated vsize (KiB) 15877700

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 15740 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+193.6 s]
/proc/loadavg: 2.30 2.16 2.08 3/181 15751
/proc/meminfo: memFree=19151488/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=0 CPUtime=193.57 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) Z 15737 15740 11324 0 -1 4203532 3816904 0 0 0 18809 548 0 0 20 0 2 0 25840327 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 0 0 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=0 CPUtime=0.29 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) R 15737 15740 11324 0 -1 4203588 8 0 0 0 0 29 0 0 20 0 2 0 25840327 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 193.57
Current children cumulated vsize (KiB) 0

[startup+194 s]
/proc/loadavg: 2.30 2.16 2.08 3/181 15751
/proc/meminfo: memFree=19151488/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=0 CPUtime=193.96 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) Z 15737 15740 11324 0 -1 4203532 3816904 0 0 0 18809 587 0 0 20 0 2 0 25840327 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 0 0 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=0 CPUtime=0.68 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) R 15737 15740 11324 0 -1 4203588 8 0 0 0 0 68 0 0 20 0 2 0 25840327 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 193.96
Current children cumulated vsize (KiB) 0

[startup+194.1 s]
/proc/loadavg: 2.30 2.16 2.08 3/181 15751
/proc/meminfo: memFree=19151488/32872528 swapFree=249320/249320
[pid=15740] ppid=15737 vsize=0 CPUtime=194.06 cores=1,3,5,7
/proc/15740/stat : 15740 (toysat) Z 15737 15740 11324 0 -1 4203532 3816904 0 0 0 18809 597 0 0 20 0 2 0 25840327 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/15740/statm: 0 0 0 0 0 0 0
[pid=15740/tid=15742] ppid=15737 vsize=0 CPUtime=0.78 cores=1,3,5,7
/proc/15740/task/15742/stat : 15742 (toysat) R 15737 15740 11324 0 -1 4203588 8 0 0 0 0 78 0 0 20 0 2 0 25840327 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 194.06
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 194.126
CPU time (s): 194.083
CPU user time (s): 188.088
CPU system time (s): 5.99409
CPU usage (%): 99.9775
Max. virtual memory (cumulated for all children) (KiB): 15877700

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 188.088
system time used= 5.99409
maximum resident set size= 15646952
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3816904
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 60
involuntary context switches= 212

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.957854 second user time and 2.14067 second system time

The end

Launcher Data

Begin job on node103 at 2016-06-18 10:18:19
IDJOB=4103581
IDBENCH=2400
IDSOLVER=2542
FILE ID=node103/4103581-1466237899
RUNJOBID= node103-1466206104-11341
PBS_JOBID= 19918169
Free space on /tmp= 71712 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-agg2.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103581-1466237899/watcher-4103581-1466237899 -o /tmp/evaluation-result-4103581-1466237899/solver-4103581-1466237899 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103581-1466237899.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ba775969fc3da5c6701f023896ca8f88
RANDOM SEED=335651105

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29704252 kB
Buffers:          127888 kB
Cached:           132692 kB
SwapCached:         2188 kB
Active:          2005084 kB
Inactive:         170908 kB
Active(anon):    1913744 kB
Inactive(anon):     3672 kB
Active(file):      91340 kB
Inactive(file):   167236 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             17848 kB
Writeback:             0 kB
AnonPages:       2167388 kB
Mapped:            10708 kB
Shmem:                 0 kB
Slab:             602700 kB
SReclaimable:      46384 kB
SUnreclaim:       556316 kB
KernelStack:        1448 kB
PageTables:         8220 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    2309716 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    288768 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71696 MiB
End job on node103 at 2016-06-18 10:21:33