Trace number 4103185

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
toysat 2016-05-02? (MO) 185.178 185.215

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/fctp/normalized-mps-v2-20-10-n370e.opb
MD5SUM2ed7df63a411bcdd93a5895df0fcaa15
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark9488653097
Best CPU time to get the best result obtained on this benchmark1800.75
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 4571140278
Optimality of the best value was proved NO
Number of variables155000
Total number of constraints5150
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints5150
Minimum length of a constraint31
Maximum length of a constraint3000
Number of terms in the objective function 155000
Biggest coefficient in the objective function 4294967296
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 29700464693312
Number of bits of the sum of numbers in the objective function 45
Biggest number in a constraint 4294967296
Number of bits of the biggest number in a constraint 33
Biggest sum of numbers in a constraint 29700464693312
Number of bits of the biggest sum of numbers45
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c 2016-06-18T09:06:35+0200
0.00/0.00	c version = 0.5.0
0.00/0.00	c githash = 1a49202
0.00/0.00	c compilationtime = 2016-05-02 00:19:28.990761 UTC
0.00/0.00	c arch = x86_64
0.00/0.00	c os = linux
0.00/0.00	c compiler = ghc 7.10
0.00/0.00	c packages:
0.00/0.00	c   OptDir-0.0.3
0.00/0.00	c   array-0.5.1.0
0.00/0.00	c   base-4.8.2.0
0.00/0.00	c   bytestring-0.10.6.0
0.00/0.00	c   bytestring-builder-0.10.6.0.0
0.00/0.00	c   clock-0.7.2
0.00/0.00	c   containers-0.5.6.2
0.00/0.00	c   data-default-0.5.3
0.00/0.00	c   data-default-class-0.0.1
0.00/0.00	c   data-interval-1.2.0
0.00/0.00	c   deepseq-1.4.1.1
0.00/0.00	c   directory-1.2.2.0
0.00/0.00	c   exceptions-0.8.2.1
0.00/0.00	c   extended-reals-0.2.1.0
0.00/0.00	c   filepath-1.4.0.0
0.00/0.00	c   finite-field-0.8.0
0.00/0.00	c   hashable-1.2.4.0
0.00/0.00	c   heaps-0.3.3
0.00/0.00	c   intern-0.9.1.4
0.00/0.00	c   loop-0.3.0
0.00/0.00	c   mtl-2.2.1
0.00/0.00	c   multiset-0.3.2
0.00/0.00	c   mwc-random-0.13.3.2
0.00/0.00	c   parse_dimacs-1.3
0.00/0.00	c   parsec-3.1.9
0.00/0.00	c   prettyclass-1.0.0.0
0.00/0.00	c   primes-0.2.1.0
0.00/0.00	c   primitive-0.6.1.0
0.00/0.00	c   process-1.2.3.0
0.00/0.00	c   pseudo-boolean-0.1.3.0
0.00/0.01	c   queue-0.1.2
0.00/0.01	c   semigroups-0.18.1
0.00/0.01	c   sign-0.4.3
0.00/0.01	c   stm-2.4.4.1
0.00/0.01	c   template-haskell-2.10.0.0
0.00/0.01	c   temporary-1.2.0.4
0.00/0.01	c   time-1.5.0.1
0.00/0.01	c   transformers-0.4.2.0
0.00/0.01	c   transformers-compat-0.5.1.4
0.00/0.01	c   type-level-numbers-0.1.1.1
0.00/0.01	c   unbounded-delays-0.1.0.9
0.00/0.01	c   unordered-containers-0.2.6.0
0.00/0.01	c   vector-0.11.0.0
0.00/0.01	c   vector-space-0.10.3
0.00/0.01	c command line = ["+RTS","-H1G","-M15500m","-K1G","-RTS","--pb","--search=bcd2","HOME/instance-4103185-1466233594.opb"]
0.00/0.01	c use --random-gen="29679007 3676262068 2239031701 2424659978 2692470194 608825633 50658467 510594258 1509582027 3448284530 234906960 4117966409 2494661248 1418835688 3887281298 4200255561 2939123836 160546516 1387115285 193075590 2054196711 3769525698 237633078 1449302439 156884707 3280479089 2268727938 1632853545 1488936720 1859125223 3982247171 2106987018 534566912 2855600567 3970967740 147114821 1546843569 2352848719 3014605927 1576895415 642361578 2764450863 4118962519 1616848533 281787949 2502311858 3754417630 4026693385 2068257813 1482343170 2969697519 2117607010 659728488 2105837129 2257563094 3409588449 3142408466 2651706487 2559748838 2285660219 2214238295 2090555047 426278132 1792713649 3987547804 378568953 3475318155 3562907718 1133690829 3407157350 1113422211 1244102988 2599369838 83036268 3517285161 3987200139 4070218615 3457518675 39359650 108793327 3772390230 2954064413 1047116171 4107758289 4084519337 4112385576 2689962937 3131046568 2217363177 2567270706 2165497919 3601293213 3058235732 3225721103 4077481235 1954026422 205298304 4060309771 2085507622 2730766995 3988157229 735344474 446235560 1690010469 1780078737 1974954610 1734995676 3878272717 1766142217 2739836650 1885958168 4136375397 630623436 1125526863 3334101372 1509965189 2535235795 2550120025 2058545586 2886184200 1689829763 983758166 4050010037 8237396 634125933 4008630717 1635754763 1284420077 388224601 555080444 3056439084 2032335506 3573619993 1549233506 3358424604 184476058 3757025059 1098202436 438441138 3174495972 736118330 2460321305 1999132889 3322756223 3965469889 1266759971 3897454645 4293075996 3195182946 3702859567 4197369582 699260272 1098951663 1561177333 63974807 3627666420 1830763534 2276998449 377015178 2043747224 3346066941 1352355642 1133862314 684967569 3032246064 2248108134 422404742 761667839 51949696 1167662426 3022564603 3723992624 3925322760 2139732504 1152695045 1871832865 4188554835 535269415 3174698053 1811696454 4279176845 4240253590 104272375 3161856826 3417685321 1427711202 3418151976 3923232578 1655783198 3095161248 3270332251 1465869797 2962074233 265343935 3410983526 1440080216 915886202 1997078441 1395797975 953948277 754207258 807536087 816169714 3727802206 4242125850 2837950403 426101758 2068093270 2924513064 3048257935 2542811111 2315820816 3652564674 1189012496 2549171341 1879640352 3858381115 607633946 488534958 3842790924 1881801945 403748655 267353586 3617564925 3544781464 2304997402 2544588759 160020792 306740687 1849416442 2829105862 873693 1283828342 4130525505 2908908915 876323795 1283570517 2544129819 4046486861 1093009369 2609095619 1813897615 2215306017 2225626221 693550161 3146347192 3691566601 2162357419 180099334 2006746073 1187469344 1256743002 3084887273 2236647538 1974595936 1820344513 255 362436" option to reproduce the execution
1.10/1.12	c #vars 155000
1.10/1.12	c #constraints 5150
3.79/3.80	c BCD2: Hardening is enabled.
3.79/3.80	c BCD2: BiasedSearch is enabled.
3.79/3.80	c Solving starts ...
3.79/3.80	c ============================[ Search Statistics ]============================
3.79/3.80	c  Time | Restart | Decision | Conflict |      LEARNT     | Fixed    | Removed 
3.79/3.80	c       |         |          |          |    Limit     GC | Var      | Constra 
3.79/3.80	c =============================================================================
3.89/3.92	c  0.0s |       0 |        0 |        0 |    53433      0 |    59624 |        0
6.69/6.76	c  2.8s |       0 |     6101 |        0 |    53433      0 |    59624 |        0
6.69/6.76	c #cpu_time = 2.726s
6.69/6.76	c #wall_clock_time = 2.733s
6.69/6.76	c #decision = 6101
6.69/6.76	c #random_decision = 17
6.69/6.76	c #conflict = 0
6.69/6.76	c #restart = 0
6.69/6.77	o 82653004028

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103185-1466233594/watcher-4103185-1466233594 -o /tmp/evaluation-result-4103185-1466233594/solver-4103185-1466233594 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960 toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103185-1466233594.opb 

pid=14928
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.02 2.00 3/179 14931
/proc/meminfo: memFree=19125400/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=716220 CPUtime=0 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 2668 0 0 0 0 0 0 0 20 0 4 0 25409880 733409280 3029 33554432000 4194304 16246674 140737131587744 140737131587168 15002730 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 179311 3037 441 2943 0 176205 0
[pid=14931/tid=14932] ppid=14928 vsize=733628 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 751235072 3101 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=738748 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 756477952 3118 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=742844 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 760672256 3134 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0

[startup+0.100137 s]
/proc/loadavg: 2.00 2.02 2.00 3/179 14931
/proc/meminfo: memFree=19125400/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=1303108 CPUtime=0.09 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 30063 0 0 0 5 4 0 0 20 0 4 0 25409880 1334382592 30362 33554432000 4194304 16246674 140737131587744 140737131587056 7377409 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 325777 30378 798 2943 0 322671 0
[pid=14931/tid=14932] ppid=14928 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 1334382592 30390 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 1334382592 30401 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=1303108 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 1334382592 30412 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 1303108

[startup+0.200542 s]
/proc/loadavg: 2.00 2.02 2.00 3/179 14931
/proc/meminfo: memFree=19125400/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=1312324 CPUtime=0.19 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 42716 0 0 0 14 5 0 0 20 0 4 0 25409880 1343819776 43526 33554432000 4194304 16246674 140737131587744 140737131587056 4221116 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 328081 43526 799 2943 0 324975 0
[pid=14931/tid=14932] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 43526 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 43526 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 43526 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 1312324

[startup+0.300505 s]
/proc/loadavg: 2.00 2.02 2.00 3/179 14931
/proc/meminfo: memFree=19125400/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=1312324 CPUtime=0.29 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 46084 0 0 0 23 6 0 0 20 0 4 0 25409880 1343819776 46894 33554432000 4194304 16246674 140737131587744 140737131587056 4220912 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 328081 46894 799 2943 0 324975 0
[pid=14931/tid=14932] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 46894 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 46894 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 46894 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 1312324

[startup+0.700425 s]
/proc/loadavg: 2.00 2.02 2.00 3/179 14931
/proc/meminfo: memFree=19125400/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=1312324 CPUtime=0.69 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 52371 0 0 0 62 7 0 0 20 0 4 0 25409880 1343819776 53181 33554432000 4194304 16246674 140737131587744 140737131587056 7439436 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 328081 53181 802 2943 0 324975 0
[pid=14931/tid=14932] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 53181 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 53181 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=1312324 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 1343819776 53181 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 1312324

[startup+1.50043 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14935
/proc/meminfo: memFree=18645956/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=1380932 CPUtime=1.49 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 86812 0 0 0 137 12 0 0 20 0 4 0 25409880 1414074368 87622 33554432000 4194304 16246674 140737131587744 140737131570736 4222260 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 345233 87622 836 2943 0 342127 0
[pid=14931/tid=14932] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 87622 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 87622 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 87622 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 1380932

[startup+3.10042 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14935
/proc/meminfo: memFree=18057196/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=1380932 CPUtime=3.09 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 100117 0 0 0 295 14 0 0 20 0 4 0 25409880 1414074368 100927 33554432000 4194304 16246674 140737131587744 140737131586840 5599971 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 345233 100927 837 2943 0 342127 0
[pid=14931/tid=14932] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 100927 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 100927 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 100927 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 1380932

[startup+6.3004 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14935
/proc/meminfo: memFree=16759008/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=1380932 CPUtime=6.29 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 175802 0 0 0 603 26 0 0 20 0 4 0 25409880 1414074368 176612 33554432000 4194304 16246674 140737131587744 140737131569664 5599933 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 345233 176612 878 2943 0 342127 0
[pid=14931/tid=14932] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 176612 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 176612 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=1380932 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 1414074368 176612 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 1380932

[startup+12.7004 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14935
/proc/meminfo: memFree=15487268/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=2209348 CPUtime=12.69 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 493005 0 0 0 1201 68 0 0 20 0 4 0 25409880 2262372352 493811 33554432000 4194304 16246674 140737131587744 140737131587056 4225171 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 552337 493811 880 2943 0 549231 0
[pid=14931/tid=14932] ppid=14928 vsize=2209348 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 2262372352 493811 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=2209348 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 2262372352 493811 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=2209348 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 2262372352 493811 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 2209348

[startup+25.5004 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14935
/proc/meminfo: memFree=13327604/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=4362820 CPUtime=25.49 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 1031373 0 0 0 2411 138 0 0 20 0 4 0 25409880 4467527680 1032179 33554432000 4194304 16246674 140737131587744 140737131586840 14628944 0 0 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 1090705 1032179 880 2943 0 1087599 0
[pid=14931/tid=14932] ppid=14928 vsize=4362820 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 4467527680 1032179 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=4362820 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 4467527680 1032179 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=4362820 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 4467527680 1032179 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 4362820

[startup+51.1004 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 14935
/proc/meminfo: memFree=7371344/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=9871940 CPUtime=51.08 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 2408656 0 0 0 4788 320 0 0 20 0 4 0 25409880 10108866560 2409462 33554432000 4194304 16246674 140737131587744 140737131586920 4220520 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 2467985 2409462 880 2943 0 2464879 0
[pid=14931/tid=14932] ppid=14928 vsize=9871940 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 10108866560 2409462 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=9871940 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 10108866560 2409462 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=9871940 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 10108866560 2409462 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 9871940

[startup+102.3 s]
/proc/loadavg: 2.05 2.03 2.00 3/183 14984
/proc/meminfo: memFree=18028928/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=12714564 CPUtime=102.27 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 3072095 0 0 0 9814 413 0 0 20 0 4 0 25409880 13019713536 3119913 33554432000 4194304 16246674 140737131587744 140737131585728 4226242 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 3178641 3119913 884 2943 0 3175535 0
[pid=14931/tid=14932] ppid=14928 vsize=12714564 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 13019713536 3119913 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=12714564 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 13019713536 3119913 33554432000 4194304 16246674 140737131587744 140628984830992 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=12714564 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 13019713536 3119913 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 12714564

[startup+162.3 s]
/proc/loadavg: 2.08 2.04 2.00 3/183 14985
/proc/meminfo: memFree=15024680/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=15712836 CPUtime=162.26 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 3763557 0 0 0 15711 515 0 0 20 0 4 0 25409880 16089944064 3869629 33554432000 4194304 16246674 140737131587744 140737131585664 14014086 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 3928209 3869629 884 2943 0 3925103 0
[pid=14931/tid=14932] ppid=14928 vsize=15712836 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 16089944064 3869629 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=15712836 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 16089944064 3869629 33554432000 4194304 16246674 140737131587744 140628984830992 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=15712836 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 16089944064 3869629 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 15712836



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+184.4 s]
/proc/loadavg: 2.05 2.03 2.00 3/183 14987
/proc/meminfo: memFree=15024036/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=15880772 CPUtime=184.37 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) R 14928 14931 11324 0 -1 4202496 3805355 0 0 0 17913 524 0 0 20 0 4 0 25409880 16261910528 3911427 33554432000 4194304 16246674 140737131587744 140737131586840 15015658 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 3970193 3911427 884 2943 0 3967087 0
[pid=14931/tid=14932] ppid=14928 vsize=15880772 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) S 14928 14931 11324 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 4 0 25409881 16261910528 3911429 33554432000 4194304 16246674 140737131587744 140628995321072 15012391 0 0 0 34082818 18446744071580610281 0 0 -1 5 0 0 0 0 0
[pid=14931/tid=14933] ppid=14928 vsize=15880772 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14933/stat : 14933 (toysat) S 14928 14931 11324 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 4 0 25409881 16261910528 3911435 33554432000 4194304 16246674 140737131587744 140628984831216 14998865 0 0 0 34082818 18446744071580425449 0 0 -1 1 0 0 0 0 0
[pid=14931/tid=14934] ppid=14928 vsize=15880772 CPUtime=0 cores=1,3,5,7
/proc/14931/task/14934/stat : 14934 (toysat) S 14928 14931 11324 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 4 0 25409881 16261910528 3911442 33554432000 4194304 16246674 140737131587744 140628906208432 14069300 0 0 0 34082818 18446744071579510697 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 184.37
Current children cumulated vsize (KiB) 15880772

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 14931 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+185 s]
/proc/loadavg: 2.05 2.03 2.00 3/181 14987
/proc/meminfo: memFree=26117568/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=0 CPUtime=184.97 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) Z 14928 14931 11324 0 -1 4203532 3805897 0 0 0 17913 584 0 0 20 0 2 0 25409880 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 0 0 0 0 0 0 0
[pid=14931/tid=14932] ppid=14928 vsize=0 CPUtime=0.58 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) R 14928 14931 11324 0 -1 4203588 10 0 0 0 0 58 0 0 20 0 2 0 25409881 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 184.97
Current children cumulated vsize (KiB) 0

[startup+185.2 s]
/proc/loadavg: 2.05 2.03 2.00 3/181 14987
/proc/meminfo: memFree=26117568/32872528 swapFree=249320/249320
[pid=14931] ppid=14928 vsize=0 CPUtime=185.16 cores=1,3,5,7
/proc/14931/stat : 14931 (toysat) Z 14928 14931 11324 0 -1 4203532 3805897 0 0 0 17913 603 0 0 20 0 2 0 25409880 0 0 33554432000 0 0 0 0 0 0 2 0 34082818 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/14931/statm: 0 0 0 0 0 0 0
[pid=14931/tid=14932] ppid=14928 vsize=0 CPUtime=0.78 cores=1,3,5,7
/proc/14931/task/14932/stat : 14932 (toysat) R 14928 14931 11324 0 -1 4203588 10 0 0 0 0 78 0 0 20 0 2 0 25409881 0 0 33554432000 0 0 0 0 0 0 0 0 34082818 18446744073709551615 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 185.16
Current children cumulated vsize (KiB) 0

Child ended because it received signal 15 (SIGTERM)
Real time (s): 185.215
CPU time (s): 185.178
CPU user time (s): 179.136
CPU system time (s): 6.04208
CPU usage (%): 99.9798
Max. virtual memory (cumulated for all children) (KiB): 15880772

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 179.136
system time used= 6.04208
maximum resident set size= 15647876
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3805897
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 54
involuntary context switches= 207

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.448931 second user time and 0.739887 second system time

The end

Launcher Data 

Begin job on node103 at 2016-06-18 09:06:35
IDJOB=4103185
IDBENCH=2292
IDSOLVER=2542
FILE ID=node103/4103185-1466233594
RUNJOBID= node103-1466206104-11341
PBS_JOBID= 19918169
Free space on /tmp= 71700 MiB

SOLVER NAME= toysat 2016-05-02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/fctp/normalized-mps-v2-20-10-n370e.opb
COMMAND LINE= toysat +RTS -H1G -MMEMLIMITm -K1G -RTS --pb --search=bcd2 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103185-1466233594/watcher-4103185-1466233594 -o /tmp/evaluation-result-4103185-1466233594/solver-4103185-1466233594 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node103-1466206104-11341 --watchdog 1960  toysat +RTS -H1G -M15500m -K1G -RTS --pb --search=bcd2 HOME/instance-4103185-1466233594.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2ed7df63a411bcdd93a5895df0fcaa15
RANDOM SEED=352141938

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.278
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        19125408 kB
Buffers:          120820 kB
Cached:           138356 kB
SwapCached:         1672 kB
Active:         12582672 kB
Inactive:         156716 kB
Active(anon):   12479324 kB
Inactive(anon):     3180 kB
Active(file):     103348 kB
Inactive(file):   153536 kB
Unevictable:      249320 kB
Mlocked:          249320 kB
SwapTotal:      67108856 kB
SwapFree:       67099436 kB
Dirty:             24968 kB
Writeback:             0 kB
AnonPages:      12730924 kB
Mapped:            10696 kB
Shmem:                 0 kB
Slab:             602908 kB
SReclaimable:      46628 kB
SUnreclaim:       556280 kB
KernelStack:        1480 kB
PageTables:        28960 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:   12873212 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    192512 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71692 MiB
End job on node103 at 2016-06-18 09:09:40