Pipeline_Preparation.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Content Collection and Processing for TSE-NER Long-tail Entity Extraction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here we will try to follow the full process required to collect and prepare the data required before we can train and use a NER model. In the second pipeline, we review the process of Term and Sentence Expansion, training, and finally using the Stanford NER Tagger."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# This is in case you update modules while working\n",
    "%load_ext autoreload \n",
    "%autoreload 2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Content Collection (a.k.a. getting a *lot* of papers)\n",
    "\n",
    "For this step we will be using [sci-paper-miner](https://github.com/ronentk/sci-paper-miner) to download scientific publications from arXiv. \n",
    "\n",
    "In the `crawl_core` file, you can modify the topics and range of years that you want to download, for example here we selected papers only from 2017 for Artificial Intelligence, Computational Complexity, Cryptography and Security, Human-Computer Interaction, Logic in Computer Science, Mathematical Software, Multiagent Systems, Neural and Evolutionary Computing and Sound (in the `crawl_core` file they have all the topics, you can choose what to keep).  In `configs` you can write a name for the folder where the data will be stored.\n",
    "\n",
    "Get the code from their repository, and use the following command to run it:\n",
    "\n",
    "`python crawl_core.py <your-api-key>` "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "%run crawl_core.py <your-api>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import json\n",
    "import os"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# This is the default path where all the dataset files were downloaded \n",
    "\n",
    "path = 'sci_paper_miner/data/arxiv_2006-2017_cs/db/'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "3814 with full text 1658 without\n"
     ]
    }
   ],
   "source": [
    "filename = 'fulltext_0.json'\n",
    "json_file = os.path.join(path, filename)\n",
    "articles = []\n",
    "for line in open(json_file):\n",
    "    articles.append(json.loads(line))\n",
    "    \n",
    "x, y = 0, 0\n",
    "for article in articles:\n",
    "    if article['fullText']:\n",
    "        x+=1\n",
    "    else:\n",
    "        y+=1\n",
    "print(x, 'with full text', y, 'without')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Awesome! So we have to iterate for all the articles so we can store it in a database. In this case we will use MongoDB."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Extraction and Storage - MongoDB"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We use MongoDB because it is great for prototyping and quick schema changes, but other storage systems can be probably used. Ultimately, all the data is then indexed in Elasticsearch, and that's where we actually query in production.\n",
    "\n",
    "You can go [here](https://docs.mongodb.com/manual/installation/) to install MongoDB.\n",
    "\n",
    "Then, using a MongoDB client, create a database, for example _pub_ and a collection, like _publications_."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from pymongo import MongoClient\n",
    "from pymongo.errors import ServerSelectionTimeoutError\n",
    "import string"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# Default values\n",
    "mongoDB_IP = '127.0.0.1'\n",
    "mongoDB_Port = 27017\n",
    "mongoDB_db = 'pub'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def connect_to_mongo():\n",
    "    \"\"\"\n",
    "    Returns a db connection to the mongo instance\n",
    "    :return:\n",
    "    \"\"\"\n",
    "    try:\n",
    "        client = MongoClient(mongoDB_IP, mongoDB_Port)\n",
    "        db = client[mongoDB_db]\n",
    "        db.downloads.find_one({'_id': 'test'})\n",
    "        return db\n",
    "    except ServerSelectionTimeoutError as e:\n",
    "        raise Exception(\"Local MongoDB instance at \"+mongoDB_IP+\":\"+mongoDB_Port+\" could not be accessed.\") from e"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can test the connection to the database with the following command:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "db = connect_to_mongo()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Then we define a function that will take each of the articles from the JSON files downloaded from CORE, and store the information into our collection.\n",
    "\n",
    "The data obtained from CORE does not separate sections in the text, it is not so important except for the references, since we may use them later on, therefore we also define a function that will manage this."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def arxiv_json_to_mongo(article):\n",
    "    \"\"\"\n",
    "    Creates a new entry in mongodb from the input article\n",
    "    :return:\n",
    "    \"\"\"\n",
    "    \n",
    "    mongo_input = {}\n",
    "    translator = str.maketrans('', '', string.punctuation)\n",
    "    article_data = article\n",
    "\n",
    "    mongo_input['title'] = article_data['title']\n",
    "    mongo_input['authors'] = article_data['authors']\n",
    "    mongo_input['journal'] = 'arxiv'\n",
    "    mongo_input['year'] = article_data['year']\n",
    "    mongo_input['type'] = article_data['subjects']\n",
    "    mongo_input['content.abstract'] = article_data['description']\n",
    "    mongo_input['content.keywords'] = article_data['topics']\n",
    "    mongo_input['content.fulltext'] = article_data['fullText']\n",
    "    mongo_input['content.references'] = article_data['references']\n",
    "\n",
    "    mongo_mongo_input = db.publications.update_one(\n",
    "        {'_id': 'arxiv_' + article_data['id']},\n",
    "        {'$set': mongo_input},\n",
    "        upsert=True\n",
    "    )    \n",
    "    print('Processed', article_data['id'], 'from JSON')\n",
    "    \n",
    "def manage_text_and_refs(article):\n",
    "    article['fullText'] = article['fullText'].replace('\\n', ' ').replace('\\r', '')\n",
    "    if len(article['fullText'].split('References', 1)) == 2:\n",
    "        article['references'] = article['fullText'].split('References', 1)[1].split('[')\n",
    "        article['fullText'] = article['fullText'].split('References', 1)[0]\n",
    "    elif len(article['fullText'].split('REFERENCES', 1)) == 2:\n",
    "        article['references'] = article['fullText'].split('REFERENCES', 1)[1].split('[')\n",
    "        article['fullText'] = article['fullText'].split('References', 1)[0]\n",
    "    else:\n",
    "        article['fullText'] = article['fullText']\n",
    "        article['references'] = ''\n",
    "    return article"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we have to iterate through all the downloaded JSON files, and all the articles in each file, to process them and introduce them into our database."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Processed 25036267 from JSON\n",
      "Processed 2113087 from JSON\n",
      "Processed 25025591 from JSON\n",
      "Processed 25015102 from JSON\n",
      "Processed 24956790 from JSON\n",
      "Processed 25038409 from JSON\n",
      "Processed 2246166 from JSON\n",
      "Processed 73386897 from JSON\n",
      "Processed 83863968 from JSON\n",
      "Processed 83867371 from JSON\n",
      "Processed 94047681 from JSON\n",
      "Processed 146472595 from JSON\n",
      "Processed 94063315 from JSON\n",
      "Processed 29526388 from JSON\n",
      "Processed 29536914 from JSON\n",
      "Processed 84090473 from JSON\n",
      "Processed 84093559 from JSON\n",
      "Processed 84093915 from JSON\n",
      "Processed 84093852 from JSON\n",
      "Processed 84094420 from JSON\n",
      "Processed 84326602 from JSON\n",
      "Processed 84328172 from JSON\n",
      "Processed 84330324 from JSON\n",
      "Processed 84329889 from JSON\n",
      "Processed 84326664 from JSON\n",
      "Processed 84331310 from JSON\n",
      "Processed 86416235 from JSON\n",
      "Processed 86419366 from JSON\n",
      "Processed 86420205 from JSON\n",
      "Processed 84330603 from JSON\n",
      "Processed 84330526 from JSON\n",
      "Processed 84331497 from JSON\n",
      "Processed 73423992 from JSON\n",
      "Processed 73417539 from JSON\n",
      "Processed 73408850 from JSON\n",
      "Processed 73402977 from JSON\n",
      "Processed 73441057 from JSON\n",
      "Processed 73402263 from JSON\n",
      "Processed 73401169 from JSON\n",
      "Processed 73419124 from JSON\n",
      "Processed 74202727 from JSON\n",
      "Processed 141537703 from JSON\n",
      "Processed 141535062 from JSON\n",
      "Processed 141535000 from JSON\n",
      "Processed 74251318 from JSON\n",
      "Processed 78506531 from JSON\n",
      "Processed 78509819 from JSON\n",
      "Processed 78507673 from JSON\n",
      "Processed 78506997 from JSON\n",
      "Processed 141531301 from JSON\n",
      "Processed 141535714 from JSON\n",
      "Processed 141533509 from JSON\n",
      "Processed 141533662 from JSON\n",
      "Processed 141529553 from JSON\n",
      "Processed 74250827 from JSON\n",
      "Processed 78512677 from JSON\n",
      "Processed 141534850 from JSON\n",
      "Processed 141530562 from JSON\n",
      "Processed 141530719 from JSON\n",
      "Processed 141529755 from JSON\n",
      "Processed 141530827 from JSON\n",
      "Processed 73988871 from JSON\n",
      "Processed 42681963 from JSON\n",
      "Processed 93945889 from JSON\n",
      "Processed 93949588 from JSON\n",
      "Processed 93951134 from JSON\n",
      "Processed 93891203 from JSON\n",
      "Processed 93902620 from JSON\n",
      "Processed 93937103 from JSON\n",
      "Processed 93939510 from JSON\n",
      "Processed 93888469 from JSON\n",
      "Processed 93943946 from JSON\n",
      "Processed 93944482 from JSON\n",
      "Processed 93947070 from JSON\n",
      "Processed 93951893 from JSON\n",
      "Processed 93952276 from JSON\n",
      "Processed 93945050 from JSON\n",
      "Processed 42688887 from JSON\n",
      "Processed 42728664 from JSON\n",
      "Processed 73989191 from JSON\n",
      "Processed 73987683 from JSON\n",
      "Processed 73988439 from JSON\n",
      "Processed 73990249 from JSON\n",
      "Processed 129276907 from JSON\n",
      "Processed 129276534 from JSON\n",
      "Processed 129356184 from JSON\n",
      "Processed 129359594 from JSON\n",
      "Processed 129359316 from JSON\n",
      "Processed 42698141 from JSON\n",
      "Processed 93952959 from JSON\n",
      "Processed 93957815 from JSON\n",
      "Processed 93958647 from JSON\n",
      "Processed 93959107 from JSON\n",
      "Processed 83869098 from JSON\n",
      "Processed 83868949 from JSON\n",
      "Processed 73384288 from JSON\n",
      "Processed 83835974 from JSON\n",
      "Processed 83836249 from JSON\n",
      "Processed 83832829 from JSON\n",
      "Processed 83832595 from JSON\n",
      "Processed 73357095 from JSON\n",
      "Processed 83841717 from JSON\n",
      "Processed 83838980 from JSON\n",
      "Processed 83839952 from JSON\n",
      "Processed 83840699 from JSON\n",
      "Processed 83840682 from JSON\n",
      "Processed 83870216 from JSON\n",
      "Processed 73387883 from JSON\n",
      "Processed 94039688 from JSON\n",
      "Processed 94033907 from JSON\n",
      "Processed 94044473 from JSON\n",
      "Processed 94064596 from JSON\n",
      "Processed 94067728 from JSON\n",
      "Processed 94067742 from JSON\n",
      "Processed 94068466 from JSON\n",
      "Processed 93937583 from JSON\n",
      "Processed 93937615 from JSON\n",
      "Processed 93937367 from JSON\n",
      "Processed 93939154 from JSON\n",
      "Processed 93939077 from JSON\n",
      "Processed 93939293 from JSON\n",
      "Processed 93938308 from JSON\n",
      "Processed 93943092 from JSON\n",
      "Processed 93959138 from JSON\n",
      "Processed 73376557 from JSON\n",
      "Processed 73379051 from JSON\n",
      "Processed 83852593 from JSON\n",
      "Processed 83855011 from JSON\n",
      "Processed 83859549 from JSON\n",
      "Processed 73380851 from JSON\n",
      "Processed 83859361 from JSON\n",
      "Processed 83850681 from JSON\n",
      "Processed 83846248 from JSON\n",
      "Processed 73364305 from JSON\n",
      "Processed 83868608 from JSON\n",
      "Processed 83863920 from JSON\n",
      "Processed 94078124 from JSON\n",
      "Processed 129358856 from JSON\n",
      "Processed 129358762 from JSON\n",
      "Processed 129360806 from JSON\n",
      "Processed 129361931 from JSON\n",
      "Processed 129349191 from JSON\n",
      "Processed 129349146 from JSON\n",
      "Processed 129353798 from JSON\n",
      "Processed 129357620 from JSON\n",
      "Processed 129357435 from JSON\n",
      "Processed 129361575 from JSON\n",
      "Processed 129363083 from JSON\n",
      "Processed 93866807 from JSON\n",
      "Processed 129261181 from JSON\n",
      "Processed 129275113 from JSON\n",
      "Processed 129249853 from JSON\n",
      "Processed 93876558 from JSON\n",
      "Processed 73956575 from JSON\n",
      "Processed 73955976 from JSON\n",
      "Processed 73957516 from JSON\n",
      "Processed 83852517 from JSON\n",
      "Processed 83856634 from JSON\n",
      "Processed 83856665 from JSON\n",
      "Processed 83859392 from JSON\n",
      "Processed 83855679 from JSON\n",
      "Processed 83858717 from JSON\n",
      "Processed 83859114 from JSON\n",
      "Processed 83848701 from JSON\n",
      "Processed 83834801 from JSON\n",
      "Processed 83845694 from JSON\n",
      "Processed 83850294 from JSON\n",
      "Processed 83844350 from JSON\n",
      "Processed 83843162 from JSON\n",
      "Processed 83833303 from JSON\n",
      "Processed 83833194 from JSON\n",
      "Processed 83832534 from JSON\n",
      "Processed 83834275 from JSON\n",
      "Processed 83860838 from JSON\n",
      "Processed 83861994 from JSON\n",
      "Processed 73376356 from JSON\n",
      "Processed 83864784 from JSON\n",
      "Processed 83863781 from JSON\n",
      "Processed 83863642 from JSON\n",
      "Processed 73958642 from JSON\n",
      "Processed 73988858 from JSON\n",
      "Processed 73987653 from JSON\n",
      "Processed 73953724 from JSON\n",
      "Processed 86420761 from JSON\n",
      "Processed 84327512 from JSON\n",
      "Processed 84326665 from JSON\n",
      "Processed 42679813 from JSON\n",
      "Processed 78507191 from JSON\n",
      "Processed 78512070 from JSON\n",
      "Processed 78512397 from JSON\n",
      "Processed 78508024 from JSON\n",
      "Processed 74252134 from JSON\n",
      "Processed 141534293 from JSON\n",
      "Processed 141538226 from JSON\n",
      "Processed 141533865 from JSON\n",
      "Processed 141533771 from JSON\n",
      "Processed 141538473 from JSON\n",
      "Processed 73411633 from JSON\n",
      "Processed 73414098 from JSON\n",
      "Processed 73423979 from JSON\n",
      "Processed 42714190 from JSON\n",
      "Processed 29509195 from JSON\n",
      "Processed 84094933 from JSON\n",
      "Processed 73442277 from JSON\n",
      "Processed 86414492 from JSON\n",
      "Processed 42641564 from JSON\n",
      "Processed 42688561 from JSON\n",
      "Processed 42655868 from JSON\n",
      "Processed 42742913 from JSON\n",
      "Processed 74202836 from JSON\n",
      "Processed 74203978 from JSON\n",
      "Processed 74203947 from JSON\n",
      "Processed 42743606 from JSON\n",
      "Processed 129239884 from JSON\n",
      "Processed 129243931 from JSON\n",
      "Processed 73993085 from JSON\n",
      "Processed 42730879 from JSON\n",
      "Processed 42739232 from JSON\n",
      "Processed 42737724 from JSON\n",
      "Processed 129270085 from JSON\n",
      "Processed 129269247 from JSON\n",
      "Processed 129274513 from JSON\n",
      "Processed 94031902 from JSON\n",
      "Processed 141529941 from JSON\n",
      "Processed 141530082 from JSON\n",
      "Processed 74250873 from JSON\n",
      "Processed 74251720 from JSON\n",
      "Processed 78509678 from JSON\n",
      "Processed 141533043 from JSON\n",
      "Processed 141532723 from JSON\n",
      "Processed 78512366 from JSON\n",
      "Processed 146472859 from JSON\n",
      "Processed 94046603 from JSON\n",
      "Processed 93908494 from JSON\n",
      "Processed 93914826 from JSON\n",
      "Processed 93940131 from JSON\n",
      "Processed 94058437 from JSON\n",
      "Processed 93943325 from JSON\n",
      "Processed 93942601 from JSON\n",
      "Processed 83851623 from JSON\n",
      "Processed 83852190 from JSON\n",
      "Processed 83855074 from JSON\n",
      "Processed 83853319 from JSON\n",
      "Processed 83856666 from JSON\n",
      "Processed 83833551 from JSON\n",
      "Processed 83833380 from JSON\n",
      "Processed 83842999 from JSON\n",
      "Processed 83842672 from JSON\n",
      "Processed 83840203 from JSON\n",
      "Processed 73360638 from JSON\n",
      "Processed 83843132 from JSON\n",
      "Processed 83843428 from JSON\n",
      "Processed 83851065 from JSON\n",
      "Processed 83853193 from JSON\n",
      "Processed 83833258 from JSON\n",
      "Processed 83836745 from JSON\n",
      "Processed 83837375 from JSON\n",
      "Processed 73352039 from JSON\n",
      "Processed 83836992 from JSON\n",
      "Processed 83836947 from JSON\n",
      "Processed 83847437 from JSON\n",
      "Processed 83847932 from JSON\n",
      "Processed 83835122 from JSON\n",
      "Processed 83835696 from JSON\n",
      "Processed 83846775 from JSON\n",
      "Processed 83846915 from JSON\n",
      "Processed 83850264 from JSON\n",
      "Processed 83859425 from JSON\n",
      "Processed 83867682 from JSON\n",
      "Processed 83870262 from JSON\n",
      "Processed 83868933 from JSON\n",
      "Processed 83860388 from JSON\n",
      "Processed 83860340 from JSON\n",
      "Processed 83862980 from JSON\n",
      "Processed 83862966 from JSON\n",
      "Processed 83860713 from JSON\n",
      "Processed 93907648 from JSON\n",
      "Processed 93937892 from JSON\n",
      "Processed 93938679 from JSON\n",
      "Processed 93904858 from JSON\n",
      "Processed 129356046 from JSON\n",
      "Processed 93945251 from JSON\n",
      "Processed 93944948 from JSON\n",
      "Processed 93894302 from JSON\n",
      "Processed 93898481 from JSON\n",
      "Processed 129219280 from JSON\n",
      "Processed 93945763 from JSON\n",
      "Processed 93945701 from JSON\n",
      "Processed 93948368 from JSON\n",
      "Processed 93948926 from JSON\n",
      "Processed 93951272 from JSON\n",
      "Processed 93951227 from JSON\n",
      "Processed 93950349 from JSON\n",
      "Processed 129357436 from JSON\n",
      "Processed 129354242 from JSON\n",
      "Processed 93955298 from JSON\n",
      "Processed 93957100 from JSON\n",
      "Processed 93954637 from JSON\n",
      "Processed 86415589 from JSON\n",
      "Processed 86416049 from JSON\n",
      "Processed 86421656 from JSON\n",
      "Processed 86420019 from JSON\n",
      "Processed 86416917 from JSON\n",
      "Processed 84332112 from JSON\n",
      "Processed 84331544 from JSON\n",
      "Processed 86417035 from JSON\n",
      "Processed 86415248 from JSON\n",
      "Processed 86414384 from JSON\n",
      "Processed 84331049 from JSON\n",
      "Processed 129362579 from JSON\n",
      "Processed 129353364 from JSON\n",
      "Processed 129358112 from JSON\n",
      "Processed 129363022 from JSON\n",
      "Processed 129349022 from JSON\n",
      "Processed 129348500 from JSON\n",
      "Processed 129355601 from JSON\n",
      "Processed 129355043 from JSON\n",
      "Processed 129252805 from JSON\n",
      "Processed 129263821 from JSON\n",
      "Processed 129269449 from JSON\n",
      "Processed 129276487 from JSON\n",
      "Processed 94077449 from JSON\n",
      "Processed 94026340 from JSON\n",
      "Processed 73404689 from JSON\n",
      "Processed 73402359 from JSON\n",
      "Processed 73403592 from JSON\n",
      "Processed 84090569 from JSON\n",
      "Processed 84091942 from JSON\n",
      "Processed 84092015 from JSON\n",
      "Processed 84092325 from JSON\n",
      "Processed 84093359 from JSON\n",
      "Processed 84091726 from JSON\n",
      "Processed 73413438 from JSON\n",
      "Processed 73421602 from JSON\n",
      "Processed 86421035 from JSON\n",
      "Processed 86415139 from JSON\n",
      "Processed 86417034 from JSON\n",
      "Processed 86413878 from JSON\n",
      "Processed 86418998 from JSON\n",
      "Processed 86419193 from JSON\n",
      "Processed 86415571 from JSON\n",
      "Processed 86415742 from JSON\n",
      "Processed 86415696 from JSON\n",
      "Processed 86419890 from JSON\n",
      "Processed 86418099 from JSON\n",
      "Processed 73422681 from JSON\n",
      "Processed 42665589 from JSON\n",
      "Processed 42666140 from JSON\n",
      "Processed 73959088 from JSON\n",
      "Processed 73990405 from JSON\n",
      "Processed 42638860 from JSON\n",
      "Processed 84093513 from JSON\n",
      "Processed 86416620 from JSON\n",
      "Processed 84330775 from JSON\n",
      "Processed 73958643 from JSON\n",
      "Processed 73959817 from JSON\n",
      "Processed 73961285 from JSON\n",
      "Processed 42739341 from JSON\n",
      "Processed 42695896 from JSON\n",
      "Processed 78511595 from JSON\n",
      "Processed 141529276 from JSON\n",
      "Processed 141531877 from JSON\n",
      "Processed 141531428 from JSON\n",
      "Processed 141531923 from JSON\n",
      "Processed 141532166 from JSON\n",
      "Processed 141529353 from JSON\n",
      "Processed 84328422 from JSON\n",
      "Processed 86421592 from JSON\n",
      "Processed 84326527 from JSON\n",
      "Processed 84327917 from JSON\n",
      "Processed 84332221 from JSON\n",
      "Processed 84331095 from JSON\n",
      "Processed 84329379 from JSON\n",
      "Processed 84329641 from JSON\n",
      "Processed 84330465 from JSON\n",
      "Processed 42690170 from JSON\n",
      "Processed 42690512 from JSON\n",
      "Processed 74251118 from JSON\n",
      "Processed 78507936 from JSON\n",
      "Processed 42741911 from JSON\n",
      "Processed 78509785 from JSON\n",
      "Processed 141529803 from JSON\n",
      "Processed 141535886 from JSON\n",
      "Processed 141529959 from JSON\n",
      "Processed 141529928 from JSON\n",
      "Processed 141536067 from JSON\n",
      "Processed 42743993 from JSON\n",
      "Processed 74203373 from JSON\n",
      "Processed 42743809 from JSON\n",
      "Processed 146475679 from JSON\n",
      "Processed 94044970 from JSON\n",
      "Processed 83834151 from JSON\n",
      "Processed 73354416 from JSON\n",
      "Processed 83840918 from JSON\n",
      "Processed 83839442 from JSON\n",
      "Processed 83836948 from JSON\n",
      "Processed 83858144 from JSON\n",
      "Processed 83861267 from JSON\n",
      "Processed 83859767 from JSON\n",
      "Processed 83862688 from JSON\n",
      "Processed 83862842 from JSON\n",
      "Processed 83862037 from JSON\n",
      "Processed 83862486 from JSON\n",
      "Processed 83862424 from JSON\n",
      "Processed 83865322 from JSON\n",
      "Processed 83865199 from JSON\n",
      "Processed 83852595 from JSON\n",
      "Processed 73369364 from JSON\n",
      "Processed 83854104 from JSON\n",
      "Processed 83862549 from JSON\n",
      "Processed 83863009 from JSON\n",
      "Processed 73381591 from JSON\n",
      "Processed 73380125 from JSON\n",
      "Processed 83849751 from JSON\n",
      "Processed 83852038 from JSON\n",
      "Processed 83856667 from JSON\n",
      "Processed 93905627 from JSON\n",
      "Processed 93916148 from JSON\n",
      "Processed 93939152 from JSON\n",
      "Processed 93941739 from JSON\n",
      "Processed 129359736 from JSON\n",
      "Processed 129359363 from JSON\n",
      "Processed 129357420 from JSON\n",
      "Processed 129357204 from JSON\n",
      "Processed 93943418 from JSON\n",
      "Processed 93942679 from JSON\n",
      "Processed 93888962 from JSON\n",
      "Processed 146473488 from JSON\n",
      "Processed 146472980 from JSON\n",
      "Processed 146473363 from JSON\n",
      "Processed 146473628 from JSON\n",
      "Processed 93875522 from JSON\n",
      "Processed 93892127 from JSON\n",
      "Processed 93902293 from JSON\n",
      "Processed 129227338 from JSON\n",
      "Processed 93947085 from JSON\n",
      "Processed 93946873 from JSON\n",
      "Processed 93951303 from JSON\n",
      "Processed 93959756 from JSON\n",
      "Processed 93955482 from JSON\n",
      "Processed 93958753 from JSON\n",
      "Processed 93943913 from JSON\n",
      "Processed 93944651 from JSON\n",
      "Processed 93946765 from JSON\n",
      "Processed 93950331 from JSON\n",
      "Processed 93952476 from JSON\n",
      "Processed 93910582 from JSON\n",
      "Processed 93937132 from JSON\n",
      "Processed 93936627 from JSON\n",
      "Processed 93939183 from JSON\n",
      "Processed 93941722 from JSON\n",
      "Processed 146471514 from JSON\n",
      "Processed 94079422 from JSON\n",
      "Processed 94078467 from JSON\n",
      "Processed 94054241 from JSON\n",
      "Processed 83847344 from JSON\n",
      "Processed 83847281 from JSON\n",
      "Processed 83831950 from JSON\n",
      "Processed 83847685 from JSON\n",
      "Processed 83841702 from JSON\n",
      "Processed 83844244 from JSON\n",
      "Processed 83844136 from JSON\n",
      "Processed 83859394 from JSON\n",
      "Processed 73378719 from JSON\n",
      "Processed 141529896 from JSON\n",
      "Processed 141533277 from JSON\n",
      "Processed 129361128 from JSON\n",
      "Processed 129349458 from JSON\n",
      "Processed 129348051 from JSON\n",
      "Processed 129350171 from JSON\n",
      "Processed 129281396 from JSON\n",
      "Processed 129362626 from JSON\n",
      "Processed 129353411 from JSON\n",
      "Processed 129259557 from JSON\n",
      "Processed 129263200 from JSON\n",
      "Processed 73393611 from JSON\n",
      "Processed 83868314 from JSON\n",
      "Processed 73387791 from JSON\n",
      "Processed 73394056 from JSON\n",
      "Processed 83851826 from JSON\n",
      "Processed 83837098 from JSON\n",
      "Processed 83846018 from JSON\n",
      "Processed 83863877 from JSON\n",
      "Processed 83850932 from JSON\n",
      "Processed 83857560 from JSON\n",
      "Processed 83836110 from JSON\n",
      "Processed 83832334 from JSON\n",
      "Processed 83833229 from JSON\n",
      "Processed 83833197 from JSON\n",
      "Processed 83836420 from JSON\n",
      "Processed 94064847 from JSON\n",
      "Processed 146473191 from JSON\n",
      "Processed 146475337 from JSON\n",
      "Processed 146476246 from JSON\n",
      "Processed 93942616 from JSON\n",
      "Processed 129356372 from JSON\n",
      "Processed 129355867 from JSON\n",
      "Processed 94073951 from JSON\n",
      "Processed 94074613 from JSON\n",
      "Processed 84326542 from JSON\n",
      "Processed 84329642 from JSON\n",
      "Processed 84329534 from JSON\n",
      "Processed 73957083 from JSON\n",
      "Processed 42715025 from JSON\n",
      "Processed 42709888 from JSON\n",
      "Processed 93889591 from JSON\n",
      "Processed 93888790 from JSON\n",
      "Processed 93908586 from JSON\n",
      "Processed 93912556 from JSON\n",
      "Processed 129363271 from JSON\n",
      "Processed 129362487 from JSON\n",
      "Processed 129362348 from JSON\n",
      "Processed 129351548 from JSON\n",
      "Processed 129351500 from JSON\n",
      "Processed 129352426 from JSON\n",
      "Processed 129355494 from JSON\n",
      "Processed 129361686 from JSON\n",
      "Processed 129361220 from JSON\n",
      "Processed 93936796 from JSON\n",
      "Processed 93937489 from JSON\n",
      "Processed 93945374 from JSON\n",
      "Processed 93951410 from JSON\n",
      "Processed 93952444 from JSON\n",
      "Processed 93946997 from JSON\n",
      "Processed 93946036 from JSON\n",
      "Processed 93951720 from JSON\n",
      "Processed 93910815 from JSON\n",
      "Processed 93938367 from JSON\n",
      "Processed 93941428 from JSON\n",
      "Processed 93940254 from JSON\n",
      "Processed 93940300 from JSON\n",
      "Processed 129206040 from JSON\n",
      "Processed 129252555 from JSON\n",
      "Processed 129237242 from JSON\n",
      "Processed 129201432 from JSON\n",
      "Processed 129281737 from JSON\n",
      "Processed 129271550 from JSON\n",
      "Processed 93901446 from JSON\n",
      "Processed 93881960 from JSON\n",
      "Processed 129351872 from JSON\n",
      "Processed 129354756 from JSON\n",
      "Processed 129354244 from JSON\n",
      "Processed 129354383 from JSON\n",
      "Processed 129348331 from JSON\n",
      "Processed 93952862 from JSON\n",
      "Processed 94036992 from JSON\n",
      "Processed 83832132 from JSON\n",
      "Processed 83835263 from JSON\n",
      "Processed 83840825 from JSON\n",
      "Processed 83839380 from JSON\n",
      "Processed 83837036 from JSON\n",
      "Processed 83843521 from JSON\n",
      "Processed 83837238 from JSON\n",
      "Processed 83861112 from JSON\n",
      "Processed 83859984 from JSON\n",
      "Processed 83863024 from JSON\n",
      "Processed 83863550 from JSON\n",
      "Processed 83862393 from JSON\n",
      "Processed 83864724 from JSON\n",
      "Processed 73399146 from JSON\n",
      "Processed 73391128 from JSON\n",
      "Processed 73392518 from JSON\n",
      "Processed 83861345 from JSON\n",
      "Processed 73375773 from JSON\n",
      "Processed 83864832 from JSON\n",
      "Processed 83868144 from JSON\n",
      "Processed 83864306 from JSON\n",
      "Processed 83867608 from JSON\n",
      "Processed 83853070 from JSON\n",
      "Processed 83851269 from JSON\n",
      "Processed 83853816 from JSON\n",
      "Processed 83853645 from JSON\n",
      "Processed 83856668 from JSON\n",
      "Processed 83857173 from JSON\n",
      "Processed 83839816 from JSON\n",
      "Processed 83844865 from JSON\n",
      "Processed 83866542 from JSON\n",
      "Processed 83857452 from JSON\n",
      "Processed 73441151 from JSON\n",
      "Processed 73440273 from JSON\n",
      "Processed 84328005 from JSON\n",
      "Processed 84327886 from JSON\n",
      "Processed 84326852 from JSON\n",
      "Processed 84330466 from JSON\n",
      "Processed 84332626 from JSON\n",
      "Processed 84330219 from JSON\n",
      "Processed 84332455 from JSON\n",
      "Processed 84328997 from JSON\n",
      "Processed 84329008 from JSON\n",
      "Processed 84331887 from JSON\n",
      "Processed 86421933 from JSON\n",
      "Processed 86421793 from JSON\n",
      "Processed 86419363 from JSON\n",
      "Processed 86415570 from JSON\n",
      "Processed 73958877 from JSON\n",
      "Processed 42652830 from JSON\n",
      "Processed 73959584 from JSON\n",
      "Processed 73990095 from JSON\n",
      "Processed 141536020 from JSON\n",
      "Processed 141531924 from JSON\n",
      "Processed 9259374 from JSON\n",
      "Processed 2418176 from JSON\n",
      "Processed 24952807 from JSON\n",
      "Processed 25041752 from JSON\n",
      "Processed 25054883 from JSON\n",
      "Processed 2064976 from JSON\n",
      "Processed 25036302 from JSON\n",
      "Processed 25015255 from JSON\n",
      "Processed 25015890 from JSON\n",
      "Processed 24978117 from JSON\n",
      "Processed 24961009 from JSON\n",
      "Processed 25063031 from JSON\n",
      "Processed 25060134 from JSON\n",
      "Processed 24960871 from JSON\n",
      "Processed 25004536 from JSON\n",
      "Processed 24975044 from JSON\n",
      "Processed 25058543 from JSON\n",
      "Processed 25015215 from JSON\n",
      "Processed 2192099 from JSON\n",
      "Processed 25050201 from JSON\n",
      "Processed 25043984 from JSON\n",
      "Processed 24947497 from JSON\n",
      "Processed 25030700 from JSON\n",
      "Processed 24960513 from JSON\n",
      "Processed 2246166 from JSON\n",
      "Processed 24965000 from JSON\n",
      "Processed 146472672 from JSON\n",
      "Processed 94066275 from JSON\n",
      "Processed 84090954 from JSON\n",
      "Processed 86419582 from JSON\n",
      "Processed 86418022 from JSON\n",
      "Processed 86420919 from JSON\n",
      "Processed 84329360 from JSON\n",
      "Processed 73407275 from JSON\n",
      "Processed 73406878 from JSON\n",
      "Processed 73441800 from JSON\n",
      "Processed 73441893 from JSON\n",
      "Processed 42753217 from JSON\n",
      "Processed 42751583 from JSON\n",
      "Processed 141534881 from JSON\n",
      "Processed 74251534 from JSON\n",
      "Processed 78511100 from JSON\n",
      "Processed 73993192 from JSON\n",
      "Processed 42663985 from JSON\n",
      "Processed 42654105 from JSON\n",
      "Processed 93949913 from JSON\n",
      "Processed 93915642 from JSON\n",
      "Processed 93884568 from JSON\n",
      "Processed 42722510 from JSON\n",
      "Processed 42723359 from JSON\n",
      "Processed 73988655 from JSON\n",
      "Processed 129264577 from JSON\n",
      "Processed 129356603 from JSON\n",
      "Processed 42645851 from JSON\n",
      "Processed 93903577 from JSON\n",
      "Processed 94023100 from JSON\n",
      "Processed 83832829 from JSON\n",
      "Processed 83832627 from JSON\n",
      "Processed 83841623 from JSON\n",
      "Processed 83840543 from JSON\n",
      "Processed 73351530 from JSON\n",
      "Processed 146476061 from JSON\n",
      "Processed 94067122 from JSON\n",
      "Processed 93906723 from JSON\n",
      "Processed 93937040 from JSON\n",
      "Processed 93943249 from JSON\n",
      "Processed 94027993 from JSON\n",
      "Processed 83865058 from JSON\n",
      "Processed 83832456 from JSON\n",
      "Processed 83832797 from JSON\n",
      "Processed 129361296 from JSON\n",
      "Processed 93871933 from JSON\n",
      "Processed 129354070 from JSON\n",
      "Processed 83851266 from JSON\n",
      "Processed 83837158 from JSON\n",
      "Processed 83832920 from JSON\n",
      "Processed 73988098 from JSON\n",
      "Processed 84091136 from JSON\n",
      "Processed 73956994 from JSON\n",
      "Processed 73953988 from JSON\n",
      "Processed 29532502 from JSON\n",
      "Processed 84330046 from JSON\n",
      "Processed 141538567 from JSON\n",
      "Processed 73423140 from JSON\n",
      "Processed 73413002 from JSON\n",
      "Processed 42714190 from JSON\n",
      "Processed 29552081 from JSON\n",
      "Processed 29550636 from JSON\n",
      "Processed 29554397 from JSON\n",
      "Processed 42655402 from JSON\n",
      "Processed 129206244 from JSON\n",
      "Processed 129204178 from JSON\n",
      "Processed 42663645 from JSON\n",
      "Processed 42726690 from JSON\n",
      "Processed 42711526 from JSON\n",
      "Processed 42739573 from JSON\n",
      "Processed 129269247 from JSON\n",
      "Processed 129274683 from JSON\n",
      "Processed 93952307 from JSON\n",
      "Processed 93952150 from JSON\n",
      "Processed 94022317 from JSON\n",
      "Processed 141529802 from JSON\n",
      "Processed 141533012 from JSON\n",
      "Processed 141529693 from JSON\n",
      "Processed 78510579 from JSON\n",
      "Processed 78510144 from JSON\n",
      "Processed 78510175 from JSON\n",
      "Processed 141536174 from JSON\n",
      "Processed 141531908 from JSON\n",
      "Processed 94052794 from JSON\n",
      "Processed 94039735 from JSON\n",
      "Processed 146473799 from JSON\n",
      "Processed 129359564 from JSON\n",
      "Processed 94042269 from JSON\n",
      "Processed 83851591 from JSON\n",
      "Processed 83855771 from JSON\n",
      "Processed 73359256 from JSON\n",
      "Processed 83833119 from JSON\n",
      "Processed 83843024 from JSON\n",
      "Processed 83853674 from JSON\n",
      "Processed 83835898 from JSON\n",
      "Processed 83845602 from JSON\n",
      "Processed 73395212 from JSON\n",
      "Processed 73393595 from JSON\n",
      "Processed 83850961 from JSON\n",
      "Processed 73371870 from JSON\n",
      "Processed 93940612 from JSON\n",
      "Processed 93888639 from JSON\n",
      "Processed 93947163 from JSON\n",
      "Processed 86418456 from JSON\n",
      "Processed 86416157 from JSON\n",
      "Processed 84332530 from JSON\n",
      "Processed 93873426 from JSON\n",
      "Processed 129353364 from JSON\n",
      "Processed 129362517 from JSON\n",
      "Processed 129355043 from JSON\n",
      "Processed 84091865 from JSON\n",
      "Processed 84091339 from JSON\n",
      "Processed 84093436 from JSON\n",
      "Processed 29551964 from JSON\n",
      "Processed 73412062 from JSON\n",
      "Processed 73419171 from JSON\n",
      "Processed 86420854 from JSON\n",
      "Processed 86420513 from JSON\n",
      "Processed 86413690 from JSON\n",
      "Processed 73990809 from JSON\n",
      "Processed 73991763 from JSON\n",
      "Processed 73990467 from JSON\n",
      "Processed 84095021 from JSON\n",
      "Processed 42728558 from JSON\n",
      "Processed 42716553 from JSON\n",
      "Processed 78512428 from JSON\n",
      "Processed 141531334 from JSON\n",
      "Processed 42728495 from JSON\n",
      "Processed 74250920 from JSON\n",
      "Processed 129202715 from JSON\n",
      "Processed 141530564 from JSON\n",
      "Processed 78512240 from JSON\n",
      "Processed 129204766 from JSON\n",
      "Processed 94044475 from JSON\n",
      "Processed 83831905 from JSON\n",
      "Processed 83832410 from JSON\n",
      "Processed 73353785 from JSON\n",
      "Processed 83839860 from JSON\n",
      "Processed 83838209 from JSON\n",
      "Processed 83865245 from JSON\n",
      "Processed 83854940 from JSON\n",
      "Processed 83853505 from JSON\n",
      "Processed 73381546 from JSON\n",
      "Processed 83832629 from JSON\n",
      "Processed 83852052 from JSON\n",
      "Processed 93912355 from JSON\n",
      "Processed 129356201 from JSON\n",
      "Processed 93953152 from JSON\n",
      "Processed 129225750 from JSON\n",
      "Processed 129236815 from JSON\n",
      "Processed 94024167 from JSON\n",
      "Processed 94064271 from JSON\n",
      "Processed 94066570 from JSON\n",
      "Processed 94064411 from JSON\n",
      "Processed 129240520 from JSON\n",
      "Processed 83848145 from JSON\n",
      "Processed 129285639 from JSON\n",
      "Processed 129286997 from JSON\n",
      "Processed 129348905 from JSON\n",
      "Processed 129281086 from JSON\n",
      "Processed 129353118 from JSON\n",
      "Processed 73392050 from JSON\n",
      "Processed 83851888 from JSON\n",
      "Processed 83855463 from JSON\n",
      "Processed 83833818 from JSON\n",
      "Processed 94051685 from JSON\n",
      "Processed 94055973 from JSON\n",
      "Processed 146475072 from JSON\n",
      "Processed 129259772 from JSON\n",
      "Processed 129356978 from JSON\n",
      "Processed 146475940 from JSON\n",
      "Processed 84327095 from JSON\n",
      "Processed 73987794 from JSON\n",
      "Processed 93909680 from JSON\n",
      "Processed 93939694 from JSON\n",
      "Processed 93949864 from JSON\n",
      "Processed 93946409 from JSON\n",
      "Processed 93954387 from JSON\n",
      "Processed 93958567 from JSON\n",
      "Processed 129254171 from JSON\n",
      "Processed 129234717 from JSON\n",
      "Processed 129273912 from JSON\n",
      "Processed 129348780 from JSON\n",
      "Processed 129348115 from JSON\n",
      "Processed 93898465 from JSON\n",
      "Processed 94024586 from JSON\n",
      "Processed 94022629 from JSON\n",
      "Processed 83859597 from JSON\n",
      "Processed 83867406 from JSON\n",
      "Processed 83851283 from JSON\n",
      "Processed 83857281 from JSON\n",
      "Processed 73417121 from JSON\n",
      "Processed 84328517 from JSON\n",
      "Processed 73993025 from JSON\n",
      "Processed 74251739 from JSON\n",
      "Processed 78508286 from JSON\n",
      "Processed 141536518 from JSON\n",
      "Processed 42726616 from JSON\n",
      "Processed 42749978 from JSON\n",
      "Processed 42751896 from JSON\n",
      "Processed 42748557 from JSON\n",
      "Processed 84095161 from JSON\n",
      "Processed 29542332 from JSON\n",
      "Processed 29544864 from JSON\n",
      "Processed 42746056 from JSON\n",
      "Processed 94068624 from JSON\n",
      "Processed 94055246 from JSON\n",
      "Processed 93905500 from JSON\n",
      "Processed 129355806 from JSON\n",
      "Processed 93904189 from JSON\n",
      "Processed 93915732 from JSON\n",
      "Processed 93869934 from JSON\n",
      "Processed 129348611 from JSON\n",
      "Processed 93955699 from JSON\n",
      "Processed 141535220 from JSON\n",
      "Processed 129269756 from JSON\n",
      "Processed 73956872 from JSON\n",
      "Processed 93906767 from JSON\n",
      "Processed 83836452 from JSON\n",
      "Processed 146476290 from JSON\n",
      "Processed 83860994 from JSON\n",
      "Processed 83855495 from JSON\n",
      "Processed 83867469 from JSON\n",
      "Processed 83846374 from JSON\n",
      "Processed 83834805 from JSON\n",
      "Processed 83857840 from JSON\n",
      "Processed 83857282 from JSON\n",
      "Processed 83863708 from JSON\n",
      "Processed 83837020 from JSON\n",
      "Processed 73956889 from JSON\n",
      "Processed 73990902 from JSON\n",
      "Processed 42671999 from JSON\n",
      "Processed 84328424 from JSON\n",
      "Processed 84327964 from JSON\n",
      "Processed 141529696 from JSON\n",
      "Processed 141531367 from JSON\n",
      "Processed 42752636 from JSON\n",
      "Processed 129215021 from JSON\n",
      "Processed 73419438 from JSON\n",
      "Processed 84090693 from JSON\n",
      "Processed 84091805 from JSON\n",
      "Processed 29510842 from JSON\n",
      "Processed 29547220 from JSON\n",
      "Processed 73418745 from JSON\n",
      "Processed 73407915 from JSON\n",
      "Processed 73408033 from JSON\n",
      "Processed 73412421 from JSON\n",
      "Processed 42723099 from JSON\n",
      "Processed 42745365 from JSON\n",
      "Processed 78512393 from JSON\n",
      "Processed 141531630 from JSON\n",
      "Processed 141538352 from JSON\n",
      "Processed 141530442 from JSON\n",
      "Processed 93936686 from JSON\n",
      "Processed 93944122 from JSON\n",
      "Processed 93950561 from JSON\n",
      "Processed 129354835 from JSON\n",
      "Processed 93941969 from JSON\n",
      "Processed 129359582 from JSON\n",
      "Processed 42750631 from JSON\n",
      "Processed 93946421 from JSON\n",
      "Processed 146471465 from JSON\n",
      "Processed 83857579 from JSON\n",
      "Processed 73380515 from JSON\n",
      "Processed 83840283 from JSON\n",
      "Processed 83846483 from JSON\n",
      "Processed 73368441 from JSON\n",
      "Processed 83854138 from JSON\n",
      "Processed 73388735 from JSON\n",
      "Processed 84094456 from JSON\n",
      "Processed 86420325 from JSON\n",
      "Processed 84328519 from JSON\n",
      "Processed 42641366 from JSON\n",
      "Processed 42665126 from JSON\n",
      "Processed 73988612 from JSON\n",
      "Processed 73988782 from JSON\n",
      "Processed 73987842 from JSON\n",
      "Processed 42701158 from JSON\n",
      "Processed 73359320 from JSON\n",
      "Processed 83837177 from JSON\n",
      "Processed 83865527 from JSON\n",
      "Processed 93955960 from JSON\n",
      "Processed 94075803 from JSON\n",
      "Processed 83847068 from JSON\n",
      "Processed 93888370 from JSON\n",
      "Processed 42739003 from JSON\n",
      "Processed 93867540 from JSON\n",
      "Processed 93875891 from JSON\n",
      "Processed 129350143 from JSON\n",
      "Processed 93874843 from JSON\n",
      "Processed 83858768 from JSON\n",
      "Processed 73349182 from JSON\n",
      "Processed 73395899 from JSON\n",
      "Processed 83857671 from JSON\n",
      "Processed 83860794 from JSON\n",
      "Processed 83845746 from JSON\n",
      "Processed 73422623 from JSON\n",
      "Processed 73400698 from JSON\n",
      "Processed 73407079 from JSON\n",
      "Processed 84093827 from JSON\n",
      "Processed 29554804 from JSON\n",
      "Processed 73409828 from JSON\n",
      "Processed 84329847 from JSON\n",
      "Processed 73954126 from JSON\n",
      "Processed 73957459 from JSON\n",
      "Processed 73989678 from JSON\n",
      "Processed 42644498 from JSON\n",
      "Processed 84328192 from JSON\n",
      "Processed 74204161 from JSON\n",
      "Processed 146472203 from JSON\n",
      "Processed 94056359 from JSON\n",
      "Processed 129229912 from JSON\n",
      "Processed 129231986 from JSON\n",
      "Processed 93958968 from JSON\n",
      "Processed 93952953 from JSON\n",
      "Processed 73378364 from JSON\n",
      "Processed 73351846 from JSON\n",
      "Processed 73351721 from JSON\n",
      "Processed 74251648 from JSON\n",
      "Processed 141531213 from JSON\n",
      "Processed 141531910 from JSON\n",
      "Processed 129252785 from JSON\n",
      "Processed 93913479 from JSON\n",
      "Processed 93958177 from JSON\n",
      "Processed 93894996 from JSON\n",
      "Processed 129352474 from JSON\n",
      "Processed 129358193 from JSON\n",
      "Processed 78508548 from JSON\n",
      "Processed 141537785 from JSON\n",
      "Processed 141535905 from JSON\n",
      "Processed 93944137 from JSON\n",
      "Processed 93951050 from JSON\n",
      "Processed 93951827 from JSON\n",
      "Processed 93950280 from JSON\n",
      "Processed 93943103 from JSON\n",
      "Processed 93958811 from JSON\n",
      "Processed 94026391 from JSON\n",
      "Processed 42702999 from JSON\n",
      "Processed 42750556 from JSON\n",
      "Processed 42753207 from JSON\n",
      "Processed 83868643 from JSON\n",
      "Processed 93953335 from JSON\n",
      "Processed 129251349 from JSON\n",
      "Processed 94043895 from JSON\n",
      "Processed 84331331 from JSON\n",
      "Processed 42654760 from JSON\n",
      "Processed 42693491 from JSON\n",
      "Processed 73988443 from JSON\n",
      "Processed 42649805 from JSON\n",
      "Processed 42652074 from JSON\n",
      "Processed 42640923 from JSON\n",
      "Processed 42732422 from JSON\n",
      "Processed 129351876 from JSON\n",
      "Processed 129271190 from JSON\n",
      "Processed 93882945 from JSON\n",
      "Processed 93886163 from JSON\n",
      "Processed 93885146 from JSON\n",
      "Processed 93886909 from JSON\n",
      "Processed 93936778 from JSON\n",
      "Processed 93939506 from JSON\n",
      "Processed 93940452 from JSON\n",
      "Processed 129215965 from JSON\n",
      "Processed 129362614 from JSON\n",
      "Processed 93869436 from JSON\n",
      "Processed 78509021 from JSON\n",
      "Processed 78510852 from JSON\n",
      "Processed 141537229 from JSON\n",
      "Processed 141530521 from JSON\n",
      "Processed 73419114 from JSON\n",
      "Processed 29499607 from JSON\n",
      "Processed 84092298 from JSON\n",
      "Processed 84094643 from JSON\n",
      "Processed 73418375 from JSON\n",
      "Processed 73356626 from JSON\n",
      "Processed 83838925 from JSON\n",
      "Processed 73378396 from JSON\n",
      "Processed 83867392 from JSON\n",
      "Processed 83857874 from JSON\n",
      "Processed 73375157 from JSON\n",
      "Processed 42659216 from JSON\n",
      "Processed 84326578 from JSON\n",
      "Processed 86419654 from JSON\n",
      "Processed 42746291 from JSON\n",
      "Processed 78507062 from JSON\n",
      "Processed 78506850 from JSON\n",
      "Processed 78509455 from JSON\n",
      "Processed 78508281 from JSON\n",
      "Processed 78509828 from JSON\n",
      "Processed 86416383 from JSON\n",
      "Processed 86420618 from JSON\n",
      "Processed 84332568 from JSON\n",
      "Processed 84326453 from JSON\n",
      "Processed 83855824 from JSON\n",
      "Processed 73373121 from JSON\n",
      "Processed 83865809 from JSON\n",
      "Processed 73387658 from JSON\n",
      "Processed 146471633 from JSON\n",
      "Processed 93951251 from JSON\n",
      "Processed 93951732 from JSON\n",
      "Processed 93911844 from JSON\n",
      "Processed 93888632 from JSON\n",
      "Processed 129351194 from JSON\n",
      "Processed 129349865 from JSON\n",
      "Processed 93906826 from JSON\n",
      "Processed 129261842 from JSON\n",
      "Processed 93943380 from JSON\n",
      "Processed 73988569 from JSON\n",
      "Processed 129203200 from JSON\n",
      "Processed 129206052 from JSON\n",
      "Processed 129228878 from JSON\n",
      "Processed 93937794 from JSON\n",
      "Processed 93955695 from JSON\n",
      "Processed 93868728 from JSON\n",
      "Processed 129264788 from JSON\n",
      "Processed 129279629 from JSON\n",
      "Processed 129286047 from JSON\n",
      "Processed 83863012 from JSON\n",
      "Processed 83860068 from JSON\n",
      "Processed 73378429 from JSON\n",
      "Processed 73350643 from JSON\n",
      "Processed 83840534 from JSON\n",
      "Processed 83846626 from JSON\n",
      "Processed 73349913 from JSON\n",
      "Processed 73393958 from JSON\n",
      "Processed 94057316 from JSON\n",
      "Processed 73356595 from JSON\n",
      "Processed 83838661 from JSON\n",
      "Processed 83845344 from JSON\n",
      "Processed 73352137 from JSON\n",
      "Processed 83850610 from JSON\n",
      "Processed 83832012 from JSON\n",
      "Processed 73417450 from JSON\n",
      "Processed 84094769 from JSON\n",
      "Processed 84094783 from JSON\n",
      "Processed 73418453 from JSON\n",
      "Processed 73406977 from JSON\n",
      "Processed 73422967 from JSON\n",
      "Processed 73406358 from JSON\n",
      "Processed 73407096 from JSON\n",
      "Processed 29522260 from JSON\n",
      "Processed 94067378 from JSON\n",
      "Processed 94074291 from JSON\n",
      "Processed 94070826 from JSON\n",
      "Processed 129351366 from JSON\n",
      "Processed 129351241 from JSON\n",
      "Processed 129350611 from JSON\n",
      "Processed 129356873 from JSON\n",
      "Processed 93891165 from JSON\n",
      "Processed 93953922 from JSON\n",
      "Processed 93940669 from JSON\n",
      "Processed 93940467 from JSON\n",
      "Processed 93943163 from JSON\n",
      "Processed 93909413 from JSON\n",
      "Processed 129282222 from JSON\n",
      "Processed 129281142 from JSON\n",
      "Processed 94066438 from JSON\n",
      "Processed 129232056 from JSON\n",
      "Processed 129236515 from JSON\n",
      "Processed 129255370 from JSON\n",
      "Processed 129236825 from JSON\n",
      "Processed 73371133 from JSON\n",
      "Processed 83867394 from JSON\n",
      "Processed 83858893 from JSON\n",
      "Processed 73372989 from JSON\n",
      "Processed 83837892 from JSON\n",
      "Processed 83836611 from JSON\n",
      "Processed 73988755 from JSON\n",
      "Processed 73988320 from JSON\n",
      "Processed 42709271 from JSON\n",
      "Processed 42707453 from JSON\n",
      "Processed 86417880 from JSON\n",
      "Processed 84327084 from JSON\n",
      "Processed 42667739 from JSON\n",
      "Processed 42665795 from JSON\n",
      "Processed 78511156 from JSON\n",
      "Processed 141538666 from JSON\n",
      "Processed 74203426 from JSON\n",
      "Processed 84094582 from JSON\n",
      "Processed 84093844 from JSON\n",
      "Processed 83840768 from JSON\n",
      "Processed 83847055 from JSON\n",
      "Processed 83850767 from JSON\n",
      "Processed 83851210 from JSON\n",
      "Processed 83835346 from JSON\n",
      "Processed 83835238 from JSON\n",
      "Processed 83860641 from JSON\n",
      "Processed 73373867 from JSON\n",
      "Processed 93903338 from JSON\n",
      "Processed 129349246 from JSON\n",
      "Processed 93942874 from JSON\n",
      "Processed 93899866 from JSON\n",
      "Processed 129359137 from JSON\n",
      "Processed 83846906 from JSON\n",
      "Processed 73392368 from JSON\n",
      "Processed 73395468 from JSON\n",
      "Processed 73375268 from JSON\n",
      "Processed 73376425 from JSON\n",
      "Processed 83860301 from JSON\n",
      "Processed 83864079 from JSON\n",
      "Processed 83837817 from JSON\n",
      "Processed 73354452 from JSON\n",
      "Processed 83837475 from JSON\n",
      "Processed 73368477 from JSON\n",
      "Processed 83855718 from JSON\n",
      "Processed 73991709 from JSON\n",
      "Processed 42729023 from JSON\n",
      "Processed 42699834 from JSON\n",
      "Processed 84331738 from JSON\n",
      "Processed 86419450 from JSON\n",
      "Processed 86419032 from JSON\n",
      "Processed 93908255 from JSON\n",
      "Processed 94078441 from JSON\n",
      "Processed 94065854 from JSON\n",
      "Processed 83847506 from JSON\n",
      "Processed 73361382 from JSON\n",
      "Processed 73406885 from JSON\n",
      "Processed 73406311 from JSON\n",
      "Processed 73412596 from JSON\n",
      "Processed 73408348 from JSON\n",
      "Processed 73419441 from JSON\n",
      "Processed 93947342 from JSON\n",
      "Processed 73961276 from JSON\n",
      "Processed 42666504 from JSON\n",
      "Processed 141533143 from JSON\n",
      "Processed 73990489 from JSON\n",
      "Processed 78510943 from JSON\n",
      "Processed 78512576 from JSON\n",
      "Processed 78510075 from JSON\n",
      "Processed 129359556 from JSON\n",
      "Processed 129268827 from JSON\n",
      "Processed 29530550 from JSON\n",
      "Processed 129358041 from JSON\n",
      "Processed 129361195 from JSON\n",
      "Processed 129361119 from JSON\n",
      "Processed 86417632 from JSON\n",
      "Processed 84330533 from JSON\n",
      "Processed 42712706 from JSON\n",
      "Processed 42719149 from JSON\n",
      "Processed 129254648 from JSON\n",
      "Processed 129209383 from JSON\n",
      "Processed 129211922 from JSON\n",
      "Processed 84092812 from JSON\n",
      "Processed 93906450 from JSON\n",
      "Processed 93907268 from JSON\n",
      "Processed 94030055 from JSON\n",
      "Processed 94066346 from JSON\n",
      "Processed 94043231 from JSON\n",
      "Processed 129351988 from JSON\n",
      "Processed 129357272 from JSON\n",
      "Processed 83835209 from JSON\n",
      "Processed 73349233 from JSON\n",
      "Processed 83840645 from JSON\n",
      "Processed 73957586 from JSON\n",
      "Processed 42655921 from JSON\n",
      "Processed 86420305 from JSON\n",
      "Processed 73993371 from JSON\n",
      "Processed 73992772 from JSON\n",
      "Processed 42654050 from JSON\n",
      "Processed 42683775 from JSON\n",
      "Processed 42683838 from JSON\n",
      "Processed 42736017 from JSON\n",
      "Processed 93939393 from JSON\n",
      "Processed 93867878 from JSON\n",
      "Processed 78509096 from JSON\n",
      "Processed 78506819 from JSON\n",
      "Processed 83851476 from JSON\n",
      "Processed 83852260 from JSON\n",
      "Processed 83855593 from JSON\n",
      "Processed 83858585 from JSON\n",
      "Processed 83845734 from JSON\n",
      "Processed 83855841 from JSON\n",
      "Processed 83844825 from JSON\n",
      "Processed 78511899 from JSON\n",
      "Processed 73387288 from JSON\n",
      "Processed 141532918 from JSON\n",
      "Processed 93897084 from JSON\n",
      "Processed 83847336 from JSON\n",
      "Processed 83859944 from JSON\n",
      "Processed 84094692 from JSON\n",
      "Processed 84093303 from JSON\n",
      "Processed 83848897 from JSON\n",
      "Processed 83848727 from JSON\n",
      "Processed 83849218 from JSON\n",
      "Processed 83852278 from JSON\n",
      "Processed 83850272 from JSON\n",
      "Processed 83842604 from JSON\n",
      "Processed 73354579 from JSON\n",
      "Processed 73377367 from JSON\n",
      "Processed 83869728 from JSON\n",
      "Processed 83863650 from JSON\n",
      "Processed 83867397 from JSON\n",
      "Processed 73351431 from JSON\n",
      "Processed 129354096 from JSON\n",
      "Processed 93946309 from JSON\n",
      "Processed 93948590 from JSON\n",
      "Processed 93953828 from JSON\n",
      "Processed 93889927 from JSON\n",
      "Processed 73423893 from JSON\n",
      "Processed 29559494 from JSON\n",
      "Processed 73406964 from JSON\n",
      "Processed 73407518 from JSON\n",
      "Processed 73416608 from JSON\n",
      "Processed 29506180 from JSON\n",
      "Processed 29530381 from JSON\n",
      "Processed 73404261 from JSON\n",
      "Processed 83856395 from JSON\n",
      "Processed 73348729 from JSON\n",
      "Processed 73381445 from JSON\n",
      "Processed 73380459 from JSON\n",
      "Processed 73374003 from JSON\n",
      "Processed 73389184 from JSON\n",
      "Processed 42721999 from JSON\n",
      "Processed 146474203 from JSON\n",
      "Processed 93936850 from JSON\n",
      "Processed 94037071 from JSON\n",
      "Processed 94039109 from JSON\n",
      "Processed 146472632 from JSON\n",
      "Processed 42660180 from JSON\n",
      "Processed 74251714 from JSON\n",
      "Processed 129361104 from JSON\n",
      "Processed 73990722 from JSON\n",
      "Processed 73989636 from JSON\n",
      "Processed 42641851 from JSON\n",
      "Processed 86421028 from JSON\n",
      "Processed 86421523 from JSON\n",
      "Processed 86416923 from JSON\n",
      "Processed 84326471 from JSON\n",
      "Processed 84332663 from JSON\n",
      "Processed 73416313 from JSON\n",
      "Processed 73422721 from JSON\n",
      "Processed 73410050 from JSON\n",
      "Processed 94039124 from JSON\n",
      "Processed 94061134 from JSON\n",
      "Processed 94075267 from JSON\n",
      "Processed 83834020 from JSON\n",
      "Processed 83834563 from JSON\n",
      "Processed 73390428 from JSON\n",
      "Processed 129359573 from JSON\n",
      "Processed 129356118 from JSON\n",
      "Processed 129351928 from JSON\n",
      "Processed 129353746 from JSON\n",
      "Processed 93953858 from JSON\n",
      "Processed 93952329 from JSON\n",
      "Processed 73351805 from JSON\n",
      "Processed 83845053 from JSON\n",
      "Processed 83845659 from JSON\n",
      "Processed 83846070 from JSON\n",
      "Processed 83847927 from JSON\n",
      "Processed 73365659 from JSON\n",
      "Processed 73373791 from JSON\n",
      "Processed 83868942 from JSON\n",
      "Processed 83833421 from JSON\n",
      "Processed 73352031 from JSON\n",
      "Processed 29523609 from JSON\n",
      "Processed 29515226 from JSON\n",
      "Processed 84095109 from JSON\n",
      "Processed 84090591 from JSON\n",
      "Processed 84094199 from JSON\n",
      "Processed 73993328 from JSON\n",
      "Processed 73987864 from JSON\n",
      "Processed 73959577 from JSON\n",
      "Processed 42675750 from JSON\n",
      "Processed 86416270 from JSON\n",
      "Processed 42717658 from JSON\n",
      "Processed 86413822 from JSON\n",
      "Processed 84326535 from JSON\n",
      "Processed 84329868 from JSON\n",
      "Processed 84331337 from JSON\n",
      "Processed 93875189 from JSON\n",
      "Processed 129247931 from JSON\n",
      "Processed 42689403 from JSON\n",
      "Processed 42710378 from JSON\n",
      "Processed 78511633 from JSON\n",
      "Processed 78508217 from JSON\n",
      "Processed 25009107 from JSON\n",
      "Processed 25048412 from JSON\n",
      "Processed 25018601 from JSON\n",
      "Processed 24989492 from JSON\n",
      "Processed 2094649 from JSON\n",
      "Processed 25036660 from JSON\n",
      "Processed 24968951 from JSON\n",
      "Processed 24942736 from JSON\n",
      "Processed 25059921 from JSON\n",
      "Processed 24952482 from JSON\n",
      "Processed 84094716 from JSON\n",
      "Processed 84092323 from JSON\n",
      "Processed 84091630 from JSON\n",
      "Processed 84326602 from JSON\n",
      "Processed 84326804 from JSON\n",
      "Processed 84326912 from JSON\n",
      "Processed 86421765 from JSON\n",
      "Processed 84332856 from JSON\n",
      "Processed 73412990 from JSON\n",
      "Processed 73419061 from JSON\n",
      "Processed 42746921 from JSON\n",
      "Processed 74204280 from JSON\n",
      "Processed 78508366 from JSON\n",
      "Processed 141535682 from JSON\n",
      "Processed 73988624 from JSON\n",
      "Processed 93951723 from JSON\n",
      "Processed 93953077 from JSON\n",
      "Processed 93901108 from JSON\n",
      "Processed 93939541 from JSON\n",
      "Processed 93941678 from JSON\n",
      "Processed 93891809 from JSON\n",
      "Processed 93892299 from JSON\n",
      "Processed 93944886 from JSON\n",
      "Processed 93943960 from JSON\n",
      "Processed 93946875 from JSON\n",
      "Processed 93950597 from JSON\n",
      "Processed 73990326 from JSON\n",
      "Processed 129268959 from JSON\n",
      "Processed 129356526 from JSON\n",
      "Processed 42699625 from JSON\n",
      "Processed 129356076 from JSON\n",
      "Processed 83835121 from JSON\n",
      "Processed 83834414 from JSON\n",
      "Processed 83842378 from JSON\n",
      "Processed 73386525 from JSON\n",
      "Processed 94049067 from JSON\n",
      "Processed 146474630 from JSON\n",
      "Processed 94054131 from JSON\n",
      "Processed 42686076 from JSON\n",
      "Processed 42691544 from JSON\n",
      "Processed 94067355 from JSON\n",
      "Processed 94067153 from JSON\n",
      "Processed 93938214 from JSON\n",
      "Processed 93958306 from JSON\n",
      "Processed 94027993 from JSON\n",
      "Processed 83861373 from JSON\n",
      "Processed 83862129 from JSON\n",
      "Processed 83864769 from JSON\n",
      "Processed 83849906 from JSON\n",
      "Processed 83861063 from JSON\n",
      "Processed 83862376 from JSON\n",
      "Processed 83847001 from JSON\n",
      "Processed 83870805 from JSON\n",
      "Processed 83865692 from JSON\n",
      "Processed 129360387 from JSON\n",
      "Processed 129353659 from JSON\n",
      "Processed 129362794 from JSON\n",
      "Processed 129362655 from JSON\n",
      "Processed 129245332 from JSON\n",
      "Processed 73953956 from JSON\n",
      "Processed 83856898 from JSON\n",
      "Processed 83846015 from JSON\n",
      "Processed 83848422 from JSON\n",
      "Processed 83848547 from JSON\n",
      "Processed 83847993 from JSON\n",
      "Processed 83831423 from JSON\n",
      "Processed 83860807 from JSON\n",
      "Processed 73379456 from JSON\n",
      "Processed 83866634 from JSON\n",
      "Processed 73988827 from JSON\n",
      "Processed 73990358 from JSON\n",
      "Processed 73953926 from JSON\n",
      "Processed 42646855 from JSON\n",
      "Processed 84328421 from JSON\n",
      "Processed 86420576 from JSON\n",
      "Processed 84329424 from JSON\n",
      "Processed 42665711 from JSON\n",
      "Processed 78508303 from JSON\n",
      "Processed 78509539 from JSON\n",
      "Processed 78508194 from JSON\n",
      "Processed 141533942 from JSON\n",
      "Processed 141533632 from JSON\n",
      "Processed 141533555 from JSON\n",
      "Processed 141534806 from JSON\n",
      "Processed 141533618 from JSON\n",
      "Processed 141538473 from JSON\n",
      "Processed 73412605 from JSON\n",
      "Processed 73413019 from JSON\n",
      "Processed 84093512 from JSON\n",
      "Processed 42745392 from JSON\n",
      "Processed 74202836 from JSON\n",
      "Processed 74203916 from JSON\n",
      "Processed 42731447 from JSON\n",
      "Processed 94022115 from JSON\n",
      "Processed 78512520 from JSON\n",
      "Processed 141535669 from JSON\n",
      "Processed 146472068 from JSON\n",
      "Processed 93909884 from JSON\n",
      "Processed 94059904 from JSON\n",
      "Processed 94067200 from JSON\n",
      "Processed 94060759 from JSON\n",
      "Processed 94069484 from JSON\n",
      "Processed 146476154 from JSON\n",
      "Processed 83836529 from JSON\n",
      "Processed 83842348 from JSON\n",
      "Processed 83842641 from JSON\n",
      "Processed 73354383 from JSON\n",
      "Processed 83846357 from JSON\n",
      "Processed 83846124 from JSON\n",
      "Processed 83847172 from JSON\n",
      "Processed 73390558 from JSON\n",
      "Processed 73394101 from JSON\n",
      "Processed 73380636 from JSON\n",
      "Processed 83871063 from JSON\n",
      "Processed 83870248 from JSON\n",
      "Processed 83860713 from JSON\n",
      "Processed 83866108 from JSON\n",
      "Processed 83866139 from JSON\n",
      "Processed 93936875 from JSON\n",
      "Processed 93937195 from JSON\n",
      "Processed 93940751 from JSON\n",
      "Processed 129356712 from JSON\n",
      "Processed 129356217 from JSON\n",
      "Processed 93940270 from JSON\n",
      "Processed 93940580 from JSON\n",
      "Processed 93943558 from JSON\n",
      "Processed 93945206 from JSON\n",
      "Processed 93946951 from JSON\n",
      "Processed 93948940 from JSON\n",
      "Processed 93951227 from JSON\n",
      "Processed 93953975 from JSON\n",
      "Processed 93953432 from JSON\n",
      "Processed 129357171 from JSON\n",
      "Processed 129257615 from JSON\n",
      "Processed 129259109 from JSON\n",
      "Processed 93952105 from JSON\n",
      "Processed 93954125 from JSON\n",
      "Processed 93954637 from JSON\n",
      "Processed 93954808 from JSON\n",
      "Processed 84332268 from JSON\n",
      "Processed 86421935 from JSON\n",
      "Processed 86418672 from JSON\n",
      "Processed 86414865 from JSON\n",
      "Processed 129360605 from JSON\n",
      "Processed 129362005 from JSON\n",
      "Processed 93873426 from JSON\n",
      "Processed 129353395 from JSON\n",
      "Processed 129352347 from JSON\n",
      "Processed 129361514 from JSON\n",
      "Processed 129252944 from JSON\n",
      "Processed 129252557 from JSON\n",
      "Processed 129249681 from JSON\n",
      "Processed 84094578 from JSON\n",
      "Processed 86420809 from JSON\n",
      "Processed 86417779 from JSON\n",
      "Processed 86414631 from JSON\n",
      "Processed 86415449 from JSON\n",
      "Processed 86414600 from JSON\n",
      "Processed 86421996 from JSON\n",
      "Processed 42668393 from JSON\n",
      "Processed 42670019 from JSON\n",
      "Processed 73988501 from JSON\n",
      "Processed 84093885 from JSON\n",
      "Processed 73961379 from JSON\n",
      "Processed 42674275 from JSON\n",
      "Processed 42711882 from JSON\n",
      "Processed 78511393 from JSON\n",
      "Processed 78511379 from JSON\n",
      "Processed 84331824 from JSON\n",
      "Processed 42686667 from JSON\n",
      "Processed 78509569 from JSON\n",
      "Processed 78509817 from JSON\n",
      "Processed 78507020 from JSON\n",
      "Processed 78509211 from JSON\n",
      "Processed 141536238 from JSON\n",
      "Processed 141529959 from JSON\n",
      "Processed 74203638 from JSON\n",
      "Processed 83838379 from JSON\n",
      "Processed 83839132 from JSON\n",
      "Processed 83839536 from JSON\n",
      "Processed 73354740 from JSON\n",
      "Processed 83863256 from JSON\n",
      "Processed 83863458 from JSON\n",
      "Processed 83865461 from JSON\n",
      "Processed 83854368 from JSON\n",
      "Processed 83856559 from JSON\n",
      "Processed 83857343 from JSON\n",
      "Processed 83855695 from JSON\n",
      "Processed 83856294 from JSON\n",
      "Processed 83860000 from JSON\n",
      "Processed 83865803 from JSON\n",
      "Processed 83835077 from JSON\n",
      "Processed 83849751 from JSON\n",
      "Processed 83852052 from JSON\n",
      "Processed 129356124 from JSON\n",
      "Processed 129358858 from JSON\n",
      "Processed 93940659 from JSON\n",
      "Processed 93942864 from JSON\n",
      "Processed 93943759 from JSON\n",
      "Processed 93896770 from JSON\n",
      "Processed 146473534 from JSON\n",
      "Processed 94056463 from JSON\n",
      "Processed 129227352 from JSON\n",
      "Processed 93947441 from JSON\n",
      "Processed 93957750 from JSON\n",
      "Processed 93954559 from JSON\n",
      "Processed 93948817 from JSON\n",
      "Processed 93909883 from JSON\n",
      "Processed 93937738 from JSON\n",
      "Processed 146473116 from JSON\n",
      "Processed 83847623 from JSON\n",
      "Processed 141534744 from JSON\n",
      "Processed 129242742 from JSON\n",
      "Processed 83832535 from JSON\n",
      "Processed 83834740 from JSON\n",
      "Processed 83832908 from JSON\n",
      "Processed 83833413 from JSON\n",
      "Processed 83844244 from JSON\n",
      "Processed 83866820 from JSON\n",
      "Processed 129360404 from JSON\n",
      "Processed 129348967 from JSON\n",
      "Processed 129281738 from JSON\n",
      "Processed 129358098 from JSON\n",
      "Processed 129358005 from JSON\n",
      "Processed 129349410 from JSON\n",
      "Processed 129351530 from JSON\n",
      "Processed 129349845 from JSON\n",
      "Processed 83867885 from JSON\n",
      "Processed 73387265 from JSON\n",
      "Processed 83850917 from JSON\n",
      "Processed 83851763 from JSON\n",
      "Processed 83841905 from JSON\n",
      "Processed 83847376 from JSON\n",
      "Processed 83833243 from JSON\n",
      "Processed 94063022 from JSON\n",
      "Processed 94055353 from JSON\n",
      "Processed 146473519 from JSON\n",
      "Processed 146472237 from JSON\n",
      "Processed 93942399 from JSON\n",
      "Processed 129356125 from JSON\n",
      "Processed 146476152 from JSON\n",
      "Processed 146473331 from JSON\n",
      "Processed 84327127 from JSON\n",
      "Processed 84326465 from JSON\n",
      "Processed 84329952 from JSON\n",
      "Processed 129357856 from JSON\n",
      "Processed 93876214 from JSON\n",
      "Processed 129356947 from JSON\n",
      "Processed 129361965 from JSON\n",
      "Processed 93936796 from JSON\n",
      "Processed 93949895 from JSON\n",
      "Processed 93946423 from JSON\n",
      "Processed 93938660 from JSON\n",
      "Processed 93940968 from JSON\n",
      "Processed 93939973 from JSON\n",
      "Processed 94059610 from JSON\n",
      "Processed 129205922 from JSON\n",
      "Processed 93895877 from JSON\n",
      "Processed 94030451 from JSON\n",
      "Processed 83839056 from JSON\n",
      "Processed 83836963 from JSON\n",
      "Processed 83860638 from JSON\n",
      "Processed 83862487 from JSON\n",
      "Processed 83859489 from JSON\n",
      "Processed 83863163 from JSON\n",
      "Processed 83868562 from JSON\n",
      "Processed 83866744 from JSON\n",
      "Processed 83852767 from JSON\n",
      "Processed 83853366 from JSON\n",
      "Processed 83853816 from JSON\n",
      "Processed 83854136 from JSON\n",
      "Processed 83856079 from JSON\n",
      "Processed 83855975 from JSON\n",
      "Processed 83839537 from JSON\n",
      "Processed 83835078 from JSON\n",
      "Processed 73398439 from JSON\n",
      "Processed 86421111 from JSON\n",
      "Processed 84330543 from JSON\n",
      "Processed 84332176 from JSON\n",
      "Processed 84328593 from JSON\n",
      "Processed 42689319 from JSON\n",
      "Processed 42667005 from JSON\n",
      "Processed 141535856 from JSON\n",
      "Processed 141535281 from JSON\n",
      "Processed 141532275 from JSON\n",
      "Processed 141538615 from JSON\n",
      "Processed 78509816 from JSON\n",
      "Processed 74252213 from JSON\n",
      "Processed 141532198 from JSON\n",
      "Processed 141536688 from JSON\n",
      "Processed 141535173 from JSON\n",
      "Processed 73440475 from JSON\n",
      "Processed 73417462 from JSON\n",
      "Processed 84090490 from JSON\n",
      "Processed 84093514 from JSON\n",
      "Processed 84092434 from JSON\n",
      "Processed 73407850 from JSON\n",
      "Processed 29552379 from JSON\n",
      "Processed 74203280 from JSON\n",
      "Processed 78511950 from JSON\n",
      "Processed 78511208 from JSON\n",
      "Processed 78509830 from JSON\n",
      "Processed 94068624 from JSON\n",
      "Processed 146472236 from JSON\n",
      "Processed 146472281 from JSON\n",
      "Processed 129358519 from JSON\n",
      "Processed 129361500 from JSON\n",
      "Processed 93885086 from JSON\n",
      "Processed 93939554 from JSON\n",
      "Processed 93938582 from JSON\n",
      "Processed 129285606 from JSON\n",
      "Processed 129357732 from JSON\n",
      "Processed 129361283 from JSON\n",
      "Processed 129360343 from JSON\n",
      "Processed 129362053 from JSON\n",
      "Processed 129349289 from JSON\n",
      "Processed 129349070 from JSON\n",
      "Processed 129352984 from JSON\n",
      "Processed 93944091 from JSON\n",
      "Processed 93945544 from JSON\n",
      "Processed 93947780 from JSON\n",
      "Processed 93953802 from JSON\n",
      "Processed 93956591 from JSON\n",
      "Processed 94026280 from JSON\n",
      "Processed 141537721 from JSON\n",
      "Processed 129250938 from JSON\n",
      "Processed 73956531 from JSON\n",
      "Processed 93951332 from JSON\n",
      "Processed 93951192 from JSON\n",
      "Processed 93950207 from JSON\n",
      "Processed 93881976 from JSON\n",
      "Processed 93937440 from JSON\n",
      "Processed 93939756 from JSON\n",
      "Processed 93898262 from JSON\n",
      "Processed 83831488 from JSON\n",
      "Processed 146476478 from JSON\n",
      "Processed 83860901 from JSON\n",
      "Processed 83849986 from JSON\n",
      "Processed 73354324 from JSON\n",
      "Processed 83835125 from JSON\n",
      "Processed 83835745 from JSON\n",
      "Processed 83833352 from JSON\n",
      "Processed 83858146 from JSON\n",
      "Processed 83861067 from JSON\n",
      "Processed 83861531 from JSON\n",
      "Processed 83859086 from JSON\n",
      "Processed 83865494 from JSON\n",
      "Processed 83866079 from JSON\n",
      "Processed 83840376 from JSON\n",
      "Processed 83840826 from JSON\n",
      "Processed 83851068 from JSON\n",
      "Processed 83843368 from JSON\n",
      "Processed 83846451 from JSON\n",
      "Processed 83842846 from JSON\n",
      "Processed 83841146 from JSON\n",
      "Processed 83834836 from JSON\n",
      "Processed 73383380 from JSON\n",
      "Processed 83868936 from JSON\n",
      "Processed 73383986 from JSON\n",
      "Processed 73398252 from JSON\n",
      "Processed 83868208 from JSON\n",
      "Processed 73354278 from JSON\n",
      "Processed 42662087 from JSON\n",
      "Processed 73955514 from JSON\n",
      "Processed 73958614 from JSON\n",
      "Processed 42682814 from JSON\n",
      "Processed 86413876 from JSON\n",
      "Processed 86421608 from JSON\n",
      "Processed 86418516 from JSON\n",
      "Processed 84332007 from JSON\n",
      "Processed 84329131 from JSON\n",
      "Processed 84332627 from JSON\n",
      "Processed 84327933 from JSON\n",
      "Processed 84326699 from JSON\n",
      "Processed 42735118 from JSON\n",
      "Processed 74202776 from JSON\n",
      "Processed 78512008 from JSON\n",
      "Processed 78512503 from JSON\n",
      "Processed 42752030 from JSON\n",
      "Processed 78508564 from JSON\n",
      "Processed 73408203 from JSON\n",
      "Processed 73441260 from JSON\n",
      "Processed 73402623 from JSON\n",
      "Processed 73439855 from JSON\n",
      "Processed 42737449 from JSON\n",
      "Processed 42745240 from JSON\n",
      "Processed 78510544 from JSON\n",
      "Processed 78512223 from JSON\n",
      "Processed 78511871 from JSON\n",
      "Processed 141532664 from JSON\n",
      "Processed 141537784 from JSON\n",
      "Processed 141537102 from JSON\n",
      "Processed 78512160 from JSON\n",
      "Processed 141533946 from JSON\n",
      "Processed 129355713 from JSON\n",
      "Processed 93945295 from JSON\n",
      "Processed 129356747 from JSON\n",
      "Processed 129356127 from JSON\n",
      "Processed 93903091 from JSON\n",
      "Processed 93915685 from JSON\n",
      "Processed 93937209 from JSON\n",
      "Processed 93937797 from JSON\n",
      "Processed 93939724 from JSON\n",
      "Processed 93940548 from JSON\n",
      "Processed 93943725 from JSON\n",
      "Processed 93944153 from JSON\n",
      "Processed 93944711 from JSON\n",
      "Processed 93944432 from JSON\n",
      "Processed 93947626 from JSON\n",
      "Processed 93948054 from JSON\n",
      "Processed 93951672 from JSON\n",
      "Processed 93951595 from JSON\n",
      "Processed 93949970 from JSON\n",
      "Processed 93954556 from JSON\n",
      "Processed 94028054 from JSON\n",
      "Processed 146472761 from JSON\n",
      "Processed 146474750 from JSON\n",
      "Processed 146474628 from JSON\n",
      "Processed 146475582 from JSON\n",
      "Processed 83834217 from JSON\n",
      "Processed 83835328 from JSON\n",
      "Processed 83835575 from JSON\n",
      "Processed 83834697 from JSON\n",
      "Processed 83857656 from JSON\n",
      "Processed 83851829 from JSON\n",
      "Processed 83860452 from JSON\n",
      "Processed 83862566 from JSON\n",
      "Processed 83864740 from JSON\n",
      "Processed 73396512 from JSON\n",
      "Processed 86419190 from JSON\n",
      "Processed 86420837 from JSON\n",
      "Processed 86421854 from JSON\n",
      "Processed 84331517 from JSON\n",
      "Processed 84332969 from JSON\n",
      "Processed 86414676 from JSON\n",
      "Processed 86414861 from JSON\n",
      "Processed 84327376 from JSON\n",
      "Processed 42681982 from JSON\n",
      "Processed 42667285 from JSON\n",
      "Processed 73956037 from JSON\n",
      "Processed 73990888 from JSON\n",
      "Processed 42647643 from JSON\n",
      "Processed 94066977 from JSON\n",
      "Processed 83841332 from JSON\n",
      "Processed 83841736 from JSON\n",
      "Processed 83836934 from JSON\n",
      "Processed 73352071 from JSON\n",
      "Processed 83837083 from JSON\n",
      "Processed 83831674 from JSON\n",
      "Processed 83839863 from JSON\n",
      "Processed 83842241 from JSON\n",
      "Processed 73361969 from JSON\n",
      "Processed 83856266 from JSON\n",
      "Processed 73399566 from JSON\n",
      "Processed 93955991 from JSON\n",
      "Processed 94067514 from JSON\n",
      "Processed 93905129 from JSON\n",
      "Processed 83859955 from JSON\n",
      "Processed 83853508 from JSON\n",
      "Processed 83853647 from JSON\n",
      "Processed 83866948 from JSON\n",
      "Processed 83866931 from JSON\n",
      "Processed 93890041 from JSON\n",
      "Processed 129363040 from JSON\n",
      "Processed 129361594 from JSON\n",
      "Processed 129362162 from JSON\n",
      "Processed 129354044 from JSON\n",
      "Processed 83867579 from JSON\n",
      "Processed 73384448 from JSON\n",
      "Processed 83833246 from JSON\n",
      "Processed 83836656 from JSON\n",
      "Processed 73371394 from JSON\n",
      "Processed 73392085 from JSON\n",
      "Processed 73392179 from JSON\n",
      "Processed 83868363 from JSON\n",
      "Processed 73409828 from JSON\n",
      "Processed 73441976 from JSON\n",
      "Processed 86420278 from JSON\n",
      "Processed 42680795 from JSON\n",
      "Processed 73955390 from JSON\n",
      "Processed 73961412 from JSON\n",
      "Processed 42648584 from JSON\n",
      "Processed 86420588 from JSON\n",
      "Processed 86421327 from JSON\n",
      "Processed 86418901 from JSON\n",
      "Processed 42742158 from JSON\n",
      "Processed 94038148 from JSON\n",
      "Processed 146475459 from JSON\n",
      "Processed 94034975 from JSON\n",
      "Processed 129348860 from JSON\n",
      "Processed 93904884 from JSON\n",
      "Processed 93939569 from JSON\n",
      "Processed 93940547 from JSON\n",
      "Processed 93959257 from JSON\n",
      "Processed 93871665 from JSON\n",
      "Processed 73373770 from JSON\n",
      "Processed 73373864 from JSON\n",
      "Processed 83861533 from JSON\n",
      "Processed 83862149 from JSON\n",
      "Processed 83836764 from JSON\n",
      "Processed 83838830 from JSON\n",
      "Processed 83840455 from JSON\n",
      "Processed 94058595 from JSON\n",
      "Processed 146474906 from JSON\n",
      "Processed 129269211 from JSON\n",
      "Processed 93949164 from JSON\n",
      "Processed 93949753 from JSON\n",
      "Processed 93951347 from JSON\n",
      "Processed 93958906 from JSON\n",
      "Processed 129349940 from JSON\n",
      "Processed 129353631 from JSON\n",
      "Processed 129357811 from JSON\n",
      "Processed 129358193 from JSON\n",
      "Processed 93937626 from JSON\n",
      "Processed 93938302 from JSON\n",
      "Processed 93942891 from JSON\n",
      "Processed 93951455 from JSON\n",
      "Processed 78506528 from JSON\n",
      "Processed 141529838 from JSON\n",
      "Processed 141537040 from JSON\n",
      "Processed 141534919 from JSON\n",
      "Processed 141533233 from JSON\n",
      "Processed 78510637 from JSON\n",
      "Processed 78511003 from JSON\n",
      "Processed 83831707 from JSON\n",
      "Processed 93949163 from JSON\n",
      "Processed 93950918 from JSON\n",
      "Processed 93940313 from JSON\n",
      "Processed 93955432 from JSON\n",
      "Processed 93954554 from JSON\n",
      "Processed 93957034 from JSON\n",
      "Processed 94039306 from JSON\n",
      "Processed 146471742 from JSON\n",
      "Processed 74251430 from JSON\n",
      "Processed 74252123 from JSON\n",
      "Processed 83838071 from JSON\n",
      "Processed 93952488 from JSON\n",
      "Processed 129275200 from JSON\n",
      "Processed 93873437 from JSON\n",
      "Processed 93945774 from JSON\n",
      "Processed 93943970 from JSON\n",
      "Processed 93942410 from JSON\n",
      "Processed 93945231 from JSON\n",
      "Processed 146474842 from JSON\n",
      "Processed 146473173 from JSON\n",
      "Processed 146473344 from JSON\n",
      "Processed 146473887 from JSON\n",
      "Processed 74203020 from JSON\n",
      "Processed 94071175 from JSON\n",
      "Processed 93907286 from JSON\n",
      "Processed 146475814 from JSON\n",
      "Processed 146475319 from JSON\n",
      "Processed 84329242 from JSON\n",
      "Processed 84332240 from JSON\n",
      "Processed 86421681 from JSON\n",
      "Processed 86421559 from JSON\n",
      "Processed 84333274 from JSON\n",
      "Processed 73987363 from JSON\n",
      "Processed 86414845 from JSON\n",
      "Processed 86420323 from JSON\n",
      "Processed 42680176 from JSON\n",
      "Processed 42681535 from JSON\n",
      "Processed 42690656 from JSON\n",
      "Processed 73956983 from JSON\n",
      "Processed 73958105 from JSON\n",
      "Processed 84326717 from JSON\n",
      "Processed 73990518 from JSON\n",
      "Processed 78507885 from JSON\n",
      "Processed 129349554 from JSON\n",
      "Processed 129350518 from JSON\n",
      "Processed 129351706 from JSON\n",
      "Processed 129354527 from JSON\n",
      "Processed 93895950 from JSON\n",
      "Processed 93897228 from JSON\n",
      "Processed 129271190 from JSON\n",
      "Processed 86420880 from JSON\n",
      "Processed 86419439 from JSON\n",
      "Processed 74203378 from JSON\n",
      "Processed 74203518 from JSON\n",
      "Processed 93940546 from JSON\n",
      "Processed 129259862 from JSON\n",
      "Processed 129355311 from JSON\n",
      "Processed 129357223 from JSON\n",
      "Processed 129215965 from JSON\n",
      "Processed 129358675 from JSON\n",
      "Processed 78507962 from JSON\n",
      "Processed 78511095 from JSON\n",
      "Processed 141535519 from JSON\n",
      "Processed 141537212 from JSON\n",
      "Processed 141537229 from JSON\n",
      "Processed 78507503 from JSON\n",
      "Processed 93939419 from JSON\n",
      "Processed 146473256 from JSON\n",
      "Processed 74203373 from JSON\n",
      "Processed 93942678 from JSON\n",
      "Processed 86419464 from JSON\n",
      "Processed 83836957 from JSON\n",
      "Processed 84094216 from JSON\n",
      "Processed 146472502 from JSON\n",
      "Processed 84326602 from JSON\n",
      "Processed 84331512 from JSON\n",
      "Processed 73421819 from JSON\n",
      "Processed 29508209 from JSON\n",
      "Processed 141533725 from JSON\n",
      "Processed 73992593 from JSON\n",
      "Processed 93953868 from JSON\n",
      "Processed 73988174 from JSON\n",
      "Processed 83834337 from JSON\n",
      "Processed 83837451 from JSON\n",
      "Processed 83840606 from JSON\n",
      "Processed 94044473 from JSON\n",
      "Processed 94055057 from JSON\n",
      "Processed 42680960 from JSON\n",
      "Processed 93941180 from JSON\n",
      "Processed 129358344 from JSON\n",
      "Processed 83838144 from JSON\n",
      "Processed 83867341 from JSON\n",
      "Processed 84330464 from JSON\n",
      "Processed 78508132 from JSON\n",
      "Processed 78507906 from JSON\n",
      "Processed 141533942 from JSON\n",
      "Processed 73407214 from JSON\n",
      "Processed 84092386 from JSON\n",
      "Processed 42742153 from JSON\n",
      "Processed 74202728 from JSON\n",
      "Processed 141530501 from JSON\n",
      "Processed 141532196 from JSON\n",
      "Processed 93940876 from JSON\n",
      "Processed 146473256 from JSON\n",
      "Processed 83842812 from JSON\n",
      "Processed 83840746 from JSON\n",
      "Processed 83837298 from JSON\n",
      "Processed 83832938 from JSON\n",
      "Processed 73365260 from JSON\n",
      "Processed 83868933 from JSON\n",
      "Processed 93939247 from JSON\n",
      "Processed 93945701 from JSON\n",
      "Processed 93946425 from JSON\n",
      "Processed 86420949 from JSON\n",
      "Processed 86417718 from JSON\n",
      "Processed 84330262 from JSON\n",
      "Processed 129362980 from JSON\n",
      "Processed 29526359 from JSON\n",
      "Processed 73412916 from JSON\n",
      "Processed 42665589 from JSON\n",
      "Processed 86416620 from JSON\n",
      "Processed 42734391 from JSON\n",
      "Processed 84332827 from JSON\n",
      "Processed 74250874 from JSON\n",
      "Processed 42743683 from JSON\n",
      "Processed 78506515 from JSON\n",
      "Processed 78508302 from JSON\n",
      "Processed 74202729 from JSON\n",
      "Processed 83834151 from JSON\n",
      "Processed 83839194 from JSON\n",
      "Processed 83835806 from JSON\n",
      "Processed 83865322 from JSON\n",
      "Processed 83865199 from JSON\n",
      "Processed 83856821 from JSON\n",
      "Processed 83858315 from JSON\n",
      "Processed 83859611 from JSON\n",
      "Processed 93939912 from JSON\n",
      "Processed 93939943 from JSON\n",
      "Processed 141536997 from JSON\n",
      "Processed 141537192 from JSON\n",
      "Processed 141534821 from JSON\n",
      "Processed 83832179 from JSON\n",
      "Processed 83833398 from JSON\n",
      "Processed 129350171 from JSON\n",
      "Processed 83836033 from JSON\n",
      "Processed 129356884 from JSON\n",
      "Processed 93937922 from JSON\n",
      "Processed 93953663 from JSON\n",
      "Processed 94066540 from JSON\n",
      "Processed 129269430 from JSON\n",
      "Processed 129267939 from JSON\n",
      "Processed 129275110 from JSON\n",
      "Processed 83863411 from JSON\n",
      "Processed 83867949 from JSON\n",
      "Processed 73440723 from JSON\n",
      "Processed 84331003 from JSON\n",
      "Processed 86413769 from JSON\n",
      "Processed 86421933 from JSON\n",
      "Processed 86419705 from JSON\n",
      "Processed 141533850 from JSON\n",
      "Processed 141538273 from JSON\n",
      "Processed 141538723 from JSON\n",
      "Processed 141531474 from JSON\n",
      "Processed 42655699 from JSON\n",
      "Processed 73423065 from JSON\n",
      "Processed 78510546 from JSON\n",
      "Processed 78508781 from JSON\n",
      "Processed 93941441 from JSON\n",
      "Processed 93942848 from JSON\n",
      "Processed 93937642 from JSON\n",
      "Processed 93944077 from JSON\n",
      "Processed 141537721 from JSON\n",
      "Processed 93939972 from JSON\n",
      "Processed 129359194 from JSON\n",
      "Processed 83833369 from JSON\n",
      "Processed 83867111 from JSON\n",
      "Processed 73392209 from JSON\n",
      "Processed 83846189 from JSON\n",
      "Processed 83843894 from JSON\n",
      "Processed 83848596 from JSON\n",
      "Processed 73385557 from JSON\n",
      "Processed 83865261 from JSON\n",
      "Processed 73990344 from JSON\n",
      "Processed 73988750 from JSON\n",
      "Processed 86419470 from JSON\n",
      "Processed 86416558 from JSON\n",
      "Processed 86420465 from JSON\n",
      "Processed 141532182 from JSON\n",
      "Processed 141532043 from JSON\n",
      "Processed 73423004 from JSON\n",
      "Processed 42730152 from JSON\n",
      "Processed 78511624 from JSON\n",
      "Processed 78511888 from JSON\n",
      "Processed 141532400 from JSON\n",
      "Processed 141536952 from JSON\n",
      "Processed 141533605 from JSON\n",
      "Processed 93953197 from JSON\n",
      "Processed 93941767 from JSON\n",
      "Processed 93942753 from JSON\n",
      "Processed 129285915 from JSON\n",
      "Processed 129222169 from JSON\n",
      "Processed 74204069 from JSON\n",
      "Processed 93957670 from JSON\n",
      "Processed 94050127 from JSON\n",
      "Processed 94071065 from JSON\n",
      "Processed 83851829 from JSON\n",
      "Processed 83865262 from JSON\n",
      "Processed 83865248 from JSON\n",
      "Processed 86418128 from JSON\n",
      "Processed 84093732 from JSON\n",
      "Processed 84326917 from JSON\n",
      "Processed 84327097 from JSON\n",
      "Processed 73988566 from JSON\n",
      "Processed 73993104 from JSON\n",
      "Processed 73990220 from JSON\n",
      "Processed 73987222 from JSON\n",
      "Processed 93905840 from JSON\n",
      "Processed 129360250 from JSON\n",
      "Processed 129350794 from JSON\n",
      "Processed 129351982 from JSON\n",
      "Processed 83868503 from JSON\n",
      "Processed 73385357 from JSON\n",
      "Processed 83833695 from JSON\n",
      "Processed 73407233 from JSON\n",
      "Processed 84091977 from JSON\n",
      "Processed 84093687 from JSON\n",
      "Processed 86415399 from JSON\n",
      "Processed 84326576 from JSON\n",
      "Processed 84331657 from JSON\n",
      "Processed 84328349 from JSON\n",
      "Processed 129349678 from JSON\n",
      "Processed 93942752 from JSON\n",
      "Processed 93942257 from JSON\n",
      "Processed 83850810 from JSON\n",
      "Processed 94067515 from JSON\n",
      "Processed 129358148 from JSON\n",
      "Processed 129363274 from JSON\n",
      "Processed 93941362 from JSON\n",
      "Processed 141534159 from JSON\n",
      "Processed 141530056 from JSON\n",
      "Processed 141529636 from JSON\n",
      "Processed 78512006 from JSON\n",
      "Processed 78506605 from JSON\n",
      "Processed 93941734 from JSON\n",
      "Processed 94064928 from JSON\n",
      "Processed 83832927 from JSON\n",
      "Processed 83831412 from JSON\n",
      "Processed 146474671 from JSON\n",
      "Processed 146474518 from JSON\n",
      "Processed 94077717 from JSON\n",
      "Processed 84328612 from JSON\n",
      "Processed 86418450 from JSON\n",
      "Processed 84332581 from JSON\n",
      "Processed 73989460 from JSON\n",
      "Processed 73991629 from JSON\n",
      "Processed 129351706 from JSON\n",
      "Processed 86420974 from JSON\n",
      "Processed 129349369 from JSON\n",
      "Processed 141529435 from JSON\n",
      "Processed 78510775 from JSON\n",
      "Processed 78511608 from JSON\n",
      "Processed 141538385 from JSON\n",
      "Processed 73405106 from JSON\n",
      "Processed 84091808 from JSON\n",
      "Processed 84091574 from JSON\n",
      "Processed 83854945 from JSON\n",
      "Processed 83842539 from JSON\n",
      "Processed 83837751 from JSON\n",
      "Processed 83864292 from JSON\n",
      "Processed 83868441 from JSON\n",
      "Processed 83852475 from JSON\n",
      "Processed 83845576 from JSON\n",
      "Processed 42667334 from JSON\n",
      "Processed 141532249 from JSON\n",
      "Processed 42745089 from JSON\n",
      "Processed 86418187 from JSON\n",
      "Processed 86419173 from JSON\n",
      "Processed 141537693 from JSON\n",
      "Processed 93946295 from JSON\n",
      "Processed 93953334 from JSON\n",
      "Processed 129351396 from JSON\n",
      "Processed 93943551 from JSON\n",
      "Processed 73987597 from JSON\n",
      "Processed 93954755 from JSON\n",
      "Processed 93942844 from JSON\n",
      "Processed 93954553 from JSON\n",
      "Processed 93954508 from JSON\n",
      "Processed 83860222 from JSON\n",
      "Processed 73391781 from JSON\n",
      "Processed 83856935 from JSON\n",
      "Processed 83846316 from JSON\n",
      "Processed 83867829 from JSON\n",
      "Processed 94034650 from JSON\n",
      "Processed 83841739 from JSON\n",
      "Processed 83833433 from JSON\n",
      "Processed 84093874 from JSON\n",
      "Processed 146476396 from JSON\n",
      "Processed 146475223 from JSON\n",
      "Processed 129361954 from JSON\n",
      "Processed 93909848 from JSON\n",
      "Processed 141533623 from JSON\n",
      "Processed 83848490 from JSON\n",
      "Processed 83850053 from JSON\n",
      "Processed 83841305 from JSON\n",
      "Processed 73990349 from JSON\n",
      "Processed 84332367 from JSON\n",
      "Processed 84326485 from JSON\n",
      "Processed 78508297 from JSON\n",
      "Processed 78512407 from JSON\n",
      "Processed 86418977 from JSON\n",
      "Processed 74202687 from JSON\n",
      "Processed 86414021 from JSON\n",
      "Processed 83841242 from JSON\n",
      "Processed 83841165 from JSON\n",
      "Processed 83854202 from JSON\n",
      "Processed 83861271 from JSON\n",
      "Processed 83861769 from JSON\n",
      "Processed 93951919 from JSON\n",
      "Processed 129348229 from JSON\n",
      "Processed 129354079 from JSON\n",
      "Processed 129355887 from JSON\n",
      "Processed 83851925 from JSON\n",
      "Processed 83856393 from JSON\n",
      "Processed 83857288 from JSON\n",
      "Processed 83857257 from JSON\n",
      "Processed 83840411 from JSON\n",
      "Processed 83869043 from JSON\n",
      "Processed 83831972 from JSON\n",
      "Processed 93888368 from JSON\n",
      "Processed 146474407 from JSON\n",
      "Processed 73992120 from JSON\n",
      "Processed 93938904 from JSON\n",
      "Processed 83839046 from JSON\n",
      "Processed 73408564 from JSON\n",
      "Processed 93955415 from JSON\n",
      "Processed 93956850 from JSON\n",
      "Processed 93956216 from JSON\n",
      "Processed 93960325 from JSON\n",
      "Processed 73991026 from JSON\n",
      "Processed 74251293 from JSON\n",
      "Processed 93936869 from JSON\n",
      "Processed 129357985 from JSON\n",
      "Processed 129361708 from JSON\n",
      "Processed 129361210 from JSON\n",
      "Processed 129359943 from JSON\n",
      "Processed 86419854 from JSON\n",
      "Processed 84332490 from JSON\n",
      "Processed 84332476 from JSON\n",
      "Processed 86415117 from JSON\n",
      "Processed 129234215 from JSON\n",
      "Processed 129236514 from JSON\n",
      "Processed 83866532 from JSON\n",
      "Processed 86416429 from JSON\n",
      "Processed 86414841 from JSON\n",
      "Processed 83832976 from JSON\n",
      "Processed 129351522 from JSON\n",
      "Processed 84333355 from JSON\n",
      "Processed 129350550 from JSON\n",
      "Processed 93938888 from JSON\n",
      "Processed 129361709 from JSON\n",
      "Processed 73365981 from JSON\n",
      "Processed 83866920 from JSON\n",
      "Processed 78508310 from JSON\n",
      "Processed 78508884 from JSON\n",
      "Processed 78511091 from JSON\n",
      "Processed 129223041 from JSON\n",
      "Processed 93946850 from JSON\n",
      "Processed 93959719 from JSON\n",
      "Processed 94078721 from JSON\n",
      "Processed 83837027 from JSON\n",
      "Processed 73375904 from JSON\n",
      "Processed 73442455 from JSON\n",
      "Processed 83852449 from JSON\n",
      "Processed 83850722 from JSON\n",
      "Processed 83869139 from JSON\n",
      "Processed 83834377 from JSON\n",
      "Processed 93940868 from JSON\n",
      "Processed 129350380 from JSON\n",
      "Processed 129350056 from JSON\n",
      "Processed 93945539 from JSON\n",
      "Processed 93953765 from JSON\n",
      "Processed 93892817 from JSON\n",
      "Processed 93945368 from JSON\n",
      "Processed 83836708 from JSON\n",
      "Processed 83838711 from JSON\n",
      "Processed 83832201 from JSON\n",
      "Processed 73375981 from JSON\n",
      "Processed 83859882 from JSON\n",
      "Processed 83866440 from JSON\n",
      "Processed 83846411 from JSON\n",
      "Processed 73389418 from JSON\n",
      "Processed 74204073 from JSON\n",
      "Processed 141536492 from JSON\n",
      "Processed 141531048 from JSON\n",
      "Processed 141534287 from JSON\n",
      "Processed 93942035 from JSON\n",
      "Processed 129350690 from JSON\n",
      "Processed 129244197 from JSON\n",
      "Processed 86421446 from JSON\n",
      "Processed 86420272 from JSON\n",
      "Processed 86419559 from JSON\n",
      "Processed 84091391 from JSON\n",
      "Processed 42695238 from JSON\n",
      "Processed 73405126 from JSON\n",
      "Processed 93942034 from JSON\n",
      "Processed 93952716 from JSON\n",
      "Processed 129357692 from JSON\n",
      "Processed 93944799 from JSON\n",
      "Processed 83854592 from JSON\n",
      "Processed 83835737 from JSON\n",
      "Processed 83835845 from JSON\n",
      "Processed 84091518 from JSON\n",
      "Processed 73991074 from JSON\n",
      "Processed 73987477 from JSON\n",
      "Processed 86417305 from JSON\n",
      "Processed 74204074 from JSON\n",
      "Processed 86420598 from JSON\n",
      "Processed 86414717 from JSON\n",
      "Processed 129358695 from JSON\n",
      "Processed 129360164 from JSON\n",
      "Processed 78508293 from JSON\n",
      "Processed 93937340 from JSON\n",
      "Processed 141535399 from JSON\n",
      "Processed 42753429 from JSON\n",
      "Processed 73953842 from JSON\n",
      "Processed 74204075 from JSON\n",
      "Processed 129358045 from JSON\n",
      "Processed 129361663 from JSON\n",
      "Processed 129362837 from JSON\n",
      "Processed 78511353 from JSON\n",
      "Processed 78511649 from JSON\n",
      "Processed 129265646 from JSON\n",
      "Processed 84328587 from JSON\n",
      "Processed 93953376 from JSON\n",
      "Processed 83839514 from JSON\n",
      "Processed 83835815 from JSON\n",
      "Processed 94042837 from JSON\n",
      "Processed 93915662 from JSON\n",
      "Processed 93896932 from JSON\n",
      "Processed 94035178 from JSON\n",
      "Processed 93956197 from JSON\n",
      "Processed 146476252 from JSON\n",
      "Processed 146475747 from JSON\n",
      "Processed 83859170 from JSON\n",
      "Processed 83845737 from JSON\n",
      "Processed 83847353 from JSON\n",
      "Processed 141538825 from JSON\n",
      "Processed 141534119 from JSON\n",
      "Processed 78512495 from JSON\n",
      "Processed 73408429 from JSON\n",
      "Processed 73413339 from JSON\n",
      "Processed 83831712 from JSON\n",
      "Processed 83834254 from JSON\n",
      "Processed 84091116 from JSON\n",
      "Processed 84093509 from JSON\n",
      "Processed 93878643 from JSON\n",
      "Processed 84326722 from JSON\n",
      "Processed 86420596 from JSON\n",
      "Processed 86421816 from JSON\n",
      "Processed 86413572 from JSON\n",
      "Processed 73440794 from JSON\n",
      "Processed 83860692 from JSON\n",
      "Processed 73957249 from JSON\n",
      "Processed 129359126 from JSON\n",
      "Processed 141537234 from JSON\n",
      "Processed 141533597 from JSON\n",
      "Processed 74203369 from JSON\n",
      "Processed 83841680 from JSON\n",
      "Processed 83835133 from JSON\n",
      "Processed 83832590 from JSON\n",
      "Processed 83859544 from JSON\n",
      "Processed 83861587 from JSON\n",
      "Processed 73378046 from JSON\n",
      "Processed 93907512 from JSON\n",
      "Processed 93938187 from JSON\n",
      "Processed 93944564 from JSON\n",
      "Processed 83831404 from JSON\n",
      "Processed 83832793 from JSON\n",
      "Processed 83835242 from JSON\n",
      "Processed 83863654 from JSON\n",
      "Processed 83869575 from JSON\n",
      "Processed 84094279 from JSON\n",
      "Processed 129354191 from JSON\n",
      "Processed 93953590 from JSON\n",
      "Processed 93939949 from JSON\n",
      "Processed 93945580 from JSON\n",
      "Processed 78507057 from JSON\n",
      "Processed 74202817 from JSON\n",
      "Processed 141529458 from JSON\n",
      "Processed 93959853 from JSON\n",
      "Processed 146473352 from JSON\n",
      "Processed 129356135 from JSON\n",
      "Processed 93942682 from JSON\n",
      "Processed 83855396 from JSON\n",
      "Processed 83865179 from JSON\n",
      "Processed 73378124 from JSON\n",
      "Processed 83858681 from JSON\n",
      "Processed 83837293 from JSON\n",
      "Processed 83852405 from JSON\n",
      "Processed 83841807 from JSON\n",
      "Processed 73421675 from JSON\n",
      "Processed 86418754 from JSON\n",
      "Processed 84331013 from JSON\n",
      "Processed 86421985 from JSON\n",
      "Processed 141534786 from JSON\n",
      "Processed 86414232 from JSON\n",
      "Processed 84093880 from JSON\n",
      "Processed 83840432 from JSON\n",
      "Processed 83848900 from JSON\n",
      "Processed 83849530 from JSON\n",
      "Processed 83863220 from JSON\n",
      "Processed 129356631 from JSON\n",
      "Processed 74251391 from JSON\n",
      "Processed 74203912 from JSON\n",
      "Processed 93955627 from JSON\n",
      "Processed 93946955 from JSON\n",
      "Processed 129361387 from JSON\n",
      "Processed 129360555 from JSON\n",
      "Processed 129362683 from JSON\n",
      "Processed 83870338 from JSON\n",
      "Processed 83846911 from JSON\n",
      "Processed 83868371 from JSON\n",
      "Processed 83871230 from JSON\n",
      "Processed 73365242 from JSON\n",
      "Processed 83859281 from JSON\n",
      "Processed 84329420 from JSON\n",
      "Processed 84326522 from JSON\n",
      "Processed 74202894 from JSON\n",
      "Processed 42696801 from JSON\n",
      "Processed 141538859 from JSON\n",
      "Processed 73439941 from JSON\n",
      "Processed 83835212 from JSON\n",
      "Processed 83848918 from JSON\n",
      "Processed 83857820 from JSON\n",
      "Processed 83842345 from JSON\n",
      "Processed 83859718 from JSON\n",
      "Processed 73365940 from JSON\n",
      "Processed 129284748 from JSON\n",
      "Processed 93878145 from JSON\n",
      "Processed 93937509 from JSON\n",
      "Processed 73955727 from JSON\n",
      "Processed 83833426 from JSON\n",
      "Processed 83837668 from JSON\n",
      "Processed 83838577 from JSON\n",
      "Processed 83831684 from JSON\n",
      "Processed 83843379 from JSON\n",
      "Processed 83834210 from JSON\n",
      "Processed 86420593 from JSON\n",
      "Processed 84329654 from JSON\n",
      "Processed 84332931 from JSON\n",
      "Processed 73954368 from JSON\n",
      "Processed 141531688 from JSON\n",
      "Processed 74202770 from JSON\n",
      "Processed 93957660 from JSON\n",
      "Processed 93886528 from JSON\n",
      "Processed 93951787 from JSON\n",
      "Processed 93951662 from JSON\n",
      "Processed 84092352 from JSON\n",
      "Processed 141533228 from JSON\n",
      "Processed 84095268 from JSON\n",
      "Processed 86421209 from JSON\n",
      "Processed 86418984 from JSON\n",
      "Processed 84326740 from JSON\n",
      "Processed 141530143 from JSON\n",
      "Processed 129251121 from JSON\n",
      "Processed 129362870 from JSON\n",
      "Processed 93943808 from JSON\n",
      "Processed 93946148 from JSON\n",
      "Processed 93951616 from JSON\n",
      "Processed 93953991 from JSON\n",
      "Processed 83831793 from JSON\n",
      "Processed 93958105 from JSON\n",
      "Processed 93942076 from JSON\n",
      "Processed 93945037 from JSON\n",
      "Processed 83853502 from JSON\n",
      "Processed 83853362 from JSON\n",
      "Processed 83854240 from JSON\n",
      "Processed 146473443 from JSON\n",
      "Processed 93914967 from JSON\n",
      "Processed 93941167 from JSON\n",
      "Processed 141537795 from JSON\n",
      "Processed 141537656 from JSON\n",
      "Processed 93906894 from JSON\n",
      "Processed 93936752 from JSON\n",
      "Processed 83837777 from JSON\n",
      "Processed 25050344 from JSON\n",
      "Processed 25056701 from JSON\n",
      "Processed 25041752 from JSON\n",
      "Processed 25048645 from JSON\n",
      "Processed 24984510 from JSON\n",
      "Processed 24938942 from JSON\n",
      "Processed 24953401 from JSON\n",
      "Processed 25013547 from JSON\n",
      "Processed 24964557 from JSON\n",
      "Processed 25015102 from JSON\n",
      "Processed 24992766 from JSON\n",
      "Processed 25029857 from JSON\n",
      "Processed 2189676 from JSON\n",
      "Processed 2184911 from JSON\n",
      "Processed 25062049 from JSON\n",
      "Processed 24956790 from JSON\n",
      "Processed 25048018 from JSON\n",
      "Processed 25023845 from JSON\n",
      "Processed 25054674 from JSON\n",
      "Processed 25030049 from JSON\n",
      "Processed 25043675 from JSON\n",
      "Processed 25034492 from JSON\n",
      "Processed 24973903 from JSON\n",
      "Processed 25030003 from JSON\n",
      "Processed 25041490 from JSON\n",
      "Processed 2246166 from JSON\n",
      "Processed 24970122 from JSON\n",
      "Processed 83864257 from JSON\n",
      "Processed 83864163 from JSON\n",
      "Processed 94063795 from JSON\n",
      "Processed 84327713 from JSON\n",
      "Processed 84328778 from JSON\n",
      "Processed 86415573 from JSON\n",
      "Processed 86416297 from JSON\n",
      "Processed 86419520 from JSON\n",
      "Processed 86414169 from JSON\n",
      "Processed 73400940 from JSON\n",
      "Processed 42744514 from JSON\n",
      "Processed 42750256 from JSON\n",
      "Processed 42752430 from JSON\n",
      "Processed 141534881 from JSON\n",
      "Processed 78506531 from JSON\n",
      "Processed 78507781 from JSON\n",
      "Processed 78511148 from JSON\n",
      "Processed 78506997 from JSON\n",
      "Processed 73992269 from JSON\n",
      "Processed 73988826 from JSON\n",
      "Processed 93945841 from JSON\n",
      "Processed 93946503 from JSON\n",
      "Processed 93951848 from JSON\n",
      "Processed 93888469 from JSON\n",
      "Processed 93892439 from JSON\n",
      "Processed 93944608 from JSON\n",
      "Processed 93948770 from JSON\n",
      "Processed 93942385 from JSON\n",
      "Processed 129226337 from JSON\n",
      "Processed 73991297 from JSON\n",
      "Processed 73991684 from JSON\n",
      "Processed 73988655 from JSON\n",
      "Processed 129262449 from JSON\n",
      "Processed 129359811 from JSON\n",
      "Processed 129285794 from JSON\n",
      "Processed 93959107 from JSON\n",
      "Processed 93882810 from JSON\n",
      "Processed 83832627 from JSON\n",
      "Processed 83834089 from JSON\n",
      "Processed 83835075 from JSON\n",
      "Processed 83841623 from JSON\n",
      "Processed 83841560 from JSON\n",
      "Processed 73384752 from JSON\n",
      "Processed 94033907 from JSON\n",
      "Processed 146475727 from JSON\n",
      "Processed 146475741 from JSON\n",
      "Processed 146475897 from JSON\n",
      "Processed 146474849 from JSON\n",
      "Processed 94067122 from JSON\n",
      "Processed 93939091 from JSON\n",
      "Processed 93938430 from JSON\n",
      "Processed 146471686 from JSON\n",
      "Processed 93958616 from JSON\n",
      "Processed 94024956 from JSON\n",
      "Processed 73390045 from JSON\n",
      "Processed 83861311 from JSON\n",
      "Processed 83862390 from JSON\n",
      "Processed 83850232 from JSON\n",
      "Processed 83852904 from JSON\n",
      "Processed 83860820 from JSON\n",
      "Processed 73365168 from JSON\n",
      "Processed 73364305 from JSON\n",
      "Processed 83832223 from JSON\n",
      "Processed 83832160 from JSON\n",
      "Processed 73382174 from JSON\n",
      "Processed 73394845 from JSON\n",
      "Processed 129360060 from JSON\n",
      "Processed 129354582 from JSON\n",
      "Processed 129243420 from JSON\n",
      "Processed 129354241 from JSON\n",
      "Processed 129259559 from JSON\n",
      "Processed 73961269 from JSON\n",
      "Processed 73370883 from JSON\n",
      "Processed 83848129 from JSON\n",
      "Processed 83862360 from JSON\n",
      "Processed 73988656 from JSON\n",
      "Processed 73989983 from JSON\n",
      "Processed 73991298 from JSON\n",
      "Processed 73991902 from JSON\n",
      "Processed 73953724 from JSON\n",
      "Processed 73960919 from JSON\n",
      "Processed 78511488 from JSON\n",
      "Processed 42674104 from JSON\n",
      "Processed 42670760 from JSON\n",
      "Processed 73404811 from JSON\n",
      "Processed 29515837 from JSON\n",
      "Processed 29501982 from JSON\n",
      "Processed 73415039 from JSON\n",
      "Processed 73415161 from JSON\n",
      "Processed 29554397 from JSON\n",
      "Processed 42679983 from JSON\n",
      "Processed 74203790 from JSON\n",
      "Processed 42743606 from JSON\n",
      "Processed 74202728 from JSON\n",
      "Processed 73992998 from JSON\n",
      "Processed 42737692 from JSON\n",
      "Processed 94022317 from JSON\n",
      "Processed 141529802 from JSON\n",
      "Processed 78508846 from JSON\n",
      "Processed 141531566 from JSON\n",
      "Processed 94049657 from JSON\n",
      "Processed 93907369 from JSON\n",
      "Processed 94063657 from JSON\n",
      "Processed 94059409 from JSON\n",
      "Processed 129359564 from JSON\n",
      "Processed 73370884 from JSON\n",
      "Processed 83842766 from JSON\n",
      "Processed 83849938 from JSON\n",
      "Processed 83850093 from JSON\n",
      "Processed 83852967 from JSON\n",
      "Processed 83854691 from JSON\n",
      "Processed 83847127 from JSON\n",
      "Processed 83848360 from JSON\n",
      "Processed 73352673 from JSON\n",
      "Processed 73394101 from JSON\n",
      "Processed 73385073 from JSON\n",
      "Processed 93915595 from JSON\n",
      "Processed 93939090 from JSON\n",
      "Processed 93904081 from JSON\n",
      "Processed 93940287 from JSON\n",
      "Processed 129222093 from JSON\n",
      "Processed 93946829 from JSON\n",
      "Processed 93951861 from JSON\n",
      "Processed 129357652 from JSON\n",
      "Processed 129354134 from JSON\n",
      "Processed 83844337 from JSON\n",
      "Processed 86415589 from JSON\n",
      "Processed 86415572 from JSON\n",
      "Processed 86416157 from JSON\n",
      "Processed 129362841 from JSON\n",
      "Processed 129349426 from JSON\n",
      "Processed 129349471 from JSON\n",
      "Processed 129349952 from JSON\n",
      "Processed 129252944 from JSON\n",
      "Processed 129261971 from JSON\n",
      "Processed 73401666 from JSON\n",
      "Processed 73404379 from JSON\n",
      "Processed 29557652 from JSON\n",
      "Processed 73402809 from JSON\n",
      "Processed 73401495 from JSON\n",
      "Processed 84093359 from JSON\n",
      "Processed 73412048 from JSON\n",
      "Processed 73422326 from JSON\n",
      "Processed 86415588 from JSON\n",
      "Processed 73992595 from JSON\n",
      "Processed 73989054 from JSON\n",
      "Processed 73991299 from JSON\n",
      "Processed 73991763 from JSON\n",
      "Processed 73990467 from JSON\n",
      "Processed 73990621 from JSON\n",
      "Processed 84093917 from JSON\n",
      "Processed 84093683 from JSON\n",
      "Processed 86416808 from JSON\n",
      "Processed 42674275 from JSON\n",
      "Processed 78511766 from JSON\n",
      "Processed 141533121 from JSON\n",
      "Processed 86421655 from JSON\n",
      "Processed 84328592 from JSON\n",
      "Processed 84326527 from JSON\n",
      "Processed 84331545 from JSON\n",
      "Processed 42685183 from JSON\n",
      "Processed 42682223 from JSON\n",
      "Processed 78507765 from JSON\n",
      "Processed 78507051 from JSON\n",
      "Processed 129202715 from JSON\n",
      "Processed 74202729 from JSON\n",
      "Processed 42743809 from JSON\n",
      "Processed 146475725 from JSON\n",
      "Processed 83831811 from JSON\n",
      "Processed 83842440 from JSON\n",
      "Processed 83840451 from JSON\n",
      "Processed 83860310 from JSON\n",
      "Processed 83862239 from JSON\n",
      "Processed 83862424 from JSON\n",
      "Processed 73379534 from JSON\n",
      "Processed 83865461 from JSON\n",
      "Processed 83853024 from JSON\n",
      "Processed 83854692 from JSON\n",
      "Processed 83855431 from JSON\n",
      "Processed 83858562 from JSON\n",
      "Processed 83859457 from JSON\n",
      "Processed 83863023 from JSON\n",
      "Processed 93915532 from JSON\n",
      "Processed 93915873 from JSON\n",
      "Processed 93936704 from JSON\n",
      "Processed 129274466 from JSON\n",
      "Processed 129356030 from JSON\n",
      "Processed 93942895 from JSON\n",
      "Processed 129266735 from JSON\n",
      "Processed 93950797 from JSON\n",
      "Processed 93887914 from JSON\n",
      "Processed 146473224 from JSON\n",
      "Processed 94056463 from JSON\n",
      "Processed 129354584 from JSON\n",
      "Processed 129354692 from JSON\n",
      "Processed 129354399 from JSON\n",
      "Processed 93958429 from JSON\n",
      "Processed 93878110 from JSON\n",
      "Processed 83848998 from JSON\n",
      "Processed 83847344 from JSON\n",
      "Processed 83848068 from JSON\n",
      "Processed 73400074 from JSON\n",
      "Processed 83868903 from JSON\n",
      "Processed 73385942 from JSON\n",
      "Processed 129350265 from JSON\n",
      "Processed 73388345 from JSON\n",
      "Processed 83867993 from JSON\n",
      "Processed 73385524 from JSON\n",
      "Processed 73399099 from JSON\n",
      "Processed 83841859 from JSON\n",
      "Processed 83844308 from JSON\n",
      "Processed 83869178 from JSON\n",
      "Processed 83848069 from JSON\n",
      "Processed 83863613 from JSON\n",
      "Processed 146473191 from JSON\n",
      "Processed 146476556 from JSON\n",
      "Processed 93941846 from JSON\n",
      "Processed 93906395 from JSON\n",
      "Processed 129359597 from JSON\n",
      "Processed 94062269 from JSON\n",
      "Processed 146475926 from JSON\n",
      "Processed 84326991 from JSON\n",
      "Processed 73987794 from JSON\n",
      "Processed 42709888 from JSON\n",
      "Processed 129358037 from JSON\n",
      "Processed 129350280 from JSON\n",
      "Processed 129355494 from JSON\n",
      "Processed 93915841 from JSON\n",
      "Processed 93936671 from JSON\n",
      "Processed 93944186 from JSON\n",
      "Processed 93941428 from JSON\n",
      "Processed 93958567 from JSON\n",
      "Processed 129348317 from JSON\n",
      "Processed 94036992 from JSON\n",
      "Processed 83843057 from JSON\n",
      "Processed 83842922 from JSON\n",
      "Processed 83865462 from JSON\n",
      "Processed 73399254 from JSON\n",
      "Processed 73392037 from JSON\n",
      "Processed 83849459 from JSON\n",
      "Processed 83854958 from JSON\n",
      "Processed 83854554 from JSON\n",
      "Processed 83853878 from JSON\n",
      "Processed 83859333 from JSON\n",
      "Processed 84332626 from JSON\n",
      "Processed 84328733 from JSON\n",
      "Processed 86417949 from JSON\n",
      "Processed 86418283 from JSON\n",
      "Processed 42686031 from JSON\n",
      "Processed 73961301 from JSON\n",
      "Processed 74252028 from JSON\n",
      "Processed 78508286 from JSON\n",
      "Processed 141532244 from JSON\n",
      "Processed 141530673 from JSON\n",
      "Processed 141536051 from JSON\n",
      "Processed 141535560 from JSON\n",
      "Processed 141537751 from JSON\n",
      "Processed 74203949 from JSON\n",
      "Processed 73419684 from JSON\n",
      "Processed 84091354 from JSON\n",
      "Processed 84092061 from JSON\n",
      "Processed 73402792 from JSON\n",
      "Processed 29499418 from JSON\n",
      "Processed 78511424 from JSON\n",
      "Processed 78510469 from JSON\n",
      "Processed 78507670 from JSON\n",
      "Processed 78508673 from JSON\n",
      "Processed 78512100 from JSON\n",
      "Processed 78508907 from JSON\n",
      "Processed 129209900 from JSON\n",
      "Processed 93903698 from JSON\n",
      "Processed 94054926 from JSON\n",
      "Processed 94065771 from JSON\n",
      "Processed 93905687 from JSON\n",
      "Processed 93911970 from JSON\n",
      "Processed 93889189 from JSON\n",
      "Processed 93943168 from JSON\n",
      "Processed 93942879 from JSON\n",
      "Processed 129355046 from JSON\n",
      "Processed 129286933 from JSON\n",
      "Processed 129349133 from JSON\n",
      "Processed 129355231 from JSON\n",
      "Processed 129353925 from JSON\n",
      "Processed 93956902 from JSON\n",
      "Processed 94026747 from JSON\n",
      "Processed 141535174 from JSON\n",
      "Processed 129240441 from JSON\n",
      "Processed 129236628 from JSON\n",
      "Processed 129251258 from JSON\n",
      "Processed 129243806 from JSON\n",
      "Processed 129269756 from JSON\n",
      "Processed 129260672 from JSON\n",
      "Processed 93946097 from JSON\n",
      "Processed 93897029 from JSON\n",
      "Processed 129359411 from JSON\n",
      "Processed 83858300 from JSON\n",
      "Processed 83852472 from JSON\n",
      "Processed 83835714 from JSON\n",
      "Processed 83860437 from JSON\n",
      "Processed 73377624 from JSON\n",
      "Processed 83862457 from JSON\n",
      "Processed 83856311 from JSON\n",
      "Processed 83840871 from JSON\n",
      "Processed 83854353 from JSON\n",
      "Processed 83841191 from JSON\n",
      "Processed 83837998 from JSON\n",
      "Processed 73387267 from JSON\n",
      "Processed 83856513 from JSON\n",
      "Processed 83857390 from JSON\n",
      "Processed 73397002 from JSON\n",
      "Processed 42658240 from JSON\n",
      "Processed 73958722 from JSON\n",
      "Processed 73991998 from JSON\n",
      "Processed 73992489 from JSON\n",
      "Processed 42647039 from JSON\n",
      "Processed 42682009 from JSON\n",
      "Processed 73988875 from JSON\n",
      "Processed 73988907 from JSON\n",
      "Processed 73988952 from JSON\n",
      "Processed 42678844 from JSON\n",
      "Processed 86415447 from JSON\n",
      "Processed 86417188 from JSON\n",
      "Processed 86413643 from JSON\n",
      "Processed 86416882 from JSON\n",
      "Processed 86415586 from JSON\n",
      "Processed 141535871 from JSON\n",
      "Processed 141533123 from JSON\n",
      "Processed 74203793 from JSON\n",
      "Processed 42749746 from JSON\n",
      "Processed 74204006 from JSON\n",
      "Processed 74203205 from JSON\n",
      "Processed 42745117 from JSON\n",
      "Processed 129213265 from JSON\n",
      "Processed 73416833 from JSON\n",
      "Processed 73423439 from JSON\n",
      "Processed 29525930 from JSON\n",
      "Processed 73404333 from JSON\n",
      "Processed 73423376 from JSON\n",
      "Processed 73407915 from JSON\n",
      "Processed 73408110 from JSON\n",
      "Processed 73408033 from JSON\n",
      "Processed 73422949 from JSON\n",
      "Processed 29499371 from JSON\n",
      "Processed 42707512 from JSON\n",
      "Processed 42717852 from JSON\n",
      "Processed 141537830 from JSON\n",
      "Processed 141535702 from JSON\n",
      "Processed 78512610 from JSON\n",
      "Processed 129248817 from JSON\n",
      "Processed 129257332 from JSON\n",
      "Processed 129258690 from JSON\n",
      "Processed 129263726 from JSON\n",
      "Processed 93895440 from JSON\n",
      "Processed 93896722 from JSON\n",
      "Processed 129349398 from JSON\n",
      "Processed 93943509 from JSON\n",
      "Processed 93941813 from JSON\n",
      "Processed 129359520 from JSON\n",
      "Processed 129359582 from JSON\n",
      "Processed 74203934 from JSON\n",
      "Processed 78507793 from JSON\n",
      "Processed 93943167 from JSON\n",
      "Processed 93946250 from JSON\n",
      "Processed 94079331 from JSON\n",
      "Processed 83831814 from JSON\n",
      "Processed 83832273 from JSON\n",
      "Processed 83840625 from JSON\n",
      "Processed 83865945 from JSON\n",
      "Processed 83852118 from JSON\n",
      "Processed 83861518 from JSON\n",
      "Processed 73384649 from JSON\n",
      "Processed 86419347 from JSON\n",
      "Processed 84092342 from JSON\n",
      "Processed 84094021 from JSON\n",
      "Processed 86415679 from JSON\n",
      "Processed 84326746 from JSON\n",
      "Processed 84327749 from JSON\n",
      "Processed 42683522 from JSON\n",
      "Processed 73991300 from JSON\n",
      "Processed 73991007 from JSON\n",
      "Processed 73954358 from JSON\n",
      "Processed 73988580 from JSON\n",
      "Processed 73988612 from JSON\n",
      "Processed 73991519 from JSON\n",
      "Processed 83841813 from JSON\n",
      "Processed 83839010 from JSON\n",
      "Processed 83839445 from JSON\n",
      "Processed 83847222 from JSON\n",
      "Processed 83858596 from JSON\n",
      "Processed 94073814 from JSON\n",
      "Processed 93959892 from JSON\n",
      "Processed 83861316 from JSON\n",
      "Processed 83855821 from JSON\n",
      "Processed 83838194 from JSON\n",
      "Processed 83843136 from JSON\n",
      "Processed 83837874 from JSON\n",
      "Processed 83847068 from JSON\n",
      "Processed 83847114 from JSON\n",
      "Processed 83836268 from JSON\n",
      "Processed 42739003 from JSON\n",
      "Processed 42739825 from JSON\n",
      "Processed 93867540 from JSON\n",
      "Processed 129351425 from JSON\n",
      "Processed 129354493 from JSON\n",
      "Processed 93904683 from JSON\n",
      "Processed 93877664 from JSON\n",
      "Processed 83841799 from JSON\n",
      "Processed 83842785 from JSON\n",
      "Processed 83842970 from JSON\n",
      "Processed 83839446 from JSON\n",
      "Processed 83851750 from JSON\n",
      "Processed 73368954 from JSON\n",
      "Processed 73371394 from JSON\n",
      "Processed 73388673 from JSON\n",
      "Processed 73382055 from JSON\n",
      "Processed 73398021 from JSON\n",
      "Processed 73398038 from JSON\n",
      "Processed 73422748 from JSON\n",
      "Processed 73403426 from JSON\n",
      "Processed 29562782 from JSON\n",
      "Processed 84094642 from JSON\n",
      "Processed 29562737 from JSON\n",
      "Processed 86413766 from JSON\n",
      "Processed 86413797 from JSON\n",
      "Processed 86415755 from JSON\n",
      "Processed 84327081 from JSON\n",
      "Processed 84329924 from JSON\n",
      "Processed 84327221 from JSON\n",
      "Processed 73958863 from JSON\n",
      "Processed 73961289 from JSON\n",
      "Processed 73989678 from JSON\n",
      "Processed 73991844 from JSON\n",
      "Processed 73991705 from JSON\n",
      "Processed 73991301 from JSON\n",
      "Processed 73992119 from JSON\n",
      "Processed 84331020 from JSON\n",
      "Processed 84329412 from JSON\n",
      "Processed 84328488 from JSON\n",
      "Processed 86415584 from JSON\n",
      "Processed 74202730 from JSON\n",
      "Processed 42744147 from JSON\n",
      "Processed 42749825 from JSON\n",
      "Processed 94047579 from JSON\n",
      "Processed 93943166 from JSON\n",
      "Processed 94061687 from JSON\n",
      "Processed 93941797 from JSON\n",
      "Processed 83849616 from JSON\n",
      "Processed 83853509 from JSON\n",
      "Processed 83840424 from JSON\n",
      "Processed 83864758 from JSON\n",
      "Processed 83848365 from JSON\n",
      "Processed 83848707 from JSON\n",
      "Processed 93892899 from JSON\n",
      "Processed 94062534 from JSON\n",
      "Processed 94069472 from JSON\n",
      "Processed 146476010 from JSON\n",
      "Processed 141531181 from JSON\n",
      "Processed 129259104 from JSON\n",
      "Processed 129264711 from JSON\n",
      "Processed 129266654 from JSON\n",
      "Processed 93905469 from JSON\n",
      "Processed 93946172 from JSON\n",
      "Processed 93957655 from JSON\n",
      "Processed 93894718 from JSON\n",
      "Processed 129355790 from JSON\n",
      "Processed 93938287 from JSON\n",
      "Processed 93953071 from JSON\n",
      "Processed 42706200 from JSON\n",
      "Processed 74251244 from JSON\n",
      "Processed 78508810 from JSON\n",
      "Processed 141532122 from JSON\n",
      "Processed 78507002 from JSON\n",
      "Processed 83831428 from JSON\n",
      "Processed 93949240 from JSON\n",
      "Processed 93943165 from JSON\n",
      "Processed 94039306 from JSON\n",
      "Processed 146471836 from JSON\n",
      "Processed 42747914 from JSON\n",
      "Processed 74203905 from JSON\n",
      "Processed 74251555 from JSON\n",
      "Processed 42753207 from JSON\n",
      "Processed 83868225 from JSON\n",
      "Processed 83834574 from JSON\n",
      "Processed 73352756 from JSON\n",
      "Processed 83838228 from JSON\n",
      "Processed 83834233 from JSON\n",
      "Processed 93945231 from JSON\n",
      "Processed 74202731 from JSON\n",
      "Processed 94064322 from JSON\n",
      "Processed 94060591 from JSON\n",
      "Processed 94078967 from JSON\n",
      "Processed 94045404 from JSON\n",
      "Processed 86418498 from JSON\n",
      "Processed 86415583 from JSON\n",
      "Processed 84331456 from JSON\n",
      "Processed 84331951 from JSON\n",
      "Processed 73990051 from JSON\n",
      "Processed 73991023 from JSON\n",
      "Processed 84330484 from JSON\n",
      "Processed 84330251 from JSON\n",
      "Processed 78507669 from JSON\n",
      "Processed 129348861 from JSON\n",
      "Processed 129354495 from JSON\n",
      "Processed 129354154 from JSON\n",
      "Processed 129357780 from JSON\n",
      "Processed 93902180 from JSON\n",
      "Processed 86416771 from JSON\n",
      "Processed 86420880 from JSON\n",
      "Processed 93936778 from JSON\n",
      "Processed 93938286 from JSON\n",
      "Processed 129362537 from JSON\n",
      "Processed 129360858 from JSON\n",
      "Processed 129207195 from JSON\n",
      "Processed 42703118 from JSON\n",
      "Processed 78509999 from JSON\n",
      "Processed 78509874 from JSON\n",
      "Processed 73406091 from JSON\n",
      "Processed 84091884 from JSON\n",
      "Processed 73441232 from JSON\n",
      "Processed 73441869 from JSON\n",
      "Processed 83857209 from JSON\n",
      "Processed 73377627 from JSON\n",
      "Processed 83863523 from JSON\n",
      "Processed 83863648 from JSON\n",
      "Processed 83849972 from JSON\n",
      "Processed 83860562 from JSON\n",
      "Processed 83839447 from JSON\n",
      "Processed 42670224 from JSON\n",
      "Processed 42685002 from JSON\n",
      "Processed 42682630 from JSON\n",
      "Processed 84328581 from JSON\n",
      "Processed 84329476 from JSON\n",
      "Processed 86419654 from JSON\n",
      "Processed 86422188 from JSON\n",
      "Processed 42738003 from JSON\n",
      "Processed 74204226 from JSON\n",
      "Processed 42693896 from JSON\n",
      "Processed 86415568 from JSON\n",
      "Processed 86415582 from JSON\n",
      "Processed 78507341 from JSON\n",
      "Processed 78507668 from JSON\n",
      "Processed 78508919 from JSON\n",
      "Processed 78510868 from JSON\n",
      "Processed 78510046 from JSON\n",
      "Processed 84331426 from JSON\n",
      "Processed 86416446 from JSON\n",
      "Processed 84332690 from JSON\n",
      "Processed 84327999 from JSON\n",
      "Processed 42674404 from JSON\n",
      "Processed 141533639 from JSON\n",
      "Processed 141534346 from JSON\n",
      "Processed 83855499 from JSON\n",
      "Processed 83859648 from JSON\n",
      "Processed 83866732 from JSON\n",
      "Processed 83868769 from JSON\n",
      "Processed 146475611 from JSON\n",
      "Processed 146471633 from JSON\n",
      "Processed 93944338 from JSON\n",
      "Processed 93905049 from JSON\n",
      "Processed 93905094 from JSON\n",
      "Processed 93905001 from JSON\n",
      "Processed 93892974 from JSON\n",
      "Processed 129361410 from JSON\n",
      "Processed 129360222 from JSON\n",
      "Processed 129349012 from JSON\n",
      "Processed 93915310 from JSON\n",
      "Processed 129250871 from JSON\n",
      "Processed 93870381 from JSON\n",
      "Processed 93942286 from JSON\n",
      "Processed 94025003 from JSON\n",
      "Processed 73989029 from JSON\n",
      "Processed 73990470 from JSON\n",
      "Processed 73992863 from JSON\n",
      "Processed 24930779 from JSON\n",
      "Processed 25030003 from JSON\n",
      "Processed 86417517 from JSON\n",
      "Processed 129205956 from JSON\n",
      "Processed 94024259 from JSON\n",
      "Processed 83860666 from JSON\n",
      "Processed 129350991 from JSON\n",
      "Processed 83857264 from JSON\n",
      "Processed 83842145 from JSON\n",
      "Processed 83838175 from JSON\n",
      "Processed 73961361 from JSON\n",
      "Processed 73421461 from JSON\n",
      "Processed 42694258 from JSON\n",
      "Processed 129241322 from JSON\n",
      "Processed 141532259 from JSON\n",
      "Processed 129356820 from JSON\n",
      "Processed 83853876 from JSON\n",
      "Processed 83849053 from JSON\n",
      "Processed 86415541 from JSON\n",
      "Processed 84330976 from JSON\n",
      "Processed 129358390 from JSON\n",
      "Processed 73421309 from JSON\n",
      "Processed 84329069 from JSON\n",
      "Processed 84327993 from JSON\n",
      "Processed 78506856 from JSON\n",
      "Processed 42745470 from JSON\n",
      "Processed 83833862 from JSON\n",
      "Processed 129359813 from JSON\n",
      "Processed 129237940 from JSON\n",
      "Processed 93940921 from JSON\n",
      "Processed 129363302 from JSON\n",
      "Processed 129362208 from JSON\n",
      "Processed 83857623 from JSON\n",
      "Processed 94050389 from JSON\n",
      "Processed 93952660 from JSON\n",
      "Processed 93955018 from JSON\n",
      "Processed 129353847 from JSON\n",
      "Processed 86421250 from JSON\n",
      "Processed 78510111 from JSON\n",
      "Processed 129284324 from JSON\n",
      "Processed 129244467 from JSON\n",
      "Processed 83832847 from JSON\n",
      "Processed 73385975 from JSON\n",
      "Processed 84330498 from JSON\n",
      "Processed 93942195 from JSON\n",
      "Processed 83835993 from JSON\n",
      "Processed 83862782 from JSON\n",
      "Processed 42694245 from JSON\n",
      "Processed 73991812 from JSON\n",
      "Processed 129362535 from JSON\n",
      "Processed 93892991 from JSON\n",
      "Processed 84326886 from JSON\n",
      "Processed 83855219 from JSON\n",
      "Processed 146476553 from JSON\n",
      "Processed 129352645 from JSON\n",
      "Processed 141530272 from JSON\n",
      "Processed 83834202 from JSON\n",
      "Processed 73990361 from JSON\n",
      "Processed 129348025 from JSON\n",
      "Processed 86418683 from JSON\n",
      "Processed 29571501 from JSON\n",
      "Processed 83862847 from JSON\n",
      "Processed 83864216 from JSON\n",
      "Processed 83850563 from JSON\n",
      "Processed 83857160 from JSON\n",
      "Processed 141535844 from JSON\n",
      "Processed 42745414 from JSON\n",
      "Processed 86415924 from JSON\n",
      "Processed 78506728 from JSON\n",
      "Processed 86416446 from JSON\n",
      "Processed 42720668 from JSON\n",
      "Processed 83846114 from JSON\n",
      "Processed 146474485 from JSON\n",
      "Processed 146473761 from JSON\n",
      "Processed 129358645 from JSON\n",
      "Processed 129362398 from JSON\n",
      "Processed 73382893 from JSON\n",
      "Processed 84093982 from JSON\n",
      "Processed 129361163 from JSON\n",
      "Processed 93959209 from JSON\n",
      "Processed 83860659 from JSON\n",
      "Processed 73379417 from JSON\n",
      "Processed 146473620 from JSON\n",
      "Processed 146473529 from JSON\n",
      "Processed 129352757 from JSON\n",
      "Processed 93936852 from JSON\n",
      "Processed 129351584 from JSON\n",
      "Processed 83839371 from JSON\n",
      "Processed 42746528 from JSON\n",
      "Processed 42745772 from JSON\n",
      "Processed 93959904 from JSON\n",
      "Processed 83859247 from JSON\n",
      "Processed 83860132 from JSON\n",
      "Processed 83865423 from JSON\n",
      "Processed 93950665 from JSON\n",
      "Processed 29545176 from JSON\n",
      "Processed 129358430 from JSON\n",
      "Processed 86422090 from JSON\n",
      "Processed 42656862 from JSON\n",
      "Processed 94045486 from JSON\n",
      "Processed 129353607 from JSON\n",
      "Processed 83854718 from JSON\n",
      "Processed 42648264 from JSON\n",
      "Processed 84331863 from JSON\n",
      "Processed 93938545 from JSON\n",
      "Processed 78512294 from JSON\n",
      "Processed 141536400 from JSON\n",
      "Processed 141533393 from JSON\n",
      "Processed 84332665 from JSON\n",
      "Processed 141532670 from JSON\n",
      "Processed 94048121 from JSON\n",
      "Processed 93914753 from JSON\n",
      "Processed 73956353 from JSON\n",
      "Processed 141533394 from JSON\n",
      "Processed 78511803 from JSON\n",
      "Processed 93941371 from JSON\n",
      "Processed 93944705 from JSON\n",
      "Processed 29552403 from JSON\n",
      "Processed 83848061 from JSON\n",
      "Processed 73379373 from JSON\n",
      "Processed 83849343 from JSON\n",
      "Processed 93956211 from JSON\n",
      "Processed 93945550 from JSON\n",
      "Processed 93949406 from JSON\n",
      "Processed 93937354 from JSON\n",
      "Processed 73385674 from JSON\n",
      "Processed 93889132 from JSON\n",
      "Processed 141532610 from JSON\n",
      "Processed 129362404 from JSON\n",
      "Processed 83866538 from JSON\n",
      "Processed 83857121 from JSON\n",
      "Processed 86418583 from JSON\n",
      "Processed 86415095 from JSON\n",
      "Processed 83844427 from JSON\n",
      "Processed 74251810 from JSON\n",
      "Processed 94077445 from JSON\n",
      "Processed 129348746 from JSON\n",
      "Processed 93891484 from JSON\n",
      "Processed 129352590 from JSON\n",
      "Processed 129355241 from JSON\n",
      "Processed 83863903 from JSON\n",
      "Processed 73953535 from JSON\n",
      "Processed 83868000 from JSON\n",
      "Processed 83844769 from JSON\n",
      "Processed 83836913 from JSON\n",
      "Processed 86421349 from JSON\n",
      "Processed 84328620 from JSON\n",
      "Processed 42638082 from JSON\n",
      "Processed 78511739 from JSON\n",
      "Processed 93942123 from JSON\n",
      "Processed 42745268 from JSON\n",
      "Processed 73959100 from JSON\n",
      "Processed 73992299 from JSON\n",
      "Processed 93869566 from JSON\n",
      "Processed 83832392 from JSON\n",
      "Processed 141538147 from JSON\n",
      "Processed 24952807 from JSON\n",
      "Processed 25020569 from JSON\n",
      "Processed 25038736 from JSON\n",
      "Processed 25044757 from JSON\n",
      "Processed 83864257 from JSON\n",
      "Processed 73380419 from JSON\n",
      "Processed 84329593 from JSON\n",
      "Processed 86420919 from JSON\n",
      "Processed 73408557 from JSON\n",
      "Processed 73408773 from JSON\n",
      "Processed 42703313 from JSON\n",
      "Processed 74251471 from JSON\n",
      "Processed 141529351 from JSON\n",
      "Processed 141530562 from JSON\n",
      "Processed 129356526 from JSON\n",
      "Processed 83832829 from JSON\n",
      "Processed 83837778 from JSON\n",
      "Processed 83838500 from JSON\n",
      "Processed 83865058 from JSON\n",
      "Processed 83849689 from JSON\n",
      "Processed 73383393 from JSON\n",
      "Processed 83865957 from JSON\n",
      "Processed 129348035 from JSON\n",
      "Processed 129238743 from JSON\n",
      "Processed 83841438 from JSON\n",
      "Processed 83841964 from JSON\n",
      "Processed 83860838 from JSON\n",
      "Processed 73953724 from JSON\n",
      "Processed 78507937 from JSON\n",
      "Processed 73411633 from JSON\n",
      "Processed 73423140 from JSON\n",
      "Processed 42714905 from JSON\n",
      "Processed 93884303 from JSON\n",
      "Processed 78509010 from JSON\n",
      "Processed 94040388 from JSON\n",
      "Processed 83851623 from JSON\n",
      "Processed 73372859 from JSON\n",
      "Processed 83840157 from JSON\n",
      "Processed 73348735 from JSON\n",
      "Processed 93946920 from JSON\n",
      "Processed 86417004 from JSON\n",
      "Processed 84327219 from JSON\n",
      "Processed 129363147 from JSON\n",
      "Processed 129355043 from JSON\n",
      "Processed 86415571 from JSON\n",
      "Processed 86419890 from JSON\n",
      "Processed 73959088 from JSON\n",
      "Processed 141529353 from JSON\n",
      "Processed 84328268 from JSON\n",
      "Processed 42691887 from JSON\n",
      "Processed 42690170 from JSON\n",
      "Processed 42743809 from JSON\n",
      "Processed 146475819 from JSON\n",
      "Processed 83840918 from JSON\n",
      "Processed 73381560 from JSON\n",
      "Processed 73373163 from JSON\n",
      "Processed 146474830 from JSON\n",
      "Processed 73348736 from JSON\n",
      "Processed 83847685 from JSON\n",
      "Processed 73391235 from JSON\n",
      "Processed 83869921 from JSON\n",
      "Processed 83847422 from JSON\n",
      "Processed 83850994 from JSON\n",
      "Processed 83833197 from JSON\n",
      "Processed 93938026 from JSON\n",
      "Processed 93944915 from JSON\n",
      "Processed 93946269 from JSON\n",
      "Processed 93949958 from JSON\n",
      "Processed 93886509 from JSON\n",
      "Processed 93896058 from JSON\n",
      "Processed 83831951 from JSON\n",
      "Processed 83838503 from JSON\n",
      "Processed 73375944 from JSON\n",
      "Processed 83854105 from JSON\n",
      "Processed 83866294 from JSON\n",
      "Processed 86414229 from JSON\n",
      "Processed 84326357 from JSON\n",
      "Processed 73411945 from JSON\n",
      "Processed 74202852 from JSON\n",
      "Processed 78510096 from JSON\n",
      "Processed 93915732 from JSON\n",
      "Processed 129360406 from JSON\n",
      "Processed 93945638 from JSON\n",
      "Processed 93953958 from JSON\n",
      "Processed 93952412 from JSON\n",
      "Processed 93957068 from JSON\n",
      "Processed 93948288 from JSON\n",
      "Processed 94067683 from JSON\n",
      "Processed 83838117 from JSON\n",
      "Processed 83852566 from JSON\n",
      "Processed 83847687 from JSON\n",
      "Processed 73987670 from JSON\n",
      "Processed 42685666 from JSON\n",
      "Processed 42737929 from JSON\n",
      "Processed 141535826 from JSON\n",
      "Processed 42709067 from JSON\n",
      "Processed 129214547 from JSON\n",
      "Processed 78508796 from JSON\n",
      "Processed 141531539 from JSON\n",
      "Processed 141530707 from JSON\n",
      "Processed 141530815 from JSON\n",
      "Processed 141535719 from JSON\n",
      "Processed 129351689 from JSON\n",
      "Processed 93948225 from JSON\n",
      "Processed 73390778 from JSON\n",
      "Processed 86415307 from JSON\n",
      "Processed 86415585 from JSON\n",
      "Processed 93907613 from JSON\n",
      "Processed 83860128 from JSON\n",
      "Processed 83838396 from JSON\n",
      "Processed 83863754 from JSON\n",
      "Processed 83858768 from JSON\n",
      "Processed 73381672 from JSON\n",
      "Processed 83839059 from JSON\n",
      "Processed 29550592 from JSON\n",
      "Processed 86416013 from JSON\n",
      "Processed 86420401 from JSON\n",
      "Processed 42659555 from JSON\n",
      "Processed 83864866 from JSON\n",
      "Processed 93884733 from JSON\n",
      "Processed 93946033 from JSON\n",
      "Processed 93951347 from JSON\n",
      "Processed 93959738 from JSON\n",
      "Processed 78509534 from JSON\n",
      "Processed 93949396 from JSON\n",
      "Processed 93949194 from JSON\n",
      "Processed 129356749 from JSON\n",
      "Processed 93938349 from JSON\n",
      "Processed 42751650 from JSON\n",
      "Processed 83834808 from JSON\n",
      "Processed 129249940 from JSON\n",
      "Processed 84333166 from JSON\n",
      "Processed 86414472 from JSON\n",
      "Processed 73957380 from JSON\n",
      "Processed 73991489 from JSON\n",
      "Processed 129351225 from JSON\n",
      "Processed 93890878 from JSON\n",
      "Processed 129273398 from JSON\n",
      "Processed 129358567 from JSON\n",
      "Processed 78507993 from JSON\n",
      "Processed 141532046 from JSON\n",
      "Processed 141535223 from JSON\n",
      "Processed 73440291 from JSON\n",
      "Processed 83862924 from JSON\n",
      "Processed 83867284 from JSON\n",
      "Processed 74251107 from JSON\n",
      "Processed 141532047 from JSON\n",
      "Processed 83855451 from JSON\n",
      "Processed 83847148 from JSON\n",
      "Processed 83839138 from JSON\n",
      "Processed 93944369 from JSON\n",
      "Processed 93891724 from JSON\n",
      "Processed 129357705 from JSON\n",
      "Processed 129357349 from JSON\n",
      "Processed 129362785 from JSON\n",
      "Processed 73987597 from JSON\n",
      "Processed 93950900 from JSON\n",
      "Processed 129286047 from JSON\n",
      "Processed 83854092 from JSON\n",
      "Processed 83844358 from JSON\n",
      "Processed 84095274 from JSON\n",
      "Processed 93955492 from JSON\n",
      "Processed 93889881 from JSON\n",
      "Processed 94022322 from JSON\n",
      "Processed 141534671 from JSON\n",
      "Processed 73992693 from JSON\n",
      "Processed 42707453 from JSON\n",
      "Processed 84333322 from JSON\n",
      "Processed 84333214 from JSON\n",
      "Processed 78508622 from JSON\n",
      "Processed 141531711 from JSON\n",
      "Processed 74202935 from JSON\n",
      "Processed 83835579 from JSON\n",
      "Processed 83835562 from JSON\n",
      "Processed 83861303 from JSON\n",
      "Processed 83839557 from JSON\n",
      "Processed 93937297 from JSON\n",
      "Processed 146476009 from JSON\n",
      "Processed 94029742 from JSON\n",
      "Processed 83848523 from JSON\n",
      "Processed 83839293 from JSON\n",
      "Processed 73358911 from JSON\n",
      "Processed 93959051 from JSON\n",
      "Processed 93950573 from JSON\n",
      "Processed 93958762 from JSON\n",
      "Processed 93942020 from JSON\n",
      "Processed 42658277 from JSON\n",
      "Processed 129361784 from JSON\n",
      "Processed 84328381 from JSON\n",
      "Processed 86415580 from JSON\n",
      "Processed 84090839 from JSON\n",
      "Processed 129230888 from JSON\n",
      "Processed 129239955 from JSON\n",
      "Processed 74203023 from JSON\n",
      "Processed 86413684 from JSON\n",
      "Processed 84091237 from JSON\n",
      "Processed 93944924 from JSON\n",
      "Processed 94048476 from JSON\n",
      "Processed 94070006 from JSON\n",
      "Processed 94046300 from JSON\n",
      "Processed 83835069 from JSON\n",
      "Processed 42682929 from JSON\n",
      "Processed 129234182 from JSON\n",
      "Processed 129348478 from JSON\n",
      "Processed 129354653 from JSON\n",
      "Processed 93944366 from JSON\n",
      "Processed 129231330 from JSON\n",
      "Processed 73383217 from JSON\n",
      "Processed 83866254 from JSON\n",
      "Processed 78508884 from JSON\n",
      "Processed 78510911 from JSON\n",
      "Processed 141533423 from JSON\n",
      "Processed 141530633 from JSON\n",
      "Processed 83866160 from JSON\n",
      "Processed 84090652 from JSON\n",
      "Processed 84093459 from JSON\n",
      "Processed 93874637 from JSON\n",
      "Processed 93946400 from JSON\n",
      "Processed 93949036 from JSON\n",
      "Processed 94040707 from JSON\n",
      "Processed 94047195 from JSON\n",
      "Processed 141534706 from JSON\n",
      "Processed 129356131 from JSON\n",
      "Processed 129202722 from JSON\n",
      "Processed 129352292 from JSON\n",
      "Processed 73992261 from JSON\n",
      "Processed 86421011 from JSON\n",
      "Processed 86419294 from JSON\n",
      "Processed 83865190 from JSON\n",
      "Processed 93943626 from JSON\n",
      "Processed 129356118 from JSON\n",
      "Processed 93948296 from JSON\n",
      "Processed 83852558 from JSON\n",
      "Processed 94067118 from JSON\n",
      "Processed 84092085 from JSON\n",
      "Processed 42746962 from JSON\n",
      "Processed 78508433 from JSON\n",
      "Processed 93937807 from JSON\n",
      "Processed 141530433 from JSON\n",
      "Processed 141534303 from JSON\n",
      "Processed 129361757 from JSON\n",
      "Processed 129360211 from JSON\n",
      "Processed 78511649 from JSON\n",
      "Processed 129356645 from JSON\n",
      "Processed 93951077 from JSON\n",
      "Processed 83839730 from JSON\n",
      "Processed 83837633 from JSON\n",
      "Processed 83852852 from JSON\n",
      "Processed 93907265 from JSON\n",
      "Processed 83850661 from JSON\n",
      "Processed 29532389 from JSON\n",
      "Processed 29534176 from JSON\n",
      "Processed 129355750 from JSON\n",
      "Processed 93943625 from JSON\n",
      "Processed 83832854 from JSON\n",
      "Processed 73407908 from JSON\n",
      "Processed 84328139 from JSON\n",
      "Processed 84327554 from JSON\n",
      "Processed 86418957 from JSON\n",
      "Processed 86414140 from JSON\n",
      "Processed 83857803 from JSON\n",
      "Processed 129268822 from JSON\n",
      "Processed 141532765 from JSON\n",
      "Processed 74203631 from JSON\n",
      "Processed 74203662 from JSON\n",
      "Processed 83844519 from JSON\n",
      "Processed 83831511 from JSON\n",
      "Processed 93947138 from JSON\n",
      "Processed 93953159 from JSON\n",
      "Processed 73392091 from JSON\n",
      "Processed 129350290 from JSON\n",
      "Processed 93896776 from JSON\n",
      "Processed 146472164 from JSON\n",
      "Processed 29562605 from JSON\n",
      "Processed 129250943 from JSON\n",
      "Processed 93952294 from JSON\n",
      "Processed 93946970 from JSON\n",
      "Processed 78511135 from JSON\n",
      "Processed 129241884 from JSON\n",
      "Processed 93954454 from JSON\n",
      "Processed 94042808 from JSON\n",
      "Processed 93942219 from JSON\n",
      "Processed 83840183 from JSON\n",
      "Processed 83844301 from JSON\n",
      "Processed 73408027 from JSON\n",
      "Processed 84333329 from JSON\n",
      "Processed 141533550 from JSON\n",
      "Processed 141531097 from JSON\n",
      "Processed 141538500 from JSON\n",
      "Processed 86416657 from JSON\n",
      "Processed 86415591 from JSON\n",
      "Processed 84092818 from JSON\n",
      "Processed 83841219 from JSON\n",
      "Processed 83840742 from JSON\n",
      "Processed 83847046 from JSON\n",
      "Processed 83847851 from JSON\n",
      "Processed 73391665 from JSON\n",
      "Processed 74251966 from JSON\n",
      "Processed 94078804 from JSON\n",
      "Processed 93954516 from JSON\n",
      "Processed 94054967 from JSON\n",
      "Processed 93947198 from JSON\n",
      "Processed 73373283 from JSON\n",
      "Processed 83838110 from JSON\n",
      "Processed 78511615 from JSON\n",
      "Processed 141533070 from JSON\n",
      "Processed 78510751 from JSON\n",
      "Processed 42706100 from JSON\n",
      "Processed 141538378 from JSON\n",
      "Processed 93960056 from JSON\n",
      "Processed 83857914 from JSON\n",
      "Processed 83831901 from JSON\n",
      "Processed 83867401 from JSON\n",
      "Processed 94054317 from JSON\n",
      "Processed 83835244 from JSON\n",
      "Processed 83835073 from JSON\n",
      "Processed 129350603 from JSON\n",
      "Processed 129362653 from JSON\n",
      "Processed 93867547 from JSON\n",
      "Processed 73989889 from JSON\n",
      "Processed 78509695 from JSON\n",
      "Processed 141530779 from JSON\n",
      "Processed 42749492 from JSON\n",
      "Processed 141538348 from JSON\n",
      "Processed 93959820 from JSON\n",
      "Processed 84093914 from JSON\n",
      "Processed 84092492 from JSON\n",
      "Processed 86418287 from JSON\n",
      "Processed 86421766 from JSON\n",
      "Processed 74203729 from JSON\n",
      "Processed 42749493 from JSON\n",
      "Processed 78508862 from JSON\n",
      "Processed 73958222 from JSON\n",
      "Processed 129269698 from JSON\n",
      "Processed 83832703 from JSON\n",
      "Processed 83836820 from JSON\n",
      "Processed 83835276 from JSON\n",
      "Processed 93942139 from JSON\n",
      "Processed 83863347 from JSON\n",
      "Processed 73375863 from JSON\n",
      "Processed 83853362 from JSON\n",
      "Processed 129356556 from JSON\n",
      "Processed 93909158 from JSON\n",
      "Processed 93955454 from JSON\n",
      "Processed 93959247 from JSON\n",
      "Processed 129356710 from JSON\n",
      "Processed 129354303 from JSON\n",
      "Processed 83861341 from JSON\n",
      "Processed 73372718 from JSON\n",
      "Processed 83870556 from JSON\n",
      "Processed 24996533 from JSON\n",
      "Processed 25036599 from JSON\n",
      "Processed 24946375 from JSON\n",
      "Processed 24930779 from JSON\n",
      "Processed 25010353 from JSON\n",
      "Processed 146472595 from JSON\n",
      "Processed 94040495 from JSON\n",
      "Processed 84094297 from JSON\n",
      "Processed 84327388 from JSON\n",
      "Processed 84331341 from JSON\n",
      "Processed 86418178 from JSON\n",
      "Processed 86414323 from JSON\n",
      "Processed 73408557 from JSON\n",
      "Processed 73409093 from JSON\n",
      "Processed 73408773 from JSON\n",
      "Processed 42747087 from JSON\n",
      "Processed 42748600 from JSON\n",
      "Processed 42752834 from JSON\n",
      "Processed 78509679 from JSON\n",
      "Processed 78507673 from JSON\n",
      "Processed 78507488 from JSON\n",
      "Processed 141538256 from JSON\n",
      "Processed 42681963 from JSON\n",
      "Processed 93939510 from JSON\n",
      "Processed 93910508 from JSON\n",
      "Processed 93943946 from JSON\n",
      "Processed 93947070 from JSON\n",
      "Processed 93944918 from JSON\n",
      "Processed 129233964 from JSON\n",
      "Processed 73989191 from JSON\n",
      "Processed 73987652 from JSON\n",
      "Processed 93895212 from JSON\n",
      "Processed 129265378 from JSON\n",
      "Processed 129268182 from JSON\n",
      "Processed 129268834 from JSON\n",
      "Processed 129269527 from JSON\n",
      "Processed 129356230 from JSON\n",
      "Processed 93942741 from JSON\n",
      "Processed 83869517 from JSON\n",
      "Processed 83836249 from JSON\n",
      "Processed 83836650 from JSON\n",
      "Processed 73349162 from JSON\n",
      "Processed 83842316 from JSON\n",
      "Processed 83842967 from JSON\n",
      "Processed 83839147 from JSON\n",
      "Processed 146472393 from JSON\n",
      "Processed 93907151 from JSON\n",
      "Processed 93911835 from JSON\n",
      "Processed 146471390 from JSON\n",
      "Processed 93954777 from JSON\n",
      "Processed 93959138 from JSON\n",
      "Processed 73375662 from JSON\n",
      "Processed 83850681 from JSON\n",
      "Processed 129349146 from JSON\n",
      "Processed 129351312 from JSON\n",
      "Processed 129357156 from JSON\n",
      "Processed 129362516 from JSON\n",
      "Processed 129239652 from JSON\n",
      "Processed 129246289 from JSON\n",
      "Processed 129348592 from JSON\n",
      "Processed 129353781 from JSON\n",
      "Processed 129260289 from JSON\n",
      "Processed 129269837 from JSON\n",
      "Processed 73958069 from JSON\n",
      "Processed 73955356 from JSON\n",
      "Processed 83851653 from JSON\n",
      "Processed 83854366 from JSON\n",
      "Processed 83855460 from JSON\n",
      "Processed 83846015 from JSON\n",
      "Processed 83834786 from JSON\n",
      "Processed 83858376 from JSON\n",
      "Processed 73375199 from JSON\n",
      "Processed 83862548 from JSON\n",
      "Processed 83862207 from JSON\n",
      "Processed 73378871 from JSON\n",
      "Processed 73953522 from JSON\n",
      "Processed 73987653 from JSON\n",
      "Processed 42704829 from JSON\n",
      "Processed 73414098 from JSON\n",
      "Processed 73407618 from JSON\n",
      "Processed 42719669 from JSON\n",
      "Processed 29543814 from JSON\n",
      "Processed 84094964 from JSON\n",
      "Processed 73442277 from JSON\n",
      "Processed 42655868 from JSON\n",
      "Processed 42742913 from JSON\n",
      "Processed 42749558 from JSON\n",
      "Processed 129239884 from JSON\n",
      "Processed 129248277 from JSON\n",
      "Processed 129229450 from JSON\n",
      "Processed 129202918 from JSON\n",
      "Processed 42730879 from JSON\n",
      "Processed 42719140 from JSON\n",
      "Processed 42735021 from JSON\n",
      "Processed 93952910 from JSON\n",
      "Processed 129268415 from JSON\n",
      "Processed 129268491 from JSON\n",
      "Processed 129270085 from JSON\n",
      "Processed 93949619 from JSON\n",
      "Processed 94022115 from JSON\n",
      "Processed 141529941 from JSON\n",
      "Processed 141529321 from JSON\n",
      "Processed 146472455 from JSON\n",
      "Processed 146473580 from JSON\n",
      "Processed 94051621 from JSON\n",
      "Processed 93907989 from JSON\n",
      "Processed 93908588 from JSON\n",
      "Processed 93908494 from JSON\n",
      "Processed 93906986 from JSON\n",
      "Processed 94058437 from JSON\n",
      "Processed 94074781 from JSON\n",
      "Processed 73363815 from JSON\n",
      "Processed 83844414 from JSON\n",
      "Processed 83840203 from JSON\n",
      "Processed 83852703 from JSON\n",
      "Processed 83835634 from JSON\n",
      "Processed 83837438 from JSON\n",
      "Processed 83840791 from JSON\n",
      "Processed 73353847 from JSON\n",
      "Processed 83839768 from JSON\n",
      "Processed 83835122 from JSON\n",
      "Processed 73398141 from JSON\n",
      "Processed 83850389 from JSON\n",
      "Processed 73364539 from JSON\n",
      "Processed 83867682 from JSON\n",
      "Processed 83864227 from JSON\n",
      "Processed 93886183 from JSON\n",
      "Processed 93898481 from JSON\n",
      "Processed 93951366 from JSON\n",
      "Processed 93951227 from JSON\n",
      "Processed 93950952 from JSON\n",
      "Processed 129259510 from JSON\n",
      "Processed 129354165 from JSON\n",
      "Processed 73356156 from JSON\n",
      "Processed 86416049 from JSON\n",
      "Processed 84331575 from JSON\n",
      "Processed 86417390 from JSON\n",
      "Processed 129361451 from JSON\n",
      "Processed 129348500 from JSON\n",
      "Processed 129354538 from JSON\n",
      "Processed 129252805 from JSON\n",
      "Processed 129269449 from JSON\n",
      "Processed 129276487 from JSON\n",
      "Processed 94068234 from JSON\n",
      "Processed 84094965 from JSON\n",
      "Processed 73410756 from JSON\n",
      "Processed 73423622 from JSON\n",
      "Processed 86415898 from JSON\n",
      "Processed 73990063 from JSON\n",
      "Processed 73991934 from JSON\n",
      "Processed 73958643 from JSON\n",
      "Processed 42726088 from JSON\n",
      "Processed 74204035 from JSON\n",
      "Processed 141529322 from JSON\n",
      "Processed 141529245 from JSON\n",
      "Processed 141531163 from JSON\n",
      "Processed 84328345 from JSON\n",
      "Processed 84327931 from JSON\n",
      "Processed 84329191 from JSON\n",
      "Processed 84331949 from JSON\n",
      "Processed 84326882 from JSON\n",
      "Processed 42675139 from JSON\n",
      "Processed 78507936 from JSON\n",
      "Processed 78507176 from JSON\n",
      "Processed 78510439 from JSON\n",
      "Processed 42739776 from JSON\n",
      "Processed 94044970 from JSON\n",
      "Processed 83838920 from JSON\n",
      "Processed 83839149 from JSON\n",
      "Processed 83836948 from JSON\n",
      "Processed 83860961 from JSON\n",
      "Processed 83860822 from JSON\n",
      "Processed 83860776 from JSON\n",
      "Processed 83862378 from JSON\n",
      "Processed 73381250 from JSON\n",
      "Processed 73381591 from JSON\n",
      "Processed 93913620 from JSON\n",
      "Processed 93943418 from JSON\n",
      "Processed 146473488 from JSON\n",
      "Processed 146473363 from JSON\n",
      "Processed 94067542 from JSON\n",
      "Processed 94069454 from JSON\n",
      "Processed 94074799 from JSON\n",
      "Processed 129283260 from JSON\n",
      "Processed 93873874 from JSON\n",
      "Processed 93902293 from JSON\n",
      "Processed 129227338 from JSON\n",
      "Processed 93945609 from JSON\n",
      "Processed 94066943 from JSON\n",
      "Processed 94069144 from JSON\n",
      "Processed 83847281 from JSON\n",
      "Processed 83847654 from JSON\n",
      "Processed 129210446 from JSON\n",
      "Processed 73348907 from JSON\n",
      "Processed 83847870 from JSON\n",
      "Processed 83841702 from JSON\n",
      "Processed 83841454 from JSON\n",
      "Processed 73378719 from JSON\n",
      "Processed 129361825 from JSON\n",
      "Processed 129349706 from JSON\n",
      "Processed 129353411 from JSON\n",
      "Processed 129270534 from JSON\n",
      "Processed 73393611 from JSON\n",
      "Processed 83844771 from JSON\n",
      "Processed 83833399 from JSON\n",
      "Processed 73348908 from JSON\n",
      "Processed 146475337 from JSON\n",
      "Processed 93942755 from JSON\n",
      "Processed 129359287 from JSON\n",
      "Processed 94060915 from JSON\n",
      "Processed 94073627 from JSON\n",
      "Processed 146476385 from JSON\n",
      "Processed 84327406 from JSON\n",
      "Processed 93888790 from JSON\n",
      "Processed 93907367 from JSON\n",
      "Processed 93936796 from JSON\n",
      "Processed 93938211 from JSON\n",
      "Processed 93941644 from JSON\n",
      "Processed 93939771 from JSON\n",
      "Processed 93943866 from JSON\n",
      "Processed 93946997 from JSON\n",
      "Processed 93949895 from JSON\n",
      "Processed 93951720 from JSON\n",
      "Processed 93912710 from JSON\n",
      "Processed 93940254 from JSON\n",
      "Processed 94045619 from JSON\n",
      "Processed 94042300 from JSON\n",
      "Processed 129237242 from JSON\n",
      "Processed 129269555 from JSON\n",
      "Processed 93901446 from JSON\n",
      "Processed 93881960 from JSON\n",
      "Processed 129355014 from JSON\n",
      "Processed 83831393 from JSON\n",
      "Processed 73355371 from JSON\n",
      "Processed 83844012 from JSON\n",
      "Processed 83843831 from JSON\n",
      "Processed 73371517 from JSON\n",
      "Processed 73371500 from JSON\n",
      "Processed 73355698 from JSON\n",
      "Processed 83844865 from JSON\n",
      "Processed 83835775 from JSON\n",
      "Processed 83850730 from JSON\n",
      "Processed 86417141 from JSON\n",
      "Processed 84329255 from JSON\n",
      "Processed 86414243 from JSON\n",
      "Processed 86415044 from JSON\n",
      "Processed 141531924 from JSON\n",
      "Processed 78508440 from JSON\n",
      "Processed 141529323 from JSON\n",
      "Processed 141535065 from JSON\n",
      "Processed 141537612 from JSON\n",
      "Processed 73419590 from JSON\n",
      "Processed 73411200 from JSON\n",
      "Processed 84094113 from JSON\n",
      "Processed 84094966 from JSON\n",
      "Processed 73408435 from JSON\n",
      "Processed 78511859 from JSON\n",
      "Processed 42735085 from JSON\n",
      "Processed 94075941 from JSON\n",
      "Processed 93952070 from JSON\n",
      "Processed 129357934 from JSON\n",
      "Processed 129268537 from JSON\n",
      "Processed 93867806 from JSON\n",
      "Processed 93902260 from JSON\n",
      "Processed 129351424 from JSON\n",
      "Processed 141533541 from JSON\n",
      "Processed 141535035 from JSON\n",
      "Processed 129231058 from JSON\n",
      "Processed 129237412 from JSON\n",
      "Processed 93959970 from JSON\n",
      "Processed 93960143 from JSON\n",
      "Processed 93947083 from JSON\n",
      "Processed 93949724 from JSON\n",
      "Processed 93950252 from JSON\n",
      "Processed 94067683 from JSON\n",
      "Processed 83831767 from JSON\n",
      "Processed 146472887 from JSON\n",
      "Processed 94047142 from JSON\n",
      "Processed 94048222 from JSON\n",
      "Processed 94068112 from JSON\n",
      "Processed 94067931 from JSON\n",
      "Processed 83859473 from JSON\n",
      "Processed 83849335 from JSON\n",
      "Processed 83836731 from JSON\n",
      "Processed 83864927 from JSON\n",
      "Processed 83865696 from JSON\n",
      "Processed 83840718 from JSON\n",
      "Processed 83866574 from JSON\n",
      "Processed 83847050 from JSON\n",
      "Processed 73389799 from JSON\n",
      "Processed 83854555 from JSON\n",
      "Processed 83839569 from JSON\n",
      "Processed 83870683 from JSON\n",
      "Processed 83869597 from JSON\n",
      "Processed 83867748 from JSON\n",
      "Processed 83856993 from JSON\n",
      "Processed 42657362 from JSON\n",
      "Processed 42698051 from JSON\n",
      "Processed 73988192 from JSON\n",
      "Processed 84328532 from JSON\n",
      "Processed 86416729 from JSON\n",
      "Processed 84332982 from JSON\n",
      "Processed 84331345 from JSON\n",
      "Processed 84327173 from JSON\n",
      "Processed 141535578 from JSON\n",
      "Processed 141532043 from JSON\n",
      "Processed 141529696 from JSON\n",
      "Processed 42753204 from JSON\n",
      "Processed 42721357 from JSON\n",
      "Processed 42707821 from JSON\n",
      "Processed 129210879 from JSON\n",
      "Processed 129212837 from JSON\n",
      "Processed 73409143 from JSON\n",
      "Processed 73409299 from JSON\n",
      "Processed 29565835 from JSON\n",
      "Processed 84094501 from JSON\n",
      "Processed 73417759 from JSON\n",
      "Processed 73418125 from JSON\n",
      "Processed 73410107 from JSON\n",
      "Processed 73400433 from JSON\n",
      "Processed 73408576 from JSON\n",
      "Processed 73409315 from JSON\n",
      "Processed 73414441 from JSON\n",
      "Processed 42735676 from JSON\n",
      "Processed 42731155 from JSON\n",
      "Processed 42732158 from JSON\n",
      "Processed 78507577 from JSON\n",
      "Processed 78510948 from JSON\n",
      "Processed 141529248 from JSON\n",
      "Processed 129272551 from JSON\n",
      "Processed 129269988 from JSON\n",
      "Processed 129272955 from JSON\n",
      "Processed 129279211 from JSON\n",
      "Processed 93945404 from JSON\n",
      "Processed 93951209 from JSON\n",
      "Processed 93895318 from JSON\n",
      "Processed 129286653 from JSON\n",
      "Processed 74203578 from JSON\n",
      "Processed 74251041 from JSON\n",
      "Processed 93937083 from JSON\n",
      "Processed 93948225 from JSON\n",
      "Processed 93954556 from JSON\n",
      "Processed 94028674 from JSON\n",
      "Processed 94053119 from JSON\n",
      "Processed 83834666 from JSON\n",
      "Processed 83850143 from JSON\n",
      "Processed 83850112 from JSON\n",
      "Processed 83852024 from JSON\n",
      "Processed 83861239 from JSON\n",
      "Processed 73379537 from JSON\n",
      "Processed 73397779 from JSON\n",
      "Processed 73396480 from JSON\n",
      "Processed 84332022 from JSON\n",
      "Processed 84332907 from JSON\n",
      "Processed 84094968 from JSON\n",
      "Processed 84329815 from JSON\n",
      "Processed 42705600 from JSON\n",
      "Processed 73991502 from JSON\n",
      "Processed 73957410 from JSON\n",
      "Processed 83835683 from JSON\n",
      "Processed 73356237 from JSON\n",
      "Processed 83840827 from JSON\n",
      "Processed 83858534 from JSON\n",
      "Processed 83868362 from JSON\n",
      "Processed 83858286 from JSON\n",
      "Processed 94069673 from JSON\n",
      "Processed 93907271 from JSON\n",
      "Processed 93907086 from JSON\n",
      "Processed 93907783 from JSON\n",
      "Processed 93907613 from JSON\n",
      "Processed 93908212 from JSON\n",
      "Processed 93908940 from JSON\n",
      "Processed 146475025 from JSON\n",
      "Processed 83860964 from JSON\n",
      "Processed 83859582 from JSON\n",
      "Processed 83861563 from JSON\n",
      "Processed 83862270 from JSON\n",
      "Processed 83855807 from JSON\n",
      "Processed 83851160 from JSON\n",
      "Processed 83849848 from JSON\n",
      "Processed 83863862 from JSON\n",
      "Processed 73360346 from JSON\n",
      "Processed 83849088 from JSON\n",
      "Processed 83847981 from JSON\n",
      "Processed 93877417 from JSON\n",
      "Processed 83866499 from JSON\n",
      "Processed 83832849 from JSON\n",
      "Processed 83838241 from JSON\n",
      "Processed 83839167 from JSON\n",
      "Processed 83853275 from JSON\n",
      "Processed 73393242 from JSON\n",
      "Processed 73361148 from JSON\n",
      "Processed 83847160 from JSON\n",
      "Processed 73420526 from JSON\n",
      "Processed 73407389 from JSON\n",
      "Processed 73408623 from JSON\n",
      "Processed 84092329 from JSON\n",
      "Processed 84092855 from JSON\n",
      "Processed 73420728 from JSON\n",
      "Processed 84094969 from JSON\n",
      "Processed 73953774 from JSON\n",
      "Processed 84330096 from JSON\n",
      "Processed 84327283 from JSON\n",
      "Processed 42680346 from JSON\n",
      "Processed 73992924 from JSON\n",
      "Processed 73987595 from JSON\n",
      "Processed 84333196 from JSON\n",
      "Processed 84328534 from JSON\n",
      "Processed 42655452 from JSON\n",
      "Processed 42654776 from JSON\n",
      "Processed 86421295 from JSON\n",
      "Processed 84327935 from JSON\n",
      "Processed 42743221 from JSON\n",
      "Processed 146472018 from JSON\n",
      "Processed 129348954 from JSON\n",
      "Processed 129353648 from JSON\n",
      "Processed 94027285 from JSON\n",
      "Processed 42735754 from JSON\n",
      "Processed 94067128 from JSON\n",
      "Processed 94058456 from JSON\n",
      "Processed 93943337 from JSON\n",
      "Processed 83860268 from JSON\n",
      "Processed 83861704 from JSON\n",
      "Processed 73369818 from JSON\n",
      "Processed 83840532 from JSON\n",
      "Processed 83837022 from JSON\n",
      "Processed 83863135 from JSON\n",
      "Processed 93893791 from JSON\n",
      "Processed 94061423 from JSON\n",
      "Processed 94076883 from JSON\n",
      "Processed 146476010 from JSON\n",
      "Processed 146471572 from JSON\n",
      "Processed 141532401 from JSON\n",
      "Processed 129271254 from JSON\n",
      "Processed 129248582 from JSON\n",
      "Processed 129255931 from JSON\n",
      "Processed 93914326 from JSON\n",
      "Processed 93937068 from JSON\n",
      "Processed 93907674 from JSON\n",
      "Processed 93948952 from JSON\n",
      "Processed 129355031 from JSON\n",
      "Processed 93938674 from JSON\n",
      "Processed 78508656 from JSON\n",
      "Processed 141531244 from JSON\n",
      "Processed 141535765 from JSON\n",
      "Processed 141529186 from JSON\n",
      "Processed 141529249 from JSON\n",
      "Processed 93946467 from JSON\n",
      "Processed 93948331 from JSON\n",
      "Processed 93953520 from JSON\n",
      "Processed 42701251 from JSON\n",
      "Processed 42739966 from JSON\n",
      "Processed 83832198 from JSON\n",
      "Processed 73349121 from JSON\n",
      "Processed 83866407 from JSON\n",
      "Processed 93948874 from JSON\n",
      "Processed 93946931 from JSON\n",
      "Processed 93912987 from JSON\n",
      "Processed 93945015 from JSON\n",
      "Processed 93942643 from JSON\n",
      "Processed 94079148 from JSON\n",
      "Processed 94058844 from JSON\n",
      "Processed 84332891 from JSON\n",
      "Processed 84331348 from JSON\n",
      "Processed 84330624 from JSON\n",
      "Processed 84331502 from JSON\n",
      "Processed 86413671 from JSON\n",
      "Processed 73989662 from JSON\n",
      "Processed 73957133 from JSON\n",
      "Processed 73959850 from JSON\n",
      "Processed 84328117 from JSON\n",
      "Processed 84328364 from JSON\n",
      "Processed 42731669 from JSON\n",
      "Processed 129350796 from JSON\n",
      "Processed 129354976 from JSON\n",
      "Processed 129272054 from JSON\n",
      "Processed 93898214 from JSON\n",
      "Processed 93907907 from JSON\n",
      "Processed 93907736 from JSON\n",
      "Processed 93883171 from JSON\n",
      "Processed 129214498 from JSON\n",
      "Processed 93937283 from JSON\n",
      "Processed 129355450 from JSON\n",
      "Processed 129208491 from JSON\n",
      "Processed 141532882 from JSON\n",
      "Processed 141533126 from JSON\n",
      "Processed 78512252 from JSON\n",
      "Processed 141535766 from JSON\n",
      "Processed 141531245 from JSON\n",
      "Processed 73419284 from JSON\n",
      "Processed 73408237 from JSON\n",
      "Processed 73407575 from JSON\n",
      "Processed 73411141 from JSON\n",
      "Processed 73408888 from JSON\n",
      "Processed 84093981 from JSON\n",
      "Processed 73400606 from JSON\n",
      "Processed 73418609 from JSON\n",
      "Processed 83857300 from JSON\n",
      "Processed 83837427 from JSON\n",
      "Processed 83842940 from JSON\n"
     ]
    }
   ],
   "source": [
    "for article in articles:\n",
    "    # Process text and references for each article\n",
    "    manage_text_and_refs(article)\n",
    "    # Store to database\n",
    "    arxiv_json_to_mongo(article)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Done! We have a bunch of files in our database! "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Indexing - Elasticsearch \n",
    "\n",
    "We use Elasticsearch for the quick and very flexible (elastic?) queries across the full text of articles, so we have to index all the content from the database for this.\n",
    "\n",
    "Once again, we have to [install](https://www.elastic.co/guide/en/elasticsearch/reference/current/_installation.html) it and run the service...yay!\n",
    "\n",
    "Once it's running we can connect and check status:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import pymongo\n",
    "import elasticsearch\n",
    "import requests\n",
    "import nltk\n",
    "from elasticsearch import helpers\n",
    "import re\n",
    "import string"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "client = pymongo.MongoClient('localhost:' + str(mongoDB_Port))\n",
    "publications_collection = client.pub.publications\n",
    "es = elasticsearch.Elasticsearch([{'host': 'localhost', 'port': 9200}],\n",
    "                                 timeout=30, max_retries=10, retry_on_timeout=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'active_primary_shards': 0,\n",
       " 'active_shards': 0,\n",
       " 'active_shards_percent_as_number': 100.0,\n",
       " 'cluster_name': 'elasticsearch',\n",
       " 'delayed_unassigned_shards': 0,\n",
       " 'initializing_shards': 0,\n",
       " 'number_of_data_nodes': 1,\n",
       " 'number_of_in_flight_fetch': 0,\n",
       " 'number_of_nodes': 1,\n",
       " 'number_of_pending_tasks': 0,\n",
       " 'relocating_shards': 0,\n",
       " 'status': 'green',\n",
       " 'task_max_waiting_in_queue_millis': 0,\n",
       " 'timed_out': False,\n",
       " 'unassigned_shards': 0}"
      ]
     },
     "execution_count": 26,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "es.cluster.health()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Full text indexing\n",
    "\n",
    "First we index the full content of every article in the database.\n",
    "\n",
    "(This step corresponds to `collection_extraction -> index_papersfulltext.py` in the code)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def extract_metadata(documents):\n",
    "    list_of_docs = []\n",
    "    for i, r in enumerate(documents):\n",
    "        extracted = {\n",
    "                \"_id\": \"\",\n",
    "                \"title\": \"\",\n",
    "                \"publication\": \"\",\n",
    "                \"year\": \"\",\n",
    "                \"content\": \"\",\n",
    "                \"abstract\": \"\",\n",
    "                \"authors\": [],\n",
    "                \"references\": []}\n",
    "        extracted['_id'] = r['_id']\n",
    "        extracted['title'] = r['title']\n",
    "        extracted['publication'] = r['journal']\n",
    "        extracted['year'] = r['year']\n",
    "        extracted['content'] = r['content']['fulltext']\n",
    "        extracted['abstract'] = r['content']['abstract']\n",
    "        extracted['authors'] = r['authors']\n",
    "        extracted['references'] = r['content']['references']\n",
    "        list_of_docs.append(extracted)\n",
    "    return list_of_docs"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "filter_publications = ['arxiv'] # Here we could also put PubMed or other sources\n",
    "\n",
    "extracted_publications = []\n",
    "for publication in filter_publications:\n",
    "    query ={'$and': [{'journal': publication}, {'content.fulltext': {'$exists': True}}]}                   \n",
    "    results = publications_collection.find(query)\n",
    "    extracted_publications.append(extract_metadata(results))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Done with (3814, []) articles added to index\n"
     ]
    }
   ],
   "source": [
    "for publication in extracted_publications:\n",
    "    actions = []\n",
    "    for article in publication:\n",
    "        authors = []\n",
    "        if len(article['authors']) > 0:\n",
    "            if type(article['authors'][0]) == list:\n",
    "                try:\n",
    "                    for name in article['authors']:\n",
    "                        authors.append(', '.join([name[1], name[0]]))\n",
    "                    authors = list(set(authors))\n",
    "                except:\n",
    "                    pass\n",
    "            else:\n",
    "                authors = article['authors']\n",
    "        actions.append({\n",
    "            \"_index\": \"ir\", \n",
    "            \"_type\": \"publications\",  \n",
    "            \"_id\": article['_id'],\n",
    "            \"_source\": {\n",
    "                \"title\": article[\"title\"],\n",
    "                \"journal\": article['publication'],\n",
    "                \"year\": str(article['year']),\n",
    "                \"content\": article[\"content\"],\n",
    "                \"abstract\": article[\"abstract\"],\n",
    "                \"authors\": authors,\n",
    "                \"references\": article[\"references\"]\n",
    "            }\n",
    "        })\n",
    "    if len(actions) == 0:\n",
    "        continue\n",
    "    res = helpers.bulk(es, actions)\n",
    "    print('Done with', res, 'articles added to index')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can look for anything in the text, like this:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Got 1 Hits:\n",
      "arxiv_84094279 Re-Evaluating the Netflix Prize - Human Uncertainty and its Impact on\n",
      "  Reliability\n",
      "arxiv_84094279 In this paper, we examine the statistical soundness of comparative\n",
      "assessments within the field of recommender systems in terms of reliability and\n",
      "human uncertainty. From a controlled experiment, we get the insight that users\n",
      "provide different ratings on same items when repeatedly asked. This volatility\n",
      "of user ratings justifies the assumption of using probability densities instead\n",
      "of single rating scores. As a consequence, the well-known accuracy metrics\n",
      "(e.g. MAE, MSE, RMSE) yield a density themselves that emerges from convolution\n",
      "of all rating densities. When two different systems produce different RMSE\n",
      "distributions with significant intersection, then there exists a probability of\n",
      "error for each possible ranking. As an application, we examine possible ranking\n",
      "errors of the Netflix Prize. We are able to show that all top rankings are more\n",
      "or less subject to high probabilities of error and that some rankings may be\n",
      "deemed to be caused by mere chance rather than system quality\n",
      "--------------------------------------------------\n"
     ]
    }
   ],
   "source": [
    "res = es.search(index = \"ir\", body = {\"query\": {\"match\": {\"title\" : \"netflix\"}}}, size = 10)\n",
    "\n",
    "print(\"Got %d Hits:\" % res['hits']['total'])\n",
    "for hit in res['hits']['hits']:\n",
    "    print(hit['_id'], hit['_source']['title'])\n",
    "    print(hit['_id'], hit['_source']['abstract'])\n",
    "    print('-'*50)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Sentence Indexing \n",
    "For the sentence expansion step of our process, we need to have sentences indexed. This is because we need to find similar sentences as well as their surrounding sentences, for context. \n",
    "\n",
    "In addition, we create a file with all the text, of all our articles, and we will use it later for the training of embedding models.\n",
    "\n",
    "(This step corresponds to `collection_extraction -> index_twosent.py` in the code)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "sent_detector = nltk.data.load('tokenizers/punkt/english.pickle')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Done\n"
     ]
    }
   ],
   "source": [
    "for publication in extracted_publications:\n",
    "    for article in publication:\n",
    "        actions = []\n",
    "        cleaned = []\n",
    "        dataset_sent = []\n",
    "        other_sent = []\n",
    "\n",
    "        lines = (sent_detector.tokenize(article['content'].strip()))\n",
    "        \n",
    "        # This will be used for the training of word2vec and doc2vec\n",
    "        # You need to create the data folder beforehand\n",
    "        with open('data/full_text_corpus.txt', 'a', encoding='utf-8') as f:\n",
    "            for line in lines:\n",
    "                f.write(line)\n",
    "        f.close()\n",
    "        \n",
    "        if len(lines) < 3:\n",
    "            continue\n",
    "\n",
    "        for i in range(len(lines)):\n",
    "            words = nltk.word_tokenize(lines[i])\n",
    "            word_lengths = [len(x) for x in words]\n",
    "            average_word_length = sum(word_lengths) / len(word_lengths)\n",
    "            if average_word_length < 4:\n",
    "                continue\n",
    "\n",
    "            two_sentences = ''\n",
    "            try:\n",
    "                two_sentences = lines[i] + ' ' + lines[i - 1]\n",
    "            except:\n",
    "                two_sentences = lines[i] + ' ' + lines[i + 1]\n",
    "\n",
    "            dataset_sent.append(two_sentences)\n",
    "\n",
    "        for num, added_lines in enumerate(dataset_sent):\n",
    "            actions.append({\n",
    "                \"_index\": \"twosent\",\n",
    "                \"_type\": \"twosentnorules\",\n",
    "                \"_id\": article['_id'] + str(num),\n",
    "                \"_source\": {\n",
    "                    \"title\": article['title'],\n",
    "                    \"content.chapter.sentpositive\": added_lines,\n",
    "                    \"paper_id\": article['_id']\n",
    "                }})\n",
    "\n",
    "        if len(actions) == 0:\n",
    "            continue\n",
    "        res = helpers.bulk(es, actions)\n",
    "print('Done')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Got 1311 Hits:\n",
      "arxiv_94074613218 Expert Gate: Lifelong Learning with a Network of Experts\n",
      "We consider the following knowl- edge transfer cases: Scenes → Actions, ImageNet → Ac- tions, SVHN → Letters, ImageNet → Letters, SVHN → Mnist, ImageNet→ Mnist, Flowers→ Cars and Imagenet → Cars. We also consider ImageNet as a possible source.\n",
      "--------------------------------------------------\n",
      "arxiv_93937583198 Learning Efficient Convolutional Networks through Network Slimming\n",
      "The results for ImageNet dataset are summa- rized in Table 2. ImageNet.\n",
      "--------------------------------------------------\n",
      "arxiv_86420809239 ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural\n",
      "  Networks without Training Substitute Models\n",
      "Substi- tute model based attack cannot easily scale to ImageNet. Table 2: Untargeted ImageNet attacks comparison.\n",
      "--------------------------------------------------\n",
      "arxiv_93937583152 Learning Efficient Convolutional Networks through Network Slimming\n",
      "The ImageNet dataset contains 1.2 million training images and 50,000 validation images of 1000 classes. ImageNet.\n",
      "--------------------------------------------------\n",
      "arxiv_93873437146 Towards Evaluating the Robustness of Neural Networks\n",
      "Along with considering MNIST and CIFAR, which are both relatively small datasets, we also consider the ImageNet dataset. ImageNet.\n",
      "--------------------------------------------------\n"
     ]
    }
   ],
   "source": [
    "res = es.search(index = \"twosent\", body = {\"query\": {\"match\": {\"content.chapter.sentpositive\" : \"imagenet\"}}}, size = 5)\n",
    "\n",
    "print(\"Got %d Hits:\" % res['hits']['total'])\n",
    "for hit in res['hits']['hits']:\n",
    "    print(hit['_id'], hit['_source']['title'])\n",
    "    print(hit['_source']['content.chapter.sentpositive'])\n",
    "    print('-'*50)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Doc2vec Indexing\n",
    "\n",
    "Once again, we index the sentences from the full text file created before, which will be used for the Sentence Expansion using doc2vec.\n",
    "\n",
    "(This step corresponds to `collection_extraction -> index_doc2vec.py` in the code)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Sentences ready\n",
      "112410\n",
      "112410\n",
      "(112410, [])\n"
     ]
    }
   ],
   "source": [
    "file = open('data/full_text_corpus.txt', 'r', encoding='utf-8')\n",
    "text = file.read()\n",
    "file.close()\n",
    "sentences = nltk.tokenize.sent_tokenize(text)\n",
    "print('Sentences ready')\n",
    "count = 0\n",
    "docLabels = []\n",
    "actions = []\n",
    "\n",
    "for i, sent in enumerate(sentences):\n",
    "    try:\n",
    "        neighbors = sentences[i + 1]\n",
    "        neighbor_count = count + 1\n",
    "    except:\n",
    "        neighbors = sentences[i - 1]\n",
    "        neighbor_count = count - 1\n",
    "\n",
    "    docLabels.append(count)\n",
    "    actions.append({\n",
    "        \"_index\": \"devtwosentnew\",\n",
    "        \"_type\": \"devtwosentnorulesnew\",\n",
    "        \"_id\": count,\n",
    "        \"_source\": {\n",
    "            \"content.chapter.sentpositive\": sent,\n",
    "            \"content.chapter.sentnegtive\": neighbors,\n",
    "            \"neighborcount\": neighbor_count\n",
    "        }})\n",
    "    count = count + 1\n",
    "\n",
    "print(len(sentences))\n",
    "print(len(docLabels))\n",
    "res = helpers.bulk(es, actions)\n",
    "print(res)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Training Embedding Models (word2vec & doc2vec)\n",
    "\n",
    "For the Term and Sentence expansion, we need to find similar words or sentences, and we use word2vec and doc2vec respectively. We have to generate a document with all the sentences in our corpus, which will be stored in the data folder. While this is not a full implementation, we have around 4 million sentences, so it is a considerable example, and processing can take some time.\n",
    "\n",
    "(This step corresponds to `data_preparation -> prepare_embedding_data.py` in the code)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Done ----------------------------------------------------------------------------------------------------\n"
     ]
    }
   ],
   "source": [
    "sentence_text = []\n",
    "translator = str.maketrans('', '', string.punctuation)\n",
    "\n",
    "for publication in extracted_publications:\n",
    "    for article in publication:\n",
    "        query = {\"query\":\n",
    "                     {\"match\":\n",
    "                          {\"_id\":\n",
    "                               {\"query\": article['_id'],\n",
    "                                \"operator\": \"and\"\n",
    "                                }\n",
    "                           }\n",
    "                      }\n",
    "                 }\n",
    "\n",
    "        results = es.search(index=\"ir\", body=query, size=200)\n",
    "        for doc in results['hits']['hits']:\n",
    "            fulltext = doc[\"_source\"][\"content\"]\n",
    "            fulltext = re.sub(\"[\\[].*?[\\]]\", \"\", fulltext)\n",
    "            sentence_text.append(fulltext)\n",
    "    print('Done', '-' * 100)\n",
    "\n",
    "f = open(\"data/data2vec.txt\", \"w\", encoding='utf-8')\n",
    "for line in sentence_text:\n",
    "    f.write(line)\n",
    "f.close()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Before training, verify that you have the optimized version of Gensim using Cython, for better performance."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "import gensim\n",
    "assert gensim.models.doc2vec.FAST_VERSION > -1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that we have the document with all the text, we can use them for the training. \n",
    "\n",
    "We will use a bigram model for word2vec, since it's common that entities are represented as two words. You can run the command from your Python console or directly here, using the magic `%run` syntax. The structure of this command is as follows:\n",
    "\n",
    "`%run script_to_run training_data model_output word_vector_output`\n",
    "\n",
    "This was run in a normal Lenovo machine with 8GB and i7 processor. As you can see by the timestamps below, it might take a while..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "2018-05-15 17:07:25,101: INFO: running data_preparation/train_word2vec.py data/data2vec.txt embedding_models/modelword2vecbigram.model embedding_models/modelword2vecbigram.vec\n",
      "2018-05-15 17:17:08,824: INFO: collecting all words and their counts\n",
      "2018-05-15 17:17:08,831: INFO: PROGRESS: at sentence #0, processed 0 words and 0 word types\n",
      "2018-05-15 17:17:09,350: INFO: PROGRESS: at sentence #10000, processed 201700 words and 71739 word types\n",
      "2018-05-15 17:17:09,858: INFO: PROGRESS: at sentence #20000, processed 398393 words and 134942 word types\n",
      "2018-05-15 17:17:10,411: INFO: PROGRESS: at sentence #30000, processed 617098 words and 204286 word types\n",
      "2018-05-15 17:17:11,162: INFO: PROGRESS: at sentence #40000, processed 862142 words and 279857 word types\n",
      "2018-05-15 17:17:11,845: INFO: PROGRESS: at sentence #50000, processed 1119381 words and 356880 word types\n",
      "2018-05-15 17:17:12,539: INFO: PROGRESS: at sentence #60000, processed 1357143 words and 420874 word types\n",
      "2018-05-15 17:17:13,233: INFO: PROGRESS: at sentence #70000, processed 1598677 words and 476863 word types\n",
      "2018-05-15 17:17:13,891: INFO: PROGRESS: at sentence #80000, processed 1808845 words and 534021 word types\n",
      "2018-05-15 17:17:14,675: INFO: PROGRESS: at sentence #90000, processed 2043827 words and 590064 word types\n",
      "2018-05-15 17:17:15,406: INFO: PROGRESS: at sentence #100000, processed 2262240 words and 647224 word types\n",
      "2018-05-15 17:17:16,024: INFO: PROGRESS: at sentence #110000, processed 2463773 words and 703490 word types\n",
      "2018-05-15 17:17:16,588: INFO: PROGRESS: at sentence #120000, processed 2655146 words and 754161 word types\n",
      "2018-05-15 17:17:17,309: INFO: PROGRESS: at sentence #130000, processed 2891561 words and 808354 word types\n",
      "2018-05-15 17:17:18,182: INFO: PROGRESS: at sentence #140000, processed 3140594 words and 864937 word types\n",
      "2018-05-15 17:17:18,606: INFO: PROGRESS: at sentence #150000, processed 3280627 words and 890344 word types\n",
      "2018-05-15 17:17:19,447: INFO: PROGRESS: at sentence #160000, processed 3507436 words and 940301 word types\n",
      "2018-05-15 17:17:20,166: INFO: PROGRESS: at sentence #170000, processed 3715231 words and 989266 word types\n",
      "2018-05-15 17:17:20,903: INFO: PROGRESS: at sentence #180000, processed 3894460 words and 1028397 word types\n",
      "2018-05-15 17:17:21,729: INFO: PROGRESS: at sentence #190000, processed 4117682 words and 1067750 word types\n",
      "2018-05-15 17:17:22,389: INFO: PROGRESS: at sentence #200000, processed 4353301 words and 1115084 word types\n",
      "2018-05-15 17:17:23,070: INFO: PROGRESS: at sentence #210000, processed 4547823 words and 1154733 word types\n",
      "2018-05-15 17:17:23,832: INFO: PROGRESS: at sentence #220000, processed 4784273 words and 1203252 word types\n",
      "2018-05-15 17:17:24,514: INFO: PROGRESS: at sentence #230000, processed 5022069 words and 1252446 word types\n",
      "2018-05-15 17:17:24,970: INFO: PROGRESS: at sentence #240000, processed 5196766 words and 1290425 word types\n",
      "2018-05-15 17:17:25,577: INFO: PROGRESS: at sentence #250000, processed 5439403 words and 1333353 word types\n",
      "2018-05-15 17:17:26,232: INFO: PROGRESS: at sentence #260000, processed 5694804 words and 1382038 word types\n",
      "2018-05-15 17:17:26,978: INFO: PROGRESS: at sentence #270000, processed 5927632 words and 1425313 word types\n",
      "2018-05-15 17:17:27,554: INFO: PROGRESS: at sentence #280000, processed 6164687 words and 1463149 word types\n",
      "2018-05-15 17:17:28,137: INFO: PROGRESS: at sentence #290000, processed 6384945 words and 1491367 word types\n",
      "2018-05-15 17:17:28,670: INFO: PROGRESS: at sentence #300000, processed 6595480 words and 1519565 word types\n",
      "2018-05-15 17:17:29,305: INFO: PROGRESS: at sentence #310000, processed 6812557 words and 1554545 word types\n",
      "2018-05-15 17:17:29,997: INFO: PROGRESS: at sentence #320000, processed 7036698 words and 1584134 word types\n",
      "2018-05-15 17:17:30,631: INFO: PROGRESS: at sentence #330000, processed 7216633 words and 1607894 word types\n",
      "2018-05-15 17:17:31,451: INFO: PROGRESS: at sentence #340000, processed 7420318 words and 1637825 word types\n",
      "2018-05-15 17:17:31,970: INFO: PROGRESS: at sentence #350000, processed 7638190 words and 1664305 word types\n",
      "2018-05-15 17:17:32,584: INFO: PROGRESS: at sentence #360000, processed 7887669 words and 1698006 word types\n",
      "2018-05-15 17:17:33,154: INFO: PROGRESS: at sentence #370000, processed 8081941 words and 1724861 word types\n",
      "2018-05-15 17:17:33,701: INFO: PROGRESS: at sentence #380000, processed 8293172 words and 1750127 word types\n",
      "2018-05-15 17:17:34,276: INFO: PROGRESS: at sentence #390000, processed 8519970 words and 1775939 word types\n",
      "2018-05-15 17:17:34,857: INFO: PROGRESS: at sentence #400000, processed 8734423 words and 1799607 word types\n",
      "2018-05-15 17:17:35,449: INFO: PROGRESS: at sentence #410000, processed 8974389 words and 1825499 word types\n",
      "2018-05-15 17:17:36,038: INFO: PROGRESS: at sentence #420000, processed 9210248 words and 1854348 word types\n",
      "2018-05-15 17:17:36,725: INFO: PROGRESS: at sentence #430000, processed 9466017 words and 1877235 word types\n",
      "2018-05-15 17:17:37,351: INFO: PROGRESS: at sentence #440000, processed 9698829 words and 1906528 word types\n",
      "2018-05-15 17:17:37,878: INFO: PROGRESS: at sentence #450000, processed 9914492 words and 1925044 word types\n",
      "2018-05-15 17:17:38,535: INFO: PROGRESS: at sentence #460000, processed 10144280 words and 1949071 word types\n",
      "2018-05-15 17:17:39,095: INFO: PROGRESS: at sentence #470000, processed 10361374 words and 1971803 word types\n",
      "2018-05-15 17:17:39,550: INFO: PROGRESS: at sentence #480000, processed 10543939 words and 1989135 word types\n",
      "2018-05-15 17:17:40,139: INFO: PROGRESS: at sentence #490000, processed 10789426 words and 2011561 word types\n",
      "2018-05-15 17:17:40,779: INFO: PROGRESS: at sentence #500000, processed 11025293 words and 2031455 word types\n",
      "2018-05-15 17:17:41,271: INFO: PROGRESS: at sentence #510000, processed 11209682 words and 2055248 word types\n",
      "2018-05-15 17:17:41,790: INFO: PROGRESS: at sentence #520000, processed 11416369 words and 2070960 word types\n",
      "2018-05-15 17:17:42,359: INFO: PROGRESS: at sentence #530000, processed 11650001 words and 2084382 word types\n",
      "2018-05-15 17:17:42,846: INFO: PROGRESS: at sentence #540000, processed 11835910 words and 2095420 word types\n",
      "2018-05-15 17:17:43,576: INFO: PROGRESS: at sentence #550000, processed 12083625 words and 2107404 word types\n",
      "2018-05-15 17:17:44,177: INFO: PROGRESS: at sentence #560000, processed 12278908 words and 2132620 word types\n",
      "2018-05-15 17:17:44,718: INFO: PROGRESS: at sentence #570000, processed 12463546 words and 2151035 word types\n",
      "2018-05-15 17:17:45,253: INFO: PROGRESS: at sentence #580000, processed 12670199 words and 2166180 word types\n",
      "2018-05-15 17:17:45,826: INFO: PROGRESS: at sentence #590000, processed 12888781 words and 2181115 word types\n",
      "2018-05-15 17:17:46,330: INFO: PROGRESS: at sentence #600000, processed 13075824 words and 2198258 word types\n",
      "2018-05-15 17:17:46,958: INFO: PROGRESS: at sentence #610000, processed 13314084 words and 2220675 word types\n",
      "2018-05-15 17:17:47,610: INFO: PROGRESS: at sentence #620000, processed 13534353 words and 2244754 word types\n",
      "2018-05-15 17:17:48,193: INFO: PROGRESS: at sentence #630000, processed 13743461 words and 2264209 word types\n",
      "2018-05-15 17:17:48,825: INFO: PROGRESS: at sentence #640000, processed 13979318 words and 2282367 word types\n",
      "2018-05-15 17:17:49,422: INFO: PROGRESS: at sentence #650000, processed 14194686 words and 2297929 word types\n",
      "2018-05-15 17:17:49,969: INFO: PROGRESS: at sentence #660000, processed 14406405 words and 2309764 word types\n",
      "2018-05-15 17:17:50,565: INFO: PROGRESS: at sentence #670000, processed 14627311 words and 2332154 word types\n",
      "2018-05-15 17:17:51,291: INFO: PROGRESS: at sentence #680000, processed 14845992 words and 2365738 word types\n",
      "2018-05-15 17:17:51,951: INFO: PROGRESS: at sentence #690000, processed 15072275 words and 2408440 word types\n",
      "2018-05-15 17:17:52,604: INFO: PROGRESS: at sentence #700000, processed 15289531 words and 2451584 word types\n",
      "2018-05-15 17:17:53,279: INFO: PROGRESS: at sentence #710000, processed 15510705 words and 2496718 word types\n",
      "2018-05-15 17:17:53,884: INFO: PROGRESS: at sentence #720000, processed 15700995 words and 2525316 word types\n",
      "2018-05-15 17:17:54,554: INFO: PROGRESS: at sentence #730000, processed 15907790 words and 2560231 word types\n",
      "2018-05-15 17:17:55,380: INFO: PROGRESS: at sentence #740000, processed 16120117 words and 2597213 word types\n",
      "2018-05-15 17:17:56,083: INFO: PROGRESS: at sentence #750000, processed 16345603 words and 2637256 word types\n",
      "2018-05-15 17:17:56,753: INFO: PROGRESS: at sentence #760000, processed 16571765 words and 2675889 word types\n",
      "2018-05-15 17:17:57,412: INFO: PROGRESS: at sentence #770000, processed 16792631 words and 2716795 word types\n",
      "2018-05-15 17:17:57,987: INFO: PROGRESS: at sentence #780000, processed 16981822 words and 2749520 word types\n",
      "2018-05-15 17:17:58,700: INFO: PROGRESS: at sentence #790000, processed 17225297 words and 2783581 word types\n",
      "2018-05-15 17:17:59,690: INFO: PROGRESS: at sentence #800000, processed 17459556 words and 2822675 word types\n",
      "2018-05-15 17:18:00,351: INFO: PROGRESS: at sentence #810000, processed 17683519 words and 2858184 word types\n",
      "2018-05-15 17:18:01,101: INFO: PROGRESS: at sentence #820000, processed 17920868 words and 2895177 word types\n",
      "2018-05-15 17:18:01,830: INFO: PROGRESS: at sentence #830000, processed 18153063 words and 2932806 word types\n",
      "2018-05-15 17:18:02,537: INFO: PROGRESS: at sentence #840000, processed 18376719 words and 2963637 word types\n",
      "2018-05-15 17:18:03,262: INFO: PROGRESS: at sentence #850000, processed 18619268 words and 2993305 word types\n",
      "2018-05-15 17:18:03,922: INFO: PROGRESS: at sentence #860000, processed 18852243 words and 3028680 word types\n",
      "2018-05-15 17:18:04,619: INFO: PROGRESS: at sentence #870000, processed 19082994 words and 3068830 word types\n",
      "2018-05-15 17:18:05,352: INFO: PROGRESS: at sentence #880000, processed 19315135 words and 3109251 word types\n",
      "2018-05-15 17:18:06,029: INFO: PROGRESS: at sentence #890000, processed 19530998 words and 3146847 word types\n",
      "2018-05-15 17:18:06,697: INFO: PROGRESS: at sentence #900000, processed 19760546 words and 3180527 word types\n",
      "2018-05-15 17:18:07,378: INFO: PROGRESS: at sentence #910000, processed 19997045 words and 3216418 word types\n",
      "2018-05-15 17:18:08,034: INFO: PROGRESS: at sentence #920000, processed 20238176 words and 3242651 word types\n",
      "2018-05-15 17:18:08,689: INFO: PROGRESS: at sentence #930000, processed 20471552 words and 3274760 word types\n",
      "2018-05-15 17:18:09,424: INFO: PROGRESS: at sentence #940000, processed 20697608 words and 3308986 word types\n",
      "2018-05-15 17:18:10,212: INFO: PROGRESS: at sentence #950000, processed 20920890 words and 3332487 word types\n",
      "2018-05-15 17:18:11,095: INFO: PROGRESS: at sentence #960000, processed 21167255 words and 3367921 word types\n",
      "2018-05-15 17:18:11,747: INFO: PROGRESS: at sentence #970000, processed 21366481 words and 3397224 word types\n",
      "2018-05-15 17:18:12,333: INFO: PROGRESS: at sentence #980000, processed 21562203 words and 3435231 word types\n",
      "2018-05-15 17:18:13,085: INFO: PROGRESS: at sentence #990000, processed 21792926 words and 3481316 word types\n",
      "2018-05-15 17:18:13,754: INFO: PROGRESS: at sentence #1000000, processed 22003235 words and 3523430 word types\n",
      "2018-05-15 17:18:14,357: INFO: PROGRESS: at sentence #1010000, processed 22204036 words and 3559441 word types\n",
      "2018-05-15 17:18:14,934: INFO: PROGRESS: at sentence #1020000, processed 22406393 words and 3594504 word types\n",
      "2018-05-15 17:18:15,507: INFO: PROGRESS: at sentence #1030000, processed 22606370 words and 3629097 word types\n",
      "2018-05-15 17:18:16,091: INFO: PROGRESS: at sentence #1040000, processed 22817699 words and 3663646 word types\n",
      "2018-05-15 17:18:16,684: INFO: PROGRESS: at sentence #1050000, processed 23019395 words and 3697064 word types\n",
      "2018-05-15 17:18:17,287: INFO: PROGRESS: at sentence #1060000, processed 23228009 words and 3733371 word types\n",
      "2018-05-15 17:18:17,880: INFO: PROGRESS: at sentence #1070000, processed 23439207 words and 3771960 word types\n",
      "2018-05-15 17:18:18,525: INFO: PROGRESS: at sentence #1080000, processed 23654309 words and 3810341 word types\n",
      "2018-05-15 17:18:19,407: INFO: PROGRESS: at sentence #1090000, processed 23890738 words and 3843102 word types\n",
      "2018-05-15 17:18:20,201: INFO: PROGRESS: at sentence #1100000, processed 24108491 words and 3874109 word types\n",
      "2018-05-15 17:18:20,924: INFO: PROGRESS: at sentence #1110000, processed 24333594 words and 3903573 word types\n",
      "2018-05-15 17:18:21,531: INFO: PROGRESS: at sentence #1120000, processed 24512127 words and 3923446 word types\n",
      "2018-05-15 17:18:22,360: INFO: PROGRESS: at sentence #1130000, processed 24719468 words and 3953215 word types\n",
      "2018-05-15 17:18:23,074: INFO: PROGRESS: at sentence #1140000, processed 24941033 words and 3990449 word types\n",
      "2018-05-15 17:18:23,863: INFO: PROGRESS: at sentence #1150000, processed 25172435 words and 4026609 word types\n",
      "2018-05-15 17:18:24,671: INFO: PROGRESS: at sentence #1160000, processed 25393668 words and 4058714 word types\n",
      "2018-05-15 17:18:25,355: INFO: PROGRESS: at sentence #1170000, processed 25623591 words and 4089461 word types\n",
      "2018-05-15 17:18:25,929: INFO: PROGRESS: at sentence #1180000, processed 25827375 words and 4116202 word types\n",
      "2018-05-15 17:18:26,684: INFO: PROGRESS: at sentence #1190000, processed 26063566 words and 4149585 word types\n",
      "2018-05-15 17:18:27,400: INFO: PROGRESS: at sentence #1200000, processed 26312522 words and 4180917 word types\n",
      "2018-05-15 17:18:28,111: INFO: PROGRESS: at sentence #1210000, processed 26551208 words and 4215771 word types\n",
      "2018-05-15 17:18:28,669: INFO: PROGRESS: at sentence #1220000, processed 26739879 words and 4240475 word types\n",
      "2018-05-15 17:18:29,369: INFO: PROGRESS: at sentence #1230000, processed 26973988 words and 4277347 word types\n",
      "2018-05-15 17:18:30,061: INFO: PROGRESS: at sentence #1240000, processed 27205891 words and 4308559 word types\n",
      "2018-05-15 17:18:30,922: INFO: PROGRESS: at sentence #1250000, processed 27463371 words and 4335989 word types\n",
      "2018-05-15 17:18:31,707: INFO: PROGRESS: at sentence #1260000, processed 27701877 words and 4365191 word types\n",
      "2018-05-15 17:18:32,271: INFO: PROGRESS: at sentence #1270000, processed 27907712 words and 4392125 word types\n",
      "2018-05-15 17:18:32,906: INFO: PROGRESS: at sentence #1280000, processed 28145694 words and 4423584 word types\n",
      "2018-05-15 17:18:33,750: INFO: PROGRESS: at sentence #1290000, processed 28386355 words and 4452504 word types\n",
      "2018-05-15 17:18:34,551: INFO: PROGRESS: at sentence #1300000, processed 28618806 words and 4481148 word types\n",
      "2018-05-15 17:18:35,352: INFO: PROGRESS: at sentence #1310000, processed 28874578 words and 4517704 word types\n",
      "2018-05-15 17:18:35,976: INFO: PROGRESS: at sentence #1320000, processed 29101982 words and 4544518 word types\n",
      "2018-05-15 17:18:36,643: INFO: PROGRESS: at sentence #1330000, processed 29333067 words and 4563641 word types\n",
      "2018-05-15 17:18:37,366: INFO: PROGRESS: at sentence #1340000, processed 29566997 words and 4584553 word types\n",
      "2018-05-15 17:18:37,981: INFO: PROGRESS: at sentence #1350000, processed 29786229 words and 4609596 word types\n",
      "2018-05-15 17:18:38,735: INFO: PROGRESS: at sentence #1360000, processed 30016916 words and 4638457 word types\n",
      "2018-05-15 17:18:39,591: INFO: PROGRESS: at sentence #1370000, processed 30267788 words and 4651958 word types\n",
      "2018-05-15 17:18:40,466: INFO: PROGRESS: at sentence #1380000, processed 30522637 words and 4668617 word types\n",
      "2018-05-15 17:18:41,451: INFO: PROGRESS: at sentence #1390000, processed 30758736 words and 4689722 word types\n",
      "2018-05-15 17:18:42,201: INFO: PROGRESS: at sentence #1400000, processed 30997262 words and 4713772 word types\n",
      "2018-05-15 17:18:42,854: INFO: PROGRESS: at sentence #1410000, processed 31233463 words and 4738019 word types\n",
      "2018-05-15 17:18:43,459: INFO: PROGRESS: at sentence #1420000, processed 31437671 words and 4746903 word types\n",
      "2018-05-15 17:18:44,168: INFO: PROGRESS: at sentence #1430000, processed 31674171 words and 4778058 word types\n",
      "2018-05-15 17:18:44,737: INFO: PROGRESS: at sentence #1440000, processed 31895740 words and 4794637 word types\n",
      "2018-05-15 17:18:45,165: INFO: PROGRESS: at sentence #1450000, processed 32055605 words and 4808818 word types\n",
      "2018-05-15 17:18:45,880: INFO: PROGRESS: at sentence #1460000, processed 32350469 words and 4832817 word types\n",
      "2018-05-15 17:18:46,472: INFO: PROGRESS: at sentence #1470000, processed 32585067 words and 4858118 word types\n",
      "2018-05-15 17:18:47,109: INFO: PROGRESS: at sentence #1480000, processed 32831953 words and 4880299 word types\n",
      "2018-05-15 17:18:47,773: INFO: PROGRESS: at sentence #1490000, processed 33089396 words and 4905102 word types\n",
      "2018-05-15 17:18:48,349: INFO: PROGRESS: at sentence #1500000, processed 33316021 words and 4928569 word types\n",
      "2018-05-15 17:18:48,983: INFO: PROGRESS: at sentence #1510000, processed 33538115 words and 4946507 word types\n",
      "2018-05-15 17:18:49,781: INFO: PROGRESS: at sentence #1520000, processed 33811072 words and 4965999 word types\n",
      "2018-05-15 17:18:50,274: INFO: PROGRESS: at sentence #1530000, processed 33983474 words and 4994608 word types\n",
      "2018-05-15 17:18:50,843: INFO: PROGRESS: at sentence #1540000, processed 34189105 words and 5026079 word types\n",
      "2018-05-15 17:18:51,448: INFO: PROGRESS: at sentence #1550000, processed 34433445 words and 5059287 word types\n",
      "2018-05-15 17:18:51,977: INFO: PROGRESS: at sentence #1560000, processed 34644834 words and 5091811 word types\n",
      "2018-05-15 17:18:52,538: INFO: PROGRESS: at sentence #1570000, processed 34866405 words and 5131430 word types\n",
      "2018-05-15 17:18:53,155: INFO: PROGRESS: at sentence #1580000, processed 35113237 words and 5163165 word types\n",
      "2018-05-15 17:18:53,708: INFO: PROGRESS: at sentence #1590000, processed 35336538 words and 5198175 word types\n",
      "2018-05-15 17:18:54,301: INFO: PROGRESS: at sentence #1600000, processed 35578098 words and 5228258 word types\n",
      "2018-05-15 17:18:54,899: INFO: PROGRESS: at sentence #1610000, processed 35825211 words and 5255299 word types\n",
      "2018-05-15 17:18:55,516: INFO: PROGRESS: at sentence #1620000, processed 36072122 words and 5281600 word types\n",
      "2018-05-15 17:18:56,136: INFO: PROGRESS: at sentence #1630000, processed 36303990 words and 5309408 word types\n",
      "2018-05-15 17:18:56,756: INFO: PROGRESS: at sentence #1640000, processed 36546756 words and 5334898 word types\n",
      "2018-05-15 17:18:57,003: INFO: PROGRESS: at sentence #1650000, processed 36645080 words and 5344831 word types\n",
      "2018-05-15 17:18:57,642: INFO: PROGRESS: at sentence #1660000, processed 36895019 words and 5375215 word types\n",
      "2018-05-15 17:18:58,196: INFO: PROGRESS: at sentence #1670000, processed 37120246 words and 5398293 word types\n",
      "2018-05-15 17:18:58,808: INFO: PROGRESS: at sentence #1680000, processed 37374898 words and 5416375 word types\n",
      "2018-05-15 17:18:59,412: INFO: PROGRESS: at sentence #1690000, processed 37619760 words and 5439892 word types\n",
      "2018-05-15 17:18:59,994: INFO: PROGRESS: at sentence #1700000, processed 37848256 words and 5463127 word types\n",
      "2018-05-15 17:19:00,412: INFO: PROGRESS: at sentence #1710000, processed 38016912 words and 5480404 word types\n",
      "2018-05-15 17:19:00,906: INFO: PROGRESS: at sentence #1720000, processed 38220160 words and 5497971 word types\n",
      "2018-05-15 17:19:01,483: INFO: PROGRESS: at sentence #1730000, processed 38460534 words and 5519457 word types\n",
      "2018-05-15 17:19:02,075: INFO: PROGRESS: at sentence #1740000, processed 38703360 words and 5542447 word types\n",
      "2018-05-15 17:19:02,620: INFO: PROGRESS: at sentence #1750000, processed 38924863 words and 5574339 word types\n",
      "2018-05-15 17:19:03,784: INFO: PROGRESS: at sentence #1760000, processed 39164841 words and 5610266 word types\n",
      "2018-05-15 17:19:04,457: INFO: PROGRESS: at sentence #1770000, processed 39407484 words and 5640342 word types\n",
      "2018-05-15 17:19:05,039: INFO: PROGRESS: at sentence #1780000, processed 39632128 words and 5671113 word types\n",
      "2018-05-15 17:19:05,457: INFO: PROGRESS: at sentence #1790000, processed 39783798 words and 5695561 word types\n",
      "2018-05-15 17:19:05,991: INFO: PROGRESS: at sentence #1800000, processed 39994939 words and 5720270 word types\n",
      "2018-05-15 17:19:06,609: INFO: PROGRESS: at sentence #1810000, processed 40222413 words and 5748420 word types\n",
      "2018-05-15 17:19:07,154: INFO: PROGRESS: at sentence #1820000, processed 40435429 words and 5769004 word types\n",
      "2018-05-15 17:19:07,779: INFO: PROGRESS: at sentence #1830000, processed 40669437 words and 5807085 word types\n",
      "2018-05-15 17:19:08,367: INFO: PROGRESS: at sentence #1840000, processed 40890538 words and 5822331 word types\n",
      "2018-05-15 17:19:08,982: INFO: PROGRESS: at sentence #1850000, processed 41118535 words and 5844211 word types\n",
      "2018-05-15 17:19:09,643: INFO: PROGRESS: at sentence #1860000, processed 41334314 words and 5870108 word types\n",
      "2018-05-15 17:19:10,263: INFO: PROGRESS: at sentence #1870000, processed 41565698 words and 5897235 word types\n",
      "2018-05-15 17:19:10,907: INFO: PROGRESS: at sentence #1880000, processed 41800552 words and 5918398 word types\n",
      "2018-05-15 17:19:11,563: INFO: PROGRESS: at sentence #1890000, processed 42046972 words and 5950400 word types\n",
      "2018-05-15 17:19:12,003: INFO: collected 5964258 word types from a corpus of 42219106 words (unigram + bigrams) and 1897215 sentences\n",
      "2018-05-15 17:19:12,004: INFO: using 5964258 counts as vocab in Phrases<0 vocab, min_count=2, threshold=2, max_vocab_size=40000000>\n",
      "2018-05-15 17:19:12,007: INFO: source_vocab length 5964258\n",
      "2018-05-15 17:19:18,186: INFO: Phraser added 50000 phrasegrams\n",
      "2018-05-15 17:19:24,742: INFO: Phraser added 100000 phrasegrams\n",
      "2018-05-15 17:19:34,190: INFO: Phraser added 150000 phrasegrams\n",
      "2018-05-15 17:19:40,729: INFO: Phraser added 200000 phrasegrams\n",
      "2018-05-15 17:19:48,271: INFO: Phraser added 250000 phrasegrams\n",
      "2018-05-15 17:19:57,229: INFO: Phraser added 300000 phrasegrams\n",
      "2018-05-15 17:20:09,371: INFO: Phraser added 350000 phrasegrams\n",
      "2018-05-15 17:20:21,380: INFO: Phraser added 400000 phrasegrams\n",
      "2018-05-15 17:20:31,293: INFO: Phraser added 450000 phrasegrams\n",
      "2018-05-15 17:20:42,215: INFO: Phraser added 500000 phrasegrams\n",
      "2018-05-15 17:20:48,383: INFO: Phraser built with 528035 528035 phrasegrams\n",
      "2018-05-15 17:20:48,387: INFO: collecting all words and their counts\n",
      "2018-05-15 17:20:48,388: INFO: PROGRESS: at sentence #0, processed 0 words, keeping 0 word types\n",
      "2018-05-15 17:20:49,238: INFO: PROGRESS: at sentence #10000, processed 163467 words, keeping 17525 word types\n",
      "2018-05-15 17:20:50,100: INFO: PROGRESS: at sentence #20000, processed 326080 words, keeping 32679 word types\n",
      "2018-05-15 17:20:51,066: INFO: PROGRESS: at sentence #30000, processed 504321 words, keeping 48704 word types\n",
      "2018-05-15 17:20:52,092: INFO: PROGRESS: at sentence #40000, processed 703254 words, keeping 65702 word types\n",
      "2018-05-15 17:20:53,230: INFO: PROGRESS: at sentence #50000, processed 910568 words, keeping 82255 word types\n",
      "2018-05-15 17:20:54,260: INFO: PROGRESS: at sentence #60000, processed 1100840 words, keeping 97470 word types\n",
      "2018-05-15 17:20:55,268: INFO: PROGRESS: at sentence #70000, processed 1296415 words, keeping 109095 word types\n",
      "2018-05-15 17:20:56,186: INFO: PROGRESS: at sentence #80000, processed 1467489 words, keeping 120989 word types\n",
      "2018-05-15 17:20:57,168: INFO: PROGRESS: at sentence #90000, processed 1658153 words, keeping 132353 word types\n",
      "2018-05-15 17:20:58,091: INFO: PROGRESS: at sentence #100000, processed 1833080 words, keeping 144627 word types\n",
      "2018-05-15 17:20:59,051: INFO: PROGRESS: at sentence #110000, processed 1998210 words, keeping 156537 word types\n",
      "2018-05-15 17:20:59,858: INFO: PROGRESS: at sentence #120000, processed 2155023 words, keeping 165833 word types\n",
      "2018-05-15 17:21:00,860: INFO: PROGRESS: at sentence #130000, processed 2346542 words, keeping 175899 word types\n",
      "2018-05-15 17:21:01,915: INFO: PROGRESS: at sentence #140000, processed 2548314 words, keeping 186243 word types\n",
      "2018-05-15 17:21:02,513: INFO: PROGRESS: at sentence #150000, processed 2663111 words, keeping 190634 word types\n",
      "2018-05-15 17:21:03,477: INFO: PROGRESS: at sentence #160000, processed 2847030 words, keeping 199940 word types\n",
      "2018-05-15 17:21:04,371: INFO: PROGRESS: at sentence #170000, processed 3016412 words, keeping 209080 word types\n",
      "2018-05-15 17:21:05,124: INFO: PROGRESS: at sentence #180000, processed 3161733 words, keeping 216315 word types\n",
      "2018-05-15 17:21:06,085: INFO: PROGRESS: at sentence #190000, processed 3341291 words, keeping 223218 word types\n",
      "2018-05-15 17:21:07,120: INFO: PROGRESS: at sentence #200000, processed 3530257 words, keeping 231989 word types\n",
      "2018-05-15 17:21:07,996: INFO: PROGRESS: at sentence #210000, processed 3686697 words, keeping 238539 word types\n",
      "2018-05-15 17:21:08,972: INFO: PROGRESS: at sentence #220000, processed 3877199 words, keeping 246786 word types\n",
      "2018-05-15 17:21:09,980: INFO: PROGRESS: at sentence #230000, processed 4069387 words, keeping 256004 word types\n",
      "2018-05-15 17:21:10,738: INFO: PROGRESS: at sentence #240000, processed 4214508 words, keeping 261233 word types\n",
      "2018-05-15 17:21:11,743: INFO: PROGRESS: at sentence #250000, processed 4410567 words, keeping 268577 word types\n",
      "2018-05-15 17:21:12,814: INFO: PROGRESS: at sentence #260000, processed 4617727 words, keeping 275896 word types\n",
      "2018-05-15 17:21:13,804: INFO: PROGRESS: at sentence #270000, processed 4808859 words, keeping 283390 word types\n",
      "2018-05-15 17:21:14,787: INFO: PROGRESS: at sentence #280000, processed 5001159 words, keeping 290583 word types\n",
      "2018-05-15 17:21:15,680: INFO: PROGRESS: at sentence #290000, processed 5179180 words, keeping 295423 word types\n",
      "2018-05-15 17:21:16,542: INFO: PROGRESS: at sentence #300000, processed 5346906 words, keeping 301698 word types\n",
      "2018-05-15 17:21:17,447: INFO: PROGRESS: at sentence #310000, processed 5521343 words, keeping 309444 word types\n",
      "2018-05-15 17:21:18,390: INFO: PROGRESS: at sentence #320000, processed 5701907 words, keeping 315491 word types\n",
      "2018-05-15 17:21:19,149: INFO: PROGRESS: at sentence #330000, processed 5847811 words, keeping 319969 word types\n",
      "2018-05-15 17:21:19,987: INFO: PROGRESS: at sentence #340000, processed 6013056 words, keeping 326095 word types\n",
      "2018-05-15 17:21:20,919: INFO: PROGRESS: at sentence #350000, processed 6189742 words, keeping 331380 word types\n",
      "2018-05-15 17:21:21,958: INFO: PROGRESS: at sentence #360000, processed 6388151 words, keeping 338805 word types\n",
      "2018-05-15 17:21:22,776: INFO: PROGRESS: at sentence #370000, processed 6544970 words, keeping 344687 word types\n",
      "2018-05-15 17:21:23,669: INFO: PROGRESS: at sentence #380000, processed 6714852 words, keeping 350146 word types\n",
      "2018-05-15 17:21:24,615: INFO: PROGRESS: at sentence #390000, processed 6898176 words, keeping 354662 word types\n",
      "2018-05-15 17:21:25,485: INFO: PROGRESS: at sentence #400000, processed 7069363 words, keeping 359421 word types\n",
      "2018-05-15 17:21:26,528: INFO: PROGRESS: at sentence #410000, processed 7259600 words, keeping 365162 word types\n",
      "2018-05-15 17:21:27,497: INFO: PROGRESS: at sentence #420000, processed 7449109 words, keeping 369949 word types\n",
      "2018-05-15 17:21:28,535: INFO: PROGRESS: at sentence #430000, processed 7652600 words, keeping 373729 word types\n",
      "2018-05-15 17:21:29,514: INFO: PROGRESS: at sentence #440000, processed 7840761 words, keeping 378754 word types\n",
      "2018-05-15 17:21:30,432: INFO: PROGRESS: at sentence #450000, processed 8012397 words, keeping 382452 word types\n",
      "2018-05-15 17:21:31,388: INFO: PROGRESS: at sentence #460000, processed 8198107 words, keeping 386693 word types\n",
      "2018-05-15 17:21:32,292: INFO: PROGRESS: at sentence #470000, processed 8371310 words, keeping 390898 word types\n",
      "2018-05-15 17:21:33,047: INFO: PROGRESS: at sentence #480000, processed 8518074 words, keeping 393737 word types\n",
      "2018-05-15 17:21:34,223: INFO: PROGRESS: at sentence #490000, processed 8713339 words, keeping 397846 word types\n",
      "2018-05-15 17:21:35,210: INFO: PROGRESS: at sentence #500000, processed 8903359 words, keeping 401027 word types\n",
      "2018-05-15 17:21:36,161: INFO: PROGRESS: at sentence #510000, processed 9053223 words, keeping 405457 word types\n",
      "2018-05-15 17:21:37,260: INFO: PROGRESS: at sentence #520000, processed 9218180 words, keeping 408253 word types\n",
      "2018-05-15 17:21:38,735: INFO: PROGRESS: at sentence #530000, processed 9402917 words, keeping 410931 word types\n",
      "2018-05-15 17:21:39,569: INFO: PROGRESS: at sentence #540000, processed 9551170 words, keeping 413135 word types\n",
      "2018-05-15 17:21:40,555: INFO: PROGRESS: at sentence #550000, processed 9747363 words, keeping 415142 word types\n",
      "2018-05-15 17:21:41,334: INFO: PROGRESS: at sentence #560000, processed 9907068 words, keeping 419302 word types\n",
      "2018-05-15 17:21:42,058: INFO: PROGRESS: at sentence #570000, processed 10054362 words, keeping 423024 word types\n",
      "2018-05-15 17:21:42,881: INFO: PROGRESS: at sentence #580000, processed 10218524 words, keeping 425394 word types\n",
      "2018-05-15 17:21:43,737: INFO: PROGRESS: at sentence #590000, processed 10391493 words, keeping 427948 word types\n",
      "2018-05-15 17:21:44,576: INFO: PROGRESS: at sentence #600000, processed 10542039 words, keeping 430552 word types\n",
      "2018-05-15 17:21:45,631: INFO: PROGRESS: at sentence #610000, processed 10733720 words, keeping 434247 word types\n",
      "2018-05-15 17:21:46,640: INFO: PROGRESS: at sentence #620000, processed 10912664 words, keeping 438357 word types\n",
      "2018-05-15 17:21:47,546: INFO: PROGRESS: at sentence #630000, processed 11080869 words, keeping 441768 word types\n",
      "2018-05-15 17:21:48,682: INFO: PROGRESS: at sentence #640000, processed 11270565 words, keeping 444933 word types\n",
      "2018-05-15 17:21:49,577: INFO: PROGRESS: at sentence #650000, processed 11443910 words, keeping 447460 word types\n",
      "2018-05-15 17:21:50,408: INFO: PROGRESS: at sentence #660000, processed 11612020 words, keeping 449186 word types\n",
      "2018-05-15 17:21:51,961: INFO: PROGRESS: at sentence #670000, processed 11791037 words, keeping 452576 word types\n",
      "2018-05-15 17:21:53,776: INFO: PROGRESS: at sentence #680000, processed 11968185 words, keeping 458160 word types\n",
      "2018-05-15 17:21:55,259: INFO: PROGRESS: at sentence #690000, processed 12149735 words, keeping 466164 word types\n",
      "2018-05-15 17:21:56,300: INFO: PROGRESS: at sentence #700000, processed 12323730 words, keeping 476026 word types\n",
      "2018-05-15 17:21:57,360: INFO: PROGRESS: at sentence #710000, processed 12503340 words, keeping 483307 word types\n",
      "2018-05-15 17:21:58,233: INFO: PROGRESS: at sentence #720000, processed 12657126 words, keeping 488526 word types\n",
      "2018-05-15 17:21:59,064: INFO: PROGRESS: at sentence #730000, processed 12822165 words, keeping 494675 word types\n",
      "2018-05-15 17:21:59,933: INFO: PROGRESS: at sentence #740000, processed 12992290 words, keeping 501567 word types\n",
      "2018-05-15 17:22:00,827: INFO: PROGRESS: at sentence #750000, processed 13173986 words, keeping 508070 word types\n",
      "2018-05-15 17:22:01,836: INFO: PROGRESS: at sentence #760000, processed 13355496 words, keeping 514732 word types\n",
      "2018-05-15 17:22:02,753: INFO: PROGRESS: at sentence #770000, processed 13535474 words, keeping 521468 word types\n",
      "2018-05-15 17:22:03,528: INFO: PROGRESS: at sentence #780000, processed 13688752 words, keeping 527262 word types\n",
      "2018-05-15 17:22:04,470: INFO: PROGRESS: at sentence #790000, processed 13879545 words, keeping 532940 word types\n",
      "2018-05-15 17:22:05,398: INFO: PROGRESS: at sentence #800000, processed 14068194 words, keeping 539414 word types\n",
      "2018-05-15 17:22:06,288: INFO: PROGRESS: at sentence #810000, processed 14248149 words, keeping 545055 word types\n",
      "2018-05-15 17:22:07,243: INFO: PROGRESS: at sentence #820000, processed 14439227 words, keeping 550506 word types\n",
      "2018-05-15 17:22:08,180: INFO: PROGRESS: at sentence #830000, processed 14625963 words, keeping 557454 word types\n",
      "2018-05-15 17:22:09,067: INFO: PROGRESS: at sentence #840000, processed 14805943 words, keeping 562323 word types\n",
      "2018-05-15 17:22:10,023: INFO: PROGRESS: at sentence #850000, processed 14997397 words, keeping 566531 word types\n",
      "2018-05-15 17:22:10,983: INFO: PROGRESS: at sentence #860000, processed 15185404 words, keeping 572362 word types\n",
      "2018-05-15 17:22:11,916: INFO: PROGRESS: at sentence #870000, processed 15372268 words, keeping 578142 word types\n",
      "2018-05-15 17:22:12,855: INFO: PROGRESS: at sentence #880000, processed 15560396 words, keeping 584069 word types\n",
      "2018-05-15 17:22:13,724: INFO: PROGRESS: at sentence #890000, processed 15733111 words, keeping 589311 word types\n",
      "2018-05-15 17:22:14,668: INFO: PROGRESS: at sentence #900000, processed 15918500 words, keeping 593933 word types\n",
      "2018-05-15 17:22:15,605: INFO: PROGRESS: at sentence #910000, processed 16109801 words, keeping 599841 word types\n",
      "2018-05-15 17:22:16,551: INFO: PROGRESS: at sentence #920000, processed 16298015 words, keeping 603968 word types\n",
      "2018-05-15 17:22:17,490: INFO: PROGRESS: at sentence #930000, processed 16485190 words, keeping 609106 word types\n",
      "2018-05-15 17:22:18,406: INFO: PROGRESS: at sentence #940000, processed 16669315 words, keeping 614194 word types\n",
      "2018-05-15 17:22:19,277: INFO: PROGRESS: at sentence #950000, processed 16845908 words, keeping 617891 word types\n",
      "2018-05-15 17:22:20,257: INFO: PROGRESS: at sentence #960000, processed 17045165 words, keeping 622723 word types\n",
      "2018-05-15 17:22:21,063: INFO: PROGRESS: at sentence #970000, processed 17206815 words, keeping 626420 word types\n",
      "2018-05-15 17:22:21,860: INFO: PROGRESS: at sentence #980000, processed 17366391 words, keeping 631957 word types\n",
      "2018-05-15 17:22:22,792: INFO: PROGRESS: at sentence #990000, processed 17552913 words, keeping 640484 word types\n",
      "2018-05-15 17:22:23,665: INFO: PROGRESS: at sentence #1000000, processed 17723623 words, keeping 647237 word types\n",
      "2018-05-15 17:22:24,577: INFO: PROGRESS: at sentence #1010000, processed 17884475 words, keeping 653943 word types\n",
      "2018-05-15 17:22:25,382: INFO: PROGRESS: at sentence #1020000, processed 18045564 words, keeping 659946 word types\n",
      "2018-05-15 17:22:26,194: INFO: PROGRESS: at sentence #1030000, processed 18204849 words, keeping 665730 word types\n",
      "2018-05-15 17:22:27,043: INFO: PROGRESS: at sentence #1040000, processed 18374412 words, keeping 670703 word types\n",
      "2018-05-15 17:22:27,875: INFO: PROGRESS: at sentence #1050000, processed 18538306 words, keeping 674940 word types\n",
      "2018-05-15 17:22:28,717: INFO: PROGRESS: at sentence #1060000, processed 18706921 words, keeping 679588 word types\n",
      "2018-05-15 17:22:29,567: INFO: PROGRESS: at sentence #1070000, processed 18878033 words, keeping 685187 word types\n",
      "2018-05-15 17:22:30,456: INFO: PROGRESS: at sentence #1080000, processed 19052481 words, keeping 690409 word types\n",
      "2018-05-15 17:22:31,401: INFO: PROGRESS: at sentence #1090000, processed 19239694 words, keeping 695488 word types\n",
      "2018-05-15 17:22:32,376: INFO: PROGRESS: at sentence #1100000, processed 19414284 words, keeping 699448 word types\n",
      "2018-05-15 17:22:33,378: INFO: PROGRESS: at sentence #1110000, processed 19596036 words, keeping 703048 word types\n",
      "2018-05-15 17:22:34,128: INFO: PROGRESS: at sentence #1120000, processed 19737357 words, keeping 705485 word types\n",
      "2018-05-15 17:22:34,954: INFO: PROGRESS: at sentence #1130000, processed 19903549 words, keeping 709422 word types\n",
      "2018-05-15 17:22:35,844: INFO: PROGRESS: at sentence #1140000, processed 20082603 words, keeping 714091 word types\n",
      "2018-05-15 17:22:36,807: INFO: PROGRESS: at sentence #1150000, processed 20269880 words, keeping 718467 word types\n",
      "2018-05-15 17:22:37,725: INFO: PROGRESS: at sentence #1160000, processed 20446848 words, keeping 722425 word types\n",
      "2018-05-15 17:22:39,602: INFO: PROGRESS: at sentence #1170000, processed 20633018 words, keeping 726522 word types\n",
      "2018-05-15 17:22:40,587: INFO: PROGRESS: at sentence #1180000, processed 20800082 words, keeping 731061 word types\n",
      "2018-05-15 17:22:41,898: INFO: PROGRESS: at sentence #1190000, processed 20994845 words, keeping 736514 word types\n",
      "2018-05-15 17:22:43,447: INFO: PROGRESS: at sentence #1200000, processed 21201408 words, keeping 741354 word types\n",
      "2018-05-15 17:22:44,893: INFO: PROGRESS: at sentence #1210000, processed 21392495 words, keeping 749386 word types\n",
      "2018-05-15 17:22:46,398: INFO: PROGRESS: at sentence #1220000, processed 21545956 words, keeping 754048 word types\n",
      "2018-05-15 17:22:48,013: INFO: PROGRESS: at sentence #1230000, processed 21738451 words, keeping 761241 word types\n",
      "2018-05-15 17:22:49,464: INFO: PROGRESS: at sentence #1240000, processed 21925080 words, keeping 767814 word types\n",
      "2018-05-15 17:22:51,567: INFO: PROGRESS: at sentence #1250000, processed 22135326 words, keeping 772634 word types\n",
      "2018-05-15 17:22:53,685: INFO: PROGRESS: at sentence #1260000, processed 22329282 words, keeping 778332 word types\n",
      "2018-05-15 17:22:55,788: INFO: PROGRESS: at sentence #1270000, processed 22498096 words, keeping 782894 word types\n",
      "2018-05-15 17:22:57,356: INFO: PROGRESS: at sentence #1280000, processed 22692474 words, keeping 788442 word types\n",
      "2018-05-15 17:22:59,052: INFO: PROGRESS: at sentence #1290000, processed 22890823 words, keeping 793201 word types\n",
      "2018-05-15 17:23:01,444: INFO: PROGRESS: at sentence #1300000, processed 23079746 words, keeping 798933 word types\n",
      "2018-05-15 17:23:04,475: INFO: PROGRESS: at sentence #1310000, processed 23282450 words, keeping 807077 word types\n",
      "2018-05-15 17:23:07,681: INFO: PROGRESS: at sentence #1320000, processed 23468109 words, keeping 811055 word types\n",
      "2018-05-15 17:23:09,996: INFO: PROGRESS: at sentence #1330000, processed 23653678 words, keeping 814639 word types\n",
      "2018-05-15 17:23:12,893: INFO: PROGRESS: at sentence #1340000, processed 23844524 words, keeping 817818 word types\n",
      "2018-05-15 17:23:14,738: INFO: PROGRESS: at sentence #1350000, processed 24025445 words, keeping 821591 word types\n",
      "2018-05-15 17:23:16,337: INFO: PROGRESS: at sentence #1360000, processed 24215239 words, keeping 826234 word types\n",
      "2018-05-15 17:23:17,896: INFO: PROGRESS: at sentence #1370000, processed 24412999 words, keeping 828417 word types\n",
      "2018-05-15 17:23:19,383: INFO: PROGRESS: at sentence #1380000, processed 24617498 words, keeping 831216 word types\n",
      "2018-05-15 17:23:20,945: INFO: PROGRESS: at sentence #1390000, processed 24810842 words, keeping 834360 word types\n",
      "2018-05-15 17:23:22,466: INFO: PROGRESS: at sentence #1400000, processed 25004859 words, keeping 838290 word types\n",
      "2018-05-15 17:23:23,708: INFO: PROGRESS: at sentence #1410000, processed 25197191 words, keeping 841964 word types\n",
      "2018-05-15 17:23:24,994: INFO: PROGRESS: at sentence #1420000, processed 25360410 words, keeping 843143 word types\n",
      "2018-05-15 17:23:26,682: INFO: PROGRESS: at sentence #1430000, processed 25555398 words, keeping 847627 word types\n",
      "2018-05-15 17:23:32,752: INFO: PROGRESS: at sentence #1440000, processed 25735220 words, keeping 850108 word types\n",
      "2018-05-15 17:23:35,352: INFO: PROGRESS: at sentence #1450000, processed 25864936 words, keeping 852449 word types\n",
      "2018-05-15 17:23:36,876: INFO: PROGRESS: at sentence #1460000, processed 26098524 words, keeping 856888 word types\n",
      "2018-05-15 17:23:38,128: INFO: PROGRESS: at sentence #1470000, processed 26293491 words, keeping 860968 word types\n",
      "2018-05-15 17:23:39,341: INFO: PROGRESS: at sentence #1480000, processed 26491593 words, keeping 864034 word types\n",
      "2018-05-15 17:23:40,706: INFO: PROGRESS: at sentence #1490000, processed 26701925 words, keeping 867346 word types\n",
      "2018-05-15 17:23:42,644: INFO: PROGRESS: at sentence #1500000, processed 26888017 words, keeping 870607 word types\n",
      "2018-05-15 17:23:44,181: INFO: PROGRESS: at sentence #1510000, processed 27068138 words, keeping 873445 word types\n",
      "2018-05-15 17:23:45,939: INFO: PROGRESS: at sentence #1520000, processed 27283586 words, keeping 877414 word types\n",
      "2018-05-15 17:23:46,954: INFO: PROGRESS: at sentence #1530000, processed 27426155 words, keeping 882679 word types\n",
      "2018-05-15 17:23:48,031: INFO: PROGRESS: at sentence #1540000, processed 27590941 words, keeping 889003 word types\n",
      "2018-05-15 17:23:50,232: INFO: PROGRESS: at sentence #1550000, processed 27788856 words, keeping 894167 word types\n",
      "2018-05-15 17:23:51,398: INFO: PROGRESS: at sentence #1560000, processed 27961933 words, keeping 899431 word types\n",
      "2018-05-15 17:23:52,401: INFO: PROGRESS: at sentence #1570000, processed 28144734 words, keeping 905017 word types\n",
      "2018-05-15 17:23:53,524: INFO: PROGRESS: at sentence #1580000, processed 28344417 words, keeping 910067 word types\n",
      "2018-05-15 17:23:54,551: INFO: PROGRESS: at sentence #1590000, processed 28525737 words, keeping 916365 word types\n",
      "2018-05-15 17:23:55,655: INFO: PROGRESS: at sentence #1600000, processed 28719964 words, keeping 921636 word types\n",
      "2018-05-15 17:23:56,881: INFO: PROGRESS: at sentence #1610000, processed 28915727 words, keeping 928432 word types\n",
      "2018-05-15 17:23:58,543: INFO: PROGRESS: at sentence #1620000, processed 29113575 words, keeping 932878 word types\n",
      "2018-05-15 17:23:59,652: INFO: PROGRESS: at sentence #1630000, processed 29299926 words, keeping 937533 word types\n",
      "2018-05-15 17:24:00,863: INFO: PROGRESS: at sentence #1640000, processed 29495854 words, keeping 941146 word types\n",
      "2018-05-15 17:24:01,328: INFO: PROGRESS: at sentence #1650000, processed 29576067 words, keeping 942602 word types\n",
      "2018-05-15 17:24:02,526: INFO: PROGRESS: at sentence #1660000, processed 29779627 words, keeping 946740 word types\n",
      "2018-05-15 17:24:03,589: INFO: PROGRESS: at sentence #1670000, processed 29960320 words, keeping 949814 word types\n",
      "2018-05-15 17:24:04,757: INFO: PROGRESS: at sentence #1680000, processed 30163346 words, keeping 952323 word types\n",
      "2018-05-15 17:24:05,875: INFO: PROGRESS: at sentence #1690000, processed 30358019 words, keeping 955970 word types\n",
      "2018-05-15 17:24:06,937: INFO: PROGRESS: at sentence #1700000, processed 30540864 words, keeping 959160 word types\n",
      "2018-05-15 17:24:07,710: INFO: PROGRESS: at sentence #1710000, processed 30678584 words, keeping 961612 word types\n",
      "2018-05-15 17:24:08,603: INFO: PROGRESS: at sentence #1720000, processed 30841232 words, keeping 964178 word types\n",
      "2018-05-15 17:24:09,671: INFO: PROGRESS: at sentence #1730000, processed 31035672 words, keeping 967099 word types\n",
      "2018-05-15 17:24:10,743: INFO: PROGRESS: at sentence #1740000, processed 31231321 words, keeping 970061 word types\n",
      "2018-05-15 17:24:11,743: INFO: PROGRESS: at sentence #1750000, processed 31407719 words, keeping 976310 word types\n",
      "2018-05-15 17:24:12,822: INFO: PROGRESS: at sentence #1760000, processed 31600160 words, keeping 983107 word types\n",
      "2018-05-15 17:24:13,877: INFO: PROGRESS: at sentence #1770000, processed 31792511 words, keeping 989420 word types\n",
      "2018-05-15 17:24:14,868: INFO: PROGRESS: at sentence #1780000, processed 31972586 words, keeping 994693 word types\n",
      "2018-05-15 17:24:15,583: INFO: PROGRESS: at sentence #1790000, processed 32093313 words, keeping 999889 word types\n",
      "2018-05-15 17:24:16,519: INFO: PROGRESS: at sentence #1800000, processed 32260596 words, keeping 1004131 word types\n",
      "2018-05-15 17:24:17,551: INFO: PROGRESS: at sentence #1810000, processed 32440803 words, keeping 1009100 word types\n",
      "2018-05-15 17:24:18,537: INFO: PROGRESS: at sentence #1820000, processed 32609689 words, keeping 1011940 word types\n",
      "2018-05-15 17:24:19,615: INFO: PROGRESS: at sentence #1830000, processed 32798051 words, keeping 1018758 word types\n",
      "2018-05-15 17:24:20,641: INFO: PROGRESS: at sentence #1840000, processed 32972667 words, keeping 1020821 word types\n",
      "2018-05-15 17:24:21,713: INFO: PROGRESS: at sentence #1850000, processed 33152948 words, keeping 1023766 word types\n",
      "2018-05-15 17:24:22,646: INFO: PROGRESS: at sentence #1860000, processed 33325822 words, keeping 1027832 word types\n",
      "2018-05-15 17:24:23,728: INFO: PROGRESS: at sentence #1870000, processed 33512125 words, keeping 1031636 word types\n",
      "2018-05-15 17:24:24,959: INFO: PROGRESS: at sentence #1880000, processed 33699540 words, keeping 1034393 word types\n",
      "2018-05-15 17:24:27,101: INFO: PROGRESS: at sentence #1890000, processed 33896410 words, keeping 1039088 word types\n",
      "2018-05-15 17:24:28,456: INFO: collected 1041536 word types from a corpus of 34032167 raw words and 1897215 sentences\n",
      "2018-05-15 17:24:28,459: INFO: Loading a fresh vocabulary\n",
      "2018-05-15 17:25:00,657: INFO: min_count=2 retains 687891 unique words (66% of original 1041536, drops 353645)\n",
      "2018-05-15 17:25:00,662: INFO: min_count=2 leaves 33678522 word corpus (98% of original 34032167, drops 353645)\n",
      "2018-05-15 17:25:04,141: INFO: deleting the raw counts dictionary of 1041536 items\n",
      "2018-05-15 17:25:04,219: INFO: sample=0.001 downsamples 24 most-common words\n",
      "2018-05-15 17:25:04,225: INFO: downsampling leaves estimated 24720695 word corpus (73.4% of prior 33678522)\n",
      "2018-05-15 17:25:08,763: INFO: estimated required memory for 687891 words and 100 dimensions: 894258300 bytes\n",
      "2018-05-15 17:25:08,765: INFO: resetting layer weights\n",
      "2018-05-15 17:25:24,344: INFO: training model with 8 workers on 687891 vocabulary and 100 features, using sg=1 hs=0 sample=0.001 negative=5 window=5\n",
      "2018-05-15 17:25:25,487: INFO: EPOCH 1 - PROGRESS: at 0.27% examples, 71071 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:26,508: INFO: EPOCH 1 - PROGRESS: at 0.68% examples, 72990 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:27,552: INFO: EPOCH 1 - PROGRESS: at 0.99% examples, 69277 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:28,589: INFO: EPOCH 1 - PROGRESS: at 1.36% examples, 72752 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:25:29,658: INFO: EPOCH 1 - PROGRESS: at 1.70% examples, 75880 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:30,691: INFO: EPOCH 1 - PROGRESS: at 2.04% examples, 78361 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:31,710: INFO: EPOCH 1 - PROGRESS: at 2.43% examples, 83501 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:25:32,723: INFO: EPOCH 1 - PROGRESS: at 2.89% examples, 87572 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:33,723: INFO: EPOCH 1 - PROGRESS: at 3.31% examples, 90747 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:34,752: INFO: EPOCH 1 - PROGRESS: at 3.77% examples, 93684 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:25:35,796: INFO: EPOCH 1 - PROGRESS: at 4.27% examples, 95294 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:36,857: INFO: EPOCH 1 - PROGRESS: at 4.74% examples, 97080 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:37,904: INFO: EPOCH 1 - PROGRESS: at 5.26% examples, 98771 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:38,999: INFO: EPOCH 1 - PROGRESS: at 5.68% examples, 97787 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:40,074: INFO: EPOCH 1 - PROGRESS: at 6.05% examples, 97130 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:41,082: INFO: EPOCH 1 - PROGRESS: at 6.60% examples, 98236 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:42,102: INFO: EPOCH 1 - PROGRESS: at 7.04% examples, 99670 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:43,183: INFO: EPOCH 1 - PROGRESS: at 7.34% examples, 98626 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:44,321: INFO: EPOCH 1 - PROGRESS: at 7.62% examples, 97036 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:45,380: INFO: EPOCH 1 - PROGRESS: at 8.26% examples, 96906 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:46,499: INFO: EPOCH 1 - PROGRESS: at 8.61% examples, 95592 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:47,538: INFO: EPOCH 1 - PROGRESS: at 9.00% examples, 95723 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:25:48,550: INFO: EPOCH 1 - PROGRESS: at 9.53% examples, 95878 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:49,583: INFO: EPOCH 1 - PROGRESS: at 9.83% examples, 95113 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:25:50,693: INFO: EPOCH 1 - PROGRESS: at 10.23% examples, 95009 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:51,730: INFO: EPOCH 1 - PROGRESS: at 10.60% examples, 94905 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:25:52,763: INFO: EPOCH 1 - PROGRESS: at 11.12% examples, 95347 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:53,830: INFO: EPOCH 1 - PROGRESS: at 11.51% examples, 95370 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:54,857: INFO: EPOCH 1 - PROGRESS: at 11.94% examples, 95996 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:25:55,890: INFO: EPOCH 1 - PROGRESS: at 12.47% examples, 96071 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:56,900: INFO: EPOCH 1 - PROGRESS: at 12.88% examples, 96442 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:57,979: INFO: EPOCH 1 - PROGRESS: at 13.23% examples, 96439 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:25:59,011: INFO: EPOCH 1 - PROGRESS: at 13.56% examples, 96321 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:00,054: INFO: EPOCH 1 - PROGRESS: at 13.97% examples, 96598 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:01,107: INFO: EPOCH 1 - PROGRESS: at 14.45% examples, 97329 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:02,143: INFO: EPOCH 1 - PROGRESS: at 14.96% examples, 97897 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:03,148: INFO: EPOCH 1 - PROGRESS: at 15.44% examples, 98343 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:04,194: INFO: EPOCH 1 - PROGRESS: at 15.94% examples, 99007 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:05,225: INFO: EPOCH 1 - PROGRESS: at 16.52% examples, 99664 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:06,299: INFO: EPOCH 1 - PROGRESS: at 17.01% examples, 99967 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:07,365: INFO: EPOCH 1 - PROGRESS: at 17.62% examples, 100503 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:08,369: INFO: EPOCH 1 - PROGRESS: at 18.10% examples, 100778 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:09,403: INFO: EPOCH 1 - PROGRESS: at 18.59% examples, 101003 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:10,458: INFO: EPOCH 1 - PROGRESS: at 18.98% examples, 100884 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:11,480: INFO: EPOCH 1 - PROGRESS: at 19.45% examples, 100800 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:12,505: INFO: EPOCH 1 - PROGRESS: at 19.90% examples, 100895 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:13,543: INFO: EPOCH 1 - PROGRESS: at 20.35% examples, 100920 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:14,569: INFO: EPOCH 1 - PROGRESS: at 20.83% examples, 101168 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:15,621: INFO: EPOCH 1 - PROGRESS: at 21.33% examples, 101477 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:16,661: INFO: EPOCH 1 - PROGRESS: at 21.83% examples, 101814 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:17,705: INFO: EPOCH 1 - PROGRESS: at 22.28% examples, 102258 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:18,747: INFO: EPOCH 1 - PROGRESS: at 22.76% examples, 102669 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:19,784: INFO: EPOCH 1 - PROGRESS: at 23.21% examples, 102833 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:20,838: INFO: EPOCH 1 - PROGRESS: at 23.69% examples, 102954 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:21,857: INFO: EPOCH 1 - PROGRESS: at 24.21% examples, 103365 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:22,922: INFO: EPOCH 1 - PROGRESS: at 24.68% examples, 103476 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:23,941: INFO: EPOCH 1 - PROGRESS: at 25.32% examples, 103867 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:24,988: INFO: EPOCH 1 - PROGRESS: at 25.73% examples, 103847 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:26,013: INFO: EPOCH 1 - PROGRESS: at 26.19% examples, 104101 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:27,049: INFO: EPOCH 1 - PROGRESS: at 26.75% examples, 104302 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:28,051: INFO: EPOCH 1 - PROGRESS: at 27.27% examples, 104574 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:29,062: INFO: EPOCH 1 - PROGRESS: at 27.82% examples, 104940 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:30,097: INFO: EPOCH 1 - PROGRESS: at 28.41% examples, 105119 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:31,126: INFO: EPOCH 1 - PROGRESS: at 28.90% examples, 105436 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:32,168: INFO: EPOCH 1 - PROGRESS: at 29.45% examples, 105704 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:33,208: INFO: EPOCH 1 - PROGRESS: at 30.16% examples, 105956 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:34,246: INFO: EPOCH 1 - PROGRESS: at 30.68% examples, 106242 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:35,302: INFO: EPOCH 1 - PROGRESS: at 31.21% examples, 106467 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:36,333: INFO: EPOCH 1 - PROGRESS: at 31.83% examples, 106728 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:37,371: INFO: EPOCH 1 - PROGRESS: at 32.21% examples, 106581 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:38,383: INFO: EPOCH 1 - PROGRESS: at 32.56% examples, 106272 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:39,432: INFO: EPOCH 1 - PROGRESS: at 33.02% examples, 106310 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:40,465: INFO: EPOCH 1 - PROGRESS: at 33.50% examples, 106357 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:41,470: INFO: EPOCH 1 - PROGRESS: at 33.98% examples, 106462 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:42,533: INFO: EPOCH 1 - PROGRESS: at 34.41% examples, 106392 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:43,565: INFO: EPOCH 1 - PROGRESS: at 34.95% examples, 106548 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:44,607: INFO: EPOCH 1 - PROGRESS: at 35.44% examples, 106591 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:45,672: INFO: EPOCH 1 - PROGRESS: at 35.88% examples, 106540 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:46,699: INFO: EPOCH 1 - PROGRESS: at 36.33% examples, 106637 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:47,707: INFO: EPOCH 1 - PROGRESS: at 36.81% examples, 106737 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:48,744: INFO: EPOCH 1 - PROGRESS: at 37.30% examples, 106808 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:49,790: INFO: EPOCH 1 - PROGRESS: at 37.87% examples, 106941 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:50,826: INFO: EPOCH 1 - PROGRESS: at 38.37% examples, 107022 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:51,826: INFO: EPOCH 1 - PROGRESS: at 38.88% examples, 107139 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:52,866: INFO: EPOCH 1 - PROGRESS: at 39.37% examples, 107287 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:53,928: INFO: EPOCH 1 - PROGRESS: at 39.87% examples, 107404 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:54,940: INFO: EPOCH 1 - PROGRESS: at 40.31% examples, 107505 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:55,947: INFO: EPOCH 1 - PROGRESS: at 40.84% examples, 107586 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:56,968: INFO: EPOCH 1 - PROGRESS: at 41.32% examples, 107676 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:26:57,973: INFO: EPOCH 1 - PROGRESS: at 41.76% examples, 107778 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:26:59,060: INFO: EPOCH 1 - PROGRESS: at 42.25% examples, 107856 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:00,119: INFO: EPOCH 1 - PROGRESS: at 42.74% examples, 107965 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:01,131: INFO: EPOCH 1 - PROGRESS: at 43.17% examples, 108053 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:02,135: INFO: EPOCH 1 - PROGRESS: at 43.65% examples, 108138 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:03,192: INFO: EPOCH 1 - PROGRESS: at 44.10% examples, 108230 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:04,192: INFO: EPOCH 1 - PROGRESS: at 44.56% examples, 108341 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:05,234: INFO: EPOCH 1 - PROGRESS: at 45.05% examples, 108460 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:06,306: INFO: EPOCH 1 - PROGRESS: at 45.51% examples, 108530 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:07,330: INFO: EPOCH 1 - PROGRESS: at 45.96% examples, 108607 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:08,360: INFO: EPOCH 1 - PROGRESS: at 46.41% examples, 108662 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:09,406: INFO: EPOCH 1 - PROGRESS: at 46.91% examples, 108706 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:10,432: INFO: EPOCH 1 - PROGRESS: at 47.37% examples, 108774 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:11,492: INFO: EPOCH 1 - PROGRESS: at 47.82% examples, 108852 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:12,513: INFO: EPOCH 1 - PROGRESS: at 48.30% examples, 108958 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:13,579: INFO: EPOCH 1 - PROGRESS: at 48.78% examples, 109052 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:14,608: INFO: EPOCH 1 - PROGRESS: at 49.23% examples, 109150 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:15,648: INFO: EPOCH 1 - PROGRESS: at 49.65% examples, 108980 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:16,654: INFO: EPOCH 1 - PROGRESS: at 50.02% examples, 108848 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:17,706: INFO: EPOCH 1 - PROGRESS: at 50.38% examples, 108680 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:18,753: INFO: EPOCH 1 - PROGRESS: at 50.69% examples, 108461 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:19,818: INFO: EPOCH 1 - PROGRESS: at 51.23% examples, 108347 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:20,829: INFO: EPOCH 1 - PROGRESS: at 51.68% examples, 108425 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:21,867: INFO: EPOCH 1 - PROGRESS: at 52.16% examples, 108529 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:22,891: INFO: EPOCH 1 - PROGRESS: at 52.65% examples, 108581 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:23,915: INFO: EPOCH 1 - PROGRESS: at 53.16% examples, 108566 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:24,956: INFO: EPOCH 1 - PROGRESS: at 53.68% examples, 108605 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:25,978: INFO: EPOCH 1 - PROGRESS: at 54.19% examples, 108660 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:26,991: INFO: EPOCH 1 - PROGRESS: at 54.70% examples, 108725 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:28,000: INFO: EPOCH 1 - PROGRESS: at 55.20% examples, 108727 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:29,025: INFO: EPOCH 1 - PROGRESS: at 55.70% examples, 108783 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:30,048: INFO: EPOCH 1 - PROGRESS: at 56.18% examples, 108835 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:31,143: INFO: EPOCH 1 - PROGRESS: at 56.68% examples, 108829 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:32,164: INFO: EPOCH 1 - PROGRESS: at 57.13% examples, 108882 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:33,223: INFO: EPOCH 1 - PROGRESS: at 57.62% examples, 108959 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:34,236: INFO: EPOCH 1 - PROGRESS: at 58.11% examples, 109014 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:35,254: INFO: EPOCH 1 - PROGRESS: at 58.60% examples, 109125 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:36,261: INFO: EPOCH 1 - PROGRESS: at 59.20% examples, 109179 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:37,271: INFO: EPOCH 1 - PROGRESS: at 59.65% examples, 109186 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:38,330: INFO: EPOCH 1 - PROGRESS: at 60.15% examples, 109262 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:39,335: INFO: EPOCH 1 - PROGRESS: at 60.60% examples, 109322 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:40,370: INFO: EPOCH 1 - PROGRESS: at 61.07% examples, 109360 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:41,434: INFO: EPOCH 1 - PROGRESS: at 61.56% examples, 109427 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:42,448: INFO: EPOCH 1 - PROGRESS: at 62.10% examples, 109460 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:43,485: INFO: EPOCH 1 - PROGRESS: at 62.49% examples, 109473 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:44,514: INFO: EPOCH 1 - PROGRESS: at 62.94% examples, 109499 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:45,542: INFO: EPOCH 1 - PROGRESS: at 63.34% examples, 109519 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:46,562: INFO: EPOCH 1 - PROGRESS: at 63.78% examples, 109554 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:47,584: INFO: EPOCH 1 - PROGRESS: at 64.32% examples, 109571 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:48,624: INFO: EPOCH 1 - PROGRESS: at 64.76% examples, 109576 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:49,638: INFO: EPOCH 1 - PROGRESS: at 65.25% examples, 109665 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:50,682: INFO: EPOCH 1 - PROGRESS: at 65.71% examples, 109763 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:51,706: INFO: EPOCH 1 - PROGRESS: at 66.12% examples, 109783 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:52,734: INFO: EPOCH 1 - PROGRESS: at 66.58% examples, 109843 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:53,780: INFO: EPOCH 1 - PROGRESS: at 67.06% examples, 109791 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:54,795: INFO: EPOCH 1 - PROGRESS: at 67.49% examples, 109820 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:55,835: INFO: EPOCH 1 - PROGRESS: at 67.92% examples, 109921 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:56,858: INFO: EPOCH 1 - PROGRESS: at 68.44% examples, 109988 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:57,896: INFO: EPOCH 1 - PROGRESS: at 68.92% examples, 110106 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:27:58,896: INFO: EPOCH 1 - PROGRESS: at 69.37% examples, 110176 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:27:59,915: INFO: EPOCH 1 - PROGRESS: at 69.85% examples, 110209 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:00,930: INFO: EPOCH 1 - PROGRESS: at 70.29% examples, 110233 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:01,944: INFO: EPOCH 1 - PROGRESS: at 70.77% examples, 110297 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:02,949: INFO: EPOCH 1 - PROGRESS: at 71.21% examples, 110320 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:03,964: INFO: EPOCH 1 - PROGRESS: at 71.69% examples, 110378 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:04,976: INFO: EPOCH 1 - PROGRESS: at 72.15% examples, 110457 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:05,996: INFO: EPOCH 1 - PROGRESS: at 72.57% examples, 110523 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:07,000: INFO: EPOCH 1 - PROGRESS: at 73.05% examples, 110581 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:08,049: INFO: EPOCH 1 - PROGRESS: at 73.52% examples, 110667 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:09,058: INFO: EPOCH 1 - PROGRESS: at 73.96% examples, 110737 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:10,085: INFO: EPOCH 1 - PROGRESS: at 74.52% examples, 110786 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:11,117: INFO: EPOCH 1 - PROGRESS: at 74.98% examples, 110839 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:12,131: INFO: EPOCH 1 - PROGRESS: at 75.44% examples, 110896 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:13,176: INFO: EPOCH 1 - PROGRESS: at 76.04% examples, 110938 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:14,188: INFO: EPOCH 1 - PROGRESS: at 76.53% examples, 110995 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:15,194: INFO: EPOCH 1 - PROGRESS: at 76.91% examples, 111008 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:16,244: INFO: EPOCH 1 - PROGRESS: at 77.40% examples, 111071 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:17,311: INFO: EPOCH 1 - PROGRESS: at 77.86% examples, 111137 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:18,361: INFO: EPOCH 1 - PROGRESS: at 78.31% examples, 111176 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:19,384: INFO: EPOCH 1 - PROGRESS: at 78.74% examples, 111231 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:20,416: INFO: EPOCH 1 - PROGRESS: at 79.23% examples, 111229 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:21,492: INFO: EPOCH 1 - PROGRESS: at 79.64% examples, 111165 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:22,517: INFO: EPOCH 1 - PROGRESS: at 80.04% examples, 111176 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:23,569: INFO: EPOCH 1 - PROGRESS: at 80.55% examples, 111131 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:24,614: INFO: EPOCH 1 - PROGRESS: at 81.07% examples, 111089 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:25,658: INFO: EPOCH 1 - PROGRESS: at 81.51% examples, 111085 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:26,698: INFO: EPOCH 1 - PROGRESS: at 81.95% examples, 111091 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:27,764: INFO: EPOCH 1 - PROGRESS: at 82.42% examples, 111123 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:28,794: INFO: EPOCH 1 - PROGRESS: at 82.93% examples, 111176 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:29,798: INFO: EPOCH 1 - PROGRESS: at 83.35% examples, 111201 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:30,828: INFO: EPOCH 1 - PROGRESS: at 83.78% examples, 111176 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:31,877: INFO: EPOCH 1 - PROGRESS: at 84.27% examples, 111253 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:32,916: INFO: EPOCH 1 - PROGRESS: at 84.72% examples, 111287 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:33,974: INFO: EPOCH 1 - PROGRESS: at 85.21% examples, 111354 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:35,012: INFO: EPOCH 1 - PROGRESS: at 85.63% examples, 111351 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:36,035: INFO: EPOCH 1 - PROGRESS: at 86.06% examples, 111319 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:37,094: INFO: EPOCH 1 - PROGRESS: at 86.49% examples, 111297 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:38,162: INFO: EPOCH 1 - PROGRESS: at 87.18% examples, 111197 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:39,227: INFO: EPOCH 1 - PROGRESS: at 87.63% examples, 111217 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:40,300: INFO: EPOCH 1 - PROGRESS: at 88.08% examples, 111198 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:41,341: INFO: EPOCH 1 - PROGRESS: at 88.53% examples, 111224 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:42,392: INFO: EPOCH 1 - PROGRESS: at 88.99% examples, 111257 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:43,429: INFO: EPOCH 1 - PROGRESS: at 89.47% examples, 111293 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:44,466: INFO: EPOCH 1 - PROGRESS: at 90.08% examples, 111320 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:45,491: INFO: EPOCH 1 - PROGRESS: at 90.63% examples, 111358 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:46,549: INFO: EPOCH 1 - PROGRESS: at 91.10% examples, 111373 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:47,613: INFO: EPOCH 1 - PROGRESS: at 91.53% examples, 111396 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:48,644: INFO: EPOCH 1 - PROGRESS: at 92.06% examples, 111436 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:49,686: INFO: EPOCH 1 - PROGRESS: at 92.52% examples, 111481 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:50,702: INFO: EPOCH 1 - PROGRESS: at 92.96% examples, 111497 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:51,731: INFO: EPOCH 1 - PROGRESS: at 93.39% examples, 111508 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:52,761: INFO: EPOCH 1 - PROGRESS: at 93.89% examples, 111552 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:53,779: INFO: EPOCH 1 - PROGRESS: at 94.56% examples, 111541 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:54,800: INFO: EPOCH 1 - PROGRESS: at 95.07% examples, 111592 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:28:55,844: INFO: EPOCH 1 - PROGRESS: at 95.60% examples, 111632 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:56,883: INFO: EPOCH 1 - PROGRESS: at 96.08% examples, 111676 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:57,917: INFO: EPOCH 1 - PROGRESS: at 96.58% examples, 111717 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:58,950: INFO: EPOCH 1 - PROGRESS: at 97.08% examples, 111755 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:28:59,951: INFO: EPOCH 1 - PROGRESS: at 97.53% examples, 111748 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:00,967: INFO: EPOCH 1 - PROGRESS: at 97.99% examples, 111727 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:02,010: INFO: EPOCH 1 - PROGRESS: at 98.46% examples, 111760 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:03,074: INFO: EPOCH 1 - PROGRESS: at 98.95% examples, 111782 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:04,123: INFO: EPOCH 1 - PROGRESS: at 99.40% examples, 111817 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:05,143: INFO: EPOCH 1 - PROGRESS: at 99.87% examples, 111866 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:05,339: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-15 17:29:05,341: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-15 17:29:05,343: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-15 17:29:05,345: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-15 17:29:05,347: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-15 17:29:05,349: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-15 17:29:05,414: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-15 17:29:05,418: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-15 17:29:05,419: INFO: EPOCH - 1 : training on 34032167 raw words (24721633 effective words) took 221.0s, 111881 effective words/s\n",
      "2018-05-15 17:29:06,566: INFO: EPOCH 2 - PROGRESS: at 0.55% examples, 114248 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:07,582: INFO: EPOCH 2 - PROGRESS: at 1.12% examples, 120173 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:08,605: INFO: EPOCH 2 - PROGRESS: at 1.65% examples, 122080 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:09,667: INFO: EPOCH 2 - PROGRESS: at 2.12% examples, 122478 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:10,698: INFO: EPOCH 2 - PROGRESS: at 2.57% examples, 123605 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:11,730: INFO: EPOCH 2 - PROGRESS: at 3.08% examples, 124272 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:12,776: INFO: EPOCH 2 - PROGRESS: at 3.57% examples, 124501 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:13,806: INFO: EPOCH 2 - PROGRESS: at 4.09% examples, 124753 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:14,809: INFO: EPOCH 2 - PROGRESS: at 4.58% examples, 124532 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:15,851: INFO: EPOCH 2 - PROGRESS: at 5.08% examples, 123999 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:16,868: INFO: EPOCH 2 - PROGRESS: at 5.56% examples, 123802 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:17,901: INFO: EPOCH 2 - PROGRESS: at 6.10% examples, 123428 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:18,902: INFO: EPOCH 2 - PROGRESS: at 6.67% examples, 123433 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:19,922: INFO: EPOCH 2 - PROGRESS: at 7.14% examples, 123901 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:20,978: INFO: EPOCH 2 - PROGRESS: at 7.60% examples, 124028 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:21,988: INFO: EPOCH 2 - PROGRESS: at 8.30% examples, 123895 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:23,043: INFO: EPOCH 2 - PROGRESS: at 8.83% examples, 123867 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:24,069: INFO: EPOCH 2 - PROGRESS: at 9.50% examples, 123986 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:25,116: INFO: EPOCH 2 - PROGRESS: at 9.99% examples, 123689 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:26,142: INFO: EPOCH 2 - PROGRESS: at 10.44% examples, 123236 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:27,148: INFO: EPOCH 2 - PROGRESS: at 10.91% examples, 122269 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:28,213: INFO: EPOCH 2 - PROGRESS: at 11.37% examples, 121740 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:29,262: INFO: EPOCH 2 - PROGRESS: at 11.80% examples, 120981 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:30,262: INFO: EPOCH 2 - PROGRESS: at 12.15% examples, 120221 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:31,279: INFO: EPOCH 2 - PROGRESS: at 12.73% examples, 119969 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:32,332: INFO: EPOCH 2 - PROGRESS: at 13.20% examples, 120194 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:33,373: INFO: EPOCH 2 - PROGRESS: at 13.66% examples, 120462 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:34,387: INFO: EPOCH 2 - PROGRESS: at 14.12% examples, 120505 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:35,421: INFO: EPOCH 2 - PROGRESS: at 14.63% examples, 120638 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:36,460: INFO: EPOCH 2 - PROGRESS: at 15.15% examples, 120815 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:37,493: INFO: EPOCH 2 - PROGRESS: at 15.70% examples, 120930 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:38,536: INFO: EPOCH 2 - PROGRESS: at 16.26% examples, 121043 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:39,568: INFO: EPOCH 2 - PROGRESS: at 16.78% examples, 121144 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:40,600: INFO: EPOCH 2 - PROGRESS: at 17.37% examples, 121003 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:41,634: INFO: EPOCH 2 - PROGRESS: at 17.82% examples, 120521 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:42,673: INFO: EPOCH 2 - PROGRESS: at 18.37% examples, 120588 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:43,684: INFO: EPOCH 2 - PROGRESS: at 18.83% examples, 120601 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:44,733: INFO: EPOCH 2 - PROGRESS: at 19.42% examples, 120617 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:45,740: INFO: EPOCH 2 - PROGRESS: at 19.94% examples, 120645 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:46,788: INFO: EPOCH 2 - PROGRESS: at 20.48% examples, 120699 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:47,792: INFO: EPOCH 2 - PROGRESS: at 20.99% examples, 120712 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:48,852: INFO: EPOCH 2 - PROGRESS: at 21.48% examples, 120608 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:49,882: INFO: EPOCH 2 - PROGRESS: at 21.96% examples, 120575 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:50,928: INFO: EPOCH 2 - PROGRESS: at 22.38% examples, 120500 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:51,988: INFO: EPOCH 2 - PROGRESS: at 22.88% examples, 120525 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:53,048: INFO: EPOCH 2 - PROGRESS: at 23.39% examples, 120568 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:54,070: INFO: EPOCH 2 - PROGRESS: at 23.89% examples, 120527 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:55,101: INFO: EPOCH 2 - PROGRESS: at 24.41% examples, 120493 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:56,153: INFO: EPOCH 2 - PROGRESS: at 24.95% examples, 120570 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:29:57,159: INFO: EPOCH 2 - PROGRESS: at 25.52% examples, 120560 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:58,162: INFO: EPOCH 2 - PROGRESS: at 25.98% examples, 120591 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:29:59,296: INFO: EPOCH 2 - PROGRESS: at 26.29% examples, 119645 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:00,345: INFO: EPOCH 2 - PROGRESS: at 26.75% examples, 119032 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:01,361: INFO: EPOCH 2 - PROGRESS: at 27.27% examples, 119046 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:02,399: INFO: EPOCH 2 - PROGRESS: at 27.82% examples, 119150 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:03,450: INFO: EPOCH 2 - PROGRESS: at 28.45% examples, 119192 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:04,510: INFO: EPOCH 2 - PROGRESS: at 28.93% examples, 119241 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:05,560: INFO: EPOCH 2 - PROGRESS: at 29.48% examples, 119292 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:06,603: INFO: EPOCH 2 - PROGRESS: at 30.18% examples, 119340 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:07,628: INFO: EPOCH 2 - PROGRESS: at 30.68% examples, 119346 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:08,685: INFO: EPOCH 2 - PROGRESS: at 31.16% examples, 119156 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:09,730: INFO: EPOCH 2 - PROGRESS: at 31.76% examples, 119214 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:10,730: INFO: EPOCH 2 - PROGRESS: at 32.24% examples, 119244 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:11,750: INFO: EPOCH 2 - PROGRESS: at 32.75% examples, 119344 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:12,798: INFO: EPOCH 2 - PROGRESS: at 33.29% examples, 119374 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:13,810: INFO: EPOCH 2 - PROGRESS: at 33.83% examples, 119488 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:14,842: INFO: EPOCH 2 - PROGRESS: at 34.36% examples, 119574 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:15,845: INFO: EPOCH 2 - PROGRESS: at 34.92% examples, 119711 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:16,880: INFO: EPOCH 2 - PROGRESS: at 35.44% examples, 119687 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:17,943: INFO: EPOCH 2 - PROGRESS: at 35.96% examples, 119747 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:18,975: INFO: EPOCH 2 - PROGRESS: at 36.48% examples, 119832 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:20,020: INFO: EPOCH 2 - PROGRESS: at 37.04% examples, 119914 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:21,082: INFO: EPOCH 2 - PROGRESS: at 37.65% examples, 119945 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:22,110: INFO: EPOCH 2 - PROGRESS: at 38.13% examples, 119965 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:23,163: INFO: EPOCH 2 - PROGRESS: at 38.73% examples, 120048 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:24,216: INFO: EPOCH 2 - PROGRESS: at 39.23% examples, 120029 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:25,259: INFO: EPOCH 2 - PROGRESS: at 39.75% examples, 120104 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:26,302: INFO: EPOCH 2 - PROGRESS: at 40.23% examples, 120097 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:27,309: INFO: EPOCH 2 - PROGRESS: at 40.77% examples, 120131 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:28,346: INFO: EPOCH 2 - PROGRESS: at 41.29% examples, 120134 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:29,351: INFO: EPOCH 2 - PROGRESS: at 41.76% examples, 120185 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:30,364: INFO: EPOCH 2 - PROGRESS: at 42.25% examples, 120217 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:31,384: INFO: EPOCH 2 - PROGRESS: at 42.74% examples, 120242 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:32,413: INFO: EPOCH 2 - PROGRESS: at 43.15% examples, 120086 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:33,454: INFO: EPOCH 2 - PROGRESS: at 43.60% examples, 119910 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:34,517: INFO: EPOCH 2 - PROGRESS: at 44.03% examples, 119791 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:35,517: INFO: EPOCH 2 - PROGRESS: at 44.47% examples, 119686 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:36,541: INFO: EPOCH 2 - PROGRESS: at 44.90% examples, 119645 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:37,546: INFO: EPOCH 2 - PROGRESS: at 45.37% examples, 119677 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:38,615: INFO: EPOCH 2 - PROGRESS: at 45.86% examples, 119658 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:39,666: INFO: EPOCH 2 - PROGRESS: at 46.28% examples, 119497 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:40,696: INFO: EPOCH 2 - PROGRESS: at 46.58% examples, 119057 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:41,748: INFO: EPOCH 2 - PROGRESS: at 47.00% examples, 118752 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:42,748: INFO: EPOCH 2 - PROGRESS: at 47.31% examples, 118374 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:43,763: INFO: EPOCH 2 - PROGRESS: at 47.64% examples, 118024 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:44,803: INFO: EPOCH 2 - PROGRESS: at 47.97% examples, 117680 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:45,906: INFO: EPOCH 2 - PROGRESS: at 48.27% examples, 117177 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:46,961: INFO: EPOCH 2 - PROGRESS: at 48.68% examples, 117057 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:47,975: INFO: EPOCH 2 - PROGRESS: at 49.16% examples, 117110 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:49,025: INFO: EPOCH 2 - PROGRESS: at 49.71% examples, 117177 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:30:50,072: INFO: EPOCH 2 - PROGRESS: at 50.22% examples, 117267 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:51,101: INFO: EPOCH 2 - PROGRESS: at 50.66% examples, 117312 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:52,153: INFO: EPOCH 2 - PROGRESS: at 51.33% examples, 117392 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:53,169: INFO: EPOCH 2 - PROGRESS: at 51.78% examples, 117450 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:54,195: INFO: EPOCH 2 - PROGRESS: at 52.29% examples, 117493 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:55,252: INFO: EPOCH 2 - PROGRESS: at 52.85% examples, 117564 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:56,276: INFO: EPOCH 2 - PROGRESS: at 53.40% examples, 117604 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:57,330: INFO: EPOCH 2 - PROGRESS: at 53.97% examples, 117605 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:58,330: INFO: EPOCH 2 - PROGRESS: at 54.44% examples, 117547 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:30:59,358: INFO: EPOCH 2 - PROGRESS: at 54.97% examples, 117591 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:00,408: INFO: EPOCH 2 - PROGRESS: at 55.55% examples, 117600 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:01,435: INFO: EPOCH 2 - PROGRESS: at 56.05% examples, 117643 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:02,447: INFO: EPOCH 2 - PROGRESS: at 56.57% examples, 117700 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:03,460: INFO: EPOCH 2 - PROGRESS: at 57.08% examples, 117755 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:04,491: INFO: EPOCH 2 - PROGRESS: at 57.53% examples, 117723 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:05,544: INFO: EPOCH 2 - PROGRESS: at 57.99% examples, 117607 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:06,610: INFO: EPOCH 2 - PROGRESS: at 58.40% examples, 117428 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:07,661: INFO: EPOCH 2 - PROGRESS: at 58.76% examples, 117202 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:08,685: INFO: EPOCH 2 - PROGRESS: at 59.36% examples, 117114 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:09,729: INFO: EPOCH 2 - PROGRESS: at 59.86% examples, 117147 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:10,786: INFO: EPOCH 2 - PROGRESS: at 60.36% examples, 117158 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:11,802: INFO: EPOCH 2 - PROGRESS: at 60.84% examples, 117210 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:12,814: INFO: EPOCH 2 - PROGRESS: at 61.31% examples, 117208 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:13,816: INFO: EPOCH 2 - PROGRESS: at 61.76% examples, 117211 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:14,859: INFO: EPOCH 2 - PROGRESS: at 62.30% examples, 117267 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:15,862: INFO: EPOCH 2 - PROGRESS: at 62.78% examples, 117309 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:16,865: INFO: EPOCH 2 - PROGRESS: at 63.15% examples, 117230 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:17,881: INFO: EPOCH 2 - PROGRESS: at 63.60% examples, 117209 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:18,932: INFO: EPOCH 2 - PROGRESS: at 63.97% examples, 117048 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:19,957: INFO: EPOCH 2 - PROGRESS: at 64.52% examples, 117005 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:20,973: INFO: EPOCH 2 - PROGRESS: at 64.96% examples, 116983 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:21,986: INFO: EPOCH 2 - PROGRESS: at 65.41% examples, 116966 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:23,014: INFO: EPOCH 2 - PROGRESS: at 65.80% examples, 116922 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:24,053: INFO: EPOCH 2 - PROGRESS: at 66.09% examples, 116617 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:25,085: INFO: EPOCH 2 - PROGRESS: at 66.29% examples, 116164 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:26,103: INFO: EPOCH 2 - PROGRESS: at 66.69% examples, 115931 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:27,113: INFO: EPOCH 2 - PROGRESS: at 67.11% examples, 115866 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:28,158: INFO: EPOCH 2 - PROGRESS: at 67.53% examples, 115826 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:29,221: INFO: EPOCH 2 - PROGRESS: at 67.94% examples, 115824 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:30,224: INFO: EPOCH 2 - PROGRESS: at 68.42% examples, 115765 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:31,270: INFO: EPOCH 2 - PROGRESS: at 68.89% examples, 115841 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:32,318: INFO: EPOCH 2 - PROGRESS: at 69.32% examples, 115792 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:33,343: INFO: EPOCH 2 - PROGRESS: at 69.79% examples, 115783 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:34,382: INFO: EPOCH 2 - PROGRESS: at 70.26% examples, 115797 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:35,389: INFO: EPOCH 2 - PROGRESS: at 70.72% examples, 115838 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:36,447: INFO: EPOCH 2 - PROGRESS: at 71.21% examples, 115827 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:37,456: INFO: EPOCH 2 - PROGRESS: at 71.65% examples, 115808 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:38,488: INFO: EPOCH 2 - PROGRESS: at 72.06% examples, 115746 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:39,541: INFO: EPOCH 2 - PROGRESS: at 72.39% examples, 115562 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:40,587: INFO: EPOCH 2 - PROGRESS: at 72.73% examples, 115379 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:41,594: INFO: EPOCH 2 - PROGRESS: at 73.20% examples, 115415 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:42,630: INFO: EPOCH 2 - PROGRESS: at 73.69% examples, 115524 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:43,682: INFO: EPOCH 2 - PROGRESS: at 74.20% examples, 115632 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:44,695: INFO: EPOCH 2 - PROGRESS: at 74.78% examples, 115666 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:45,741: INFO: EPOCH 2 - PROGRESS: at 75.25% examples, 115723 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:46,790: INFO: EPOCH 2 - PROGRESS: at 75.78% examples, 115823 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:47,831: INFO: EPOCH 2 - PROGRESS: at 76.47% examples, 115868 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:48,880: INFO: EPOCH 2 - PROGRESS: at 76.88% examples, 115953 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:49,890: INFO: EPOCH 2 - PROGRESS: at 77.40% examples, 116061 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:50,961: INFO: EPOCH 2 - PROGRESS: at 77.89% examples, 116138 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:52,007: INFO: EPOCH 2 - PROGRESS: at 78.38% examples, 116238 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:53,017: INFO: EPOCH 2 - PROGRESS: at 78.84% examples, 116314 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:54,051: INFO: EPOCH 2 - PROGRESS: at 79.40% examples, 116365 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:55,108: INFO: EPOCH 2 - PROGRESS: at 79.83% examples, 116361 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:56,143: INFO: EPOCH 2 - PROGRESS: at 80.39% examples, 116421 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:31:57,202: INFO: EPOCH 2 - PROGRESS: at 81.02% examples, 116465 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:58,268: INFO: EPOCH 2 - PROGRESS: at 81.53% examples, 116542 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:31:59,271: INFO: EPOCH 2 - PROGRESS: at 82.05% examples, 116620 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:00,330: INFO: EPOCH 2 - PROGRESS: at 82.52% examples, 116674 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:01,401: INFO: EPOCH 2 - PROGRESS: at 83.06% examples, 116750 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:02,445: INFO: EPOCH 2 - PROGRESS: at 83.61% examples, 116800 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:03,470: INFO: EPOCH 2 - PROGRESS: at 84.11% examples, 116905 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:04,508: INFO: EPOCH 2 - PROGRESS: at 84.59% examples, 116951 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:05,533: INFO: EPOCH 2 - PROGRESS: at 85.11% examples, 117044 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:06,538: INFO: EPOCH 2 - PROGRESS: at 85.58% examples, 117114 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:07,583: INFO: EPOCH 2 - PROGRESS: at 86.12% examples, 117194 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:08,638: INFO: EPOCH 2 - PROGRESS: at 86.94% examples, 117242 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:09,663: INFO: EPOCH 2 - PROGRESS: at 87.42% examples, 117301 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:10,716: INFO: EPOCH 2 - PROGRESS: at 87.95% examples, 117371 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:11,761: INFO: EPOCH 2 - PROGRESS: at 88.44% examples, 117445 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:12,763: INFO: EPOCH 2 - PROGRESS: at 88.94% examples, 117511 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:13,815: INFO: EPOCH 2 - PROGRESS: at 89.47% examples, 117584 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:14,823: INFO: EPOCH 2 - PROGRESS: at 90.11% examples, 117634 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:15,850: INFO: EPOCH 2 - PROGRESS: at 90.69% examples, 117676 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:16,913: INFO: EPOCH 2 - PROGRESS: at 91.20% examples, 117731 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:17,940: INFO: EPOCH 2 - PROGRESS: at 91.71% examples, 117818 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:18,965: INFO: EPOCH 2 - PROGRESS: at 92.25% examples, 117870 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:20,007: INFO: EPOCH 2 - PROGRESS: at 92.77% examples, 117955 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:21,016: INFO: EPOCH 2 - PROGRESS: at 93.26% examples, 118018 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:22,027: INFO: EPOCH 2 - PROGRESS: at 93.72% examples, 118007 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:23,086: INFO: EPOCH 2 - PROGRESS: at 94.42% examples, 117970 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:24,098: INFO: EPOCH 2 - PROGRESS: at 94.93% examples, 118003 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:25,125: INFO: EPOCH 2 - PROGRESS: at 95.40% examples, 117982 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:26,187: INFO: EPOCH 2 - PROGRESS: at 95.93% examples, 117981 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:27,226: INFO: EPOCH 2 - PROGRESS: at 96.36% examples, 117955 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:28,285: INFO: EPOCH 2 - PROGRESS: at 96.88% examples, 117949 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:29,296: INFO: EPOCH 2 - PROGRESS: at 97.40% examples, 118012 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:30,309: INFO: EPOCH 2 - PROGRESS: at 97.91% examples, 117995 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:31,359: INFO: EPOCH 2 - PROGRESS: at 98.43% examples, 118066 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:32,365: INFO: EPOCH 2 - PROGRESS: at 98.95% examples, 118125 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:33,391: INFO: EPOCH 2 - PROGRESS: at 99.45% examples, 118214 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:34,350: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-15 17:32:34,353: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-15 17:32:34,354: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-15 17:32:34,356: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-15 17:32:34,358: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-15 17:32:34,359: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-15 17:32:34,411: INFO: EPOCH 2 - PROGRESS: at 99.98% examples, 118292 words/s, in_qsize 1, out_qsize 1\n",
      "2018-05-15 17:32:34,412: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-15 17:32:34,415: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-15 17:32:34,416: INFO: EPOCH - 2 : training on 34032167 raw words (24720620 effective words) took 208.9s, 118325 effective words/s\n",
      "2018-05-15 17:32:35,521: INFO: EPOCH 3 - PROGRESS: at 0.60% examples, 124371 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:36,535: INFO: EPOCH 3 - PROGRESS: at 1.18% examples, 129339 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:37,547: INFO: EPOCH 3 - PROGRESS: at 1.70% examples, 128853 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:38,547: INFO: EPOCH 3 - PROGRESS: at 2.18% examples, 129392 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:39,556: INFO: EPOCH 3 - PROGRESS: at 2.66% examples, 131144 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:40,566: INFO: EPOCH 3 - PROGRESS: at 3.18% examples, 132195 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:41,570: INFO: EPOCH 3 - PROGRESS: at 3.69% examples, 132984 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:42,605: INFO: EPOCH 3 - PROGRESS: at 4.22% examples, 131212 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:43,631: INFO: EPOCH 3 - PROGRESS: at 4.69% examples, 129999 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:44,687: INFO: EPOCH 3 - PROGRESS: at 5.20% examples, 128753 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:45,709: INFO: EPOCH 3 - PROGRESS: at 5.73% examples, 127985 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:46,715: INFO: EPOCH 3 - PROGRESS: at 6.13% examples, 125812 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:47,738: INFO: EPOCH 3 - PROGRESS: at 6.72% examples, 125995 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:48,741: INFO: EPOCH 3 - PROGRESS: at 7.21% examples, 126950 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:49,778: INFO: EPOCH 3 - PROGRESS: at 7.97% examples, 127305 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:50,813: INFO: EPOCH 3 - PROGRESS: at 8.48% examples, 127774 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:51,854: INFO: EPOCH 3 - PROGRESS: at 9.05% examples, 128072 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:52,912: INFO: EPOCH 3 - PROGRESS: at 9.72% examples, 128143 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:53,997: INFO: EPOCH 3 - PROGRESS: at 10.29% examples, 128545 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:55,047: INFO: EPOCH 3 - PROGRESS: at 10.91% examples, 128772 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:56,069: INFO: EPOCH 3 - PROGRESS: at 11.46% examples, 129165 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:57,120: INFO: EPOCH 3 - PROGRESS: at 11.97% examples, 129291 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:32:58,127: INFO: EPOCH 3 - PROGRESS: at 12.62% examples, 129651 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:32:59,143: INFO: EPOCH 3 - PROGRESS: at 13.13% examples, 129957 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:00,167: INFO: EPOCH 3 - PROGRESS: at 13.61% examples, 130220 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:01,182: INFO: EPOCH 3 - PROGRESS: at 14.12% examples, 130442 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:02,198: INFO: EPOCH 3 - PROGRESS: at 14.66% examples, 130562 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:03,211: INFO: EPOCH 3 - PROGRESS: at 15.19% examples, 130764 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:04,266: INFO: EPOCH 3 - PROGRESS: at 15.82% examples, 130941 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:05,304: INFO: EPOCH 3 - PROGRESS: at 16.40% examples, 130959 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:06,377: INFO: EPOCH 3 - PROGRESS: at 16.98% examples, 130998 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:07,402: INFO: EPOCH 3 - PROGRESS: at 17.62% examples, 131066 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:08,438: INFO: EPOCH 3 - PROGRESS: at 18.24% examples, 131242 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:09,479: INFO: EPOCH 3 - PROGRESS: at 18.78% examples, 131241 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:10,490: INFO: EPOCH 3 - PROGRESS: at 19.37% examples, 131300 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:11,511: INFO: EPOCH 3 - PROGRESS: at 19.97% examples, 131377 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:12,521: INFO: EPOCH 3 - PROGRESS: at 20.53% examples, 131455 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:13,558: INFO: EPOCH 3 - PROGRESS: at 21.11% examples, 131457 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:14,570: INFO: EPOCH 3 - PROGRESS: at 21.63% examples, 131576 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:15,589: INFO: EPOCH 3 - PROGRESS: at 22.15% examples, 131654 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:16,624: INFO: EPOCH 3 - PROGRESS: at 22.65% examples, 131662 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:17,629: INFO: EPOCH 3 - PROGRESS: at 23.18% examples, 131763 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:18,652: INFO: EPOCH 3 - PROGRESS: at 23.76% examples, 131795 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:19,662: INFO: EPOCH 3 - PROGRESS: at 24.30% examples, 131864 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:20,692: INFO: EPOCH 3 - PROGRESS: at 24.89% examples, 131913 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:21,719: INFO: EPOCH 3 - PROGRESS: at 25.52% examples, 131911 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:22,734: INFO: EPOCH 3 - PROGRESS: at 26.02% examples, 131972 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:23,747: INFO: EPOCH 3 - PROGRESS: at 26.63% examples, 131995 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:24,749: INFO: EPOCH 3 - PROGRESS: at 27.18% examples, 131937 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:25,802: INFO: EPOCH 3 - PROGRESS: at 27.79% examples, 132032 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:26,821: INFO: EPOCH 3 - PROGRESS: at 28.45% examples, 132034 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:27,830: INFO: EPOCH 3 - PROGRESS: at 28.95% examples, 132087 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:28,836: INFO: EPOCH 3 - PROGRESS: at 29.61% examples, 132127 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:29,837: INFO: EPOCH 3 - PROGRESS: at 30.24% examples, 132057 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:30,857: INFO: EPOCH 3 - PROGRESS: at 30.81% examples, 132080 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:31,904: INFO: EPOCH 3 - PROGRESS: at 31.39% examples, 132030 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:32,910: INFO: EPOCH 3 - PROGRESS: at 31.99% examples, 132083 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:33,938: INFO: EPOCH 3 - PROGRESS: at 32.53% examples, 132069 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:34,941: INFO: EPOCH 3 - PROGRESS: at 33.13% examples, 132106 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:35,967: INFO: EPOCH 3 - PROGRESS: at 33.64% examples, 132100 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:36,977: INFO: EPOCH 3 - PROGRESS: at 34.22% examples, 132139 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:38,010: INFO: EPOCH 3 - PROGRESS: at 34.81% examples, 132145 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:39,024: INFO: EPOCH 3 - PROGRESS: at 35.39% examples, 132186 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:40,080: INFO: EPOCH 3 - PROGRESS: at 35.94% examples, 132173 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:41,097: INFO: EPOCH 3 - PROGRESS: at 36.48% examples, 132223 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:42,124: INFO: EPOCH 3 - PROGRESS: at 37.01% examples, 132047 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:43,160: INFO: EPOCH 3 - PROGRESS: at 37.65% examples, 132052 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:44,188: INFO: EPOCH 3 - PROGRESS: at 38.21% examples, 132111 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:45,237: INFO: EPOCH 3 - PROGRESS: at 38.82% examples, 132130 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:46,238: INFO: EPOCH 3 - PROGRESS: at 39.35% examples, 132125 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:47,270: INFO: EPOCH 3 - PROGRESS: at 39.89% examples, 132159 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:48,313: INFO: EPOCH 3 - PROGRESS: at 40.38% examples, 131986 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:49,390: INFO: EPOCH 3 - PROGRESS: at 40.93% examples, 131732 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:50,463: INFO: EPOCH 3 - PROGRESS: at 41.42% examples, 131526 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:51,479: INFO: EPOCH 3 - PROGRESS: at 41.87% examples, 131314 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:52,511: INFO: EPOCH 3 - PROGRESS: at 42.34% examples, 131089 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:53,538: INFO: EPOCH 3 - PROGRESS: at 42.89% examples, 131138 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:54,566: INFO: EPOCH 3 - PROGRESS: at 43.44% examples, 131193 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:33:55,582: INFO: EPOCH 3 - PROGRESS: at 43.93% examples, 131268 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:56,616: INFO: EPOCH 3 - PROGRESS: at 44.50% examples, 131309 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:57,659: INFO: EPOCH 3 - PROGRESS: at 45.00% examples, 131266 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:58,716: INFO: EPOCH 3 - PROGRESS: at 45.53% examples, 131350 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:33:59,764: INFO: EPOCH 3 - PROGRESS: at 46.11% examples, 131383 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:00,838: INFO: EPOCH 3 - PROGRESS: at 46.61% examples, 131375 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:01,873: INFO: EPOCH 3 - PROGRESS: at 47.20% examples, 131431 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:02,908: INFO: EPOCH 3 - PROGRESS: at 47.72% examples, 131444 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:03,918: INFO: EPOCH 3 - PROGRESS: at 48.24% examples, 131511 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:04,974: INFO: EPOCH 3 - PROGRESS: at 48.78% examples, 131536 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:06,048: INFO: EPOCH 3 - PROGRESS: at 49.29% examples, 131498 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:07,061: INFO: EPOCH 3 - PROGRESS: at 49.85% examples, 131471 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:08,084: INFO: EPOCH 3 - PROGRESS: at 50.38% examples, 131529 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:09,120: INFO: EPOCH 3 - PROGRESS: at 50.90% examples, 131577 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:10,166: INFO: EPOCH 3 - PROGRESS: at 51.57% examples, 131591 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:11,190: INFO: EPOCH 3 - PROGRESS: at 52.11% examples, 131646 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:12,238: INFO: EPOCH 3 - PROGRESS: at 52.69% examples, 131660 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:13,241: INFO: EPOCH 3 - PROGRESS: at 53.29% examples, 131655 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:14,290: INFO: EPOCH 3 - PROGRESS: at 53.90% examples, 131665 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:15,330: INFO: EPOCH 3 - PROGRESS: at 54.50% examples, 131704 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:16,383: INFO: EPOCH 3 - PROGRESS: at 55.15% examples, 131712 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:17,429: INFO: EPOCH 3 - PROGRESS: at 55.72% examples, 131739 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:18,459: INFO: EPOCH 3 - PROGRESS: at 56.29% examples, 131781 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:19,464: INFO: EPOCH 3 - PROGRESS: at 56.84% examples, 131782 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:20,515: INFO: EPOCH 3 - PROGRESS: at 57.39% examples, 131802 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:21,545: INFO: EPOCH 3 - PROGRESS: at 57.96% examples, 131833 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:22,577: INFO: EPOCH 3 - PROGRESS: at 58.50% examples, 131874 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:23,578: INFO: EPOCH 3 - PROGRESS: at 59.17% examples, 131867 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:24,586: INFO: EPOCH 3 - PROGRESS: at 59.72% examples, 131866 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:25,628: INFO: EPOCH 3 - PROGRESS: at 60.27% examples, 131892 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:26,663: INFO: EPOCH 3 - PROGRESS: at 60.77% examples, 131862 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:27,695: INFO: EPOCH 3 - PROGRESS: at 61.35% examples, 131901 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:28,724: INFO: EPOCH 3 - PROGRESS: at 61.87% examples, 131931 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:29,733: INFO: EPOCH 3 - PROGRESS: at 62.44% examples, 131956 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:30,735: INFO: EPOCH 3 - PROGRESS: at 62.96% examples, 132003 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:31,749: INFO: EPOCH 3 - PROGRESS: at 63.46% examples, 132031 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:32,772: INFO: EPOCH 3 - PROGRESS: at 63.97% examples, 132055 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:33,786: INFO: EPOCH 3 - PROGRESS: at 64.61% examples, 132072 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:34,827: INFO: EPOCH 3 - PROGRESS: at 65.15% examples, 132075 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:35,868: INFO: EPOCH 3 - PROGRESS: at 65.65% examples, 132122 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:36,878: INFO: EPOCH 3 - PROGRESS: at 66.14% examples, 132148 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:37,903: INFO: EPOCH 3 - PROGRESS: at 66.72% examples, 132149 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:38,918: INFO: EPOCH 3 - PROGRESS: at 67.24% examples, 132176 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:44,848: INFO: EPOCH 3 - PROGRESS: at 67.37% examples, 126440 words/s, in_qsize 0, out_qsize 1\n",
      "2018-05-15 17:34:45,879: INFO: EPOCH 3 - PROGRESS: at 67.76% examples, 126207 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:46,906: INFO: EPOCH 3 - PROGRESS: at 68.17% examples, 126047 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:47,950: INFO: EPOCH 3 - PROGRESS: at 68.62% examples, 125976 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:49,002: INFO: EPOCH 3 - PROGRESS: at 69.07% examples, 125925 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:50,048: INFO: EPOCH 3 - PROGRESS: at 69.58% examples, 125904 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:51,051: INFO: EPOCH 3 - PROGRESS: at 70.07% examples, 125889 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:52,094: INFO: EPOCH 3 - PROGRESS: at 70.52% examples, 125830 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:53,095: INFO: EPOCH 3 - PROGRESS: at 71.01% examples, 125740 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:34:54,157: INFO: EPOCH 3 - PROGRESS: at 71.53% examples, 125695 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:55,181: INFO: EPOCH 3 - PROGRESS: at 71.97% examples, 125607 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:56,183: INFO: EPOCH 3 - PROGRESS: at 72.35% examples, 125589 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:57,189: INFO: EPOCH 3 - PROGRESS: at 72.81% examples, 125552 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:58,207: INFO: EPOCH 3 - PROGRESS: at 73.28% examples, 125513 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:34:59,282: INFO: EPOCH 3 - PROGRESS: at 73.75% examples, 125474 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:00,304: INFO: EPOCH 3 - PROGRESS: at 74.20% examples, 125446 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:35:01,337: INFO: EPOCH 3 - PROGRESS: at 74.81% examples, 125443 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:02,369: INFO: EPOCH 3 - PROGRESS: at 75.25% examples, 125399 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:03,423: INFO: EPOCH 3 - PROGRESS: at 75.73% examples, 125338 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:04,494: INFO: EPOCH 3 - PROGRESS: at 76.36% examples, 125299 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:05,508: INFO: EPOCH 3 - PROGRESS: at 76.78% examples, 125257 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:06,513: INFO: EPOCH 3 - PROGRESS: at 77.26% examples, 125230 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:07,561: INFO: EPOCH 3 - PROGRESS: at 77.68% examples, 125216 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:08,645: INFO: EPOCH 3 - PROGRESS: at 78.17% examples, 125175 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:09,695: INFO: EPOCH 3 - PROGRESS: at 78.65% examples, 125176 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:10,714: INFO: EPOCH 3 - PROGRESS: at 79.14% examples, 125138 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:11,758: INFO: EPOCH 3 - PROGRESS: at 79.62% examples, 125083 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:12,760: INFO: EPOCH 3 - PROGRESS: at 80.04% examples, 125070 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:13,769: INFO: EPOCH 3 - PROGRESS: at 80.63% examples, 125048 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:14,772: INFO: EPOCH 3 - PROGRESS: at 81.14% examples, 124991 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:35:15,782: INFO: EPOCH 3 - PROGRESS: at 81.60% examples, 124974 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:16,811: INFO: EPOCH 3 - PROGRESS: at 82.11% examples, 124941 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:17,822: INFO: EPOCH 3 - PROGRESS: at 82.55% examples, 124938 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:18,867: INFO: EPOCH 3 - PROGRESS: at 83.06% examples, 124940 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:19,899: INFO: EPOCH 3 - PROGRESS: at 83.59% examples, 124906 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:20,917: INFO: EPOCH 3 - PROGRESS: at 84.03% examples, 124889 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:21,920: INFO: EPOCH 3 - PROGRESS: at 84.46% examples, 124832 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:22,938: INFO: EPOCH 3 - PROGRESS: at 84.91% examples, 124802 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:35:23,986: INFO: EPOCH 3 - PROGRESS: at 85.37% examples, 124754 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:24,992: INFO: EPOCH 3 - PROGRESS: at 85.84% examples, 124737 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:26,029: INFO: EPOCH 3 - PROGRESS: at 86.31% examples, 124692 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:27,055: INFO: EPOCH 3 - PROGRESS: at 87.06% examples, 124645 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:28,127: INFO: EPOCH 3 - PROGRESS: at 87.54% examples, 124623 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:29,184: INFO: EPOCH 3 - PROGRESS: at 88.06% examples, 124613 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:30,206: INFO: EPOCH 3 - PROGRESS: at 88.50% examples, 124580 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:31,231: INFO: EPOCH 3 - PROGRESS: at 88.97% examples, 124554 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:32,273: INFO: EPOCH 3 - PROGRESS: at 89.44% examples, 124514 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:35:33,317: INFO: EPOCH 3 - PROGRESS: at 90.06% examples, 124461 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:34,350: INFO: EPOCH 3 - PROGRESS: at 90.61% examples, 124426 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:35,360: INFO: EPOCH 3 - PROGRESS: at 91.07% examples, 124399 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:36,380: INFO: EPOCH 3 - PROGRESS: at 91.50% examples, 124377 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:37,460: INFO: EPOCH 3 - PROGRESS: at 92.03% examples, 124316 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:38,468: INFO: EPOCH 3 - PROGRESS: at 92.49% examples, 124317 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:39,532: INFO: EPOCH 3 - PROGRESS: at 92.96% examples, 124270 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:40,578: INFO: EPOCH 3 - PROGRESS: at 93.42% examples, 124241 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:41,637: INFO: EPOCH 3 - PROGRESS: at 93.92% examples, 124198 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:42,694: INFO: EPOCH 3 - PROGRESS: at 94.62% examples, 124134 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:43,732: INFO: EPOCH 3 - PROGRESS: at 95.13% examples, 124110 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:44,784: INFO: EPOCH 3 - PROGRESS: at 95.65% examples, 124079 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:35:45,815: INFO: EPOCH 3 - PROGRESS: at 96.13% examples, 124067 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:46,846: INFO: EPOCH 3 - PROGRESS: at 96.61% examples, 124011 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:35:47,930: INFO: EPOCH 3 - PROGRESS: at 97.11% examples, 123954 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:48,993: INFO: EPOCH 3 - PROGRESS: at 97.68% examples, 123916 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:50,035: INFO: EPOCH 3 - PROGRESS: at 98.12% examples, 123893 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:51,043: INFO: EPOCH 3 - PROGRESS: at 98.62% examples, 123879 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:52,080: INFO: EPOCH 3 - PROGRESS: at 99.08% examples, 123857 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:53,095: INFO: EPOCH 3 - PROGRESS: at 99.53% examples, 123856 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:35:54,006: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-15 17:35:54,008: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-15 17:35:54,010: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-15 17:35:54,012: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-15 17:35:54,015: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-15 17:35:54,018: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-15 17:35:54,084: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-15 17:35:54,086: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-15 17:35:54,088: INFO: EPOCH - 3 : training on 34032167 raw words (24721469 effective words) took 199.6s, 123853 effective words/s\n",
      "2018-05-15 17:35:55,180: INFO: EPOCH 4 - PROGRESS: at 0.52% examples, 112731 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:56,201: INFO: EPOCH 4 - PROGRESS: at 1.06% examples, 115592 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:57,218: INFO: EPOCH 4 - PROGRESS: at 1.56% examples, 117203 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:58,229: INFO: EPOCH 4 - PROGRESS: at 2.02% examples, 118338 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:35:59,284: INFO: EPOCH 4 - PROGRESS: at 2.43% examples, 118157 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:00,324: INFO: EPOCH 4 - PROGRESS: at 2.91% examples, 118601 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:01,380: INFO: EPOCH 4 - PROGRESS: at 3.40% examples, 118471 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:02,395: INFO: EPOCH 4 - PROGRESS: at 3.83% examples, 118887 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:03,397: INFO: EPOCH 4 - PROGRESS: at 4.32% examples, 118560 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:04,452: INFO: EPOCH 4 - PROGRESS: at 4.80% examples, 118392 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:05,457: INFO: EPOCH 4 - PROGRESS: at 5.26% examples, 117562 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:06,507: INFO: EPOCH 4 - PROGRESS: at 5.79% examples, 117543 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:07,528: INFO: EPOCH 4 - PROGRESS: at 6.35% examples, 117804 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:08,570: INFO: EPOCH 4 - PROGRESS: at 6.83% examples, 117925 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:09,594: INFO: EPOCH 4 - PROGRESS: at 7.26% examples, 118186 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:10,657: INFO: EPOCH 4 - PROGRESS: at 7.97% examples, 117988 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:11,734: INFO: EPOCH 4 - PROGRESS: at 8.43% examples, 117856 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:12,783: INFO: EPOCH 4 - PROGRESS: at 8.95% examples, 117842 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:13,832: INFO: EPOCH 4 - PROGRESS: at 9.55% examples, 117793 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:14,853: INFO: EPOCH 4 - PROGRESS: at 10.07% examples, 118318 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:15,861: INFO: EPOCH 4 - PROGRESS: at 10.52% examples, 118251 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:16,918: INFO: EPOCH 4 - PROGRESS: at 11.09% examples, 118281 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:17,969: INFO: EPOCH 4 - PROGRESS: at 11.55% examples, 118288 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:19,017: INFO: EPOCH 4 - PROGRESS: at 12.03% examples, 118598 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:20,101: INFO: EPOCH 4 - PROGRESS: at 12.64% examples, 118416 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:21,182: INFO: EPOCH 4 - PROGRESS: at 13.08% examples, 118002 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:22,197: INFO: EPOCH 4 - PROGRESS: at 13.51% examples, 118200 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:23,206: INFO: EPOCH 4 - PROGRESS: at 13.97% examples, 118395 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:24,223: INFO: EPOCH 4 - PROGRESS: at 14.43% examples, 118425 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:25,235: INFO: EPOCH 4 - PROGRESS: at 14.91% examples, 118505 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:26,283: INFO: EPOCH 4 - PROGRESS: at 15.44% examples, 118456 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:27,329: INFO: EPOCH 4 - PROGRESS: at 15.92% examples, 118399 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:28,374: INFO: EPOCH 4 - PROGRESS: at 16.31% examples, 117316 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:29,378: INFO: EPOCH 4 - PROGRESS: at 16.78% examples, 117200 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:30,483: INFO: EPOCH 4 - PROGRESS: at 17.17% examples, 116369 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:31,532: INFO: EPOCH 4 - PROGRESS: at 17.79% examples, 116163 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:32,566: INFO: EPOCH 4 - PROGRESS: at 18.28% examples, 116178 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:33,573: INFO: EPOCH 4 - PROGRESS: at 18.73% examples, 116117 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:34,652: INFO: EPOCH 4 - PROGRESS: at 19.25% examples, 116013 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:35,703: INFO: EPOCH 4 - PROGRESS: at 19.79% examples, 116022 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:36,718: INFO: EPOCH 4 - PROGRESS: at 20.26% examples, 115911 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:37,742: INFO: EPOCH 4 - PROGRESS: at 20.75% examples, 115863 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:38,780: INFO: EPOCH 4 - PROGRESS: at 21.23% examples, 115732 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:39,871: INFO: EPOCH 4 - PROGRESS: at 21.61% examples, 115200 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:40,873: INFO: EPOCH 4 - PROGRESS: at 21.93% examples, 114432 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:41,908: INFO: EPOCH 4 - PROGRESS: at 22.31% examples, 114219 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:42,957: INFO: EPOCH 4 - PROGRESS: at 22.82% examples, 114548 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:43,996: INFO: EPOCH 4 - PROGRESS: at 23.36% examples, 114905 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:45,018: INFO: EPOCH 4 - PROGRESS: at 23.92% examples, 115271 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:46,066: INFO: EPOCH 4 - PROGRESS: at 24.49% examples, 115579 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:47,123: INFO: EPOCH 4 - PROGRESS: at 25.13% examples, 115868 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:48,173: INFO: EPOCH 4 - PROGRESS: at 25.68% examples, 116141 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:49,202: INFO: EPOCH 4 - PROGRESS: at 26.19% examples, 116445 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:50,244: INFO: EPOCH 4 - PROGRESS: at 26.81% examples, 116684 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:51,274: INFO: EPOCH 4 - PROGRESS: at 27.42% examples, 116969 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:52,327: INFO: EPOCH 4 - PROGRESS: at 27.98% examples, 117197 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:53,336: INFO: EPOCH 4 - PROGRESS: at 28.59% examples, 117484 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:54,378: INFO: EPOCH 4 - PROGRESS: at 29.11% examples, 117692 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:55,411: INFO: EPOCH 4 - PROGRESS: at 29.77% examples, 117933 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:56,447: INFO: EPOCH 4 - PROGRESS: at 30.44% examples, 118140 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:57,506: INFO: EPOCH 4 - PROGRESS: at 30.97% examples, 118198 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:36:58,546: INFO: EPOCH 4 - PROGRESS: at 31.62% examples, 118398 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:36:59,586: INFO: EPOCH 4 - PROGRESS: at 32.15% examples, 118589 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:00,602: INFO: EPOCH 4 - PROGRESS: at 32.67% examples, 118706 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:01,608: INFO: EPOCH 4 - PROGRESS: at 33.19% examples, 118618 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:02,622: INFO: EPOCH 4 - PROGRESS: at 33.41% examples, 117788 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:03,642: INFO: EPOCH 4 - PROGRESS: at 33.87% examples, 117603 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:04,691: INFO: EPOCH 4 - PROGRESS: at 34.36% examples, 117586 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:05,781: INFO: EPOCH 4 - PROGRESS: at 34.90% examples, 117510 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:06,790: INFO: EPOCH 4 - PROGRESS: at 35.39% examples, 117455 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:07,807: INFO: EPOCH 4 - PROGRESS: at 35.85% examples, 117414 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:08,825: INFO: EPOCH 4 - PROGRESS: at 36.37% examples, 117579 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:09,840: INFO: EPOCH 4 - PROGRESS: at 36.91% examples, 117720 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:10,851: INFO: EPOCH 4 - PROGRESS: at 37.43% examples, 117891 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:11,892: INFO: EPOCH 4 - PROGRESS: at 38.07% examples, 118080 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:12,903: INFO: EPOCH 4 - PROGRESS: at 38.67% examples, 118247 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:13,939: INFO: EPOCH 4 - PROGRESS: at 39.20% examples, 118369 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:14,964: INFO: EPOCH 4 - PROGRESS: at 39.75% examples, 118581 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:15,978: INFO: EPOCH 4 - PROGRESS: at 40.25% examples, 118726 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:16,981: INFO: EPOCH 4 - PROGRESS: at 40.70% examples, 118615 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:18,005: INFO: EPOCH 4 - PROGRESS: at 41.21% examples, 118471 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:19,035: INFO: EPOCH 4 - PROGRESS: at 41.51% examples, 117986 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:20,035: INFO: EPOCH 4 - PROGRESS: at 41.87% examples, 117718 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:21,083: INFO: EPOCH 4 - PROGRESS: at 42.28% examples, 117486 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:22,120: INFO: EPOCH 4 - PROGRESS: at 42.68% examples, 117270 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:23,149: INFO: EPOCH 4 - PROGRESS: at 43.05% examples, 116983 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:24,152: INFO: EPOCH 4 - PROGRESS: at 43.33% examples, 116406 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:25,251: INFO: EPOCH 4 - PROGRESS: at 43.62% examples, 115891 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:26,255: INFO: EPOCH 4 - PROGRESS: at 43.90% examples, 115504 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:27,333: INFO: EPOCH 4 - PROGRESS: at 44.24% examples, 115015 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:28,410: INFO: EPOCH 4 - PROGRESS: at 44.53% examples, 114491 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:29,417: INFO: EPOCH 4 - PROGRESS: at 44.77% examples, 113981 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:30,487: INFO: EPOCH 4 - PROGRESS: at 44.93% examples, 113180 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:31,550: INFO: EPOCH 4 - PROGRESS: at 45.16% examples, 112537 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:32,551: INFO: EPOCH 4 - PROGRESS: at 45.40% examples, 112054 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:33,596: INFO: EPOCH 4 - PROGRESS: at 45.82% examples, 112002 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:34,623: INFO: EPOCH 4 - PROGRESS: at 46.26% examples, 111954 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:35,646: INFO: EPOCH 4 - PROGRESS: at 46.71% examples, 111921 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:36,676: INFO: EPOCH 4 - PROGRESS: at 47.17% examples, 111951 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:37,706: INFO: EPOCH 4 - PROGRESS: at 47.57% examples, 111886 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:38,761: INFO: EPOCH 4 - PROGRESS: at 48.04% examples, 111879 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:39,787: INFO: EPOCH 4 - PROGRESS: at 48.45% examples, 111824 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:40,846: INFO: EPOCH 4 - PROGRESS: at 48.87% examples, 111760 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:41,901: INFO: EPOCH 4 - PROGRESS: at 49.26% examples, 111672 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:42,950: INFO: EPOCH 4 - PROGRESS: at 49.80% examples, 111730 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:43,951: INFO: EPOCH 4 - PROGRESS: at 50.22% examples, 111715 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:45,046: INFO: EPOCH 4 - PROGRESS: at 50.59% examples, 111540 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:46,125: INFO: EPOCH 4 - PROGRESS: at 50.99% examples, 111392 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:47,204: INFO: EPOCH 4 - PROGRESS: at 51.46% examples, 111099 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:48,292: INFO: EPOCH 4 - PROGRESS: at 51.75% examples, 110752 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:49,307: INFO: EPOCH 4 - PROGRESS: at 52.07% examples, 110482 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:50,357: INFO: EPOCH 4 - PROGRESS: at 52.45% examples, 110240 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:51,402: INFO: EPOCH 4 - PROGRESS: at 52.91% examples, 110198 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:52,433: INFO: EPOCH 4 - PROGRESS: at 53.43% examples, 110229 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:53,473: INFO: EPOCH 4 - PROGRESS: at 53.94% examples, 110185 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:54,522: INFO: EPOCH 4 - PROGRESS: at 54.44% examples, 110209 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:55,533: INFO: EPOCH 4 - PROGRESS: at 54.91% examples, 110206 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:56,599: INFO: EPOCH 4 - PROGRESS: at 55.45% examples, 110143 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:37:57,645: INFO: EPOCH 4 - PROGRESS: at 55.87% examples, 110111 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:58,657: INFO: EPOCH 4 - PROGRESS: at 56.32% examples, 110104 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:37:59,674: INFO: EPOCH 4 - PROGRESS: at 56.76% examples, 110038 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:00,705: INFO: EPOCH 4 - PROGRESS: at 57.22% examples, 110071 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:01,748: INFO: EPOCH 4 - PROGRESS: at 57.65% examples, 110040 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:02,774: INFO: EPOCH 4 - PROGRESS: at 58.11% examples, 110018 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:03,788: INFO: EPOCH 4 - PROGRESS: at 58.54% examples, 110014 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:04,818: INFO: EPOCH 4 - PROGRESS: at 59.14% examples, 110042 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:05,857: INFO: EPOCH 4 - PROGRESS: at 59.62% examples, 110069 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:06,885: INFO: EPOCH 4 - PROGRESS: at 60.07% examples, 110054 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:07,919: INFO: EPOCH 4 - PROGRESS: at 60.52% examples, 110086 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:08,926: INFO: EPOCH 4 - PROGRESS: at 60.95% examples, 110082 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:09,961: INFO: EPOCH 4 - PROGRESS: at 61.41% examples, 110061 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:11,053: INFO: EPOCH 4 - PROGRESS: at 61.79% examples, 109933 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:12,073: INFO: EPOCH 4 - PROGRESS: at 62.01% examples, 109484 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:13,075: INFO: EPOCH 4 - PROGRESS: at 62.38% examples, 109367 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:14,122: INFO: EPOCH 4 - PROGRESS: at 62.82% examples, 109327 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:15,200: INFO: EPOCH 4 - PROGRESS: at 63.15% examples, 109200 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:16,253: INFO: EPOCH 4 - PROGRESS: at 63.48% examples, 109007 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:17,277: INFO: EPOCH 4 - PROGRESS: at 63.90% examples, 109040 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:18,327: INFO: EPOCH 4 - PROGRESS: at 64.43% examples, 108985 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:19,329: INFO: EPOCH 4 - PROGRESS: at 64.84% examples, 108977 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:20,336: INFO: EPOCH 4 - PROGRESS: at 65.18% examples, 108780 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:21,374: INFO: EPOCH 4 - PROGRESS: at 65.51% examples, 108649 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:22,415: INFO: EPOCH 4 - PROGRESS: at 65.91% examples, 108659 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:23,480: INFO: EPOCH 4 - PROGRESS: at 66.33% examples, 108652 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:24,488: INFO: EPOCH 4 - PROGRESS: at 66.81% examples, 108639 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:25,562: INFO: EPOCH 4 - PROGRESS: at 67.24% examples, 108630 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:26,578: INFO: EPOCH 4 - PROGRESS: at 67.66% examples, 108606 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:27,587: INFO: EPOCH 4 - PROGRESS: at 68.10% examples, 108647 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:28,622: INFO: EPOCH 4 - PROGRESS: at 68.49% examples, 108619 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:29,763: INFO: EPOCH 4 - PROGRESS: at 68.72% examples, 108288 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:30,786: INFO: EPOCH 4 - PROGRESS: at 69.01% examples, 108056 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:31,811: INFO: EPOCH 4 - PROGRESS: at 69.42% examples, 108032 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:32,857: INFO: EPOCH 4 - PROGRESS: at 69.82% examples, 107921 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:33,900: INFO: EPOCH 4 - PROGRESS: at 70.16% examples, 107804 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:34,908: INFO: EPOCH 4 - PROGRESS: at 70.59% examples, 107804 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:35,984: INFO: EPOCH 4 - PROGRESS: at 71.07% examples, 107787 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:37,061: INFO: EPOCH 4 - PROGRESS: at 71.36% examples, 107557 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:38,083: INFO: EPOCH 4 - PROGRESS: at 71.63% examples, 107321 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:39,129: INFO: EPOCH 4 - PROGRESS: at 71.86% examples, 106947 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:40,202: INFO: EPOCH 4 - PROGRESS: at 72.15% examples, 106787 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:41,306: INFO: EPOCH 4 - PROGRESS: at 72.45% examples, 106601 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:42,460: INFO: EPOCH 4 - PROGRESS: at 72.65% examples, 106209 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:43,568: INFO: EPOCH 4 - PROGRESS: at 72.90% examples, 105929 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:44,608: INFO: EPOCH 4 - PROGRESS: at 73.25% examples, 105792 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:45,634: INFO: EPOCH 4 - PROGRESS: at 73.58% examples, 105666 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:46,635: INFO: EPOCH 4 - PROGRESS: at 73.90% examples, 105598 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:47,651: INFO: EPOCH 4 - PROGRESS: at 74.31% examples, 105560 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:48,702: INFO: EPOCH 4 - PROGRESS: at 74.71% examples, 105419 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:49,726: INFO: EPOCH 4 - PROGRESS: at 75.01% examples, 105258 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:50,799: INFO: EPOCH 4 - PROGRESS: at 75.33% examples, 105112 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:51,816: INFO: EPOCH 4 - PROGRESS: at 75.65% examples, 104956 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:52,869: INFO: EPOCH 4 - PROGRESS: at 76.04% examples, 104737 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:53,878: INFO: EPOCH 4 - PROGRESS: at 76.30% examples, 104509 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:54,898: INFO: EPOCH 4 - PROGRESS: at 76.59% examples, 104356 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:55,954: INFO: EPOCH 4 - PROGRESS: at 76.88% examples, 104218 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:56,990: INFO: EPOCH 4 - PROGRESS: at 77.28% examples, 104174 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:38:57,995: INFO: EPOCH 4 - PROGRESS: at 77.57% examples, 104108 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:38:59,053: INFO: EPOCH 4 - PROGRESS: at 77.94% examples, 103979 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:00,097: INFO: EPOCH 4 - PROGRESS: at 78.20% examples, 103822 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:01,167: INFO: EPOCH 4 - PROGRESS: at 78.53% examples, 103738 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:02,180: INFO: EPOCH 4 - PROGRESS: at 78.79% examples, 103563 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:03,240: INFO: EPOCH 4 - PROGRESS: at 79.20% examples, 103474 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:04,256: INFO: EPOCH 4 - PROGRESS: at 79.54% examples, 103378 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:05,314: INFO: EPOCH 4 - PROGRESS: at 79.91% examples, 103368 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:39:06,405: INFO: EPOCH 4 - PROGRESS: at 80.26% examples, 103278 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:07,453: INFO: EPOCH 4 - PROGRESS: at 80.84% examples, 103198 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:08,511: INFO: EPOCH 4 - PROGRESS: at 81.10% examples, 103014 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:09,583: INFO: EPOCH 4 - PROGRESS: at 81.46% examples, 102966 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:10,605: INFO: EPOCH 4 - PROGRESS: at 81.77% examples, 102837 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:11,672: INFO: EPOCH 4 - PROGRESS: at 82.11% examples, 102685 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:12,697: INFO: EPOCH 4 - PROGRESS: at 82.37% examples, 102527 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:13,794: INFO: EPOCH 4 - PROGRESS: at 82.59% examples, 102298 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:14,861: INFO: EPOCH 4 - PROGRESS: at 83.01% examples, 102259 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:15,874: INFO: EPOCH 4 - PROGRESS: at 83.32% examples, 102140 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:16,932: INFO: EPOCH 4 - PROGRESS: at 83.68% examples, 102042 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:17,940: INFO: EPOCH 4 - PROGRESS: at 84.08% examples, 102073 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:39:19,081: INFO: EPOCH 4 - PROGRESS: at 84.40% examples, 101929 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:20,127: INFO: EPOCH 4 - PROGRESS: at 84.72% examples, 101828 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:21,128: INFO: EPOCH 4 - PROGRESS: at 85.05% examples, 101752 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:22,181: INFO: EPOCH 4 - PROGRESS: at 85.45% examples, 101757 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:23,235: INFO: EPOCH 4 - PROGRESS: at 85.81% examples, 101693 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:24,288: INFO: EPOCH 4 - PROGRESS: at 86.08% examples, 101527 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:25,342: INFO: EPOCH 4 - PROGRESS: at 86.34% examples, 101321 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:26,422: INFO: EPOCH 4 - PROGRESS: at 86.96% examples, 101199 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:27,502: INFO: EPOCH 4 - PROGRESS: at 87.36% examples, 101202 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:28,535: INFO: EPOCH 4 - PROGRESS: at 87.80% examples, 101252 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:39:29,561: INFO: EPOCH 4 - PROGRESS: at 88.16% examples, 101202 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:30,603: INFO: EPOCH 4 - PROGRESS: at 88.53% examples, 101174 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:31,666: INFO: EPOCH 4 - PROGRESS: at 88.97% examples, 101214 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:32,756: INFO: EPOCH 4 - PROGRESS: at 89.18% examples, 100972 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:33,776: INFO: EPOCH 4 - PROGRESS: at 89.50% examples, 100866 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:39:34,805: INFO: EPOCH 4 - PROGRESS: at 89.83% examples, 100817 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:35,935: INFO: EPOCH 4 - PROGRESS: at 90.32% examples, 100588 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:37,006: INFO: EPOCH 4 - PROGRESS: at 90.66% examples, 100491 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:38,018: INFO: EPOCH 4 - PROGRESS: at 90.97% examples, 100389 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:39,081: INFO: EPOCH 4 - PROGRESS: at 91.25% examples, 100265 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:40,158: INFO: EPOCH 4 - PROGRESS: at 91.50% examples, 100108 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:41,216: INFO: EPOCH 4 - PROGRESS: at 92.00% examples, 100151 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:42,221: INFO: EPOCH 4 - PROGRESS: at 92.33% examples, 100096 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:43,323: INFO: EPOCH 4 - PROGRESS: at 92.68% examples, 100032 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:44,466: INFO: EPOCH 4 - PROGRESS: at 93.11% examples, 100009 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:39:45,581: INFO: EPOCH 4 - PROGRESS: at 93.34% examples, 99812 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:46,593: INFO: EPOCH 4 - PROGRESS: at 93.67% examples, 99722 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:47,600: INFO: EPOCH 4 - PROGRESS: at 93.96% examples, 99602 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:48,647: INFO: EPOCH 4 - PROGRESS: at 94.51% examples, 99509 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:39:49,698: INFO: EPOCH 4 - PROGRESS: at 94.84% examples, 99413 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:50,726: INFO: EPOCH 4 - PROGRESS: at 95.07% examples, 99226 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:51,773: INFO: EPOCH 4 - PROGRESS: at 95.30% examples, 99036 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:52,813: INFO: EPOCH 4 - PROGRESS: at 95.60% examples, 98881 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:53,858: INFO: EPOCH 4 - PROGRESS: at 95.85% examples, 98727 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:39:54,889: INFO: EPOCH 4 - PROGRESS: at 96.11% examples, 98580 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:55,911: INFO: EPOCH 4 - PROGRESS: at 96.33% examples, 98404 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:56,998: INFO: EPOCH 4 - PROGRESS: at 96.58% examples, 98204 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:58,055: INFO: EPOCH 4 - PROGRESS: at 96.85% examples, 98046 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:39:59,158: INFO: EPOCH 4 - PROGRESS: at 97.11% examples, 97874 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:00,226: INFO: EPOCH 4 - PROGRESS: at 97.40% examples, 97748 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:01,288: INFO: EPOCH 4 - PROGRESS: at 97.77% examples, 97621 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:02,397: INFO: EPOCH 4 - PROGRESS: at 98.01% examples, 97479 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:03,492: INFO: EPOCH 4 - PROGRESS: at 98.28% examples, 97344 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:04,541: INFO: EPOCH 4 - PROGRESS: at 98.55% examples, 97196 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:05,671: INFO: EPOCH 4 - PROGRESS: at 98.81% examples, 97019 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:06,743: INFO: EPOCH 4 - PROGRESS: at 99.08% examples, 96895 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:07,752: INFO: EPOCH 4 - PROGRESS: at 99.30% examples, 96745 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:08,861: INFO: EPOCH 4 - PROGRESS: at 99.51% examples, 96555 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:09,929: INFO: EPOCH 4 - PROGRESS: at 99.83% examples, 96494 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:10,185: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-15 17:40:10,190: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-15 17:40:10,192: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-15 17:40:10,195: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-15 17:40:10,198: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-15 17:40:10,201: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-15 17:40:10,274: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-15 17:40:10,276: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-15 17:40:10,278: INFO: EPOCH - 4 : training on 34032167 raw words (24722180 effective words) took 256.1s, 96526 effective words/s\n",
      "2018-05-15 17:40:11,395: INFO: EPOCH 5 - PROGRESS: at 0.43% examples, 98217 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:12,408: INFO: EPOCH 5 - PROGRESS: at 0.94% examples, 97613 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:13,494: INFO: EPOCH 5 - PROGRESS: at 1.24% examples, 89395 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:14,548: INFO: EPOCH 5 - PROGRESS: at 1.56% examples, 85585 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:15,592: INFO: EPOCH 5 - PROGRESS: at 1.75% examples, 78242 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:16,631: INFO: EPOCH 5 - PROGRESS: at 1.99% examples, 75662 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:17,684: INFO: EPOCH 5 - PROGRESS: at 2.18% examples, 71833 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:18,908: INFO: EPOCH 5 - PROGRESS: at 2.35% examples, 68307 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:19,957: INFO: EPOCH 5 - PROGRESS: at 2.51% examples, 65475 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:21,143: INFO: EPOCH 5 - PROGRESS: at 2.63% examples, 61011 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:22,270: INFO: EPOCH 5 - PROGRESS: at 2.89% examples, 60771 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:23,354: INFO: EPOCH 5 - PROGRESS: at 3.13% examples, 60759 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:24,440: INFO: EPOCH 5 - PROGRESS: at 3.43% examples, 61273 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:25,498: INFO: EPOCH 5 - PROGRESS: at 3.67% examples, 61787 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:26,520: INFO: EPOCH 5 - PROGRESS: at 3.88% examples, 61476 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:27,590: INFO: EPOCH 5 - PROGRESS: at 4.16% examples, 61000 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:28,710: INFO: EPOCH 5 - PROGRESS: at 4.39% examples, 60485 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:29,806: INFO: EPOCH 5 - PROGRESS: at 4.61% examples, 60028 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:30,857: INFO: EPOCH 5 - PROGRESS: at 4.85% examples, 60155 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:31,958: INFO: EPOCH 5 - PROGRESS: at 5.14% examples, 60138 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:33,100: INFO: EPOCH 5 - PROGRESS: at 5.38% examples, 60002 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:34,168: INFO: EPOCH 5 - PROGRESS: at 5.68% examples, 59723 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:35,222: INFO: EPOCH 5 - PROGRESS: at 5.92% examples, 59559 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:36,335: INFO: EPOCH 5 - PROGRESS: at 6.15% examples, 59530 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:37,361: INFO: EPOCH 5 - PROGRESS: at 6.45% examples, 59465 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:38,468: INFO: EPOCH 5 - PROGRESS: at 6.70% examples, 59143 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:39,541: INFO: EPOCH 5 - PROGRESS: at 6.91% examples, 59002 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:40,609: INFO: EPOCH 5 - PROGRESS: at 7.11% examples, 58860 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:41,691: INFO: EPOCH 5 - PROGRESS: at 7.31% examples, 58710 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:42,755: INFO: EPOCH 5 - PROGRESS: at 7.50% examples, 58378 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:43,861: INFO: EPOCH 5 - PROGRESS: at 8.02% examples, 58561 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:44,878: INFO: EPOCH 5 - PROGRESS: at 8.30% examples, 59200 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:45,949: INFO: EPOCH 5 - PROGRESS: at 8.73% examples, 60243 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:47,016: INFO: EPOCH 5 - PROGRESS: at 9.11% examples, 61279 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:48,023: INFO: EPOCH 5 - PROGRESS: at 9.67% examples, 62322 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:49,076: INFO: EPOCH 5 - PROGRESS: at 10.07% examples, 63257 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:50,099: INFO: EPOCH 5 - PROGRESS: at 10.44% examples, 64038 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:51,155: INFO: EPOCH 5 - PROGRESS: at 10.88% examples, 64727 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:52,170: INFO: EPOCH 5 - PROGRESS: at 11.25% examples, 65451 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:53,184: INFO: EPOCH 5 - PROGRESS: at 11.67% examples, 66302 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:54,195: INFO: EPOCH 5 - PROGRESS: at 12.01% examples, 67098 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:55,281: INFO: EPOCH 5 - PROGRESS: at 12.52% examples, 67578 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:56,332: INFO: EPOCH 5 - PROGRESS: at 12.90% examples, 68237 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:40:57,361: INFO: EPOCH 5 - PROGRESS: at 13.28% examples, 69119 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:58,378: INFO: EPOCH 5 - PROGRESS: at 13.61% examples, 69636 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:40:59,395: INFO: EPOCH 5 - PROGRESS: at 14.01% examples, 70437 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:00,468: INFO: EPOCH 5 - PROGRESS: at 14.43% examples, 71062 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:01,486: INFO: EPOCH 5 - PROGRESS: at 14.82% examples, 71618 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:02,532: INFO: EPOCH 5 - PROGRESS: at 15.21% examples, 72132 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:03,551: INFO: EPOCH 5 - PROGRESS: at 15.67% examples, 72627 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:04,587: INFO: EPOCH 5 - PROGRESS: at 16.08% examples, 72972 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:05,606: INFO: EPOCH 5 - PROGRESS: at 16.46% examples, 73312 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:06,633: INFO: EPOCH 5 - PROGRESS: at 16.86% examples, 73745 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:07,707: INFO: EPOCH 5 - PROGRESS: at 17.37% examples, 74088 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:08,793: INFO: EPOCH 5 - PROGRESS: at 17.79% examples, 74313 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:09,798: INFO: EPOCH 5 - PROGRESS: at 18.14% examples, 74600 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:10,799: INFO: EPOCH 5 - PROGRESS: at 18.55% examples, 74901 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:11,828: INFO: EPOCH 5 - PROGRESS: at 18.92% examples, 75293 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:12,866: INFO: EPOCH 5 - PROGRESS: at 19.37% examples, 75627 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:13,899: INFO: EPOCH 5 - PROGRESS: at 19.79% examples, 75872 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:14,964: INFO: EPOCH 5 - PROGRESS: at 20.20% examples, 76055 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:15,989: INFO: EPOCH 5 - PROGRESS: at 20.56% examples, 76292 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:16,994: INFO: EPOCH 5 - PROGRESS: at 20.99% examples, 76647 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:17,996: INFO: EPOCH 5 - PROGRESS: at 21.36% examples, 76902 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:19,094: INFO: EPOCH 5 - PROGRESS: at 21.77% examples, 77146 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:20,154: INFO: EPOCH 5 - PROGRESS: at 22.13% examples, 77430 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:21,180: INFO: EPOCH 5 - PROGRESS: at 22.49% examples, 77628 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:22,203: INFO: EPOCH 5 - PROGRESS: at 22.88% examples, 78017 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:23,205: INFO: EPOCH 5 - PROGRESS: at 23.27% examples, 78328 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:24,217: INFO: EPOCH 5 - PROGRESS: at 23.66% examples, 78524 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:25,231: INFO: EPOCH 5 - PROGRESS: at 24.07% examples, 78788 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:26,265: INFO: EPOCH 5 - PROGRESS: at 24.49% examples, 79048 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:27,284: INFO: EPOCH 5 - PROGRESS: at 24.95% examples, 79423 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:28,376: INFO: EPOCH 5 - PROGRESS: at 25.42% examples, 79587 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:29,400: INFO: EPOCH 5 - PROGRESS: at 25.81% examples, 79824 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:30,460: INFO: EPOCH 5 - PROGRESS: at 26.19% examples, 80025 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:31,485: INFO: EPOCH 5 - PROGRESS: at 26.63% examples, 80144 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:32,557: INFO: EPOCH 5 - PROGRESS: at 27.06% examples, 80323 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:33,564: INFO: EPOCH 5 - PROGRESS: at 27.48% examples, 80470 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:34,584: INFO: EPOCH 5 - PROGRESS: at 27.86% examples, 80604 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:35,690: INFO: EPOCH 5 - PROGRESS: at 28.28% examples, 80559 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:36,774: INFO: EPOCH 5 - PROGRESS: at 28.54% examples, 80292 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:37,816: INFO: EPOCH 5 - PROGRESS: at 28.88% examples, 80321 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:38,822: INFO: EPOCH 5 - PROGRESS: at 29.27% examples, 80448 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:39,900: INFO: EPOCH 5 - PROGRESS: at 29.71% examples, 80519 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:40,982: INFO: EPOCH 5 - PROGRESS: at 30.08% examples, 80339 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:42,147: INFO: EPOCH 5 - PROGRESS: at 30.38% examples, 80024 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:43,189: INFO: EPOCH 5 - PROGRESS: at 30.78% examples, 80128 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:44,216: INFO: EPOCH 5 - PROGRESS: at 31.19% examples, 80313 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:45,257: INFO: EPOCH 5 - PROGRESS: at 31.62% examples, 80336 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:46,349: INFO: EPOCH 5 - PROGRESS: at 31.97% examples, 80314 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:47,405: INFO: EPOCH 5 - PROGRESS: at 32.21% examples, 80102 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:48,417: INFO: EPOCH 5 - PROGRESS: at 32.59% examples, 80215 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:49,505: INFO: EPOCH 5 - PROGRESS: at 32.83% examples, 79989 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:50,568: INFO: EPOCH 5 - PROGRESS: at 33.13% examples, 79698 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:51,610: INFO: EPOCH 5 - PROGRESS: at 33.41% examples, 79652 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:52,697: INFO: EPOCH 5 - PROGRESS: at 33.79% examples, 79642 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:53,711: INFO: EPOCH 5 - PROGRESS: at 34.15% examples, 79764 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:54,734: INFO: EPOCH 5 - PROGRESS: at 34.57% examples, 80022 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:41:55,762: INFO: EPOCH 5 - PROGRESS: at 35.12% examples, 80405 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:56,794: INFO: EPOCH 5 - PROGRESS: at 35.64% examples, 80771 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:57,813: INFO: EPOCH 5 - PROGRESS: at 36.13% examples, 81163 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:58,844: INFO: EPOCH 5 - PROGRESS: at 36.59% examples, 81456 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:41:59,890: INFO: EPOCH 5 - PROGRESS: at 37.09% examples, 81743 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:00,906: INFO: EPOCH 5 - PROGRESS: at 37.65% examples, 82036 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:01,970: INFO: EPOCH 5 - PROGRESS: at 38.13% examples, 82372 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:03,049: INFO: EPOCH 5 - PROGRESS: at 38.70% examples, 82698 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:04,050: INFO: EPOCH 5 - PROGRESS: at 39.17% examples, 83000 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:05,092: INFO: EPOCH 5 - PROGRESS: at 39.66% examples, 83330 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:06,108: INFO: EPOCH 5 - PROGRESS: at 40.15% examples, 83672 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:07,149: INFO: EPOCH 5 - PROGRESS: at 40.65% examples, 83993 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:08,173: INFO: EPOCH 5 - PROGRESS: at 41.02% examples, 83933 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:09,219: INFO: EPOCH 5 - PROGRESS: at 41.39% examples, 84002 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:10,243: INFO: EPOCH 5 - PROGRESS: at 41.87% examples, 84326 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:11,300: INFO: EPOCH 5 - PROGRESS: at 42.37% examples, 84626 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:12,307: INFO: EPOCH 5 - PROGRESS: at 42.85% examples, 84944 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:13,357: INFO: EPOCH 5 - PROGRESS: at 43.36% examples, 85229 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:14,404: INFO: EPOCH 5 - PROGRESS: at 43.77% examples, 85461 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:15,438: INFO: EPOCH 5 - PROGRESS: at 44.24% examples, 85676 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:16,439: INFO: EPOCH 5 - PROGRESS: at 44.68% examples, 85945 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:17,453: INFO: EPOCH 5 - PROGRESS: at 45.05% examples, 86011 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:18,526: INFO: EPOCH 5 - PROGRESS: at 45.51% examples, 86255 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:19,594: INFO: EPOCH 5 - PROGRESS: at 45.96% examples, 86461 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:20,620: INFO: EPOCH 5 - PROGRESS: at 46.44% examples, 86741 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:21,633: INFO: EPOCH 5 - PROGRESS: at 46.88% examples, 86861 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:22,653: INFO: EPOCH 5 - PROGRESS: at 47.25% examples, 86922 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:23,674: INFO: EPOCH 5 - PROGRESS: at 47.54% examples, 86848 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:24,748: INFO: EPOCH 5 - PROGRESS: at 47.97% examples, 86973 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:25,772: INFO: EPOCH 5 - PROGRESS: at 48.42% examples, 87172 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:26,798: INFO: EPOCH 5 - PROGRESS: at 48.75% examples, 87172 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:27,904: INFO: EPOCH 5 - PROGRESS: at 49.03% examples, 87006 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:28,969: INFO: EPOCH 5 - PROGRESS: at 49.23% examples, 86748 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:29,996: INFO: EPOCH 5 - PROGRESS: at 49.61% examples, 86736 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:31,032: INFO: EPOCH 5 - PROGRESS: at 49.93% examples, 86668 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:32,068: INFO: EPOCH 5 - PROGRESS: at 50.22% examples, 86553 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:33,092: INFO: EPOCH 5 - PROGRESS: at 50.59% examples, 86654 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:34,130: INFO: EPOCH 5 - PROGRESS: at 50.99% examples, 86750 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:35,175: INFO: EPOCH 5 - PROGRESS: at 51.54% examples, 86881 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:36,237: INFO: EPOCH 5 - PROGRESS: at 52.01% examples, 87108 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:37,305: INFO: EPOCH 5 - PROGRESS: at 52.51% examples, 87273 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:38,320: INFO: EPOCH 5 - PROGRESS: at 53.05% examples, 87514 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:39,382: INFO: EPOCH 5 - PROGRESS: at 53.56% examples, 87628 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:40,445: INFO: EPOCH 5 - PROGRESS: at 54.01% examples, 87690 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:41,471: INFO: EPOCH 5 - PROGRESS: at 54.50% examples, 87880 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:42,473: INFO: EPOCH 5 - PROGRESS: at 55.01% examples, 88079 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:43,522: INFO: EPOCH 5 - PROGRESS: at 55.55% examples, 88240 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:44,560: INFO: EPOCH 5 - PROGRESS: at 55.96% examples, 88319 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:45,568: INFO: EPOCH 5 - PROGRESS: at 56.49% examples, 88552 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:46,574: INFO: EPOCH 5 - PROGRESS: at 56.84% examples, 88548 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:47,624: INFO: EPOCH 5 - PROGRESS: at 57.11% examples, 88382 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:48,688: INFO: EPOCH 5 - PROGRESS: at 57.50% examples, 88439 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:49,717: INFO: EPOCH 5 - PROGRESS: at 57.86% examples, 88419 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:50,803: INFO: EPOCH 5 - PROGRESS: at 58.22% examples, 88374 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:51,859: INFO: EPOCH 5 - PROGRESS: at 58.60% examples, 88386 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:52,891: INFO: EPOCH 5 - PROGRESS: at 59.10% examples, 88411 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:53,948: INFO: EPOCH 5 - PROGRESS: at 59.57% examples, 88515 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:42:54,975: INFO: EPOCH 5 - PROGRESS: at 59.97% examples, 88595 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:55,993: INFO: EPOCH 5 - PROGRESS: at 60.36% examples, 88627 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:57,040: INFO: EPOCH 5 - PROGRESS: at 60.77% examples, 88735 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:58,055: INFO: EPOCH 5 - PROGRESS: at 61.20% examples, 88817 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:42:59,124: INFO: EPOCH 5 - PROGRESS: at 61.58% examples, 88866 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:00,133: INFO: EPOCH 5 - PROGRESS: at 62.01% examples, 88936 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:01,142: INFO: EPOCH 5 - PROGRESS: at 62.44% examples, 89040 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:43:02,195: INFO: EPOCH 5 - PROGRESS: at 62.88% examples, 89129 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:03,216: INFO: EPOCH 5 - PROGRESS: at 63.20% examples, 89182 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:04,252: INFO: EPOCH 5 - PROGRESS: at 63.65% examples, 89319 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:05,291: INFO: EPOCH 5 - PROGRESS: at 64.20% examples, 89447 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:06,310: INFO: EPOCH 5 - PROGRESS: at 64.58% examples, 89503 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:07,322: INFO: EPOCH 5 - PROGRESS: at 64.96% examples, 89566 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:08,335: INFO: EPOCH 5 - PROGRESS: at 65.35% examples, 89626 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:09,356: INFO: EPOCH 5 - PROGRESS: at 65.71% examples, 89673 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:43:10,388: INFO: EPOCH 5 - PROGRESS: at 66.06% examples, 89720 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:11,449: INFO: EPOCH 5 - PROGRESS: at 66.47% examples, 89786 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:12,486: INFO: EPOCH 5 - PROGRESS: at 66.97% examples, 89906 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:13,542: INFO: EPOCH 5 - PROGRESS: at 67.37% examples, 89980 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:14,567: INFO: EPOCH 5 - PROGRESS: at 67.78% examples, 90060 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:15,602: INFO: EPOCH 5 - PROGRESS: at 68.20% examples, 90144 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:16,643: INFO: EPOCH 5 - PROGRESS: at 68.57% examples, 90179 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:17,656: INFO: EPOCH 5 - PROGRESS: at 68.94% examples, 90246 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:18,702: INFO: EPOCH 5 - PROGRESS: at 69.34% examples, 90311 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:19,828: INFO: EPOCH 5 - PROGRESS: at 69.71% examples, 90237 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:20,881: INFO: EPOCH 5 - PROGRESS: at 69.99% examples, 90122 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:21,911: INFO: EPOCH 5 - PROGRESS: at 70.31% examples, 90090 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:43:22,951: INFO: EPOCH 5 - PROGRESS: at 70.72% examples, 90164 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:23,963: INFO: EPOCH 5 - PROGRESS: at 71.16% examples, 90244 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:24,998: INFO: EPOCH 5 - PROGRESS: at 71.55% examples, 90237 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:26,082: INFO: EPOCH 5 - PROGRESS: at 72.01% examples, 90371 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:27,130: INFO: EPOCH 5 - PROGRESS: at 72.39% examples, 90478 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:28,153: INFO: EPOCH 5 - PROGRESS: at 72.78% examples, 90550 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:29,218: INFO: EPOCH 5 - PROGRESS: at 73.20% examples, 90605 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:30,274: INFO: EPOCH 5 - PROGRESS: at 73.62% examples, 90707 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:31,312: INFO: EPOCH 5 - PROGRESS: at 74.05% examples, 90815 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:32,372: INFO: EPOCH 5 - PROGRESS: at 74.57% examples, 90909 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:33,395: INFO: EPOCH 5 - PROGRESS: at 74.98% examples, 90985 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:43:34,412: INFO: EPOCH 5 - PROGRESS: at 75.33% examples, 90994 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:35,420: INFO: EPOCH 5 - PROGRESS: at 75.58% examples, 90861 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:43:36,473: INFO: EPOCH 5 - PROGRESS: at 76.10% examples, 90884 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:37,518: INFO: EPOCH 5 - PROGRESS: at 76.51% examples, 90911 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:38,538: INFO: EPOCH 5 - PROGRESS: at 76.78% examples, 90872 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:39,560: INFO: EPOCH 5 - PROGRESS: at 77.18% examples, 90908 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:40,602: INFO: EPOCH 5 - PROGRESS: at 77.54% examples, 90965 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:41,651: INFO: EPOCH 5 - PROGRESS: at 77.97% examples, 91024 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:42,694: INFO: EPOCH 5 - PROGRESS: at 78.36% examples, 91124 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:43,745: INFO: EPOCH 5 - PROGRESS: at 78.74% examples, 91186 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:43:44,794: INFO: EPOCH 5 - PROGRESS: at 79.23% examples, 91275 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:45,856: INFO: EPOCH 5 - PROGRESS: at 79.71% examples, 91425 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:46,906: INFO: EPOCH 5 - PROGRESS: at 80.04% examples, 91419 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:47,965: INFO: EPOCH 5 - PROGRESS: at 80.63% examples, 91538 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:49,037: INFO: EPOCH 5 - PROGRESS: at 81.16% examples, 91655 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:50,078: INFO: EPOCH 5 - PROGRESS: at 81.57% examples, 91715 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:51,241: INFO: EPOCH 5 - PROGRESS: at 81.92% examples, 91627 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:52,307: INFO: EPOCH 5 - PROGRESS: at 82.35% examples, 91680 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:53,373: INFO: EPOCH 5 - PROGRESS: at 82.79% examples, 91737 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:54,429: INFO: EPOCH 5 - PROGRESS: at 83.22% examples, 91854 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:43:55,454: INFO: EPOCH 5 - PROGRESS: at 83.66% examples, 91893 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:56,464: INFO: EPOCH 5 - PROGRESS: at 83.97% examples, 91871 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:57,529: INFO: EPOCH 5 - PROGRESS: at 84.38% examples, 91919 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:58,539: INFO: EPOCH 5 - PROGRESS: at 84.77% examples, 91981 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:43:59,600: INFO: EPOCH 5 - PROGRESS: at 85.19% examples, 92028 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:00,621: INFO: EPOCH 5 - PROGRESS: at 85.58% examples, 92091 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:01,672: INFO: EPOCH 5 - PROGRESS: at 86.01% examples, 92138 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:02,703: INFO: EPOCH 5 - PROGRESS: at 86.49% examples, 92280 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:03,724: INFO: EPOCH 5 - PROGRESS: at 87.26% examples, 92395 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:04,755: INFO: EPOCH 5 - PROGRESS: at 87.74% examples, 92543 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:05,766: INFO: EPOCH 5 - PROGRESS: at 88.21% examples, 92662 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:06,773: INFO: EPOCH 5 - PROGRESS: at 88.65% examples, 92787 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:07,821: INFO: EPOCH 5 - PROGRESS: at 89.15% examples, 92920 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:08,840: INFO: EPOCH 5 - PROGRESS: at 89.66% examples, 93067 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:44:09,889: INFO: EPOCH 5 - PROGRESS: at 90.37% examples, 93191 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:44:10,933: INFO: EPOCH 5 - PROGRESS: at 90.89% examples, 93322 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:11,942: INFO: EPOCH 5 - PROGRESS: at 91.34% examples, 93468 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:44:12,990: INFO: EPOCH 5 - PROGRESS: at 91.85% examples, 93600 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:14,036: INFO: EPOCH 5 - PROGRESS: at 92.38% examples, 93741 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:44:15,064: INFO: EPOCH 5 - PROGRESS: at 92.85% examples, 93854 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:16,105: INFO: EPOCH 5 - PROGRESS: at 93.34% examples, 93993 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:17,121: INFO: EPOCH 5 - PROGRESS: at 93.84% examples, 94108 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:18,158: INFO: EPOCH 5 - PROGRESS: at 94.53% examples, 94193 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:19,206: INFO: EPOCH 5 - PROGRESS: at 95.07% examples, 94326 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:20,230: INFO: EPOCH 5 - PROGRESS: at 95.60% examples, 94439 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:21,249: INFO: EPOCH 5 - PROGRESS: at 96.08% examples, 94555 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:22,278: INFO: EPOCH 5 - PROGRESS: at 96.58% examples, 94662 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:44:23,295: INFO: EPOCH 5 - PROGRESS: at 97.08% examples, 94770 words/s, in_qsize 1, out_qsize 0\n",
      "2018-05-15 17:44:24,301: INFO: EPOCH 5 - PROGRESS: at 97.65% examples, 94885 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:25,325: INFO: EPOCH 5 - PROGRESS: at 98.09% examples, 94991 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:26,325: INFO: EPOCH 5 - PROGRESS: at 98.58% examples, 95100 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:27,381: INFO: EPOCH 5 - PROGRESS: at 99.08% examples, 95219 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:28,409: INFO: EPOCH 5 - PROGRESS: at 99.53% examples, 95326 words/s, in_qsize 0, out_qsize 0\n",
      "2018-05-15 17:44:29,285: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-15 17:44:29,287: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-15 17:44:29,288: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-15 17:44:29,290: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-15 17:44:29,292: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-15 17:44:29,294: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-15 17:44:29,370: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-15 17:44:29,378: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-15 17:44:29,379: INFO: EPOCH - 5 : training on 34032167 raw words (24720880 effective words) took 259.0s, 95441 effective words/s\n",
      "2018-05-15 17:44:29,381: INFO: training on a 170160835 raw words (123606782 effective words) took 1145.0s, 107950 effective words/s\n",
      "2018-05-15 17:44:29,397: INFO: saving Word2Vec object under embedding_models/modelword2vecbigram.model, separately None\n",
      "2018-05-15 17:44:29,418: INFO: storing np array 'vectors' to embedding_models/modelword2vecbigram.model.wv.vectors.npy\n",
      "2018-05-15 17:44:30,169: INFO: not storing attribute vectors_norm\n",
      "2018-05-15 17:44:30,196: INFO: storing np array 'syn1neg' to embedding_models/modelword2vecbigram.model.trainables.syn1neg.npy\n",
      "2018-05-15 17:44:30,905: INFO: not storing attribute cum_table\n",
      "2018-05-15 17:44:33,697: INFO: saved embedding_models/modelword2vecbigram.model\n",
      "2018-05-15 17:44:33,700: INFO: storing 687891x100 projection weights into embedding_models/modelword2vecbigram.vec\n"
     ]
    }
   ],
   "source": [
    "%run data_preparation/train_word2vec.py data/data2vec.txt embedding_models/modelword2vecbigram.model embedding_models/modelword2vecbigram.vec"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we select the sentences from the full text and use them for the doc2vec training. Once again, we can run the command from your Python console or directly here, using the magic `%run` syntax. The structure of this command is as follows:\n",
    "\n",
    "`%run script_to_run training_data model_output`\n",
    "\n",
    "This also took some time."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "C:\\Users\\mvall\\Anaconda3\\lib\\site-packages\\gensim\\utils.py:1197: UserWarning: detected Windows; aliasing chunkize to chunkize_serial\n",
      "  warnings.warn(\"detected Windows; aliasing chunkize to chunkize_serial\")\n",
      "2018-05-16 10:08:22,798: INFO: running data_preparation/train_doc2vec.py data/data2vec.txt embedding_models/doc2vec.model\n",
      "2018-05-16 10:09:38,589: INFO: collecting all words and their counts\n",
      "C:\\Users\\mvall\\PycharmProjects\\SmartPub-TSENER\\data_preparation\\train_doc2vec.py:45: DeprecationWarning: Call to deprecated `LabeledSentence` (Class will be removed in 4.0.0, use TaggedDocument instead).\n",
      "  yield LabeledSentence(words=doc.split(), tags=[self.labels_list[idx]])\n",
      "2018-05-16 10:09:38,591: INFO: PROGRESS: at example #0, processed 0 words (0/s), 0 word types, 0 tags\n",
      "2018-05-16 10:09:38,702: INFO: PROGRESS: at example #10000, processed 162831 words (1479995/s), 18123 word types, 10000 tags\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1897215\n",
      "1897215\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "2018-05-16 10:09:38,808: INFO: PROGRESS: at example #20000, processed 316533 words (1467065/s), 33211 word types, 20000 tags\n",
      "2018-05-16 10:09:38,931: INFO: PROGRESS: at example #30000, processed 493736 words (1452716/s), 48068 word types, 30000 tags\n",
      "2018-05-16 10:09:39,054: INFO: PROGRESS: at example #40000, processed 692599 words (1627814/s), 63748 word types, 40000 tags\n",
      "2018-05-16 10:09:39,176: INFO: PROGRESS: at example #50000, processed 903639 words (1751362/s), 79018 word types, 50000 tags\n",
      "2018-05-16 10:09:39,299: INFO: PROGRESS: at example #60000, processed 1095945 words (1570394/s), 91547 word types, 60000 tags\n",
      "2018-05-16 10:09:39,416: INFO: PROGRESS: at example #70000, processed 1291450 words (1682320/s), 102646 word types, 70000 tags\n",
      "2018-05-16 10:09:39,532: INFO: PROGRESS: at example #80000, processed 1464803 words (1518706/s), 114144 word types, 80000 tags\n",
      "2018-05-16 10:09:39,649: INFO: PROGRESS: at example #90000, processed 1657208 words (1660514/s), 125392 word types, 90000 tags\n",
      "2018-05-16 10:09:39,764: INFO: PROGRESS: at example #100000, processed 1836534 words (1564658/s), 136668 word types, 100000 tags\n",
      "2018-05-16 10:09:39,877: INFO: PROGRESS: at example #110000, processed 2005494 words (1510968/s), 148054 word types, 110000 tags\n",
      "2018-05-16 10:09:39,988: INFO: PROGRESS: at example #120000, processed 2166390 words (1481340/s), 157593 word types, 120000 tags\n",
      "2018-05-16 10:09:40,107: INFO: PROGRESS: at example #130000, processed 2362926 words (1666541/s), 167736 word types, 130000 tags\n",
      "2018-05-16 10:09:40,238: INFO: PROGRESS: at example #140000, processed 2572324 words (1599453/s), 177580 word types, 140000 tags\n",
      "2018-05-16 10:09:40,333: INFO: PROGRESS: at example #150000, processed 2690682 words (1265377/s), 181833 word types, 150000 tags\n",
      "2018-05-16 10:09:40,451: INFO: PROGRESS: at example #160000, processed 2878401 words (1612957/s), 191213 word types, 160000 tags\n",
      "2018-05-16 10:09:40,566: INFO: PROGRESS: at example #170000, processed 3049299 words (1490065/s), 200741 word types, 170000 tags\n",
      "2018-05-16 10:09:40,672: INFO: PROGRESS: at example #180000, processed 3198494 words (1426562/s), 207928 word types, 180000 tags\n",
      "2018-05-16 10:09:40,788: INFO: PROGRESS: at example #190000, processed 3382115 words (1592526/s), 215497 word types, 190000 tags\n",
      "2018-05-16 10:09:40,910: INFO: PROGRESS: at example #200000, processed 3581400 words (1641468/s), 223893 word types, 200000 tags\n",
      "2018-05-16 10:09:41,037: INFO: PROGRESS: at example #210000, processed 3748876 words (1337777/s), 230786 word types, 210000 tags\n",
      "2018-05-16 10:09:41,176: INFO: PROGRESS: at example #220000, processed 3947337 words (1436012/s), 239489 word types, 220000 tags\n",
      "2018-05-16 10:09:41,316: INFO: PROGRESS: at example #230000, processed 4144939 words (1429741/s), 249492 word types, 230000 tags\n",
      "2018-05-16 10:09:41,434: INFO: PROGRESS: at example #240000, processed 4292646 words (1260474/s), 255905 word types, 240000 tags\n",
      "2018-05-16 10:09:41,570: INFO: PROGRESS: at example #250000, processed 4492962 words (1483865/s), 264264 word types, 250000 tags\n",
      "2018-05-16 10:09:41,695: INFO: PROGRESS: at example #260000, processed 4706582 words (1730085/s), 272800 word types, 260000 tags\n",
      "2018-05-16 10:09:41,813: INFO: PROGRESS: at example #270000, processed 4896924 words (1628281/s), 281559 word types, 270000 tags\n",
      "2018-05-16 10:09:41,930: INFO: PROGRESS: at example #280000, processed 5084029 words (1604393/s), 290144 word types, 280000 tags\n",
      "2018-05-16 10:09:42,047: INFO: PROGRESS: at example #290000, processed 5256965 words (1502590/s), 296862 word types, 290000 tags\n",
      "2018-05-16 10:09:42,156: INFO: PROGRESS: at example #300000, processed 5422162 words (1535700/s), 303769 word types, 300000 tags\n",
      "2018-05-16 10:09:42,269: INFO: PROGRESS: at example #310000, processed 5598128 words (1575333/s), 311643 word types, 310000 tags\n",
      "2018-05-16 10:09:42,381: INFO: PROGRESS: at example #320000, processed 5774760 words (1589509/s), 318774 word types, 320000 tags\n",
      "2018-05-16 10:09:42,487: INFO: PROGRESS: at example #330000, processed 5918810 words (1368028/s), 324226 word types, 330000 tags\n",
      "2018-05-16 10:09:42,596: INFO: PROGRESS: at example #340000, processed 6081689 words (1512610/s), 331075 word types, 340000 tags\n",
      "2018-05-16 10:09:42,706: INFO: PROGRESS: at example #350000, processed 6250377 words (1549589/s), 337935 word types, 350000 tags\n",
      "2018-05-16 10:09:42,825: INFO: PROGRESS: at example #360000, processed 6446766 words (1658971/s), 346215 word types, 360000 tags\n",
      "2018-05-16 10:09:42,957: INFO: PROGRESS: at example #370000, processed 6596579 words (1137048/s), 353126 word types, 370000 tags\n",
      "2018-05-16 10:09:43,073: INFO: PROGRESS: at example #380000, processed 6764087 words (1459645/s), 359041 word types, 380000 tags\n",
      "2018-05-16 10:09:43,187: INFO: PROGRESS: at example #390000, processed 6940695 words (1570856/s), 364863 word types, 390000 tags\n",
      "2018-05-16 10:09:43,298: INFO: PROGRESS: at example #400000, processed 7107722 words (1519784/s), 370956 word types, 400000 tags\n",
      "2018-05-16 10:09:43,418: INFO: PROGRESS: at example #410000, processed 7296436 words (1582704/s), 377281 word types, 410000 tags\n",
      "2018-05-16 10:09:43,536: INFO: PROGRESS: at example #420000, processed 7484544 words (1625122/s), 384157 word types, 420000 tags\n",
      "2018-05-16 10:09:43,678: INFO: PROGRESS: at example #430000, processed 7679646 words (1385159/s), 389554 word types, 430000 tags\n",
      "2018-05-16 10:09:43,809: INFO: PROGRESS: at example #440000, processed 7865983 words (1429878/s), 396343 word types, 440000 tags\n",
      "2018-05-16 10:09:43,928: INFO: PROGRESS: at example #450000, processed 8040774 words (1489141/s), 400386 word types, 450000 tags\n",
      "2018-05-16 10:09:44,047: INFO: PROGRESS: at example #460000, processed 8223484 words (1555933/s), 406576 word types, 460000 tags\n",
      "2018-05-16 10:09:44,159: INFO: PROGRESS: at example #470000, processed 8400606 words (1595977/s), 411516 word types, 470000 tags\n",
      "2018-05-16 10:09:44,259: INFO: PROGRESS: at example #480000, processed 8545301 words (1459784/s), 415902 word types, 480000 tags\n",
      "2018-05-16 10:09:44,401: INFO: PROGRESS: at example #490000, processed 8735697 words (1356401/s), 421437 word types, 490000 tags\n",
      "2018-05-16 10:09:44,524: INFO: PROGRESS: at example #500000, processed 8923217 words (1541825/s), 426438 word types, 500000 tags\n",
      "2018-05-16 10:09:44,628: INFO: PROGRESS: at example #510000, processed 9066939 words (1389669/s), 432614 word types, 510000 tags\n",
      "2018-05-16 10:09:44,739: INFO: PROGRESS: at example #520000, processed 9230548 words (1487689/s), 436712 word types, 520000 tags\n",
      "2018-05-16 10:09:44,854: INFO: PROGRESS: at example #530000, processed 9416207 words (1631009/s), 440477 word types, 530000 tags\n",
      "2018-05-16 10:09:44,968: INFO: PROGRESS: at example #540000, processed 9563120 words (1300108/s), 443337 word types, 540000 tags\n",
      "2018-05-16 10:09:45,107: INFO: PROGRESS: at example #550000, processed 9751804 words (1371776/s), 446443 word types, 550000 tags\n",
      "2018-05-16 10:09:45,227: INFO: PROGRESS: at example #560000, processed 9908417 words (1319016/s), 452118 word types, 560000 tags\n",
      "2018-05-16 10:09:45,342: INFO: PROGRESS: at example #570000, processed 10052451 words (1260258/s), 457157 word types, 570000 tags\n",
      "2018-05-16 10:09:45,459: INFO: PROGRESS: at example #580000, processed 10214322 words (1415056/s), 461130 word types, 580000 tags\n",
      "2018-05-16 10:09:45,574: INFO: PROGRESS: at example #590000, processed 10384347 words (1486956/s), 465152 word types, 590000 tags\n",
      "2018-05-16 10:09:45,677: INFO: PROGRESS: at example #600000, processed 10534402 words (1473987/s), 469132 word types, 600000 tags\n",
      "2018-05-16 10:09:45,791: INFO: PROGRESS: at example #610000, processed 10721287 words (1655603/s), 474737 word types, 610000 tags\n",
      "2018-05-16 10:09:45,901: INFO: PROGRESS: at example #620000, processed 10894931 words (1591730/s), 480960 word types, 620000 tags\n",
      "2018-05-16 10:09:46,008: INFO: PROGRESS: at example #630000, processed 11062172 words (1567854/s), 485874 word types, 630000 tags\n",
      "2018-05-16 10:09:46,126: INFO: PROGRESS: at example #640000, processed 11247008 words (1602516/s), 490479 word types, 640000 tags\n",
      "2018-05-16 10:09:46,233: INFO: PROGRESS: at example #650000, processed 11414822 words (1563250/s), 494287 word types, 650000 tags\n",
      "2018-05-16 10:09:46,343: INFO: PROGRESS: at example #660000, processed 11582389 words (1549606/s), 497288 word types, 660000 tags\n",
      "2018-05-16 10:09:46,454: INFO: PROGRESS: at example #670000, processed 11759586 words (1609939/s), 502409 word types, 670000 tags\n",
      "2018-05-16 10:09:46,571: INFO: PROGRESS: at example #680000, processed 11938342 words (1556373/s), 508993 word types, 680000 tags\n",
      "2018-05-16 10:09:46,687: INFO: PROGRESS: at example #690000, processed 12126888 words (1633542/s), 516806 word types, 690000 tags\n",
      "2018-05-16 10:09:46,804: INFO: PROGRESS: at example #700000, processed 12308597 words (1571679/s), 524923 word types, 700000 tags\n",
      "2018-05-16 10:09:46,949: INFO: PROGRESS: at example #710000, processed 12495216 words (1295011/s), 532420 word types, 710000 tags\n",
      "2018-05-16 10:09:47,087: INFO: PROGRESS: at example #720000, processed 12650565 words (1133887/s), 538235 word types, 720000 tags\n",
      "2018-05-16 10:09:47,233: INFO: PROGRESS: at example #730000, processed 12826084 words (1210422/s), 543994 word types, 730000 tags\n",
      "2018-05-16 10:09:47,350: INFO: PROGRESS: at example #740000, processed 13003506 words (1533581/s), 550509 word types, 740000 tags\n",
      "2018-05-16 10:09:47,470: INFO: PROGRESS: at example #750000, processed 13194325 words (1607826/s), 557328 word types, 750000 tags\n",
      "2018-05-16 10:09:47,588: INFO: PROGRESS: at example #760000, processed 13380543 words (1591219/s), 564791 word types, 760000 tags\n",
      "2018-05-16 10:09:47,703: INFO: PROGRESS: at example #770000, processed 13566065 words (1617294/s), 572362 word types, 770000 tags\n",
      "2018-05-16 10:09:47,812: INFO: PROGRESS: at example #780000, processed 13722446 words (1458499/s), 578607 word types, 780000 tags\n",
      "2018-05-16 10:09:47,932: INFO: PROGRESS: at example #790000, processed 13930297 words (1736184/s), 584186 word types, 790000 tags\n",
      "2018-05-16 10:09:48,053: INFO: PROGRESS: at example #800000, processed 14122920 words (1619687/s), 591547 word types, 800000 tags\n",
      "2018-05-16 10:09:48,169: INFO: PROGRESS: at example #810000, processed 14309768 words (1623571/s), 597870 word types, 810000 tags\n",
      "2018-05-16 10:09:48,290: INFO: PROGRESS: at example #820000, processed 14508311 words (1658269/s), 603995 word types, 820000 tags\n",
      "2018-05-16 10:09:48,408: INFO: PROGRESS: at example #830000, processed 14697075 words (1620804/s), 612059 word types, 830000 tags\n",
      "2018-05-16 10:09:48,523: INFO: PROGRESS: at example #840000, processed 14879722 words (1594108/s), 618193 word types, 840000 tags\n",
      "2018-05-16 10:09:48,648: INFO: PROGRESS: at example #850000, processed 15084163 words (1656605/s), 623333 word types, 850000 tags\n",
      "2018-05-16 10:09:48,767: INFO: PROGRESS: at example #860000, processed 15274779 words (1624219/s), 630362 word types, 860000 tags\n",
      "2018-05-16 10:09:48,891: INFO: PROGRESS: at example #870000, processed 15472047 words (1603496/s), 636936 word types, 870000 tags\n",
      "2018-05-16 10:09:49,020: INFO: PROGRESS: at example #880000, processed 15668263 words (1527763/s), 643644 word types, 880000 tags\n",
      "2018-05-16 10:09:49,137: INFO: PROGRESS: at example #890000, processed 15852451 words (1585307/s), 649206 word types, 890000 tags\n",
      "2018-05-16 10:09:49,257: INFO: PROGRESS: at example #900000, processed 16039982 words (1582207/s), 655259 word types, 900000 tags\n",
      "2018-05-16 10:09:49,378: INFO: PROGRESS: at example #910000, processed 16231551 words (1599790/s), 662485 word types, 910000 tags\n",
      "2018-05-16 10:09:49,495: INFO: PROGRESS: at example #920000, processed 16426315 words (1679147/s), 668038 word types, 920000 tags\n",
      "2018-05-16 10:09:49,617: INFO: PROGRESS: at example #930000, processed 16622279 words (1616338/s), 674261 word types, 930000 tags\n",
      "2018-05-16 10:09:49,735: INFO: PROGRESS: at example #940000, processed 16806847 words (1577242/s), 680599 word types, 940000 tags\n",
      "2018-05-16 10:09:49,850: INFO: PROGRESS: at example #950000, processed 16984070 words (1567773/s), 684983 word types, 950000 tags\n",
      "2018-05-16 10:09:49,973: INFO: PROGRESS: at example #960000, processed 17188384 words (1674150/s), 691381 word types, 960000 tags\n",
      "2018-05-16 10:09:50,088: INFO: PROGRESS: at example #970000, processed 17357424 words (1484942/s), 696114 word types, 970000 tags\n",
      "2018-05-16 10:09:50,244: INFO: PROGRESS: at example #980000, processed 17525650 words (1085182/s), 702165 word types, 980000 tags\n",
      "2018-05-16 10:09:50,364: INFO: PROGRESS: at example #990000, processed 17720228 words (1638111/s), 710045 word types, 990000 tags\n",
      "2018-05-16 10:09:50,558: INFO: PROGRESS: at example #1000000, processed 17898090 words (923997/s), 717306 word types, 1000000 tags\n",
      "2018-05-16 10:09:50,687: INFO: PROGRESS: at example #1010000, processed 18068255 words (1326317/s), 723557 word types, 1010000 tags\n",
      "2018-05-16 10:09:50,799: INFO: PROGRESS: at example #1020000, processed 18236775 words (1514948/s), 729795 word types, 1020000 tags\n",
      "2018-05-16 10:09:50,913: INFO: PROGRESS: at example #1030000, processed 18405035 words (1499111/s), 735715 word types, 1030000 tags\n",
      "2018-05-16 10:09:51,036: INFO: PROGRESS: at example #1040000, processed 18583389 words (1465100/s), 741444 word types, 1040000 tags\n",
      "2018-05-16 10:09:51,149: INFO: PROGRESS: at example #1050000, processed 18754401 words (1528712/s), 746851 word types, 1050000 tags\n",
      "2018-05-16 10:09:51,267: INFO: PROGRESS: at example #1060000, processed 18933576 words (1535800/s), 752415 word types, 1060000 tags\n",
      "2018-05-16 10:09:51,384: INFO: PROGRESS: at example #1070000, processed 19111536 words (1537009/s), 759122 word types, 1070000 tags\n",
      "2018-05-16 10:09:51,502: INFO: PROGRESS: at example #1080000, processed 19293571 words (1552480/s), 765372 word types, 1080000 tags\n",
      "2018-05-16 10:09:51,623: INFO: PROGRESS: at example #1090000, processed 19494114 words (1663916/s), 770731 word types, 1090000 tags\n",
      "2018-05-16 10:09:51,740: INFO: PROGRESS: at example #1100000, processed 19678154 words (1587326/s), 775584 word types, 1100000 tags\n",
      "2018-05-16 10:09:51,864: INFO: PROGRESS: at example #1110000, processed 19868107 words (1551580/s), 780304 word types, 1110000 tags\n",
      "2018-05-16 10:09:51,973: INFO: PROGRESS: at example #1120000, processed 20019062 words (1408945/s), 783481 word types, 1120000 tags\n",
      "2018-05-16 10:09:52,088: INFO: PROGRESS: at example #1130000, processed 20194885 words (1535727/s), 788497 word types, 1130000 tags\n",
      "2018-05-16 10:09:52,207: INFO: PROGRESS: at example #1140000, processed 20383373 words (1600370/s), 794373 word types, 1140000 tags\n",
      "2018-05-16 10:09:52,330: INFO: PROGRESS: at example #1150000, processed 20578528 words (1597580/s), 800232 word types, 1150000 tags\n",
      "2018-05-16 10:09:52,450: INFO: PROGRESS: at example #1160000, processed 20766738 words (1585245/s), 805277 word types, 1160000 tags\n",
      "2018-05-16 10:09:52,571: INFO: PROGRESS: at example #1170000, processed 20960426 words (1615282/s), 810628 word types, 1170000 tags\n",
      "2018-05-16 10:09:52,677: INFO: PROGRESS: at example #1180000, processed 21119943 words (1516306/s), 817179 word types, 1180000 tags\n",
      "2018-05-16 10:09:52,807: INFO: PROGRESS: at example #1190000, processed 21311071 words (1479310/s), 824360 word types, 1190000 tags\n",
      "2018-05-16 10:09:52,927: INFO: PROGRESS: at example #1200000, processed 21507996 words (1663320/s), 831766 word types, 1200000 tags\n",
      "2018-05-16 10:09:53,068: INFO: PROGRESS: at example #1210000, processed 21700073 words (1370236/s), 839773 word types, 1210000 tags\n",
      "2018-05-16 10:09:53,172: INFO: PROGRESS: at example #1220000, processed 21846527 words (1417244/s), 845844 word types, 1220000 tags\n",
      "2018-05-16 10:09:53,288: INFO: PROGRESS: at example #1230000, processed 22027414 words (1579268/s), 855544 word types, 1230000 tags\n",
      "2018-05-16 10:09:53,406: INFO: PROGRESS: at example #1240000, processed 22215625 words (1623864/s), 862215 word types, 1240000 tags\n",
      "2018-05-16 10:09:53,525: INFO: PROGRESS: at example #1250000, processed 22412125 words (1665494/s), 869013 word types, 1250000 tags\n",
      "2018-05-16 10:09:53,646: INFO: PROGRESS: at example #1260000, processed 22601046 words (1573975/s), 876493 word types, 1260000 tags\n",
      "2018-05-16 10:09:53,756: INFO: PROGRESS: at example #1270000, processed 22766915 words (1528131/s), 882884 word types, 1270000 tags\n",
      "2018-05-16 10:09:53,873: INFO: PROGRESS: at example #1280000, processed 22956008 words (1626341/s), 890277 word types, 1280000 tags\n",
      "2018-05-16 10:09:53,990: INFO: PROGRESS: at example #1290000, processed 23144100 words (1623694/s), 897092 word types, 1290000 tags\n",
      "2018-05-16 10:09:54,105: INFO: PROGRESS: at example #1300000, processed 23325488 words (1591577/s), 904540 word types, 1300000 tags\n",
      "2018-05-16 10:09:54,225: INFO: PROGRESS: at example #1310000, processed 23521060 words (1632503/s), 912961 word types, 1310000 tags\n",
      "2018-05-16 10:09:54,340: INFO: PROGRESS: at example #1320000, processed 23700303 words (1580940/s), 919637 word types, 1320000 tags\n",
      "2018-05-16 10:09:54,454: INFO: PROGRESS: at example #1330000, processed 23885267 words (1630549/s), 924127 word types, 1330000 tags\n",
      "2018-05-16 10:09:54,574: INFO: PROGRESS: at example #1340000, processed 24065337 words (1522623/s), 929417 word types, 1340000 tags\n",
      "2018-05-16 10:09:54,684: INFO: PROGRESS: at example #1350000, processed 24235331 words (1561604/s), 935669 word types, 1350000 tags\n",
      "2018-05-16 10:09:54,797: INFO: PROGRESS: at example #1360000, processed 24413533 words (1594150/s), 943074 word types, 1360000 tags\n",
      "2018-05-16 10:09:54,914: INFO: PROGRESS: at example #1370000, processed 24608224 words (1685408/s), 946411 word types, 1370000 tags\n",
      "2018-05-16 10:09:55,034: INFO: PROGRESS: at example #1380000, processed 24806714 words (1671311/s), 951256 word types, 1380000 tags\n",
      "2018-05-16 10:09:55,149: INFO: PROGRESS: at example #1390000, processed 24992532 words (1626896/s), 956126 word types, 1390000 tags\n",
      "2018-05-16 10:09:55,264: INFO: PROGRESS: at example #1400000, processed 25185844 words (1696735/s), 961435 word types, 1400000 tags\n",
      "2018-05-16 10:09:55,382: INFO: PROGRESS: at example #1410000, processed 25372765 words (1597221/s), 967028 word types, 1410000 tags\n",
      "2018-05-16 10:09:55,491: INFO: PROGRESS: at example #1420000, processed 25534815 words (1497910/s), 968930 word types, 1420000 tags\n",
      "2018-05-16 10:09:55,608: INFO: PROGRESS: at example #1430000, processed 25722142 words (1610077/s), 976304 word types, 1430000 tags\n",
      "2018-05-16 10:09:55,720: INFO: PROGRESS: at example #1440000, processed 25896732 words (1573831/s), 980713 word types, 1440000 tags\n",
      "2018-05-16 10:09:55,820: INFO: PROGRESS: at example #1450000, processed 26026092 words (1309434/s), 983534 word types, 1450000 tags\n",
      "2018-05-16 10:09:55,941: INFO: PROGRESS: at example #1460000, processed 26231531 words (1710850/s), 991383 word types, 1460000 tags\n",
      "2018-05-16 10:09:56,057: INFO: PROGRESS: at example #1470000, processed 26406448 words (1517221/s), 998764 word types, 1470000 tags\n",
      "2018-05-16 10:09:56,177: INFO: PROGRESS: at example #1480000, processed 26601906 words (1663161/s), 1003820 word types, 1480000 tags\n",
      "2018-05-16 10:09:56,299: INFO: PROGRESS: at example #1490000, processed 26810631 words (1718752/s), 1009002 word types, 1490000 tags\n",
      "2018-05-16 10:09:56,415: INFO: PROGRESS: at example #1500000, processed 26990033 words (1572395/s), 1014535 word types, 1500000 tags\n",
      "2018-05-16 10:09:56,548: INFO: PROGRESS: at example #1510000, processed 27163447 words (1308039/s), 1019215 word types, 1510000 tags\n",
      "2018-05-16 10:09:56,691: INFO: PROGRESS: at example #1520000, processed 27380972 words (1536994/s), 1023607 word types, 1520000 tags\n",
      "2018-05-16 10:09:56,812: INFO: PROGRESS: at example #1530000, processed 27522273 words (1179558/s), 1029140 word types, 1530000 tags\n",
      "2018-05-16 10:09:56,928: INFO: PROGRESS: at example #1540000, processed 27697163 words (1525330/s), 1034622 word types, 1540000 tags\n",
      "2018-05-16 10:09:57,052: INFO: PROGRESS: at example #1550000, processed 27897948 words (1632351/s), 1041467 word types, 1550000 tags\n",
      "2018-05-16 10:09:57,168: INFO: PROGRESS: at example #1560000, processed 28074501 words (1530888/s), 1047804 word types, 1560000 tags\n",
      "2018-05-16 10:09:57,288: INFO: PROGRESS: at example #1570000, processed 28263053 words (1579154/s), 1054453 word types, 1570000 tags\n",
      "2018-05-16 10:09:57,411: INFO: PROGRESS: at example #1580000, processed 28464214 words (1655778/s), 1061199 word types, 1580000 tags\n",
      "2018-05-16 10:09:57,530: INFO: PROGRESS: at example #1590000, processed 28647955 words (1553109/s), 1068991 word types, 1590000 tags\n",
      "2018-05-16 10:09:57,651: INFO: PROGRESS: at example #1600000, processed 28844472 words (1659615/s), 1075101 word types, 1600000 tags\n",
      "2018-05-16 10:09:57,773: INFO: PROGRESS: at example #1610000, processed 29038733 words (1605864/s), 1081178 word types, 1610000 tags\n",
      "2018-05-16 10:09:57,896: INFO: PROGRESS: at example #1620000, processed 29234975 words (1606101/s), 1086556 word types, 1620000 tags\n",
      "2018-05-16 10:09:58,016: INFO: PROGRESS: at example #1630000, processed 29422479 words (1577085/s), 1092214 word types, 1630000 tags\n",
      "2018-05-16 10:09:58,137: INFO: PROGRESS: at example #1640000, processed 29616766 words (1628042/s), 1097540 word types, 1640000 tags\n",
      "2018-05-16 10:09:58,219: INFO: PROGRESS: at example #1650000, processed 29698408 words (1002766/s), 1099437 word types, 1650000 tags\n",
      "2018-05-16 10:09:58,346: INFO: PROGRESS: at example #1660000, processed 29901456 words (1620752/s), 1105378 word types, 1660000 tags\n",
      "2018-05-16 10:09:58,470: INFO: PROGRESS: at example #1670000, processed 30084986 words (1501038/s), 1109642 word types, 1670000 tags\n",
      "2018-05-16 10:09:58,592: INFO: PROGRESS: at example #1680000, processed 30287174 words (1671495/s), 1113590 word types, 1680000 tags\n",
      "2018-05-16 10:09:58,712: INFO: PROGRESS: at example #1690000, processed 30488652 words (1684729/s), 1117960 word types, 1690000 tags\n",
      "2018-05-16 10:09:58,831: INFO: PROGRESS: at example #1700000, processed 30678997 words (1610311/s), 1122479 word types, 1700000 tags\n",
      "2018-05-16 10:09:58,933: INFO: PROGRESS: at example #1710000, processed 30817437 words (1370031/s), 1125417 word types, 1710000 tags\n",
      "2018-05-16 10:09:59,064: INFO: PROGRESS: at example #1720000, processed 30975549 words (1224610/s), 1129459 word types, 1720000 tags\n",
      "2018-05-16 10:09:59,182: INFO: PROGRESS: at example #1730000, processed 31166190 words (1643229/s), 1134203 word types, 1730000 tags\n",
      "2018-05-16 10:09:59,303: INFO: PROGRESS: at example #1740000, processed 31364776 words (1650664/s), 1138959 word types, 1740000 tags\n",
      "2018-05-16 10:09:59,421: INFO: PROGRESS: at example #1750000, processed 31546718 words (1556253/s), 1145354 word types, 1750000 tags\n",
      "2018-05-16 10:09:59,545: INFO: PROGRESS: at example #1760000, processed 31748898 words (1640981/s), 1151830 word types, 1760000 tags\n",
      "2018-05-16 10:09:59,667: INFO: PROGRESS: at example #1770000, processed 31947669 words (1643994/s), 1158130 word types, 1770000 tags\n",
      "2018-05-16 10:09:59,801: INFO: PROGRESS: at example #1780000, processed 32136500 words (1427546/s), 1163623 word types, 1780000 tags\n",
      "2018-05-16 10:09:59,907: INFO: PROGRESS: at example #1790000, processed 32250243 words (1074291/s), 1169337 word types, 1790000 tags\n",
      "2018-05-16 10:10:00,031: INFO: PROGRESS: at example #1800000, processed 32426481 words (1444313/s), 1173826 word types, 1800000 tags\n",
      "2018-05-16 10:10:00,154: INFO: PROGRESS: at example #1810000, processed 32617992 words (1574470/s), 1178970 word types, 1810000 tags\n",
      "2018-05-16 10:10:00,272: INFO: PROGRESS: at example #1820000, processed 32797821 words (1533264/s), 1182392 word types, 1820000 tags\n",
      "2018-05-16 10:10:00,396: INFO: PROGRESS: at example #1830000, processed 32994439 words (1604821/s), 1190303 word types, 1830000 tags\n",
      "2018-05-16 10:10:00,514: INFO: PROGRESS: at example #1840000, processed 33178286 words (1573709/s), 1193120 word types, 1840000 tags\n",
      "2018-05-16 10:10:00,635: INFO: PROGRESS: at example #1850000, processed 33370413 words (1615043/s), 1196610 word types, 1850000 tags\n",
      "2018-05-16 10:10:00,751: INFO: PROGRESS: at example #1860000, processed 33549602 words (1559674/s), 1201395 word types, 1860000 tags\n",
      "2018-05-16 10:10:00,874: INFO: PROGRESS: at example #1870000, processed 33742472 words (1579331/s), 1206412 word types, 1870000 tags\n",
      "2018-05-16 10:10:00,997: INFO: PROGRESS: at example #1880000, processed 33937564 words (1587137/s), 1210288 word types, 1880000 tags\n",
      "2018-05-16 10:10:01,129: INFO: PROGRESS: at example #1890000, processed 34145497 words (1601648/s), 1216315 word types, 1890000 tags\n",
      "2018-05-16 10:10:01,221: INFO: collected 1219263 word types and 1897215 unique tags from a corpus of 1897215 examples and 34286985 words\n",
      "2018-05-16 10:10:01,222: INFO: Loading a fresh vocabulary\n",
      "2018-05-16 10:10:02,792: INFO: min_count=5 retains 223197 unique words (18% of original 1219263, drops 996066)\n",
      "2018-05-16 10:10:02,793: INFO: min_count=5 leaves 32764697 word corpus (95% of original 34286985, drops 1522288)\n",
      "2018-05-16 10:10:03,446: INFO: deleting the raw counts dictionary of 1219263 items\n",
      "2018-05-16 10:10:03,480: INFO: sample=0.001 downsamples 30 most-common words\n",
      "2018-05-16 10:10:03,481: INFO: downsampling leaves estimated 26806819 word corpus (81.8% of prior 32764697)\n",
      "2018-05-16 10:10:04,297: INFO: estimated required memory for 223197 words and 100 dimensions: 1049042100 bytes\n",
      "2018-05-16 10:10:04,298: INFO: resetting layer weights\n",
      "2018-05-16 10:10:28,757: INFO: training model with 8 workers on 223197 vocabulary and 100 features, using sg=0 hs=0 sample=0.001 negative=5 window=10\n",
      "2018-05-16 10:10:29,802: INFO: EPOCH 1 - PROGRESS: at 0.42% examples, 114503 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:30,872: INFO: EPOCH 1 - PROGRESS: at 1.28% examples, 159948 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:31,972: INFO: EPOCH 1 - PROGRESS: at 2.07% examples, 177717 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:10:32,992: INFO: EPOCH 1 - PROGRESS: at 2.65% examples, 179914 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:34,006: INFO: EPOCH 1 - PROGRESS: at 3.38% examples, 189809 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:10:35,097: INFO: EPOCH 1 - PROGRESS: at 4.11% examples, 191090 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:36,101: INFO: EPOCH 1 - PROGRESS: at 4.74% examples, 188735 words/s, in_qsize 14, out_qsize 1\n",
      "2018-05-16 10:10:37,165: INFO: EPOCH 1 - PROGRESS: at 5.44% examples, 189550 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:38,179: INFO: EPOCH 1 - PROGRESS: at 6.19% examples, 191114 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:39,207: INFO: EPOCH 1 - PROGRESS: at 6.83% examples, 188259 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:40,237: INFO: EPOCH 1 - PROGRESS: at 7.53% examples, 191697 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:41,342: INFO: EPOCH 1 - PROGRESS: at 8.16% examples, 191340 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:10:42,357: INFO: EPOCH 1 - PROGRESS: at 8.72% examples, 188598 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:43,372: INFO: EPOCH 1 - PROGRESS: at 9.65% examples, 189893 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:44,377: INFO: EPOCH 1 - PROGRESS: at 10.53% examples, 191645 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:45,421: INFO: EPOCH 1 - PROGRESS: at 11.13% examples, 190512 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:10:46,429: INFO: EPOCH 1 - PROGRESS: at 11.94% examples, 192814 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:47,431: INFO: EPOCH 1 - PROGRESS: at 12.55% examples, 192655 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:10:48,432: INFO: EPOCH 1 - PROGRESS: at 13.36% examples, 193902 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:49,434: INFO: EPOCH 1 - PROGRESS: at 13.93% examples, 193307 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:50,470: INFO: EPOCH 1 - PROGRESS: at 14.70% examples, 194279 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:51,572: INFO: EPOCH 1 - PROGRESS: at 15.40% examples, 193963 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:52,608: INFO: EPOCH 1 - PROGRESS: at 16.02% examples, 192607 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:53,654: INFO: EPOCH 1 - PROGRESS: at 16.84% examples, 193192 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:54,867: INFO: EPOCH 1 - PROGRESS: at 17.52% examples, 191816 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:55,931: INFO: EPOCH 1 - PROGRESS: at 18.39% examples, 191372 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:10:56,952: INFO: EPOCH 1 - PROGRESS: at 19.09% examples, 191800 words/s, in_qsize 14, out_qsize 1\n",
      "2018-05-16 10:10:58,243: INFO: EPOCH 1 - PROGRESS: at 19.81% examples, 189413 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:10:59,303: INFO: EPOCH 1 - PROGRESS: at 20.34% examples, 187484 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:00,399: INFO: EPOCH 1 - PROGRESS: at 21.11% examples, 187594 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:01,412: INFO: EPOCH 1 - PROGRESS: at 21.83% examples, 188192 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:02,421: INFO: EPOCH 1 - PROGRESS: at 22.18% examples, 185960 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:03,508: INFO: EPOCH 1 - PROGRESS: at 22.70% examples, 184711 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:04,514: INFO: EPOCH 1 - PROGRESS: at 23.28% examples, 184142 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:05,530: INFO: EPOCH 1 - PROGRESS: at 24.01% examples, 184722 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:06,546: INFO: EPOCH 1 - PROGRESS: at 24.60% examples, 184172 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:07,615: INFO: EPOCH 1 - PROGRESS: at 25.28% examples, 183827 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:08,631: INFO: EPOCH 1 - PROGRESS: at 26.04% examples, 184431 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:09,711: INFO: EPOCH 1 - PROGRESS: at 26.60% examples, 183400 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:10,734: INFO: EPOCH 1 - PROGRESS: at 27.35% examples, 183293 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:11,743: INFO: EPOCH 1 - PROGRESS: at 28.03% examples, 183502 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:12,779: INFO: EPOCH 1 - PROGRESS: at 28.69% examples, 183020 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:13,779: INFO: EPOCH 1 - PROGRESS: at 29.34% examples, 183005 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:14,801: INFO: EPOCH 1 - PROGRESS: at 30.16% examples, 182995 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:15,825: INFO: EPOCH 1 - PROGRESS: at 30.84% examples, 182795 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:16,835: INFO: EPOCH 1 - PROGRESS: at 31.55% examples, 182942 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:17,959: INFO: EPOCH 1 - PROGRESS: at 32.07% examples, 181459 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:19,421: INFO: EPOCH 1 - PROGRESS: at 32.56% examples, 178985 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:20,433: INFO: EPOCH 1 - PROGRESS: at 33.23% examples, 179292 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:21,489: INFO: EPOCH 1 - PROGRESS: at 34.03% examples, 179511 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:22,542: INFO: EPOCH 1 - PROGRESS: at 34.50% examples, 178636 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:23,545: INFO: EPOCH 1 - PROGRESS: at 34.77% examples, 176721 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:24,568: INFO: EPOCH 1 - PROGRESS: at 35.42% examples, 176448 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:25,649: INFO: EPOCH 1 - PROGRESS: at 36.07% examples, 176442 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:26,754: INFO: EPOCH 1 - PROGRESS: at 36.57% examples, 175504 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:27,929: INFO: EPOCH 1 - PROGRESS: at 36.86% examples, 173442 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:28,939: INFO: EPOCH 1 - PROGRESS: at 37.46% examples, 173436 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:29,969: INFO: EPOCH 1 - PROGRESS: at 38.03% examples, 173368 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:31,007: INFO: EPOCH 1 - PROGRESS: at 38.86% examples, 173747 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:32,146: INFO: EPOCH 1 - PROGRESS: at 39.17% examples, 172062 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:33,216: INFO: EPOCH 1 - PROGRESS: at 39.66% examples, 171409 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:34,321: INFO: EPOCH 1 - PROGRESS: at 40.05% examples, 170303 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:35,331: INFO: EPOCH 1 - PROGRESS: at 40.46% examples, 169559 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:36,333: INFO: EPOCH 1 - PROGRESS: at 40.76% examples, 168390 words/s, in_qsize 14, out_qsize 1\n",
      "2018-05-16 10:11:37,337: INFO: EPOCH 1 - PROGRESS: at 41.31% examples, 168147 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:38,472: INFO: EPOCH 1 - PROGRESS: at 41.63% examples, 166849 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:39,487: INFO: EPOCH 1 - PROGRESS: at 41.94% examples, 165763 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:40,526: INFO: EPOCH 1 - PROGRESS: at 42.33% examples, 165000 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:41,580: INFO: EPOCH 1 - PROGRESS: at 42.57% examples, 163649 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:42,585: INFO: EPOCH 1 - PROGRESS: at 42.82% examples, 162433 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:43,617: INFO: EPOCH 1 - PROGRESS: at 43.19% examples, 161756 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:44,695: INFO: EPOCH 1 - PROGRESS: at 43.45% examples, 160548 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:45,761: INFO: EPOCH 1 - PROGRESS: at 43.85% examples, 159880 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:46,786: INFO: EPOCH 1 - PROGRESS: at 44.21% examples, 159161 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:47,918: INFO: EPOCH 1 - PROGRESS: at 44.59% examples, 158378 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:48,956: INFO: EPOCH 1 - PROGRESS: at 44.95% examples, 157675 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:49,977: INFO: EPOCH 1 - PROGRESS: at 45.38% examples, 157314 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:51,244: INFO: EPOCH 1 - PROGRESS: at 45.70% examples, 156106 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:52,301: INFO: EPOCH 1 - PROGRESS: at 46.03% examples, 155425 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:53,363: INFO: EPOCH 1 - PROGRESS: at 46.30% examples, 154543 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:54,397: INFO: EPOCH 1 - PROGRESS: at 46.60% examples, 153649 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:55,671: INFO: EPOCH 1 - PROGRESS: at 46.97% examples, 152574 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:56,700: INFO: EPOCH 1 - PROGRESS: at 47.36% examples, 152125 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:11:57,733: INFO: EPOCH 1 - PROGRESS: at 47.72% examples, 151574 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:11:59,096: INFO: EPOCH 1 - PROGRESS: at 47.97% examples, 150127 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:00,129: INFO: EPOCH 1 - PROGRESS: at 48.43% examples, 149997 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:01,259: INFO: EPOCH 1 - PROGRESS: at 48.89% examples, 149709 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:02,259: INFO: EPOCH 1 - PROGRESS: at 49.20% examples, 149162 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:03,275: INFO: EPOCH 1 - PROGRESS: at 49.47% examples, 148362 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:04,277: INFO: EPOCH 1 - PROGRESS: at 49.78% examples, 147712 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:05,293: INFO: EPOCH 1 - PROGRESS: at 50.07% examples, 147043 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:06,408: INFO: EPOCH 1 - PROGRESS: at 50.22% examples, 145880 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:07,414: INFO: EPOCH 1 - PROGRESS: at 50.47% examples, 145227 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:08,575: INFO: EPOCH 1 - PROGRESS: at 50.74% examples, 144371 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:09,896: INFO: EPOCH 1 - PROGRESS: at 51.07% examples, 143482 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:10,910: INFO: EPOCH 1 - PROGRESS: at 51.39% examples, 143024 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:11,970: INFO: EPOCH 1 - PROGRESS: at 51.60% examples, 142198 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:12,998: INFO: EPOCH 1 - PROGRESS: at 51.97% examples, 141530 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:14,058: INFO: EPOCH 1 - PROGRESS: at 52.21% examples, 140743 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:15,126: INFO: EPOCH 1 - PROGRESS: at 52.30% examples, 139566 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:16,210: INFO: EPOCH 1 - PROGRESS: at 52.59% examples, 138932 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:17,400: INFO: EPOCH 1 - PROGRESS: at 52.88% examples, 138194 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:18,439: INFO: EPOCH 1 - PROGRESS: at 53.13% examples, 137571 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:19,593: INFO: EPOCH 1 - PROGRESS: at 53.62% examples, 137216 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:20,715: INFO: EPOCH 1 - PROGRESS: at 53.86% examples, 136439 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:21,790: INFO: EPOCH 1 - PROGRESS: at 54.19% examples, 135970 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:22,807: INFO: EPOCH 1 - PROGRESS: at 54.44% examples, 135354 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:23,814: INFO: EPOCH 1 - PROGRESS: at 54.64% examples, 134686 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:24,926: INFO: EPOCH 1 - PROGRESS: at 54.97% examples, 134188 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:26,045: INFO: EPOCH 1 - PROGRESS: at 55.30% examples, 133765 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:27,146: INFO: EPOCH 1 - PROGRESS: at 55.74% examples, 133439 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:28,292: INFO: EPOCH 1 - PROGRESS: at 56.08% examples, 133009 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:29,365: INFO: EPOCH 1 - PROGRESS: at 56.45% examples, 132732 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:30,397: INFO: EPOCH 1 - PROGRESS: at 56.69% examples, 132153 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:31,591: INFO: EPOCH 1 - PROGRESS: at 57.04% examples, 131701 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:32,632: INFO: EPOCH 1 - PROGRESS: at 57.41% examples, 131547 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:33,696: INFO: EPOCH 1 - PROGRESS: at 57.71% examples, 131172 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:34,817: INFO: EPOCH 1 - PROGRESS: at 58.00% examples, 130674 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:35,825: INFO: EPOCH 1 - PROGRESS: at 58.35% examples, 130493 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:36,832: INFO: EPOCH 1 - PROGRESS: at 58.59% examples, 129989 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:38,012: INFO: EPOCH 1 - PROGRESS: at 58.96% examples, 129605 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:39,034: INFO: EPOCH 1 - PROGRESS: at 59.44% examples, 129435 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:40,255: INFO: EPOCH 1 - PROGRESS: at 59.79% examples, 129063 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:41,273: INFO: EPOCH 1 - PROGRESS: at 60.06% examples, 128703 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:42,367: INFO: EPOCH 1 - PROGRESS: at 60.33% examples, 128273 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:43,388: INFO: EPOCH 1 - PROGRESS: at 60.69% examples, 128114 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:44,544: INFO: EPOCH 1 - PROGRESS: at 60.96% examples, 127640 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:45,562: INFO: EPOCH 1 - PROGRESS: at 61.12% examples, 127000 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:46,680: INFO: EPOCH 1 - PROGRESS: at 61.43% examples, 126647 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:47,812: INFO: EPOCH 1 - PROGRESS: at 61.77% examples, 126392 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:48,890: INFO: EPOCH 1 - PROGRESS: at 62.11% examples, 126075 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:49,986: INFO: EPOCH 1 - PROGRESS: at 62.37% examples, 125684 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:50,999: INFO: EPOCH 1 - PROGRESS: at 62.66% examples, 125314 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:52,177: INFO: EPOCH 1 - PROGRESS: at 62.99% examples, 124927 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:53,207: INFO: EPOCH 1 - PROGRESS: at 63.18% examples, 124484 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:54,271: INFO: EPOCH 1 - PROGRESS: at 63.46% examples, 124144 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:55,304: INFO: EPOCH 1 - PROGRESS: at 63.89% examples, 124181 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:56,371: INFO: EPOCH 1 - PROGRESS: at 64.30% examples, 124013 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:57,430: INFO: EPOCH 1 - PROGRESS: at 64.72% examples, 123790 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:12:58,619: INFO: EPOCH 1 - PROGRESS: at 65.01% examples, 123361 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:12:59,698: INFO: EPOCH 1 - PROGRESS: at 65.24% examples, 122923 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:00,739: INFO: EPOCH 1 - PROGRESS: at 65.43% examples, 122465 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:01,900: INFO: EPOCH 1 - PROGRESS: at 65.78% examples, 122242 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:02,953: INFO: EPOCH 1 - PROGRESS: at 66.13% examples, 122100 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:03,972: INFO: EPOCH 1 - PROGRESS: at 66.50% examples, 121979 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:05,111: INFO: EPOCH 1 - PROGRESS: at 66.86% examples, 121776 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:06,129: INFO: EPOCH 1 - PROGRESS: at 67.34% examples, 121774 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:07,217: INFO: EPOCH 1 - PROGRESS: at 67.58% examples, 121397 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:08,247: INFO: EPOCH 1 - PROGRESS: at 68.18% examples, 121809 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:09,263: INFO: EPOCH 1 - PROGRESS: at 68.91% examples, 122366 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:10,331: INFO: EPOCH 1 - PROGRESS: at 69.57% examples, 122685 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:11,376: INFO: EPOCH 1 - PROGRESS: at 70.11% examples, 122872 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:12,441: INFO: EPOCH 1 - PROGRESS: at 70.75% examples, 123194 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:13,458: INFO: EPOCH 1 - PROGRESS: at 71.44% examples, 123587 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:14,462: INFO: EPOCH 1 - PROGRESS: at 72.02% examples, 123876 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:15,470: INFO: EPOCH 1 - PROGRESS: at 72.56% examples, 124180 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:16,516: INFO: EPOCH 1 - PROGRESS: at 73.19% examples, 124585 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:17,534: INFO: EPOCH 1 - PROGRESS: at 73.88% examples, 125039 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:18,539: INFO: EPOCH 1 - PROGRESS: at 74.37% examples, 125137 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:19,541: INFO: EPOCH 1 - PROGRESS: at 75.00% examples, 125381 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:20,599: INFO: EPOCH 1 - PROGRESS: at 75.61% examples, 125620 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:21,664: INFO: EPOCH 1 - PROGRESS: at 76.08% examples, 125623 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:22,689: INFO: EPOCH 1 - PROGRESS: at 76.76% examples, 125980 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:23,722: INFO: EPOCH 1 - PROGRESS: at 77.46% examples, 126239 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:24,803: INFO: EPOCH 1 - PROGRESS: at 78.05% examples, 126557 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:25,818: INFO: EPOCH 1 - PROGRESS: at 78.58% examples, 126726 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:26,851: INFO: EPOCH 1 - PROGRESS: at 79.24% examples, 127014 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:27,875: INFO: EPOCH 1 - PROGRESS: at 79.85% examples, 127362 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:28,956: INFO: EPOCH 1 - PROGRESS: at 80.30% examples, 127474 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:29,976: INFO: EPOCH 1 - PROGRESS: at 81.02% examples, 127774 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:30,987: INFO: EPOCH 1 - PROGRESS: at 81.56% examples, 127895 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:32,003: INFO: EPOCH 1 - PROGRESS: at 82.12% examples, 128046 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:33,114: INFO: EPOCH 1 - PROGRESS: at 82.62% examples, 128127 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:34,190: INFO: EPOCH 1 - PROGRESS: at 83.14% examples, 128190 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:35,462: INFO: EPOCH 1 - PROGRESS: at 83.57% examples, 127983 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:36,485: INFO: EPOCH 1 - PROGRESS: at 84.02% examples, 127990 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:37,552: INFO: EPOCH 1 - PROGRESS: at 84.64% examples, 128296 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:38,577: INFO: EPOCH 1 - PROGRESS: at 85.16% examples, 128461 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:39,612: INFO: EPOCH 1 - PROGRESS: at 85.74% examples, 128726 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:40,614: INFO: EPOCH 1 - PROGRESS: at 86.20% examples, 128791 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:41,665: INFO: EPOCH 1 - PROGRESS: at 86.74% examples, 128911 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:42,670: INFO: EPOCH 1 - PROGRESS: at 86.98% examples, 128626 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:43,953: INFO: EPOCH 1 - PROGRESS: at 87.41% examples, 128301 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:45,034: INFO: EPOCH 1 - PROGRESS: at 87.87% examples, 128032 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:46,121: INFO: EPOCH 1 - PROGRESS: at 88.28% examples, 127961 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:47,165: INFO: EPOCH 1 - PROGRESS: at 88.70% examples, 127971 words/s, in_qsize 15, out_qsize 1\n",
      "2018-05-16 10:13:48,186: INFO: EPOCH 1 - PROGRESS: at 89.12% examples, 127990 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:49,218: INFO: EPOCH 1 - PROGRESS: at 89.57% examples, 127992 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:50,333: INFO: EPOCH 1 - PROGRESS: at 90.14% examples, 128161 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:51,353: INFO: EPOCH 1 - PROGRESS: at 90.67% examples, 128225 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:52,507: INFO: EPOCH 1 - PROGRESS: at 91.31% examples, 128240 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:53,557: INFO: EPOCH 1 - PROGRESS: at 91.67% examples, 128117 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:54,592: INFO: EPOCH 1 - PROGRESS: at 92.25% examples, 128291 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:55,658: INFO: EPOCH 1 - PROGRESS: at 92.80% examples, 128474 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:56,785: INFO: EPOCH 1 - PROGRESS: at 93.40% examples, 128704 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:13:57,835: INFO: EPOCH 1 - PROGRESS: at 93.93% examples, 128818 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:13:58,950: INFO: EPOCH 1 - PROGRESS: at 94.65% examples, 128852 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:00,000: INFO: EPOCH 1 - PROGRESS: at 95.29% examples, 129125 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:01,018: INFO: EPOCH 1 - PROGRESS: at 95.99% examples, 129460 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:02,027: INFO: EPOCH 1 - PROGRESS: at 96.49% examples, 129579 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:03,028: INFO: EPOCH 1 - PROGRESS: at 97.09% examples, 129797 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:04,056: INFO: EPOCH 1 - PROGRESS: at 97.68% examples, 129999 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:05,073: INFO: EPOCH 1 - PROGRESS: at 98.27% examples, 130197 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:06,083: INFO: EPOCH 1 - PROGRESS: at 98.88% examples, 130438 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:07,126: INFO: EPOCH 1 - PROGRESS: at 99.53% examples, 130806 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:07,454: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-16 10:14:07,504: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-16 10:14:07,538: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-16 10:14:07,550: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-16 10:14:07,557: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-16 10:14:07,572: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-16 10:14:07,611: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-16 10:14:07,621: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-16 10:14:07,622: INFO: EPOCH - 1 : training on 34286985 raw words (28702877 effective words) took 218.8s, 131160 effective words/s\n",
      "2018-05-16 10:14:08,645: INFO: EPOCH 2 - PROGRESS: at 0.38% examples, 108013 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:09,675: INFO: EPOCH 2 - PROGRESS: at 1.08% examples, 135992 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:10,698: INFO: EPOCH 2 - PROGRESS: at 1.78% examples, 155798 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:11,721: INFO: EPOCH 2 - PROGRESS: at 2.41% examples, 167240 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:12,721: INFO: EPOCH 2 - PROGRESS: at 2.89% examples, 164062 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:13,772: INFO: EPOCH 2 - PROGRESS: at 3.50% examples, 168372 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:14,793: INFO: EPOCH 2 - PROGRESS: at 4.20% examples, 171103 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:15,851: INFO: EPOCH 2 - PROGRESS: at 4.76% examples, 169295 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:16,857: INFO: EPOCH 2 - PROGRESS: at 5.41% examples, 171552 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:17,873: INFO: EPOCH 2 - PROGRESS: at 5.92% examples, 169822 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:18,891: INFO: EPOCH 2 - PROGRESS: at 6.64% examples, 170043 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:19,919: INFO: EPOCH 2 - PROGRESS: at 7.20% examples, 169981 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:20,988: INFO: EPOCH 2 - PROGRESS: at 7.79% examples, 171313 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:22,018: INFO: EPOCH 2 - PROGRESS: at 8.37% examples, 171240 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:23,022: INFO: EPOCH 2 - PROGRESS: at 8.83% examples, 168693 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:24,040: INFO: EPOCH 2 - PROGRESS: at 9.65% examples, 169009 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:25,087: INFO: EPOCH 2 - PROGRESS: at 10.41% examples, 169065 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:26,109: INFO: EPOCH 2 - PROGRESS: at 10.96% examples, 169048 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:27,111: INFO: EPOCH 2 - PROGRESS: at 11.57% examples, 168950 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:28,133: INFO: EPOCH 2 - PROGRESS: at 12.16% examples, 169353 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:29,154: INFO: EPOCH 2 - PROGRESS: at 12.68% examples, 168975 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:30,159: INFO: EPOCH 2 - PROGRESS: at 13.46% examples, 170716 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:31,159: INFO: EPOCH 2 - PROGRESS: at 13.96% examples, 170133 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:32,188: INFO: EPOCH 2 - PROGRESS: at 14.57% examples, 170324 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:33,227: INFO: EPOCH 2 - PROGRESS: at 15.24% examples, 170875 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:34,263: INFO: EPOCH 2 - PROGRESS: at 15.90% examples, 170818 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:35,307: INFO: EPOCH 2 - PROGRESS: at 16.53% examples, 170410 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:36,336: INFO: EPOCH 2 - PROGRESS: at 17.10% examples, 170055 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:37,377: INFO: EPOCH 2 - PROGRESS: at 17.64% examples, 169398 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:38,421: INFO: EPOCH 2 - PROGRESS: at 18.26% examples, 167754 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:39,434: INFO: EPOCH 2 - PROGRESS: at 18.83% examples, 167653 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:40,511: INFO: EPOCH 2 - PROGRESS: at 19.47% examples, 166999 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:41,545: INFO: EPOCH 2 - PROGRESS: at 20.09% examples, 166830 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:42,565: INFO: EPOCH 2 - PROGRESS: at 20.79% examples, 167483 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:43,587: INFO: EPOCH 2 - PROGRESS: at 21.41% examples, 167615 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:44,597: INFO: EPOCH 2 - PROGRESS: at 22.09% examples, 168408 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:45,642: INFO: EPOCH 2 - PROGRESS: at 22.65% examples, 168391 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:46,651: INFO: EPOCH 2 - PROGRESS: at 23.28% examples, 168702 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:47,670: INFO: EPOCH 2 - PROGRESS: at 23.93% examples, 169015 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:48,698: INFO: EPOCH 2 - PROGRESS: at 24.52% examples, 168814 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:49,711: INFO: EPOCH 2 - PROGRESS: at 25.17% examples, 168929 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:50,767: INFO: EPOCH 2 - PROGRESS: at 25.71% examples, 168137 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:51,773: INFO: EPOCH 2 - PROGRESS: at 26.18% examples, 167520 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:52,858: INFO: EPOCH 2 - PROGRESS: at 26.54% examples, 165681 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:53,864: INFO: EPOCH 2 - PROGRESS: at 27.20% examples, 165496 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:54,913: INFO: EPOCH 2 - PROGRESS: at 27.89% examples, 165910 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:56,091: INFO: EPOCH 2 - PROGRESS: at 28.50% examples, 165032 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:14:57,149: INFO: EPOCH 2 - PROGRESS: at 29.15% examples, 165351 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:58,186: INFO: EPOCH 2 - PROGRESS: at 29.70% examples, 164764 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:14:59,223: INFO: EPOCH 2 - PROGRESS: at 30.50% examples, 164918 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:00,309: INFO: EPOCH 2 - PROGRESS: at 30.99% examples, 164071 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:01,359: INFO: EPOCH 2 - PROGRESS: at 31.61% examples, 163995 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:02,369: INFO: EPOCH 2 - PROGRESS: at 32.25% examples, 163989 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:03,422: INFO: EPOCH 2 - PROGRESS: at 32.76% examples, 163529 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:04,468: INFO: EPOCH 2 - PROGRESS: at 33.32% examples, 163429 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:05,512: INFO: EPOCH 2 - PROGRESS: at 33.99% examples, 163381 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:06,511: INFO: EPOCH 2 - PROGRESS: at 34.59% examples, 163582 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:07,539: INFO: EPOCH 2 - PROGRESS: at 35.14% examples, 163126 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:08,581: INFO: EPOCH 2 - PROGRESS: at 35.72% examples, 162932 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:09,664: INFO: EPOCH 2 - PROGRESS: at 36.33% examples, 163013 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:10,691: INFO: EPOCH 2 - PROGRESS: at 37.00% examples, 163402 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:11,731: INFO: EPOCH 2 - PROGRESS: at 37.57% examples, 163340 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:12,770: INFO: EPOCH 2 - PROGRESS: at 38.27% examples, 163452 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:13,868: INFO: EPOCH 2 - PROGRESS: at 38.94% examples, 163652 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:14,896: INFO: EPOCH 2 - PROGRESS: at 39.45% examples, 163368 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:15,934: INFO: EPOCH 2 - PROGRESS: at 39.97% examples, 163093 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:17,060: INFO: EPOCH 2 - PROGRESS: at 40.54% examples, 162930 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:18,095: INFO: EPOCH 2 - PROGRESS: at 41.08% examples, 162696 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:19,176: INFO: EPOCH 2 - PROGRESS: at 41.63% examples, 162573 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:20,209: INFO: EPOCH 2 - PROGRESS: at 42.16% examples, 162454 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:21,256: INFO: EPOCH 2 - PROGRESS: at 42.75% examples, 162532 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:22,282: INFO: EPOCH 2 - PROGRESS: at 43.22% examples, 162310 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:23,426: INFO: EPOCH 2 - PROGRESS: at 43.64% examples, 161406 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:24,513: INFO: EPOCH 2 - PROGRESS: at 44.21% examples, 161534 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:25,583: INFO: EPOCH 2 - PROGRESS: at 44.68% examples, 161147 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:26,601: INFO: EPOCH 2 - PROGRESS: at 45.27% examples, 161381 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:27,615: INFO: EPOCH 2 - PROGRESS: at 45.90% examples, 161821 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:28,621: INFO: EPOCH 2 - PROGRESS: at 46.37% examples, 161549 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:29,637: INFO: EPOCH 2 - PROGRESS: at 46.98% examples, 161696 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:30,733: INFO: EPOCH 2 - PROGRESS: at 47.58% examples, 161778 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:31,918: INFO: EPOCH 2 - PROGRESS: at 48.20% examples, 161700 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:32,934: INFO: EPOCH 2 - PROGRESS: at 48.80% examples, 162033 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:34,033: INFO: EPOCH 2 - PROGRESS: at 49.33% examples, 161898 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:35,036: INFO: EPOCH 2 - PROGRESS: at 49.95% examples, 162010 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:36,133: INFO: EPOCH 2 - PROGRESS: at 50.44% examples, 161788 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:37,136: INFO: EPOCH 2 - PROGRESS: at 51.02% examples, 161942 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:38,161: INFO: EPOCH 2 - PROGRESS: at 51.48% examples, 161663 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:39,208: INFO: EPOCH 2 - PROGRESS: at 52.24% examples, 161924 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:40,308: INFO: EPOCH 2 - PROGRESS: at 52.79% examples, 161718 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:41,327: INFO: EPOCH 2 - PROGRESS: at 53.42% examples, 161774 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:42,360: INFO: EPOCH 2 - PROGRESS: at 54.00% examples, 161618 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:43,400: INFO: EPOCH 2 - PROGRESS: at 54.50% examples, 161367 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:44,434: INFO: EPOCH 2 - PROGRESS: at 54.97% examples, 161037 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:45,457: INFO: EPOCH 2 - PROGRESS: at 55.56% examples, 161063 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:46,510: INFO: EPOCH 2 - PROGRESS: at 56.15% examples, 160968 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:47,630: INFO: EPOCH 2 - PROGRESS: at 56.84% examples, 161179 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:48,681: INFO: EPOCH 2 - PROGRESS: at 57.40% examples, 161266 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:49,706: INFO: EPOCH 2 - PROGRESS: at 58.05% examples, 161544 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:50,729: INFO: EPOCH 2 - PROGRESS: at 58.69% examples, 161822 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:51,739: INFO: EPOCH 2 - PROGRESS: at 59.22% examples, 161563 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:52,759: INFO: EPOCH 2 - PROGRESS: at 59.95% examples, 161926 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:53,818: INFO: EPOCH 2 - PROGRESS: at 60.58% examples, 162115 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:55,056: INFO: EPOCH 2 - PROGRESS: at 61.25% examples, 162135 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:15:56,060: INFO: EPOCH 2 - PROGRESS: at 61.91% examples, 162481 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:57,096: INFO: EPOCH 2 - PROGRESS: at 62.57% examples, 162616 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:58,193: INFO: EPOCH 2 - PROGRESS: at 63.21% examples, 162722 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:15:59,226: INFO: EPOCH 2 - PROGRESS: at 63.76% examples, 162710 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:00,239: INFO: EPOCH 2 - PROGRESS: at 64.38% examples, 162788 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:01,253: INFO: EPOCH 2 - PROGRESS: at 65.10% examples, 162942 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:02,294: INFO: EPOCH 2 - PROGRESS: at 65.61% examples, 162846 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:03,371: INFO: EPOCH 2 - PROGRESS: at 66.28% examples, 163098 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:04,385: INFO: EPOCH 2 - PROGRESS: at 66.94% examples, 163292 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:05,385: INFO: EPOCH 2 - PROGRESS: at 67.60% examples, 163438 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:06,556: INFO: EPOCH 2 - PROGRESS: at 68.15% examples, 163299 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:07,574: INFO: EPOCH 2 - PROGRESS: at 68.88% examples, 163685 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:08,593: INFO: EPOCH 2 - PROGRESS: at 69.53% examples, 163810 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:09,639: INFO: EPOCH 2 - PROGRESS: at 70.09% examples, 163712 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:10,759: INFO: EPOCH 2 - PROGRESS: at 70.75% examples, 163778 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:11,766: INFO: EPOCH 2 - PROGRESS: at 71.36% examples, 163848 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:12,790: INFO: EPOCH 2 - PROGRESS: at 72.10% examples, 164216 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:13,830: INFO: EPOCH 2 - PROGRESS: at 72.59% examples, 164115 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:14,839: INFO: EPOCH 2 - PROGRESS: at 73.26% examples, 164377 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:15,863: INFO: EPOCH 2 - PROGRESS: at 73.90% examples, 164644 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:16,887: INFO: EPOCH 2 - PROGRESS: at 74.44% examples, 164509 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:17,917: INFO: EPOCH 2 - PROGRESS: at 75.14% examples, 164677 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:18,984: INFO: EPOCH 2 - PROGRESS: at 75.75% examples, 164667 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:20,237: INFO: EPOCH 2 - PROGRESS: at 76.34% examples, 164435 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:21,245: INFO: EPOCH 2 - PROGRESS: at 77.03% examples, 164560 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:22,323: INFO: EPOCH 2 - PROGRESS: at 77.63% examples, 164504 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:23,326: INFO: EPOCH 2 - PROGRESS: at 78.18% examples, 164444 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:24,357: INFO: EPOCH 2 - PROGRESS: at 78.54% examples, 164058 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:25,403: INFO: EPOCH 2 - PROGRESS: at 79.09% examples, 164010 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:26,421: INFO: EPOCH 2 - PROGRESS: at 79.59% examples, 163765 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:27,441: INFO: EPOCH 2 - PROGRESS: at 80.10% examples, 163777 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:28,456: INFO: EPOCH 2 - PROGRESS: at 80.71% examples, 163663 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:29,486: INFO: EPOCH 2 - PROGRESS: at 81.04% examples, 163302 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:30,487: INFO: EPOCH 2 - PROGRESS: at 81.62% examples, 163271 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:31,523: INFO: EPOCH 2 - PROGRESS: at 82.25% examples, 163306 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:32,584: INFO: EPOCH 2 - PROGRESS: at 82.89% examples, 163424 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:33,702: INFO: EPOCH 2 - PROGRESS: at 83.33% examples, 163139 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:34,730: INFO: EPOCH 2 - PROGRESS: at 83.60% examples, 162508 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:35,740: INFO: EPOCH 2 - PROGRESS: at 83.83% examples, 161839 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:36,770: INFO: EPOCH 2 - PROGRESS: at 84.05% examples, 161171 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:37,772: INFO: EPOCH 2 - PROGRESS: at 84.26% examples, 160548 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:38,855: INFO: EPOCH 2 - PROGRESS: at 84.60% examples, 160126 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:39,869: INFO: EPOCH 2 - PROGRESS: at 85.01% examples, 159897 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:41,071: INFO: EPOCH 2 - PROGRESS: at 85.39% examples, 159414 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:42,196: INFO: EPOCH 2 - PROGRESS: at 85.80% examples, 159068 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:43,201: INFO: EPOCH 2 - PROGRESS: at 86.23% examples, 158897 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:44,305: INFO: EPOCH 2 - PROGRESS: at 86.76% examples, 158784 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:45,412: INFO: EPOCH 2 - PROGRESS: at 87.36% examples, 158628 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:46,429: INFO: EPOCH 2 - PROGRESS: at 88.13% examples, 158731 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:47,449: INFO: EPOCH 2 - PROGRESS: at 88.60% examples, 158671 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:48,553: INFO: EPOCH 2 - PROGRESS: at 89.10% examples, 158574 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:49,633: INFO: EPOCH 2 - PROGRESS: at 89.54% examples, 158335 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:50,657: INFO: EPOCH 2 - PROGRESS: at 90.05% examples, 158322 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:51,676: INFO: EPOCH 2 - PROGRESS: at 90.59% examples, 158215 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:52,691: INFO: EPOCH 2 - PROGRESS: at 91.34% examples, 158358 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:53,776: INFO: EPOCH 2 - PROGRESS: at 91.95% examples, 158440 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:54,778: INFO: EPOCH 2 - PROGRESS: at 92.56% examples, 158594 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:55,781: INFO: EPOCH 2 - PROGRESS: at 93.12% examples, 158692 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:56,859: INFO: EPOCH 2 - PROGRESS: at 93.77% examples, 158865 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:57,886: INFO: EPOCH 2 - PROGRESS: at 94.41% examples, 158638 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:16:58,909: INFO: EPOCH 2 - PROGRESS: at 94.88% examples, 158532 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:16:59,923: INFO: EPOCH 2 - PROGRESS: at 95.52% examples, 158720 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:01,011: INFO: EPOCH 2 - PROGRESS: at 96.16% examples, 158834 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:02,054: INFO: EPOCH 2 - PROGRESS: at 96.68% examples, 158740 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:03,110: INFO: EPOCH 2 - PROGRESS: at 97.24% examples, 158784 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:04,132: INFO: EPOCH 2 - PROGRESS: at 97.92% examples, 158914 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:05,170: INFO: EPOCH 2 - PROGRESS: at 98.44% examples, 158920 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:06,186: INFO: EPOCH 2 - PROGRESS: at 98.80% examples, 158628 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:07,188: INFO: EPOCH 2 - PROGRESS: at 99.34% examples, 158722 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:07,845: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-16 10:17:07,913: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-16 10:17:07,915: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-16 10:17:07,931: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-16 10:17:07,943: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-16 10:17:07,979: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-16 10:17:07,993: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-16 10:17:07,999: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-16 10:17:08,000: INFO: EPOCH - 2 : training on 34286985 raw words (28705902 effective words) took 180.4s, 159160 effective words/s\n",
      "2018-05-16 10:17:09,298: INFO: EPOCH 3 - PROGRESS: at 0.47% examples, 98246 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:10,327: INFO: EPOCH 3 - PROGRESS: at 1.20% examples, 134467 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:11,379: INFO: EPOCH 3 - PROGRESS: at 1.86% examples, 149195 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:12,417: INFO: EPOCH 3 - PROGRESS: at 2.46% examples, 159144 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:13,516: INFO: EPOCH 3 - PROGRESS: at 2.95% examples, 154841 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:14,565: INFO: EPOCH 3 - PROGRESS: at 3.50% examples, 157794 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:15,590: INFO: EPOCH 3 - PROGRESS: at 4.15% examples, 160560 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:16,692: INFO: EPOCH 3 - PROGRESS: at 4.76% examples, 160280 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:17,720: INFO: EPOCH 3 - PROGRESS: at 5.32% examples, 159663 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:18,775: INFO: EPOCH 3 - PROGRESS: at 5.86% examples, 159287 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:19,777: INFO: EPOCH 3 - PROGRESS: at 6.56% examples, 160590 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:21,028: INFO: EPOCH 3 - PROGRESS: at 7.08% examples, 157268 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:22,094: INFO: EPOCH 3 - PROGRESS: at 7.62% examples, 158355 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:23,127: INFO: EPOCH 3 - PROGRESS: at 8.16% examples, 159106 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:24,137: INFO: EPOCH 3 - PROGRESS: at 8.71% examples, 158874 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:25,163: INFO: EPOCH 3 - PROGRESS: at 9.44% examples, 158239 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:26,175: INFO: EPOCH 3 - PROGRESS: at 10.07% examples, 159548 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:27,191: INFO: EPOCH 3 - PROGRESS: at 10.83% examples, 160676 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:28,322: INFO: EPOCH 3 - PROGRESS: at 11.43% examples, 159507 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:29,431: INFO: EPOCH 3 - PROGRESS: at 12.02% examples, 160112 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:30,433: INFO: EPOCH 3 - PROGRESS: at 12.60% examples, 161066 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:31,455: INFO: EPOCH 3 - PROGRESS: at 13.34% examples, 162260 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:32,584: INFO: EPOCH 3 - PROGRESS: at 13.90% examples, 162227 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:33,594: INFO: EPOCH 3 - PROGRESS: at 14.51% examples, 162829 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:34,595: INFO: EPOCH 3 - PROGRESS: at 15.21% examples, 164192 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:35,636: INFO: EPOCH 3 - PROGRESS: at 15.84% examples, 164025 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:36,640: INFO: EPOCH 3 - PROGRESS: at 16.40% examples, 163522 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:37,685: INFO: EPOCH 3 - PROGRESS: at 16.96% examples, 163093 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:38,708: INFO: EPOCH 3 - PROGRESS: at 17.44% examples, 162244 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:39,725: INFO: EPOCH 3 - PROGRESS: at 18.18% examples, 162307 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:40,772: INFO: EPOCH 3 - PROGRESS: at 18.64% examples, 160942 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:41,778: INFO: EPOCH 3 - PROGRESS: at 19.16% examples, 160569 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:42,786: INFO: EPOCH 3 - PROGRESS: at 19.84% examples, 160765 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:43,811: INFO: EPOCH 3 - PROGRESS: at 20.37% examples, 160124 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:44,884: INFO: EPOCH 3 - PROGRESS: at 21.03% examples, 160457 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:45,887: INFO: EPOCH 3 - PROGRESS: at 21.64% examples, 160874 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:46,902: INFO: EPOCH 3 - PROGRESS: at 22.30% examples, 161784 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:47,905: INFO: EPOCH 3 - PROGRESS: at 22.77% examples, 161247 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:49,028: INFO: EPOCH 3 - PROGRESS: at 23.42% examples, 161492 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:17:50,058: INFO: EPOCH 3 - PROGRESS: at 24.10% examples, 162085 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:51,139: INFO: EPOCH 3 - PROGRESS: at 24.65% examples, 161698 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:52,157: INFO: EPOCH 3 - PROGRESS: at 25.35% examples, 161773 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:53,194: INFO: EPOCH 3 - PROGRESS: at 25.93% examples, 161966 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:54,210: INFO: EPOCH 3 - PROGRESS: at 26.41% examples, 161461 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:55,409: INFO: EPOCH 3 - PROGRESS: at 26.85% examples, 159460 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:56,417: INFO: EPOCH 3 - PROGRESS: at 27.32% examples, 158722 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:57,462: INFO: EPOCH 3 - PROGRESS: at 27.80% examples, 158094 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:58,491: INFO: EPOCH 3 - PROGRESS: at 28.30% examples, 157553 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:17:59,996: INFO: EPOCH 3 - PROGRESS: at 28.74% examples, 155258 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:01,015: INFO: EPOCH 3 - PROGRESS: at 29.47% examples, 155876 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:02,114: INFO: EPOCH 3 - PROGRESS: at 30.12% examples, 155519 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:03,119: INFO: EPOCH 3 - PROGRESS: at 30.45% examples, 154058 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:04,141: INFO: EPOCH 3 - PROGRESS: at 30.75% examples, 152775 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:05,353: INFO: EPOCH 3 - PROGRESS: at 30.93% examples, 150414 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:06,391: INFO: EPOCH 3 - PROGRESS: at 31.23% examples, 149152 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:07,405: INFO: EPOCH 3 - PROGRESS: at 31.43% examples, 147594 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:08,501: INFO: EPOCH 3 - PROGRESS: at 31.83% examples, 146471 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:09,701: INFO: EPOCH 3 - PROGRESS: at 32.15% examples, 145076 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:10,830: INFO: EPOCH 3 - PROGRESS: at 32.43% examples, 143650 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:11,891: INFO: EPOCH 3 - PROGRESS: at 32.77% examples, 142802 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:13,458: INFO: EPOCH 3 - PROGRESS: at 32.98% examples, 140390 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:14,459: INFO: EPOCH 3 - PROGRESS: at 33.20% examples, 139269 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:15,602: INFO: EPOCH 3 - PROGRESS: at 33.55% examples, 138153 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:16,740: INFO: EPOCH 3 - PROGRESS: at 33.79% examples, 136830 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:17,790: INFO: EPOCH 3 - PROGRESS: at 34.14% examples, 136088 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:18,842: INFO: EPOCH 3 - PROGRESS: at 34.56% examples, 135842 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:19,869: INFO: EPOCH 3 - PROGRESS: at 35.11% examples, 135865 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:20,887: INFO: EPOCH 3 - PROGRESS: at 35.65% examples, 136015 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:21,907: INFO: EPOCH 3 - PROGRESS: at 36.24% examples, 136490 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:22,925: INFO: EPOCH 3 - PROGRESS: at 36.67% examples, 136288 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:23,997: INFO: EPOCH 3 - PROGRESS: at 37.09% examples, 135910 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:25,060: INFO: EPOCH 3 - PROGRESS: at 37.51% examples, 135651 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:26,096: INFO: EPOCH 3 - PROGRESS: at 37.89% examples, 135346 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:27,140: INFO: EPOCH 3 - PROGRESS: at 38.47% examples, 135281 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:28,362: INFO: EPOCH 3 - PROGRESS: at 38.94% examples, 134894 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:29,405: INFO: EPOCH 3 - PROGRESS: at 39.40% examples, 134793 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:30,422: INFO: EPOCH 3 - PROGRESS: at 39.66% examples, 134048 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:31,603: INFO: EPOCH 3 - PROGRESS: at 40.31% examples, 134517 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:32,696: INFO: EPOCH 3 - PROGRESS: at 41.00% examples, 135055 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:33,762: INFO: EPOCH 3 - PROGRESS: at 41.27% examples, 134265 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:34,852: INFO: EPOCH 3 - PROGRESS: at 41.63% examples, 133925 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:35,980: INFO: EPOCH 3 - PROGRESS: at 42.11% examples, 133830 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:37,006: INFO: EPOCH 3 - PROGRESS: at 42.75% examples, 134452 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:38,051: INFO: EPOCH 3 - PROGRESS: at 43.19% examples, 134466 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:39,077: INFO: EPOCH 3 - PROGRESS: at 43.80% examples, 134995 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:40,085: INFO: EPOCH 3 - PROGRESS: at 44.29% examples, 135149 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:41,186: INFO: EPOCH 3 - PROGRESS: at 44.83% examples, 135334 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:42,211: INFO: EPOCH 3 - PROGRESS: at 45.24% examples, 135188 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:43,220: INFO: EPOCH 3 - PROGRESS: at 45.58% examples, 134878 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:44,329: INFO: EPOCH 3 - PROGRESS: at 46.01% examples, 134711 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:45,394: INFO: EPOCH 3 - PROGRESS: at 46.37% examples, 134343 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:46,422: INFO: EPOCH 3 - PROGRESS: at 47.04% examples, 134906 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:47,449: INFO: EPOCH 3 - PROGRESS: at 47.61% examples, 135276 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:48,457: INFO: EPOCH 3 - PROGRESS: at 48.25% examples, 135845 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:49,487: INFO: EPOCH 3 - PROGRESS: at 48.74% examples, 136041 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:50,506: INFO: EPOCH 3 - PROGRESS: at 49.27% examples, 136303 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:51,523: INFO: EPOCH 3 - PROGRESS: at 49.92% examples, 136710 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:52,539: INFO: EPOCH 3 - PROGRESS: at 50.50% examples, 137136 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:53,551: INFO: EPOCH 3 - PROGRESS: at 50.88% examples, 136929 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:54,623: INFO: EPOCH 3 - PROGRESS: at 51.50% examples, 137344 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:55,734: INFO: EPOCH 3 - PROGRESS: at 52.30% examples, 137802 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:18:56,820: INFO: EPOCH 3 - PROGRESS: at 52.85% examples, 137892 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:57,844: INFO: EPOCH 3 - PROGRESS: at 53.45% examples, 138072 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:18:58,971: INFO: EPOCH 3 - PROGRESS: at 54.00% examples, 137966 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:00,061: INFO: EPOCH 3 - PROGRESS: at 54.55% examples, 138058 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:01,089: INFO: EPOCH 3 - PROGRESS: at 55.01% examples, 137922 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:02,187: INFO: EPOCH 3 - PROGRESS: at 55.61% examples, 137993 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:03,208: INFO: EPOCH 3 - PROGRESS: at 56.08% examples, 138010 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:04,334: INFO: EPOCH 3 - PROGRESS: at 56.81% examples, 138479 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:05,336: INFO: EPOCH 3 - PROGRESS: at 57.30% examples, 138595 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:06,400: INFO: EPOCH 3 - PROGRESS: at 57.80% examples, 138637 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:07,424: INFO: EPOCH 3 - PROGRESS: at 58.48% examples, 139138 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:08,526: INFO: EPOCH 3 - PROGRESS: at 59.02% examples, 139142 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:09,556: INFO: EPOCH 3 - PROGRESS: at 59.56% examples, 139078 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:10,646: INFO: EPOCH 3 - PROGRESS: at 60.22% examples, 139476 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:11,708: INFO: EPOCH 3 - PROGRESS: at 60.89% examples, 139913 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:12,746: INFO: EPOCH 3 - PROGRESS: at 61.42% examples, 140034 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:13,804: INFO: EPOCH 3 - PROGRESS: at 62.10% examples, 140449 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:14,877: INFO: EPOCH 3 - PROGRESS: at 62.76% examples, 140702 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:16,013: INFO: EPOCH 3 - PROGRESS: at 63.40% examples, 140998 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:17,077: INFO: EPOCH 3 - PROGRESS: at 63.92% examples, 141062 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:18,079: INFO: EPOCH 3 - PROGRESS: at 64.53% examples, 141238 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:19,083: INFO: EPOCH 3 - PROGRESS: at 65.25% examples, 141561 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:20,197: INFO: EPOCH 3 - PROGRESS: at 65.81% examples, 141683 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:21,205: INFO: EPOCH 3 - PROGRESS: at 66.43% examples, 142025 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:22,205: INFO: EPOCH 3 - PROGRESS: at 66.97% examples, 142008 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:23,258: INFO: EPOCH 3 - PROGRESS: at 67.50% examples, 142054 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:24,368: INFO: EPOCH 3 - PROGRESS: at 68.08% examples, 142237 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:25,406: INFO: EPOCH 3 - PROGRESS: at 68.70% examples, 142451 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:26,440: INFO: EPOCH 3 - PROGRESS: at 69.39% examples, 142840 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:27,462: INFO: EPOCH 3 - PROGRESS: at 70.00% examples, 143048 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:28,523: INFO: EPOCH 3 - PROGRESS: at 70.51% examples, 143044 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:29,632: INFO: EPOCH 3 - PROGRESS: at 71.19% examples, 143212 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:30,637: INFO: EPOCH 3 - PROGRESS: at 71.77% examples, 143313 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:31,644: INFO: EPOCH 3 - PROGRESS: at 72.38% examples, 143735 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:32,657: INFO: EPOCH 3 - PROGRESS: at 72.78% examples, 143583 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:33,691: INFO: EPOCH 3 - PROGRESS: at 73.35% examples, 143704 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:34,755: INFO: EPOCH 3 - PROGRESS: at 73.73% examples, 143533 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:35,911: INFO: EPOCH 3 - PROGRESS: at 74.22% examples, 143374 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:37,173: INFO: EPOCH 3 - PROGRESS: at 74.65% examples, 143005 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:38,261: INFO: EPOCH 3 - PROGRESS: at 75.23% examples, 142963 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:39,275: INFO: EPOCH 3 - PROGRESS: at 75.84% examples, 143159 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:40,351: INFO: EPOCH 3 - PROGRESS: at 76.34% examples, 143137 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:41,444: INFO: EPOCH 3 - PROGRESS: at 76.88% examples, 143036 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:42,446: INFO: EPOCH 3 - PROGRESS: at 77.55% examples, 143251 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:43,455: INFO: EPOCH 3 - PROGRESS: at 78.18% examples, 143554 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:44,523: INFO: EPOCH 3 - PROGRESS: at 78.73% examples, 143688 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:45,564: INFO: EPOCH 3 - PROGRESS: at 79.26% examples, 143633 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:46,581: INFO: EPOCH 3 - PROGRESS: at 79.88% examples, 143929 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:47,595: INFO: EPOCH 3 - PROGRESS: at 80.39% examples, 144056 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:48,607: INFO: EPOCH 3 - PROGRESS: at 81.04% examples, 144245 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:49,618: INFO: EPOCH 3 - PROGRESS: at 81.62% examples, 144326 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:50,656: INFO: EPOCH 3 - PROGRESS: at 82.29% examples, 144525 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:51,759: INFO: EPOCH 3 - PROGRESS: at 82.99% examples, 144861 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:52,819: INFO: EPOCH 3 - PROGRESS: at 83.57% examples, 144994 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:53,896: INFO: EPOCH 3 - PROGRESS: at 84.28% examples, 145357 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:54,980: INFO: EPOCH 3 - PROGRESS: at 84.95% examples, 145685 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:56,023: INFO: EPOCH 3 - PROGRESS: at 85.63% examples, 146032 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:57,079: INFO: EPOCH 3 - PROGRESS: at 86.15% examples, 146059 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:19:58,095: INFO: EPOCH 3 - PROGRESS: at 86.76% examples, 146262 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:19:59,186: INFO: EPOCH 3 - PROGRESS: at 87.59% examples, 146323 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:00,233: INFO: EPOCH 3 - PROGRESS: at 88.13% examples, 146355 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:01,239: INFO: EPOCH 3 - PROGRESS: at 88.76% examples, 146680 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:02,264: INFO: EPOCH 3 - PROGRESS: at 89.30% examples, 146775 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:03,735: INFO: EPOCH 3 - PROGRESS: at 89.75% examples, 146350 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:04,748: INFO: EPOCH 3 - PROGRESS: at 90.08% examples, 146084 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:05,814: INFO: EPOCH 3 - PROGRESS: at 90.67% examples, 146108 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:06,815: INFO: EPOCH 3 - PROGRESS: at 91.34% examples, 146182 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:07,816: INFO: EPOCH 3 - PROGRESS: at 91.84% examples, 146212 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:08,893: INFO: EPOCH 3 - PROGRESS: at 92.44% examples, 146317 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:09,917: INFO: EPOCH 3 - PROGRESS: at 93.04% examples, 146549 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:10,969: INFO: EPOCH 3 - PROGRESS: at 93.65% examples, 146755 words/s, in_qsize 14, out_qsize 1\n",
      "2018-05-16 10:20:11,990: INFO: EPOCH 3 - PROGRESS: at 94.35% examples, 146749 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:12,992: INFO: EPOCH 3 - PROGRESS: at 95.00% examples, 146964 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:14,033: INFO: EPOCH 3 - PROGRESS: at 95.60% examples, 147135 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:15,043: INFO: EPOCH 3 - PROGRESS: at 96.21% examples, 147324 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:16,089: INFO: EPOCH 3 - PROGRESS: at 96.68% examples, 147211 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:17,168: INFO: EPOCH 3 - PROGRESS: at 97.24% examples, 147298 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:18,207: INFO: EPOCH 3 - PROGRESS: at 97.87% examples, 147381 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:19,301: INFO: EPOCH 3 - PROGRESS: at 98.38% examples, 147407 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:20,351: INFO: EPOCH 3 - PROGRESS: at 98.83% examples, 147299 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:21,366: INFO: EPOCH 3 - PROGRESS: at 99.22% examples, 147177 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:22,334: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-16 10:20:22,464: INFO: EPOCH 3 - PROGRESS: at 99.84% examples, 147368 words/s, in_qsize 6, out_qsize 1\n",
      "2018-05-16 10:20:22,466: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-16 10:20:22,477: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-16 10:20:22,479: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-16 10:20:22,487: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-16 10:20:22,493: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-16 10:20:22,501: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-16 10:20:22,521: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-16 10:20:22,522: INFO: EPOCH - 3 : training on 34286985 raw words (28704507 effective words) took 194.5s, 147584 effective words/s\n",
      "2018-05-16 10:20:23,605: INFO: EPOCH 4 - PROGRESS: at 0.42% examples, 111492 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:24,610: INFO: EPOCH 4 - PROGRESS: at 1.11% examples, 138801 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:25,634: INFO: EPOCH 4 - PROGRESS: at 1.75% examples, 152194 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:26,658: INFO: EPOCH 4 - PROGRESS: at 2.36% examples, 162445 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:27,678: INFO: EPOCH 4 - PROGRESS: at 3.01% examples, 169441 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:28,732: INFO: EPOCH 4 - PROGRESS: at 3.48% examples, 166003 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:29,783: INFO: EPOCH 4 - PROGRESS: at 4.12% examples, 167112 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:30,796: INFO: EPOCH 4 - PROGRESS: at 4.81% examples, 170758 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:31,840: INFO: EPOCH 4 - PROGRESS: at 5.35% examples, 167794 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:32,861: INFO: EPOCH 4 - PROGRESS: at 5.89% examples, 167873 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:33,862: INFO: EPOCH 4 - PROGRESS: at 6.59% examples, 167766 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:34,936: INFO: EPOCH 4 - PROGRESS: at 7.20% examples, 168639 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:35,961: INFO: EPOCH 4 - PROGRESS: at 7.66% examples, 166928 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:36,976: INFO: EPOCH 4 - PROGRESS: at 8.15% examples, 166725 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:38,014: INFO: EPOCH 4 - PROGRESS: at 8.62% examples, 163570 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:39,026: INFO: EPOCH 4 - PROGRESS: at 9.22% examples, 160215 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:40,318: INFO: EPOCH 4 - PROGRESS: at 9.59% examples, 155103 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:41,352: INFO: EPOCH 4 - PROGRESS: at 10.09% examples, 154577 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:42,434: INFO: EPOCH 4 - PROGRESS: at 10.81% examples, 154590 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:43,522: INFO: EPOCH 4 - PROGRESS: at 11.46% examples, 154885 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:44,523: INFO: EPOCH 4 - PROGRESS: at 11.93% examples, 154597 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:45,582: INFO: EPOCH 4 - PROGRESS: at 12.46% examples, 155002 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:46,603: INFO: EPOCH 4 - PROGRESS: at 13.03% examples, 156003 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:47,666: INFO: EPOCH 4 - PROGRESS: at 13.81% examples, 157722 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:48,709: INFO: EPOCH 4 - PROGRESS: at 14.33% examples, 157351 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:49,715: INFO: EPOCH 4 - PROGRESS: at 14.92% examples, 157627 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:50,731: INFO: EPOCH 4 - PROGRESS: at 15.62% examples, 158405 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:20:51,918: INFO: EPOCH 4 - PROGRESS: at 16.31% examples, 158571 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:52,991: INFO: EPOCH 4 - PROGRESS: at 16.96% examples, 158979 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:53,999: INFO: EPOCH 4 - PROGRESS: at 17.55% examples, 159400 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:55,007: INFO: EPOCH 4 - PROGRESS: at 18.35% examples, 159878 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:56,070: INFO: EPOCH 4 - PROGRESS: at 18.88% examples, 159520 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:57,098: INFO: EPOCH 4 - PROGRESS: at 19.46% examples, 158895 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:58,117: INFO: EPOCH 4 - PROGRESS: at 20.16% examples, 159519 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:20:59,137: INFO: EPOCH 4 - PROGRESS: at 20.75% examples, 159659 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:00,200: INFO: EPOCH 4 - PROGRESS: at 21.41% examples, 160050 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:01,243: INFO: EPOCH 4 - PROGRESS: at 22.08% examples, 160874 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:02,255: INFO: EPOCH 4 - PROGRESS: at 22.68% examples, 161391 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:03,338: INFO: EPOCH 4 - PROGRESS: at 23.18% examples, 160755 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:04,342: INFO: EPOCH 4 - PROGRESS: at 23.74% examples, 160684 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:05,345: INFO: EPOCH 4 - PROGRESS: at 24.36% examples, 161009 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:06,374: INFO: EPOCH 4 - PROGRESS: at 24.87% examples, 160455 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:07,389: INFO: EPOCH 4 - PROGRESS: at 25.55% examples, 160587 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:08,477: INFO: EPOCH 4 - PROGRESS: at 26.04% examples, 160073 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:09,524: INFO: EPOCH 4 - PROGRESS: at 26.51% examples, 159327 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:10,850: INFO: EPOCH 4 - PROGRESS: at 26.94% examples, 157002 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:11,911: INFO: EPOCH 4 - PROGRESS: at 27.35% examples, 155829 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:12,928: INFO: EPOCH 4 - PROGRESS: at 27.72% examples, 154690 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:13,955: INFO: EPOCH 4 - PROGRESS: at 28.17% examples, 154067 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:14,964: INFO: EPOCH 4 - PROGRESS: at 28.77% examples, 154153 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:15,977: INFO: EPOCH 4 - PROGRESS: at 29.21% examples, 153547 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:16,981: INFO: EPOCH 4 - PROGRESS: at 29.80% examples, 153181 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:18,030: INFO: EPOCH 4 - PROGRESS: at 30.28% examples, 152424 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:19,108: INFO: EPOCH 4 - PROGRESS: at 30.93% examples, 152507 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:20,153: INFO: EPOCH 4 - PROGRESS: at 31.37% examples, 151886 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:21,167: INFO: EPOCH 4 - PROGRESS: at 32.07% examples, 152269 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:22,218: INFO: EPOCH 4 - PROGRESS: at 32.74% examples, 152743 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:23,257: INFO: EPOCH 4 - PROGRESS: at 33.25% examples, 152712 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:24,309: INFO: EPOCH 4 - PROGRESS: at 33.99% examples, 153098 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:25,354: INFO: EPOCH 4 - PROGRESS: at 34.62% examples, 153470 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:26,432: INFO: EPOCH 4 - PROGRESS: at 35.36% examples, 153871 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:27,536: INFO: EPOCH 4 - PROGRESS: at 35.97% examples, 153938 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:28,539: INFO: EPOCH 4 - PROGRESS: at 36.62% examples, 154480 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:29,600: INFO: EPOCH 4 - PROGRESS: at 37.29% examples, 154905 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:30,622: INFO: EPOCH 4 - PROGRESS: at 37.77% examples, 154776 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:31,628: INFO: EPOCH 4 - PROGRESS: at 38.54% examples, 155211 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:32,655: INFO: EPOCH 4 - PROGRESS: at 39.21% examples, 155685 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:33,663: INFO: EPOCH 4 - PROGRESS: at 39.84% examples, 156044 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:34,698: INFO: EPOCH 4 - PROGRESS: at 40.34% examples, 155973 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:35,748: INFO: EPOCH 4 - PROGRESS: at 41.02% examples, 156378 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:36,750: INFO: EPOCH 4 - PROGRESS: at 41.65% examples, 156857 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:37,799: INFO: EPOCH 4 - PROGRESS: at 42.24% examples, 157011 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:38,835: INFO: EPOCH 4 - PROGRESS: at 42.86% examples, 157289 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:39,879: INFO: EPOCH 4 - PROGRESS: at 43.48% examples, 157750 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:40,890: INFO: EPOCH 4 - PROGRESS: at 44.17% examples, 158408 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:41,896: INFO: EPOCH 4 - PROGRESS: at 44.70% examples, 158407 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:42,899: INFO: EPOCH 4 - PROGRESS: at 45.36% examples, 158905 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:43,921: INFO: EPOCH 4 - PROGRESS: at 45.98% examples, 159362 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:45,043: INFO: EPOCH 4 - PROGRESS: at 46.52% examples, 159192 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:46,126: INFO: EPOCH 4 - PROGRESS: at 47.20% examples, 159456 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:47,166: INFO: EPOCH 4 - PROGRESS: at 47.85% examples, 159849 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:48,190: INFO: EPOCH 4 - PROGRESS: at 48.48% examples, 160224 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:49,194: INFO: EPOCH 4 - PROGRESS: at 48.99% examples, 160191 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:50,264: INFO: EPOCH 4 - PROGRESS: at 49.62% examples, 160342 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:51,307: INFO: EPOCH 4 - PROGRESS: at 50.35% examples, 160946 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:52,429: INFO: EPOCH 4 - PROGRESS: at 50.88% examples, 160786 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:53,432: INFO: EPOCH 4 - PROGRESS: at 51.50% examples, 161116 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:54,532: INFO: EPOCH 4 - PROGRESS: at 52.27% examples, 161291 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:21:55,611: INFO: EPOCH 4 - PROGRESS: at 52.86% examples, 161232 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:56,705: INFO: EPOCH 4 - PROGRESS: at 53.45% examples, 161069 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:57,732: INFO: EPOCH 4 - PROGRESS: at 54.13% examples, 161286 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:58,783: INFO: EPOCH 4 - PROGRESS: at 54.80% examples, 161465 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:21:59,803: INFO: EPOCH 4 - PROGRESS: at 55.38% examples, 161414 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:00,816: INFO: EPOCH 4 - PROGRESS: at 56.02% examples, 161624 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:01,847: INFO: EPOCH 4 - PROGRESS: at 56.63% examples, 161722 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:02,917: INFO: EPOCH 4 - PROGRESS: at 57.32% examples, 162104 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:03,917: INFO: EPOCH 4 - PROGRESS: at 57.86% examples, 162096 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:04,919: INFO: EPOCH 4 - PROGRESS: at 58.50% examples, 162390 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:05,931: INFO: EPOCH 4 - PROGRESS: at 59.10% examples, 162371 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:06,994: INFO: EPOCH 4 - PROGRESS: at 59.70% examples, 162258 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:08,041: INFO: EPOCH 4 - PROGRESS: at 60.37% examples, 162552 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:09,135: INFO: EPOCH 4 - PROGRESS: at 61.02% examples, 162777 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:10,364: INFO: EPOCH 4 - PROGRESS: at 61.68% examples, 162791 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:11,371: INFO: EPOCH 4 - PROGRESS: at 62.35% examples, 162972 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:12,392: INFO: EPOCH 4 - PROGRESS: at 62.99% examples, 163126 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:13,471: INFO: EPOCH 4 - PROGRESS: at 63.61% examples, 163315 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:14,496: INFO: EPOCH 4 - PROGRESS: at 64.09% examples, 163087 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:15,550: INFO: EPOCH 4 - PROGRESS: at 64.78% examples, 163029 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:16,564: INFO: EPOCH 4 - PROGRESS: at 65.35% examples, 163040 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:17,589: INFO: EPOCH 4 - PROGRESS: at 65.91% examples, 163097 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:18,642: INFO: EPOCH 4 - PROGRESS: at 66.38% examples, 162818 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:19,664: INFO: EPOCH 4 - PROGRESS: at 66.94% examples, 162792 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:20,673: INFO: EPOCH 4 - PROGRESS: at 67.61% examples, 162933 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:21,866: INFO: EPOCH 4 - PROGRESS: at 68.24% examples, 162973 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:22,891: INFO: EPOCH 4 - PROGRESS: at 68.93% examples, 163288 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:23,922: INFO: EPOCH 4 - PROGRESS: at 69.61% examples, 163402 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:24,937: INFO: EPOCH 4 - PROGRESS: at 70.22% examples, 163548 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:25,986: INFO: EPOCH 4 - PROGRESS: at 70.74% examples, 163375 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:27,011: INFO: EPOCH 4 - PROGRESS: at 71.40% examples, 163555 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:28,090: INFO: EPOCH 4 - PROGRESS: at 72.13% examples, 163787 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:29,138: INFO: EPOCH 4 - PROGRESS: at 72.70% examples, 163881 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:30,141: INFO: EPOCH 4 - PROGRESS: at 73.35% examples, 164087 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:31,170: INFO: EPOCH 4 - PROGRESS: at 73.97% examples, 164350 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:32,234: INFO: EPOCH 4 - PROGRESS: at 74.64% examples, 164430 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:33,306: INFO: EPOCH 4 - PROGRESS: at 75.22% examples, 164282 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:34,319: INFO: EPOCH 4 - PROGRESS: at 75.94% examples, 164537 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:35,321: INFO: EPOCH 4 - PROGRESS: at 76.65% examples, 164743 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:36,354: INFO: EPOCH 4 - PROGRESS: at 77.22% examples, 164534 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:37,400: INFO: EPOCH 4 - PROGRESS: at 77.81% examples, 164688 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:38,439: INFO: EPOCH 4 - PROGRESS: at 78.45% examples, 164895 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:39,557: INFO: EPOCH 4 - PROGRESS: at 79.14% examples, 164999 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:40,596: INFO: EPOCH 4 - PROGRESS: at 79.76% examples, 165023 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:41,597: INFO: EPOCH 4 - PROGRESS: at 80.34% examples, 165223 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:42,647: INFO: EPOCH 4 - PROGRESS: at 81.02% examples, 165295 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:43,659: INFO: EPOCH 4 - PROGRESS: at 81.68% examples, 165357 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:44,665: INFO: EPOCH 4 - PROGRESS: at 82.23% examples, 165293 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:45,681: INFO: EPOCH 4 - PROGRESS: at 82.87% examples, 165454 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:46,727: INFO: EPOCH 4 - PROGRESS: at 83.47% examples, 165573 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:47,748: INFO: EPOCH 4 - PROGRESS: at 84.07% examples, 165607 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:48,759: INFO: EPOCH 4 - PROGRESS: at 84.64% examples, 165678 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:49,790: INFO: EPOCH 4 - PROGRESS: at 85.26% examples, 165849 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:51,015: INFO: EPOCH 4 - PROGRESS: at 85.95% examples, 165890 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:52,203: INFO: EPOCH 4 - PROGRESS: at 86.62% examples, 165916 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:53,219: INFO: EPOCH 4 - PROGRESS: at 87.30% examples, 166007 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:54,293: INFO: EPOCH 4 - PROGRESS: at 88.10% examples, 166057 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:55,349: INFO: EPOCH 4 - PROGRESS: at 88.67% examples, 166127 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:56,355: INFO: EPOCH 4 - PROGRESS: at 89.27% examples, 166237 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:57,453: INFO: EPOCH 4 - PROGRESS: at 89.87% examples, 166295 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:22:58,518: INFO: EPOCH 4 - PROGRESS: at 90.43% examples, 166084 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:22:59,523: INFO: EPOCH 4 - PROGRESS: at 91.17% examples, 166147 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:00,582: INFO: EPOCH 4 - PROGRESS: at 91.81% examples, 166309 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:01,606: INFO: EPOCH 4 - PROGRESS: at 92.49% examples, 166506 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:02,618: INFO: EPOCH 4 - PROGRESS: at 93.01% examples, 166496 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:03,633: INFO: EPOCH 4 - PROGRESS: at 93.60% examples, 166588 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:04,644: INFO: EPOCH 4 - PROGRESS: at 94.06% examples, 166281 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:05,692: INFO: EPOCH 4 - PROGRESS: at 94.75% examples, 166229 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:06,748: INFO: EPOCH 4 - PROGRESS: at 95.41% examples, 166333 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:07,854: INFO: EPOCH 4 - PROGRESS: at 96.08% examples, 166443 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:08,876: INFO: EPOCH 4 - PROGRESS: at 96.76% examples, 166618 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:09,887: INFO: EPOCH 4 - PROGRESS: at 97.24% examples, 166510 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:10,905: INFO: EPOCH 4 - PROGRESS: at 97.94% examples, 166651 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:11,957: INFO: EPOCH 4 - PROGRESS: at 98.50% examples, 166648 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:12,971: INFO: EPOCH 4 - PROGRESS: at 99.10% examples, 166789 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:13,987: INFO: EPOCH 4 - PROGRESS: at 99.59% examples, 166723 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:14,266: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-16 10:23:14,353: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-16 10:23:14,379: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-16 10:23:14,396: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-16 10:23:14,425: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-16 10:23:14,436: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-16 10:23:14,439: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-16 10:23:14,459: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-16 10:23:14,461: INFO: EPOCH - 4 : training on 34286985 raw words (28705729 effective words) took 171.9s, 166992 effective words/s\n",
      "2018-05-16 10:23:15,517: INFO: EPOCH 5 - PROGRESS: at 0.34% examples, 97155 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:16,618: INFO: EPOCH 5 - PROGRESS: at 0.90% examples, 110084 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:17,624: INFO: EPOCH 5 - PROGRESS: at 1.35% examples, 114286 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:18,677: INFO: EPOCH 5 - PROGRESS: at 1.94% examples, 125469 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:19,689: INFO: EPOCH 5 - PROGRESS: at 2.41% examples, 131169 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:20,717: INFO: EPOCH 5 - PROGRESS: at 2.92% examples, 135215 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:21,726: INFO: EPOCH 5 - PROGRESS: at 3.36% examples, 135880 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:22,764: INFO: EPOCH 5 - PROGRESS: at 3.88% examples, 137805 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:23,775: INFO: EPOCH 5 - PROGRESS: at 4.43% examples, 138854 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:24,822: INFO: EPOCH 5 - PROGRESS: at 4.97% examples, 140080 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:25,864: INFO: EPOCH 5 - PROGRESS: at 5.44% examples, 139641 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:26,866: INFO: EPOCH 5 - PROGRESS: at 5.92% examples, 140316 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:27,894: INFO: EPOCH 5 - PROGRESS: at 6.61% examples, 142012 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:28,918: INFO: EPOCH 5 - PROGRESS: at 7.20% examples, 144601 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:29,930: INFO: EPOCH 5 - PROGRESS: at 7.63% examples, 144302 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:30,944: INFO: EPOCH 5 - PROGRESS: at 8.16% examples, 146030 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:32,026: INFO: EPOCH 5 - PROGRESS: at 8.69% examples, 145497 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:33,071: INFO: EPOCH 5 - PROGRESS: at 9.46% examples, 145974 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:34,120: INFO: EPOCH 5 - PROGRESS: at 9.87% examples, 144519 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:35,121: INFO: EPOCH 5 - PROGRESS: at 10.62% examples, 146045 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:36,122: INFO: EPOCH 5 - PROGRESS: at 11.23% examples, 146953 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:37,136: INFO: EPOCH 5 - PROGRESS: at 11.77% examples, 148074 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:38,140: INFO: EPOCH 5 - PROGRESS: at 12.26% examples, 148083 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:39,159: INFO: EPOCH 5 - PROGRESS: at 12.74% examples, 148356 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:40,171: INFO: EPOCH 5 - PROGRESS: at 13.44% examples, 149320 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:41,173: INFO: EPOCH 5 - PROGRESS: at 14.03% examples, 150817 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:42,215: INFO: EPOCH 5 - PROGRESS: at 14.54% examples, 150449 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:43,233: INFO: EPOCH 5 - PROGRESS: at 15.21% examples, 151769 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:44,251: INFO: EPOCH 5 - PROGRESS: at 15.78% examples, 151594 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:45,271: INFO: EPOCH 5 - PROGRESS: at 16.46% examples, 152565 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:46,329: INFO: EPOCH 5 - PROGRESS: at 16.96% examples, 151930 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:47,427: INFO: EPOCH 5 - PROGRESS: at 17.61% examples, 152640 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:48,508: INFO: EPOCH 5 - PROGRESS: at 18.41% examples, 152962 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:49,533: INFO: EPOCH 5 - PROGRESS: at 19.01% examples, 153467 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:50,545: INFO: EPOCH 5 - PROGRESS: at 19.63% examples, 153373 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:51,588: INFO: EPOCH 5 - PROGRESS: at 20.28% examples, 153776 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:52,602: INFO: EPOCH 5 - PROGRESS: at 20.81% examples, 153673 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:53,638: INFO: EPOCH 5 - PROGRESS: at 21.42% examples, 153877 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:54,638: INFO: EPOCH 5 - PROGRESS: at 22.01% examples, 154380 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:55,721: INFO: EPOCH 5 - PROGRESS: at 22.65% examples, 155168 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:56,748: INFO: EPOCH 5 - PROGRESS: at 23.16% examples, 154912 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:57,750: INFO: EPOCH 5 - PROGRESS: at 23.63% examples, 154597 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:23:58,751: INFO: EPOCH 5 - PROGRESS: at 24.28% examples, 155050 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:23:59,809: INFO: EPOCH 5 - PROGRESS: at 24.91% examples, 155286 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:00,867: INFO: EPOCH 5 - PROGRESS: at 25.45% examples, 154658 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:01,868: INFO: EPOCH 5 - PROGRESS: at 26.04% examples, 155110 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:02,932: INFO: EPOCH 5 - PROGRESS: at 26.60% examples, 154948 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:03,956: INFO: EPOCH 5 - PROGRESS: at 27.26% examples, 154940 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:04,974: INFO: EPOCH 5 - PROGRESS: at 27.82% examples, 154983 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:06,011: INFO: EPOCH 5 - PROGRESS: at 28.25% examples, 154005 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:07,096: INFO: EPOCH 5 - PROGRESS: at 28.72% examples, 153227 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:08,102: INFO: EPOCH 5 - PROGRESS: at 29.21% examples, 152976 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:09,247: INFO: EPOCH 5 - PROGRESS: at 29.85% examples, 152532 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:10,279: INFO: EPOCH 5 - PROGRESS: at 30.59% examples, 152906 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:11,352: INFO: EPOCH 5 - PROGRESS: at 31.23% examples, 153101 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:12,392: INFO: EPOCH 5 - PROGRESS: at 31.64% examples, 152259 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:13,399: INFO: EPOCH 5 - PROGRESS: at 32.25% examples, 152323 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:14,434: INFO: EPOCH 5 - PROGRESS: at 32.66% examples, 151610 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:15,452: INFO: EPOCH 5 - PROGRESS: at 32.93% examples, 150416 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:16,505: INFO: EPOCH 5 - PROGRESS: at 33.56% examples, 150547 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:17,612: INFO: EPOCH 5 - PROGRESS: at 34.11% examples, 150287 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:18,656: INFO: EPOCH 5 - PROGRESS: at 34.74% examples, 150703 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:19,668: INFO: EPOCH 5 - PROGRESS: at 35.50% examples, 151297 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:20,678: INFO: EPOCH 5 - PROGRESS: at 36.00% examples, 151231 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:21,692: INFO: EPOCH 5 - PROGRESS: at 36.57% examples, 151411 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:22,695: INFO: EPOCH 5 - PROGRESS: at 37.15% examples, 151638 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:23,741: INFO: EPOCH 5 - PROGRESS: at 37.78% examples, 152112 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:24,888: INFO: EPOCH 5 - PROGRESS: at 38.41% examples, 151792 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:25,893: INFO: EPOCH 5 - PROGRESS: at 39.09% examples, 152348 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:26,940: INFO: EPOCH 5 - PROGRESS: at 39.69% examples, 152560 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:27,953: INFO: EPOCH 5 - PROGRESS: at 40.23% examples, 152701 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:29,038: INFO: EPOCH 5 - PROGRESS: at 40.74% examples, 152479 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:30,050: INFO: EPOCH 5 - PROGRESS: at 41.44% examples, 153119 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:31,087: INFO: EPOCH 5 - PROGRESS: at 41.93% examples, 153009 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:32,122: INFO: EPOCH 5 - PROGRESS: at 42.41% examples, 152810 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:33,165: INFO: EPOCH 5 - PROGRESS: at 43.02% examples, 153125 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:34,306: INFO: EPOCH 5 - PROGRESS: at 43.66% examples, 153345 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:35,359: INFO: EPOCH 5 - PROGRESS: at 44.31% examples, 153844 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:36,516: INFO: EPOCH 5 - PROGRESS: at 44.86% examples, 153814 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:37,551: INFO: EPOCH 5 - PROGRESS: at 45.53% examples, 154388 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:38,570: INFO: EPOCH 5 - PROGRESS: at 46.13% examples, 154792 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:39,573: INFO: EPOCH 5 - PROGRESS: at 46.73% examples, 155113 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:40,646: INFO: EPOCH 5 - PROGRESS: at 47.28% examples, 154953 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:41,680: INFO: EPOCH 5 - PROGRESS: at 47.94% examples, 155411 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:42,722: INFO: EPOCH 5 - PROGRESS: at 48.62% examples, 155970 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:43,822: INFO: EPOCH 5 - PROGRESS: at 49.14% examples, 155898 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:44,857: INFO: EPOCH 5 - PROGRESS: at 49.85% examples, 156292 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:45,905: INFO: EPOCH 5 - PROGRESS: at 50.44% examples, 156605 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:47,043: INFO: EPOCH 5 - PROGRESS: at 51.07% examples, 156760 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:48,148: INFO: EPOCH 5 - PROGRESS: at 51.57% examples, 156587 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:49,160: INFO: EPOCH 5 - PROGRESS: at 52.24% examples, 156607 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:50,213: INFO: EPOCH 5 - PROGRESS: at 52.64% examples, 156107 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:51,235: INFO: EPOCH 5 - PROGRESS: at 53.11% examples, 155852 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:52,247: INFO: EPOCH 5 - PROGRESS: at 53.65% examples, 155632 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:53,276: INFO: EPOCH 5 - PROGRESS: at 54.20% examples, 155553 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:54,280: INFO: EPOCH 5 - PROGRESS: at 54.83% examples, 155769 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:55,287: INFO: EPOCH 5 - PROGRESS: at 55.41% examples, 155796 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:56,332: INFO: EPOCH 5 - PROGRESS: at 55.99% examples, 155844 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:57,336: INFO: EPOCH 5 - PROGRESS: at 56.58% examples, 155961 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:24:58,417: INFO: EPOCH 5 - PROGRESS: at 57.25% examples, 156282 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:24:59,502: INFO: EPOCH 5 - PROGRESS: at 57.76% examples, 156203 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:00,512: INFO: EPOCH 5 - PROGRESS: at 58.40% examples, 156532 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:25:01,612: INFO: EPOCH 5 - PROGRESS: at 58.94% examples, 156365 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:25:02,672: INFO: EPOCH 5 - PROGRESS: at 59.68% examples, 156555 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:03,858: INFO: EPOCH 5 - PROGRESS: at 59.95% examples, 155624 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:04,908: INFO: EPOCH 5 - PROGRESS: at 60.25% examples, 154970 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:05,973: INFO: EPOCH 5 - PROGRESS: at 60.56% examples, 154317 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:07,145: INFO: EPOCH 5 - PROGRESS: at 61.00% examples, 153910 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:08,161: INFO: EPOCH 5 - PROGRESS: at 61.45% examples, 153726 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:09,234: INFO: EPOCH 5 - PROGRESS: at 61.91% examples, 153517 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:10,337: INFO: EPOCH 5 - PROGRESS: at 62.23% examples, 152853 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:11,437: INFO: EPOCH 5 - PROGRESS: at 62.76% examples, 152625 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:25:12,460: INFO: EPOCH 5 - PROGRESS: at 63.16% examples, 152345 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:13,476: INFO: EPOCH 5 - PROGRESS: at 63.54% examples, 152016 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:14,720: INFO: EPOCH 5 - PROGRESS: at 64.07% examples, 151757 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:15,751: INFO: EPOCH 5 - PROGRESS: at 64.53% examples, 151484 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:16,772: INFO: EPOCH 5 - PROGRESS: at 65.07% examples, 151309 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:17,872: INFO: EPOCH 5 - PROGRESS: at 65.61% examples, 151314 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:18,943: INFO: EPOCH 5 - PROGRESS: at 66.12% examples, 151266 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:19,983: INFO: EPOCH 5 - PROGRESS: at 66.60% examples, 151119 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:21,181: INFO: EPOCH 5 - PROGRESS: at 67.28% examples, 151121 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:22,212: INFO: EPOCH 5 - PROGRESS: at 67.83% examples, 151185 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:23,220: INFO: EPOCH 5 - PROGRESS: at 68.38% examples, 151230 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:24,224: INFO: EPOCH 5 - PROGRESS: at 68.70% examples, 150848 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:25,281: INFO: EPOCH 5 - PROGRESS: at 69.39% examples, 151166 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:26,326: INFO: EPOCH 5 - PROGRESS: at 69.97% examples, 151232 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:27,486: INFO: EPOCH 5 - PROGRESS: at 70.43% examples, 150927 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:28,533: INFO: EPOCH 5 - PROGRESS: at 70.90% examples, 150730 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:29,538: INFO: EPOCH 5 - PROGRESS: at 71.57% examples, 150961 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:30,546: INFO: EPOCH 5 - PROGRESS: at 72.18% examples, 151228 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:31,552: INFO: EPOCH 5 - PROGRESS: at 72.56% examples, 151033 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:25:32,660: INFO: EPOCH 5 - PROGRESS: at 73.07% examples, 151013 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:25:33,695: INFO: EPOCH 5 - PROGRESS: at 73.70% examples, 151231 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:34,749: INFO: EPOCH 5 - PROGRESS: at 74.25% examples, 151227 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:35,809: INFO: EPOCH 5 - PROGRESS: at 74.76% examples, 151156 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:37,049: INFO: EPOCH 5 - PROGRESS: at 75.20% examples, 150596 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:38,084: INFO: EPOCH 5 - PROGRESS: at 75.75% examples, 150610 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:39,192: INFO: EPOCH 5 - PROGRESS: at 76.21% examples, 150329 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:40,232: INFO: EPOCH 5 - PROGRESS: at 76.71% examples, 150224 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:25:41,275: INFO: EPOCH 5 - PROGRESS: at 77.29% examples, 150124 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:42,384: INFO: EPOCH 5 - PROGRESS: at 77.81% examples, 150138 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:43,495: INFO: EPOCH 5 - PROGRESS: at 78.40% examples, 150246 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:44,507: INFO: EPOCH 5 - PROGRESS: at 78.99% examples, 150440 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:45,548: INFO: EPOCH 5 - PROGRESS: at 79.59% examples, 150449 words/s, in_qsize 14, out_qsize 1\n",
      "2018-05-16 10:25:46,620: INFO: EPOCH 5 - PROGRESS: at 80.22% examples, 150821 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:47,649: INFO: EPOCH 5 - PROGRESS: at 80.91% examples, 150905 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:48,689: INFO: EPOCH 5 - PROGRESS: at 81.52% examples, 151031 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:49,698: INFO: EPOCH 5 - PROGRESS: at 82.02% examples, 150952 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:50,784: INFO: EPOCH 5 - PROGRESS: at 82.58% examples, 151025 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:51,815: INFO: EPOCH 5 - PROGRESS: at 82.99% examples, 150762 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:52,817: INFO: EPOCH 5 - PROGRESS: at 83.44% examples, 150705 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:53,870: INFO: EPOCH 5 - PROGRESS: at 83.95% examples, 150643 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:25:54,895: INFO: EPOCH 5 - PROGRESS: at 84.34% examples, 150414 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:55,907: INFO: EPOCH 5 - PROGRESS: at 84.91% examples, 150583 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:56,932: INFO: EPOCH 5 - PROGRESS: at 85.44% examples, 150668 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:57,968: INFO: EPOCH 5 - PROGRESS: at 85.98% examples, 150691 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:25:59,065: INFO: EPOCH 5 - PROGRESS: at 86.62% examples, 150855 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:00,084: INFO: EPOCH 5 - PROGRESS: at 87.11% examples, 150871 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:01,095: INFO: EPOCH 5 - PROGRESS: at 87.93% examples, 150931 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:02,176: INFO: EPOCH 5 - PROGRESS: at 88.49% examples, 151005 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:03,190: INFO: EPOCH 5 - PROGRESS: at 88.89% examples, 150856 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:04,224: INFO: EPOCH 5 - PROGRESS: at 89.46% examples, 150964 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:05,309: INFO: EPOCH 5 - PROGRESS: at 89.98% examples, 150983 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:06,316: INFO: EPOCH 5 - PROGRESS: at 90.48% examples, 150840 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:26:07,348: INFO: EPOCH 5 - PROGRESS: at 91.27% examples, 151057 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:26:08,450: INFO: EPOCH 5 - PROGRESS: at 91.87% examples, 151164 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:26:09,467: INFO: EPOCH 5 - PROGRESS: at 92.54% examples, 151436 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:10,511: INFO: EPOCH 5 - PROGRESS: at 93.01% examples, 151392 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:11,598: INFO: EPOCH 5 - PROGRESS: at 93.62% examples, 151548 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:12,617: INFO: EPOCH 5 - PROGRESS: at 94.29% examples, 151510 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:26:13,786: INFO: EPOCH 5 - PROGRESS: at 94.94% examples, 151522 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:14,825: INFO: EPOCH 5 - PROGRESS: at 95.57% examples, 151720 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:15,846: INFO: EPOCH 5 - PROGRESS: at 96.19% examples, 151880 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:16,964: INFO: EPOCH 5 - PROGRESS: at 96.79% examples, 151904 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:17,966: INFO: EPOCH 5 - PROGRESS: at 97.30% examples, 151941 words/s, in_qsize 16, out_qsize 0\n",
      "2018-05-16 10:26:18,993: INFO: EPOCH 5 - PROGRESS: at 97.94% examples, 152053 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:20,071: INFO: EPOCH 5 - PROGRESS: at 98.52% examples, 152156 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:21,103: INFO: EPOCH 5 - PROGRESS: at 99.16% examples, 152394 words/s, in_qsize 15, out_qsize 0\n",
      "2018-05-16 10:26:22,056: INFO: worker thread finished; awaiting finish of 7 more threads\n",
      "2018-05-16 10:26:22,106: INFO: EPOCH 5 - PROGRESS: at 99.84% examples, 152730 words/s, in_qsize 6, out_qsize 1\n",
      "2018-05-16 10:26:22,108: INFO: worker thread finished; awaiting finish of 6 more threads\n",
      "2018-05-16 10:26:22,141: INFO: worker thread finished; awaiting finish of 5 more threads\n",
      "2018-05-16 10:26:22,157: INFO: worker thread finished; awaiting finish of 4 more threads\n",
      "2018-05-16 10:26:22,160: INFO: worker thread finished; awaiting finish of 3 more threads\n",
      "2018-05-16 10:26:22,174: INFO: worker thread finished; awaiting finish of 2 more threads\n",
      "2018-05-16 10:26:22,180: INFO: worker thread finished; awaiting finish of 1 more threads\n",
      "2018-05-16 10:26:22,196: INFO: worker thread finished; awaiting finish of 0 more threads\n",
      "2018-05-16 10:26:22,197: INFO: EPOCH - 5 : training on 34286985 raw words (28705382 effective words) took 187.7s, 152927 effective words/s\n",
      "2018-05-16 10:26:22,199: INFO: training on a 171434925 raw words (143524397 effective words) took 953.4s, 150533 effective words/s\n",
      "2018-05-16 10:26:22,202: INFO: saving Doc2Vec object under embedding_models/doc2vec.model, separately None\n",
      "2018-05-16 10:26:22,209: INFO: storing np array 'syn1neg' to embedding_models/doc2vec.model.trainables.syn1neg.npy\n",
      "2018-05-16 10:26:22,435: INFO: storing np array 'vectors' to embedding_models/doc2vec.model.wv.vectors.npy\n",
      "2018-05-16 10:26:22,651: INFO: storing np array 'vectors_docs' to embedding_models/doc2vec.model.docvecs.vectors_docs.npy\n",
      "2018-05-16 10:26:25,590: INFO: saved embedding_models/doc2vec.model\n"
     ]
    }
   ],
   "source": [
    "%run data_preparation/train_doc2vec.py data/data2vec.txt embedding_models/doc2vec.model"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "And this is it for data collection, extraction and preparation!\n",
    "\n",
    "The next step is the generation of training data (with Term and Sentence Expansion) for the Named-Entity Tagger and, of course, the actual training."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.0"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}