Wrangling--Pivot-Tables-with-Pandas.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Pivot Tables with Pandas: San Francisco Crime Data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Data background\n",
    "\n",
    "The San Francisco crime data comes from the city Socrata portal:\n",
    "\n",
    "https://data.sfgov.org/Public-Safety/SFPD-Incidents-from-1-January-2003/tmnf-yvry\n",
    "\n",
    "The API call to get the data as CSV, for dates between '2006-01-01' and '2016-04-01':\n",
    "\n",
    "https://data.sfgov.org/resource/cuks-n6tp.csv?$where=date between '2006-01-01' and '2016-04-01'&$select=incidntnum,category,descript,date,time,pddistrict,resolution,address,x,y,pdid&$limit=1000000000\n",
    "\n",
    "The download is more than 200 MB+. A mirror of the data is included in this repo:\n",
    "\n",
    "[data/sf/raw/bulk-data.sfgov.org--20060101-20160401--cuks-n6tp.csv](data/sf/raw/bulk-data.sfgov.org--20060101-20160401--cuks-n6tp.csv)\n",
    "\n",
    "An important [caveat from the SF data portal](https://data.sfgov.org/Public-Safety/SFPD-Incidents-from-1-January-2003/tmnf-yvry):\n",
    "\n",
    "> ***As of July 19, 2015, the PD District boundaries have been updated through a redistricting process. These new boundaries are not reflected in the dataset yet so you cannot compare data from July 19, 2015 onward to official reports from PD with the Police District column. We are working on an update to the dataset to reflect the updated boundaries starting with data entered July 19 onward.***\n",
    "Incidents derived from SFPD Crime Incident Reporting system Updated daily, showing data from 1/1/2003 up until two weeks ago from current date. Please note: San Francisco police have implemented a new system for tracking crime. The dataset included here is still coming from the old system, which is in the process of being retired (a multi-year process). Data included here is no longer the official SFPD data. We will migrate to the new system for DataSF in the upcoming months.\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "%matplotlib inline\n",
    "from pathlib import Path\n",
    "import pandas as pd\n",
    "import matplotlib.pyplot as plt\n",
    "DATA_PATH = Path('data', 'sf', 'raw', 'bulk-data.sfgov.org--20060101-20160401--cuks-n6tp.csv')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "df = pd.read_csv(DATA_PATH, parse_dates=['date'])\n",
    "df['year'] = df['date'].dt.year\n",
    "# filter out 2016 since it's not a full year\n",
    "df = df[df['year'] < 2016]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1422525"
      ]
     },
     "execution_count": 103,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# total number of rows\n",
    "len(df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>address</th>\n",
       "      <th>category</th>\n",
       "      <th>date</th>\n",
       "      <th>descript</th>\n",
       "      <th>incidntnum</th>\n",
       "      <th>pddistrict</th>\n",
       "      <th>pdid</th>\n",
       "      <th>resolution</th>\n",
       "      <th>time</th>\n",
       "      <th>x</th>\n",
       "      <th>y</th>\n",
       "      <th>year</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>5TH ST / BRYANT ST</td>\n",
       "      <td>WARRANTS</td>\n",
       "      <td>2015-07-11</td>\n",
       "      <td>ENROUTE TO OUTSIDE JURISDICTION</td>\n",
       "      <td>150602980</td>\n",
       "      <td>SOUTHERN</td>\n",
       "      <td>15060298062050</td>\n",
       "      <td>ARREST, BOOKED</td>\n",
       "      <td>07:45</td>\n",
       "      <td>-122.400302</td>\n",
       "      <td>37.777799</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5TH ST / BRYANT ST</td>\n",
       "      <td>WARRANTS</td>\n",
       "      <td>2015-07-11</td>\n",
       "      <td>WARRANT ARREST</td>\n",
       "      <td>150602980</td>\n",
       "      <td>SOUTHERN</td>\n",
       "      <td>15060298063010</td>\n",
       "      <td>ARREST, BOOKED</td>\n",
       "      <td>07:45</td>\n",
       "      <td>-122.400302</td>\n",
       "      <td>37.777799</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>3300 Block of 20TH ST</td>\n",
       "      <td>SEX OFFENSES, FORCIBLE</td>\n",
       "      <td>2009-12-31</td>\n",
       "      <td>FORCIBLE RAPE, ARMED WITH A GUN</td>\n",
       "      <td>100000027</td>\n",
       "      <td>MISSION</td>\n",
       "      <td>10000002702001</td>\n",
       "      <td>ARREST, BOOKED</td>\n",
       "      <td>23:55</td>\n",
       "      <td>-122.416331</td>\n",
       "      <td>37.758852</td>\n",
       "      <td>2009</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>400 Block of VALENCIA ST</td>\n",
       "      <td>OTHER OFFENSES</td>\n",
       "      <td>2015-11-27</td>\n",
       "      <td>FALSE PERSONATION TO RECEIVE MONEY OR PROPERTY</td>\n",
       "      <td>160298165</td>\n",
       "      <td>MISSION</td>\n",
       "      <td>16029816509029</td>\n",
       "      <td>NONE</td>\n",
       "      <td>00:01</td>\n",
       "      <td>-122.422073</td>\n",
       "      <td>37.766126</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>100 Block of OTIS ST</td>\n",
       "      <td>NON-CRIMINAL</td>\n",
       "      <td>2015-07-15</td>\n",
       "      <td>LOST PROPERTY</td>\n",
       "      <td>160304308</td>\n",
       "      <td>SOUTHERN</td>\n",
       "      <td>16030430871000</td>\n",
       "      <td>NONE</td>\n",
       "      <td>12:00</td>\n",
       "      <td>-122.420303</td>\n",
       "      <td>37.770897</td>\n",
       "      <td>2015</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                     address                category       date  \\\n",
       "0         5TH ST / BRYANT ST                WARRANTS 2015-07-11   \n",
       "1         5TH ST / BRYANT ST                WARRANTS 2015-07-11   \n",
       "12     3300 Block of 20TH ST  SEX OFFENSES, FORCIBLE 2009-12-31   \n",
       "13  400 Block of VALENCIA ST          OTHER OFFENSES 2015-11-27   \n",
       "17      100 Block of OTIS ST            NON-CRIMINAL 2015-07-15   \n",
       "\n",
       "                                          descript  incidntnum pddistrict  \\\n",
       "0                  ENROUTE TO OUTSIDE JURISDICTION   150602980   SOUTHERN   \n",
       "1                                   WARRANT ARREST   150602980   SOUTHERN   \n",
       "12                 FORCIBLE RAPE, ARMED WITH A GUN   100000027    MISSION   \n",
       "13  FALSE PERSONATION TO RECEIVE MONEY OR PROPERTY   160298165    MISSION   \n",
       "17                                   LOST PROPERTY   160304308   SOUTHERN   \n",
       "\n",
       "              pdid      resolution   time           x          y  year  \n",
       "0   15060298062050  ARREST, BOOKED  07:45 -122.400302  37.777799  2015  \n",
       "1   15060298063010  ARREST, BOOKED  07:45 -122.400302  37.777799  2015  \n",
       "12  10000002702001  ARREST, BOOKED  23:55 -122.416331  37.758852  2009  \n",
       "13  16029816509029            NONE  00:01 -122.422073  37.766126  2015  \n",
       "17  16030430871000            NONE  12:00 -122.420303  37.770897  2015  "
      ]
     },
     "execution_count": 104,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Simple pivot chart\n",
    "\n",
    "http://pbpython.com/pandas-pivot-table-explained.html\n",
    "\n",
    "Let's do a simple pivot: for every year, aggregate the count of records.\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "year\n",
       "2006    137853\n",
       "2007    137639\n",
       "2008    141311\n",
       "2009    139860\n",
       "2010    133525\n",
       "2011    132699\n",
       "2012    140858\n",
       "2013    152811\n",
       "2014    150159\n",
       "2015    155810\n",
       "Name: pdid, dtype: int64"
      ]
     },
     "execution_count": 105,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "crimeagg = df.pivot_table(index='year', aggfunc=len, values='pdid')\n",
    "# the result\n",
    "crimeagg"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 106,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYcAAAEACAYAAABYq7oeAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAG5dJREFUeJzt3X+U1fV95/HnKxCqiUjALrA7SDSRUUxtEqyYNM3mVqNo\nu1X6h2TspmBlT88Jbs22e7IBd48Mm5xGPW1Dsj26m1Oq6MZSZDeVbCiiC3e7ntWINRYrBKYnAWEM\nk40I2fbsyQJ57x/fD/rlfmaYO/cnzLwe58zhO+/v5/N5fz8zw33f7+f7vfcqIjAzMyt7R7cPwMzM\nzj4uDmZmlnFxMDOzjIuDmZllXBzMzCzj4mBmZplRi4OkdZKGJO2qif+OpD2SXpF0Xym+StJA2ndj\nKb5A0i5J+yStLcWnSNqQ+jwnaW5p37LUfq+kpc1P18zM6lHPmcPDwKJyQFIF+DXgqoi4CviDFJ8P\nLAHmAzcDD0pS6vYQsDwieoFeSafGXA4ciYh5wFrggTTWdOBe4BrgWmC1pGkNztPMzMZg1OIQEc8C\nb9aEPwPcFxEnUpsfpfitwIaIOBER+4EBYKGk2cDUiNiZ2j0KLC71WZ+2NwHXpe1FwLaIOBYRR4Ft\nwE1jnJ+ZmTWg0WsOvcA/lfS8pB2Srk7xHuBgqd1givUAh0rxQyl2Wp+IOAkckzTjDGOZmVmbTW6i\n3/SI+Iika4AngPe16Jg0ehMzM2unRovDQeC/AkTETkknJV1E8ex+bqndnBQbBC4eJk5p3+uSJgEX\nRsQRSYNApabPjuEORpLfIMrMrAERMewT8nqXlcTpz+j/gnRtQFIvMCUi3gA2A59KdyBdClwGvBAR\nhymWixamC9RLgSfTWJuBZWn7NmB72n4KuEHStHRx+oYUG2mCXflavXr1hMrrOU+MvBNxzhPxZ30m\no545SHqc4hn8RZJeA1YDfwo8LOkV4CfpwZ6I2C1pI7AbOA6siLeP4C7gEeA8YEtEbE3xdcBjkgaA\nN4C+NNabkr4AvAgEsCaKC9NmZtZmoxaHiPiNEXb95gjtvwR8aZj4XwNXDRP/CcXtr8ON9QhFQTEz\nsw7yK6SbVKlUJlTebub2nCdG7omWt9u5R6LR1p3OBZJiPMzDzMaH2bMvYWjoQNvGnzXrvRw+vL/p\ncSQRI1yQdnEwM2ux4r6bdj4madQLynWNcobi4GUlMzPLuDiYmVnGxcHMzDIuDmbWVrNnX4Kktn3N\nnn1Jt6c4LvmCtJm11blycbaVzpU5+4K0mZmNiYuDmY1L7V7OGu9LWl5WMrO26tYSS/vzdjO3l5XM\nzKwLXBzMzCzj4mBmZhkXBzMzy7g4mJlZxsXBzMwyLg5mZpZxcTAzs8yoxUHSOklDknYNs+9fS/qp\npBml2CpJA5L2SLqxFF8gaZekfZLWluJTJG1IfZ6TNLe0b1lqv1fS0uamamZm9arnzOFhYFFtUNIc\n4AbgQCk2H1gCzAduBh5U8VJBgIeA5RHRC/RKOjXmcuBIRMwD1gIPpLGmA/cC1wDXAqslTRvzDM3M\nbMxGLQ4R8Szw5jC7vgx8riZ2K7AhIk5ExH5gAFgoaTYwNSJ2pnaPAotLfdan7U3AdWl7EbAtIo5F\nxFFgG3BTXbMyM7OmNHTNQdItwMGIeKVmVw9wsPT9YIr1AIdK8UMpdlqfiDgJHEvLVCONZS3m99sf\n//wmdDZWk8faQdL5wD0US0rtMOybQFn7DA0doJ1vEjY05F9pt7X7d1zk8O95PBlzcQDeD1wC/E26\nnjAHeEnSQopn93NLbeek2CBw8TBxSvtelzQJuDAijkgaBCo1fXaMdFD9/f1vbVcqFSqVykhN7Swx\ne/Yl6UGrPWbNei+HD+9v2/hm55pqtUq1Wq2rbV1v2S3pEuCbEXHVMPu+DyyIiDclXQl8neICcg/w\nNDAvIkLS88DdwE7gW8BXI2KrpBXAz0XECkl9wOKI6EsXpF8EFlAsf70IXJ2uP9Qeg9+yuwnj9y2V\nz75PCOuWifj21RNxzmMepZm37Jb0OPC/KO4wek3Sb9U0CdJSUETsBjYCu4EtwIrSo/ZdwDpgHzAQ\nEVtTfB3ws5IGgH8FrExjvQl8gaIofBtYM1xhaDWvv5uZ+cN+hhuLblT8bi6xjN9ndj5zOGUiPoue\niHMe8yhnOHNwccjHYnz+IY/8xzQR5zzRTMQHyok45zGP4k+CMzOzsXBxMDOzjIuDmZllXBzMzCzj\n4mATjt9Kwmx0vlspH4vxeWeF71bqXN6Rc3frluWJeOfORJzzmEfxraxjGovx+Yfs4tC5vN3M7Tl3\nLm83c/tWVjMz6wIXBzMzy7g4mJlZxsXBzMwyLg5mZpZxcTAzs4yLg5mZZVwczMws4+JgZmYZFwcz\nM8u4OJiZWWbU4iBpnaQhSbtKsQck7ZH0sqT/IunC0r5VkgbS/htL8QWSdknaJ2ltKT5F0obU5zlJ\nc0v7lqX2eyUtbc2UzcxsNPWcOTwMLKqJbQM+EBEfAgaAVQCSrgSWAPOBm4EHVbwDFcBDwPKI6AV6\nJZ0aczlwJCLmAWuBB9JY04F7gWuAa4HVkqY1NEszMxuTUYtDRDwLvFkTeyYifpq+fR6Yk7ZvATZE\nxImI2E9ROBZKmg1MjYidqd2jwOK0fSuwPm1vAq5L24uAbRFxLCKOUhSkm8Y4PzMza0ArrjncCWxJ\n2z3AwdK+wRTrAQ6V4odS7LQ+EXESOCZpxhnGMjOzNpvcTGdJ/xY4HhF/1qLjARj2vcVH09/f/9Z2\npVKhUqm06HDMzMaHarVKtVqtq23DxUHSHcCv8PYyEBTP7i8ufT8nxUaKl/u8LmkScGFEHJE0CFRq\n+uwY6XjKxcHMzHK1T5zXrFkzYtt6l5VE6Rm9pJuAzwG3RMRPSu02A33pDqRLgcuAFyLiMMVy0cJ0\ngXop8GSpz7K0fRuwPW0/BdwgaVq6OH1DipmZWZuNeuYg6XGKZ/AXSXoNWA3cA0wBnk43Iz0fESsi\nYrekjcBu4DiwovT5nXcBjwDnAVsiYmuKrwMekzQAvAH0AUTEm5K+ALxI8Xl7a9KFaTMzazN/hnQ+\nFuPz8279GdKdy9vN3J5z5/J2M7c/Q9rMzLrAxcHMzDIuDmZmlnFxMDOzjIuDmZllXBzMzCzj4mBm\nZhkXBzMzy7g4mJlZxsXBzMwyLg5mZpZxcTAzs4yLg5mZZVwczMws4+JgZmYZFwczM8u4OJiZWcbF\nwczMMi4OZmaWGbU4SFonaUjSrlJsuqRtkvZKekrStNK+VZIGJO2RdGMpvkDSLkn7JK0txadI2pD6\nPCdpbmnfstR+r6SlrZmymZmNpp4zh4eBRTWxlcAzEXE5sB1YBSDpSmAJMB+4GXhQxSdtAzwELI+I\nXqBX0qkxlwNHImIesBZ4II01HbgXuAa4FlhdLkJmZtY+oxaHiHgWeLMmfCuwPm2vBxan7VuADRFx\nIiL2AwPAQkmzgakRsTO1e7TUpzzWJuC6tL0I2BYRxyLiKLANuGkMczMzswY1es1hZkQMAUTEYWBm\nivcAB0vtBlOsBzhUih9KsdP6RMRJ4JikGWcYy8zM2mxyi8aJFo0DoNGb5Pr7+9/arlQqVCqVFh2O\nmdn4UK1WqVardbVttDgMSZoVEUNpyeiHKT4IXFxqNyfFRoqX+7wuaRJwYUQckTQIVGr67BjpgMrF\nwczMcrVPnNesWTNi23qXlcTpz+g3A3ek7WXAk6V4X7oD6VLgMuCFtPR0TNLCdIF6aU2fZWn7NooL\n3ABPATdImpYuTt+QYmZm1majnjlIepziGfxFkl4DVgP3AU9IuhM4QHGHEhGxW9JGYDdwHFgREaeW\nnO4CHgHOA7ZExNYUXwc8JmkAeAPoS2O9KekLwIsUy1Zr0oVpMzNrM7392H3ukhStmkdxYtPOn4kY\n7li7lbebucdv3m7m9pw7l7ebuUf+/zymUSQiYtjrvH6FtJmZZVwczMws4+JgZmYZFwczM8u4OJiZ\nWcbFwczMMi4OZmaWcXEwM7OMi4OZmWVcHMzMLOPiYGZmGRcHMzPLuDiYmVnGxcHMzDIuDmZmlnFx\nMDOzjIuDmZllXBzMzCzj4mBmZpmmioOk35X0t5J2Sfq6pCmSpkvaJmmvpKckTSu1XyVpQNIeSTeW\n4gvSGPskrS3Fp0jakPo8J2luM8drZmb1abg4SPonwO8ACyLi54HJwO3ASuCZiLgc2A6sSu2vBJYA\n84GbgQdVfAo3wEPA8ojoBXolLUrx5cCRiJgHrAUeaPR4zcysfs0uK00C3i1pMnA+MAjcCqxP+9cD\ni9P2LcCGiDgREfuBAWChpNnA1IjYmdo9WupTHmsTcH2Tx2tmZnVouDhExOvAHwKvURSFYxHxDDAr\nIoZSm8PAzNSlBzhYGmIwxXqAQ6X4oRQ7rU9EnASOSprR6DGbmVl9JjfaUdJ7KJ7Zvxc4Bjwh6Z8D\nUdO09vtmaKQd/f39b21XKhUqlUoL05qZnfuq1SrVarWutg0XB+CTwPci4giApG8AvwgMSZoVEUNp\nyeiHqf0gcHGp/5wUGyle7vO6pEnAhafy1SoXBzMzy9U+cV6zZs2IbZu55vAa8BFJ56ULy9cDu4HN\nwB2pzTLgybS9GehLdyBdClwGvJCWno5JWpjGWVrTZ1navo3iAreZmbVZw2cOEfGCpE3Ad4Dj6d+v\nAVOBjZLuBA5Q3KFEROyWtJGigBwHVkTEqSWnu4BHgPOALRGxNcXXAY9JGgDeAPoaPV4zM6uf3n58\nPndJilbNozh5aefPRAx3rN3K283c4zdvN3N7zp3L283cI/9/HtMoEhEx7LVcv0LazMwyLg5mZpZx\ncTAzs4yLg5mZZVwczMws4+JgZmYZFwczM8u4OJiZWcbFwczMMi4OZmaWcXEwM7OMi4OZmWVcHMzM\nLOPiYGZmGRcHMzPLuDiYmVnGxcHMzDIuDmZmlnFxMDOzTFPFQdI0SU9I2iPpVUnXSpouaZukvZKe\nkjSt1H6VpIHU/sZSfIGkXZL2SVpbik+RtCH1eU7S3GaO18zM6tPsmcNXgC0RMR/4IPBdYCXwTERc\nDmwHVgFIuhJYAswHbgYeVPEp3AAPAcsjohfolbQoxZcDRyJiHrAWeKDJ4zUzszo0XBwkXQh8PCIe\nBoiIExFxDLgVWJ+arQcWp+1bgA2p3X5gAFgoaTYwNSJ2pnaPlvqUx9oEXN/o8ZqZWf2aOXO4FPiR\npIclvSTpa5LeBcyKiCGAiDgMzEzte4CDpf6DKdYDHCrFD6XYaX0i4iRwVNKMJo7ZzMzqMLnJvguA\nuyLiRUlfplhSipp2td83QyPt6O/vf2u7UqlQqVRamNbM7NxXrVapVqt1tVVEY4/dkmYBz0XE+9L3\nv0RRHN4PVCJiKC0Z7YiI+ZJWAhER96f2W4HVwIFTbVK8D/hERHzmVJuI+LakScAPImLmMMcSjc5j\nmLFobT3LMjDcsXYrbzdzj9+83cztOXcubzdzj/z/eUyjSETEsE+6G15WSktHByX1ptD1wKvAZuCO\nFFsGPJm2NwN96Q6kS4HLgBfS0tMxSQvTBeqlNX2Wpe3bKC5wm5lZmzWzrARwN/B1Se8Evgf8FjAJ\n2CjpToqzgiUAEbFb0kZgN3AcWFF6un8X8AhwHsXdT1tTfB3wmKQB4A2gr8njNTOzOjS8rHQ28bJS\n43m7mXv85u1mbs+5c3m7mfssXlYyM7Pxy8XBzMwyLg5mZpZxcTAzs4yLg5mZZVwczMws4+JgZmYZ\nFwczM8u4OJiZWcbFwczMMi4OZmaWcXEwM7OMi4OZmWVcHMzMLOPiYGZmGRcHMzPLuDiYmVnGxcHM\nzDIuDmZmlmm6OEh6h6SXJG1O30+XtE3SXklPSZpWartK0oCkPZJuLMUXSNolaZ+ktaX4FEkbUp/n\nJM1t9njNzGx0rThz+Cywu/T9SuCZiLgc2A6sApB0JbAEmA/cDDyo4lO4AR4ClkdEL9AraVGKLweO\nRMQ8YC3wQAuO18zMRtFUcZA0B/gV4E9K4VuB9Wl7PbA4bd8CbIiIExGxHxgAFkqaDUyNiJ2p3aOl\nPuWxNgHXN3O8ZmZWn2bPHL4MfA6IUmxWRAwBRMRhYGaK9wAHS+0GU6wHOFSKH0qx0/pExEngqKQZ\nTR6zmZmNYnKjHSX9KjAUES9LqpyhaZxh35jTjrSjv7//re1KpUKlUmlhWjOzc1+1WqVardbVVhGN\nPXZL+n3g08AJ4HxgKvAN4BeASkQMpSWjHRExX9JKICLi/tR/K7AaOHCqTYr3AZ+IiM+cahMR35Y0\nCfhBRMysORQkRaPzGGYsWlvPsgwMd6zdytvN3OM3bzdze86dy9vN3CP/fx7TKBIRMeyT7oaXlSLi\nnoiYGxHvA/qA7RHxm8A3gTtSs2XAk2l7M9CX7kC6FLgMeCEtPR2TtDBdoF5a02dZ2r6N4gK3mZm1\nWcPLSmdwH7BR0p0UZwVLACJit6SNFHc2HQdWlJ7u3wU8ApwHbImIrSm+DnhM0gDwBkURMjOzNmt4\nWels4mWlxvN2M/f4zdvN3J5z5/J2M/dZvKxkZmbjl4uDmZllXBzMzCzj4mBmZhkXBzMzy7g4mJlZ\nxsXBzMwyLg5mZpZxcTAzs4yLg5mZZVwczMws4+JgZmYZFwczM8u4OJiZWcbFwczMMi4OZmaWcXEw\nM7OMi4OZmWUaLg6S5kjaLulVSa9IujvFp0vaJmmvpKckTSv1WSVpQNIeSTeW4gsk7ZK0T9LaUnyK\npA2pz3OS5jZ6vGZmVr9mzhxOAL8XER8APgrcJekKYCXwTERcDmwHVgFIuhJYAswHbgYeVPFBqwAP\nAcsjohfolbQoxZcDRyJiHrAWeKCJ4zUzszo1XBwi4nBEvJy2/x7YA8wBbgXWp2brgcVp+xZgQ0Sc\niIj9wACwUNJsYGpE7EztHi31KY+1Cbi+0eM1M7P6teSag6RLgA8BzwOzImIIigICzEzNeoCDpW6D\nKdYDHCrFD6XYaX0i4iRwVNKMVhyzmZmNrOniIOkCimf1n01nEFHTpPb7ptK1cCwzMxvB5GY6S5pM\nURgei4gnU3hI0qyIGEpLRj9M8UHg4lL3OSk2Urzc53VJk4ALI+LIcMfS39//1nalUqFSqTQxMzOz\n8adarVKtVutqq4jGn9hLehT4UUT8Xil2P8VF5PslfR6YHhEr0wXprwPXUiwXPQ3Mi4iQ9DxwN7AT\n+Bbw1YjYKmkF8HMRsUJSH7A4IvqGOY5oZh41Y9Hak50sA8Mda7fydjP3+M3bzdyec+fydjP3yP+f\nxzSKREQMuyLTcHGQ9DHgr4BXKH4KAdwDvABspHjGfwBYEhFHU59VFHcgHadYhtqW4lcDjwDnAVsi\n4rMp/jPAY8CHgTeAvnQxu/ZYXBwazNvN3OM3bzdze86dy9vN3GdxcTibuDg0nrebucdv3m7m9pw7\nl7ebudtfHPwKaTMzy7g4mJlZxsXBzMwyLg5mZpZxcTAzs4yLg5mZZVwczMws4+JgZmYZFwczM8u4\nOJiZWcbFwczMMi4OZmaWcXEwM7OMi4OZmWVcHMzMLOPiYGZmGRcHMzPLuDiYmVnGxcHMzDLnRHGQ\ndJOk70raJ+nz3T4eM7Px7qwvDpLeAfwxsAj4AHC7pCu6e1Rl1QmWt5u5u5W3m7m7lbebuSda3m7n\nHt5ZXxyAhcBARByIiOPABuDWLh9TSXWC5e1m7m7l7WbubuXtZu6JlrfbuYd3LhSHHuBg6ftDKWZm\nZm1yLhQHMzPrMEVEt4/hjCR9BOiPiJvS9yuBiIj7S23O7kmYmZ2lIkLDxc+F4jAJ2AtcD/wAeAG4\nPSL2dPXAzMzGscndPoDRRMRJSf8S2EaxDLbOhcHMrL3O+jMHMzPrPF+QriFpjqTtkl6V9Iqku1N8\nuqRtkvZKekrStFKfVZIGJO2RdGMp/k5J/yn12S3p19udV9IFkr4j6aX07/+W9EcdnPPtknZJelnS\nFkkzOpT3U5L+Jo3zpTPNt5Hckmak9v9H0ldrxlqQ5rxP0toO5v2ipNck/Xi0+bYyt6TzJf239Dt4\nRdLvd3DOf5n+rl+R9KCkYdfLW523NOZmSbs69bNO+3aoeBHwqf/XPzta/paICH+VvoDZwIfS9gUU\n1zuuAO4H/k2Kfx64L21fCXyHYonuEuDvePuMrB/496WxZ3Qib824LwIf68ScgUnAEDA9tbsfuLcD\neWcAB079fIGHgV9u8ZzfBfwi8NvAV2vG+jZwTdreAizqUN6FwCzgx2362x42N3A+8Im0PRn4qw7O\n+YLS9iZgSSfypv2/DvxnYFenftZp3w7gw/X8jlv51fUH47P9C/gL4JPAd4FZpV/8d9P2SuDzpfZ/\nCVybtl8Dzu903lKsFzjQqdzpgWIImEvxoP0Q8C86kPcXgKdL8U8Df9zKOZfaLeP0B8rZwO7S933A\nQ+3OW7OvruLQjtxp/1pgeYfn/E5gM3BbJ/IC76YogldQR3Foce4dwNWN/I6b+fKy0hlIugT4EPA8\nxS90CCAiDgMzU7PaF+kNAj2lpZAvSvprSX8u6R+1O2/NUJ8C/ryenK3IHREngBXAKxQvVpwPrGt3\nXooziMslzZU0GVgMXFznlOvNPZIeirmeUveLNJvM25RW5Zb0HuDXgP/eqbyStgKHgR9TnD10Iu8X\ngD8A/m89+VqcG+CRtKT078aav1EuDiOQdAHFH95nI+Lvgdor96NdyZ8MzAGejYirKf4w/rADecv6\ngD+rt3GzudMD82eAD0ZED0WRuKfdeSPiaMq7EfgfwPeBk6PlbUXuRnUrbytzq7jN/HFgbUTs71Te\nKF7z9I+BnwGua3deSR8E3h8RmynOiEe8ztHq3MlvRMRVwMeBj0v6dL35m+HiMIz0ILcJeCwinkzh\nIUmz0v7ZwA9TfJDTn6XOAQYj4g3gHyLiGyn+BPDhductjfXzwKSI+E6n5kzx7ChKDxQbgY92Ys4R\n8a2I+EhEfAzYl75aOeeRnPH30Ma8DWlx7q8BeyPiP3Q4LxHx/yiWlc74PmstyvtR4GpJ3wP+J9Ar\naftox9iqOUfED9K//0BRjBeO1qcVXByG96cU68hfKcU2A3ek7WXAk6V4n6Qpki4FLqN4oR7ANyX9\nctr+JLC7Q3kBbmcMZw0tyj0IXCnpotTuBmC016S0ZM6nluwkTadY2vqTFs+57K1njmlp4JikhenO\nmaUj9Glp3jrjbcst6YvAhRHxu53KK+nd6QH11APvr1Ks4bc1b0T8x4iYExHvA36JoiCOesbSityS\nJp36/yTpncA/A/62jtzN6/RFjrP9C/gYxZLEyxR3xrwE3ERxR8wzFHcdbAPeU+qzimLdew9wYyk+\nl2KZ42XgaWBOJ/KmfX8H9HZhzr9NUQRfpvjDn96hvI8Dr1L8xxn1ImWDub8P/Ihirfs14IoUv5pi\nCW0A+EoH895PcQ3mRIqPeGdYK3NTXFP5afp5nxrnzg7knUnxZOBlYBfwFeAdnfhZl/a/l/ruVmrV\nnN9Fccfhy+lv7MsMc1diO778IjgzM8t4WcnMzDIuDmZmlnFxMDOzjIuDmZllXBzMzCzj4mBmZhkX\nBzMzy7g4mJlZ5v8DLbb6kpj5NR0AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x12fba60b8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# let's chart it\n",
    "fig, ax = plt.subplots()\n",
    "ax.bar(crimeagg.index, crimeagg.values, align='center')\n",
    "ax.set_xticks(range(2006, 2016))\n",
    "ax.set_xlim(xmin=2005);"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Pivot by category\n",
    "\n",
    "A general count of crime is not interesting. Lets dive down into categories\n",
    "\n",
    "Pivot the dataframe by category, and then by year\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 107,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "catdf = df.pivot_table(index='category', columns='year', values='pdid', aggfunc=len)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 108,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>year</th>\n",
       "      <th>2006</th>\n",
       "      <th>2007</th>\n",
       "      <th>2008</th>\n",
       "      <th>2009</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>category</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>ARSON</th>\n",
       "      <td>240</td>\n",
       "      <td>246</td>\n",
       "      <td>248</td>\n",
       "      <td>222</td>\n",
       "      <td>209</td>\n",
       "      <td>203</td>\n",
       "      <td>237</td>\n",
       "      <td>248</td>\n",
       "      <td>253</td>\n",
       "      <td>311</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ASSAULT</th>\n",
       "      <td>12449</td>\n",
       "      <td>12518</td>\n",
       "      <td>12681</td>\n",
       "      <td>12284</td>\n",
       "      <td>12388</td>\n",
       "      <td>12281</td>\n",
       "      <td>12181</td>\n",
       "      <td>12583</td>\n",
       "      <td>12408</td>\n",
       "      <td>13071</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BAD CHECKS</th>\n",
       "      <td>87</td>\n",
       "      <td>69</td>\n",
       "      <td>78</td>\n",
       "      <td>64</td>\n",
       "      <td>54</td>\n",
       "      <td>45</td>\n",
       "      <td>49</td>\n",
       "      <td>26</td>\n",
       "      <td>34</td>\n",
       "      <td>37</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BRIBERY</th>\n",
       "      <td>36</td>\n",
       "      <td>56</td>\n",
       "      <td>49</td>\n",
       "      <td>46</td>\n",
       "      <td>61</td>\n",
       "      <td>47</td>\n",
       "      <td>64</td>\n",
       "      <td>69</td>\n",
       "      <td>56</td>\n",
       "      <td>72</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BURGLARY</th>\n",
       "      <td>7004</td>\n",
       "      <td>5454</td>\n",
       "      <td>5679</td>\n",
       "      <td>5379</td>\n",
       "      <td>4966</td>\n",
       "      <td>4987</td>\n",
       "      <td>6244</td>\n",
       "      <td>6195</td>\n",
       "      <td>6070</td>\n",
       "      <td>5925</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "year         2006   2007   2008   2009   2010   2011   2012   2013   2014  \\\n",
       "category                                                                    \n",
       "ARSON         240    246    248    222    209    203    237    248    253   \n",
       "ASSAULT     12449  12518  12681  12284  12388  12281  12181  12583  12408   \n",
       "BAD CHECKS     87     69     78     64     54     45     49     26     34   \n",
       "BRIBERY        36     56     49     46     61     47     64     69     56   \n",
       "BURGLARY     7004   5454   5679   5379   4966   4987   6244   6195   6070   \n",
       "\n",
       "year         2015  \n",
       "category           \n",
       "ARSON         311  \n",
       "ASSAULT     13071  \n",
       "BAD CHECKS     37  \n",
       "BRIBERY        72  \n",
       "BURGLARY     5925  "
      ]
     },
     "execution_count": 108,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "catdf.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 109,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>year</th>\n",
       "      <th>2006</th>\n",
       "      <th>2007</th>\n",
       "      <th>2008</th>\n",
       "      <th>2009</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "      <th>delta_2015_2010</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>category</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>LOITERING</th>\n",
       "      <td>96</td>\n",
       "      <td>430</td>\n",
       "      <td>441</td>\n",
       "      <td>126</td>\n",
       "      <td>187</td>\n",
       "      <td>124</td>\n",
       "      <td>135</td>\n",
       "      <td>54</td>\n",
       "      <td>36</td>\n",
       "      <td>27</td>\n",
       "      <td>-0.855615</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PROSTITUTION</th>\n",
       "      <td>1290</td>\n",
       "      <td>1873</td>\n",
       "      <td>1673</td>\n",
       "      <td>1468</td>\n",
       "      <td>1299</td>\n",
       "      <td>1094</td>\n",
       "      <td>690</td>\n",
       "      <td>692</td>\n",
       "      <td>449</td>\n",
       "      <td>371</td>\n",
       "      <td>-0.714396</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DRUG/NARCOTIC</th>\n",
       "      <td>9069</td>\n",
       "      <td>10560</td>\n",
       "      <td>11648</td>\n",
       "      <td>11950</td>\n",
       "      <td>9205</td>\n",
       "      <td>6935</td>\n",
       "      <td>6445</td>\n",
       "      <td>6775</td>\n",
       "      <td>5409</td>\n",
       "      <td>4249</td>\n",
       "      <td>-0.538403</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TREA</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>-0.500000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>LIQUOR LAWS</th>\n",
       "      <td>248</td>\n",
       "      <td>401</td>\n",
       "      <td>499</td>\n",
       "      <td>394</td>\n",
       "      <td>324</td>\n",
       "      <td>261</td>\n",
       "      <td>226</td>\n",
       "      <td>227</td>\n",
       "      <td>180</td>\n",
       "      <td>163</td>\n",
       "      <td>-0.496914</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>RUNAWAY</th>\n",
       "      <td>382</td>\n",
       "      <td>273</td>\n",
       "      <td>259</td>\n",
       "      <td>340</td>\n",
       "      <td>293</td>\n",
       "      <td>320</td>\n",
       "      <td>330</td>\n",
       "      <td>214</td>\n",
       "      <td>221</td>\n",
       "      <td>149</td>\n",
       "      <td>-0.491468</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SEX OFFENSES, NON FORCIBLE</th>\n",
       "      <td>29</td>\n",
       "      <td>39</td>\n",
       "      <td>20</td>\n",
       "      <td>17</td>\n",
       "      <td>30</td>\n",
       "      <td>29</td>\n",
       "      <td>28</td>\n",
       "      <td>18</td>\n",
       "      <td>20</td>\n",
       "      <td>19</td>\n",
       "      <td>-0.366667</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DISORDERLY CONDUCT</th>\n",
       "      <td>521</td>\n",
       "      <td>581</td>\n",
       "      <td>789</td>\n",
       "      <td>956</td>\n",
       "      <td>827</td>\n",
       "      <td>762</td>\n",
       "      <td>704</td>\n",
       "      <td>464</td>\n",
       "      <td>345</td>\n",
       "      <td>548</td>\n",
       "      <td>-0.337364</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>EXTORTION</th>\n",
       "      <td>49</td>\n",
       "      <td>41</td>\n",
       "      <td>52</td>\n",
       "      <td>92</td>\n",
       "      <td>58</td>\n",
       "      <td>41</td>\n",
       "      <td>38</td>\n",
       "      <td>30</td>\n",
       "      <td>32</td>\n",
       "      <td>39</td>\n",
       "      <td>-0.327586</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FORGERY/COUNTERFEITING</th>\n",
       "      <td>2306</td>\n",
       "      <td>2592</td>\n",
       "      <td>2468</td>\n",
       "      <td>2209</td>\n",
       "      <td>1089</td>\n",
       "      <td>820</td>\n",
       "      <td>990</td>\n",
       "      <td>913</td>\n",
       "      <td>750</td>\n",
       "      <td>744</td>\n",
       "      <td>-0.316804</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BAD CHECKS</th>\n",
       "      <td>87</td>\n",
       "      <td>69</td>\n",
       "      <td>78</td>\n",
       "      <td>64</td>\n",
       "      <td>54</td>\n",
       "      <td>45</td>\n",
       "      <td>49</td>\n",
       "      <td>26</td>\n",
       "      <td>34</td>\n",
       "      <td>37</td>\n",
       "      <td>-0.314815</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FAMILY OFFENSES</th>\n",
       "      <td>89</td>\n",
       "      <td>79</td>\n",
       "      <td>72</td>\n",
       "      <td>83</td>\n",
       "      <td>95</td>\n",
       "      <td>58</td>\n",
       "      <td>77</td>\n",
       "      <td>76</td>\n",
       "      <td>89</td>\n",
       "      <td>66</td>\n",
       "      <td>-0.305263</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DRUNKENNESS</th>\n",
       "      <td>703</td>\n",
       "      <td>671</td>\n",
       "      <td>710</td>\n",
       "      <td>804</td>\n",
       "      <td>706</td>\n",
       "      <td>652</td>\n",
       "      <td>644</td>\n",
       "      <td>954</td>\n",
       "      <td>620</td>\n",
       "      <td>576</td>\n",
       "      <td>-0.184136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SUSPICIOUS OCC</th>\n",
       "      <td>4775</td>\n",
       "      <td>4800</td>\n",
       "      <td>4751</td>\n",
       "      <td>4627</td>\n",
       "      <td>6004</td>\n",
       "      <td>6207</td>\n",
       "      <td>5860</td>\n",
       "      <td>5677</td>\n",
       "      <td>5230</td>\n",
       "      <td>5453</td>\n",
       "      <td>-0.091772</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DRIVING UNDER THE INFLUENCE</th>\n",
       "      <td>266</td>\n",
       "      <td>313</td>\n",
       "      <td>408</td>\n",
       "      <td>579</td>\n",
       "      <td>458</td>\n",
       "      <td>470</td>\n",
       "      <td>421</td>\n",
       "      <td>448</td>\n",
       "      <td>381</td>\n",
       "      <td>419</td>\n",
       "      <td>-0.085153</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>KIDNAPPING</th>\n",
       "      <td>318</td>\n",
       "      <td>345</td>\n",
       "      <td>345</td>\n",
       "      <td>478</td>\n",
       "      <td>355</td>\n",
       "      <td>421</td>\n",
       "      <td>282</td>\n",
       "      <td>528</td>\n",
       "      <td>523</td>\n",
       "      <td>339</td>\n",
       "      <td>-0.045070</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SUICIDE</th>\n",
       "      <td>86</td>\n",
       "      <td>111</td>\n",
       "      <td>100</td>\n",
       "      <td>83</td>\n",
       "      <td>82</td>\n",
       "      <td>76</td>\n",
       "      <td>86</td>\n",
       "      <td>73</td>\n",
       "      <td>70</td>\n",
       "      <td>79</td>\n",
       "      <td>-0.036585</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>OTHER OFFENSES</th>\n",
       "      <td>18306</td>\n",
       "      <td>19763</td>\n",
       "      <td>23457</td>\n",
       "      <td>24693</td>\n",
       "      <td>20990</td>\n",
       "      <td>19552</td>\n",
       "      <td>18648</td>\n",
       "      <td>19481</td>\n",
       "      <td>20743</td>\n",
       "      <td>20240</td>\n",
       "      <td>-0.035731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>VANDALISM</th>\n",
       "      <td>7688</td>\n",
       "      <td>7566</td>\n",
       "      <td>7342</td>\n",
       "      <td>7604</td>\n",
       "      <td>7934</td>\n",
       "      <td>7243</td>\n",
       "      <td>7808</td>\n",
       "      <td>6921</td>\n",
       "      <td>7167</td>\n",
       "      <td>7667</td>\n",
       "      <td>-0.033653</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PORNOGRAPHY/OBSCENE MAT</th>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>5</td>\n",
       "      <td>NaN</td>\n",
       "      <td>4</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>4</td>\n",
       "      <td>0.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MISSING PERSON</th>\n",
       "      <td>4253</td>\n",
       "      <td>4024</td>\n",
       "      <td>4335</td>\n",
       "      <td>3657</td>\n",
       "      <td>4513</td>\n",
       "      <td>4758</td>\n",
       "      <td>4373</td>\n",
       "      <td>4485</td>\n",
       "      <td>4735</td>\n",
       "      <td>4609</td>\n",
       "      <td>0.021272</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ASSAULT</th>\n",
       "      <td>12449</td>\n",
       "      <td>12518</td>\n",
       "      <td>12681</td>\n",
       "      <td>12284</td>\n",
       "      <td>12388</td>\n",
       "      <td>12281</td>\n",
       "      <td>12181</td>\n",
       "      <td>12583</td>\n",
       "      <td>12408</td>\n",
       "      <td>13071</td>\n",
       "      <td>0.055134</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>EMBEZZLEMENT</th>\n",
       "      <td>229</td>\n",
       "      <td>269</td>\n",
       "      <td>242</td>\n",
       "      <td>214</td>\n",
       "      <td>155</td>\n",
       "      <td>168</td>\n",
       "      <td>169</td>\n",
       "      <td>172</td>\n",
       "      <td>150</td>\n",
       "      <td>168</td>\n",
       "      <td>0.083871</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>WARRANTS</th>\n",
       "      <td>6498</td>\n",
       "      <td>7105</td>\n",
       "      <td>5798</td>\n",
       "      <td>5764</td>\n",
       "      <td>6187</td>\n",
       "      <td>6311</td>\n",
       "      <td>6300</td>\n",
       "      <td>7362</td>\n",
       "      <td>6728</td>\n",
       "      <td>6716</td>\n",
       "      <td>0.085502</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SECONDARY CODES</th>\n",
       "      <td>1375</td>\n",
       "      <td>1475</td>\n",
       "      <td>1580</td>\n",
       "      <td>1783</td>\n",
       "      <td>1869</td>\n",
       "      <td>1815</td>\n",
       "      <td>1865</td>\n",
       "      <td>2001</td>\n",
       "      <td>1879</td>\n",
       "      <td>2031</td>\n",
       "      <td>0.086677</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ROBBERY</th>\n",
       "      <td>4131</td>\n",
       "      <td>4027</td>\n",
       "      <td>4229</td>\n",
       "      <td>3578</td>\n",
       "      <td>3324</td>\n",
       "      <td>3376</td>\n",
       "      <td>3955</td>\n",
       "      <td>4196</td>\n",
       "      <td>3423</td>\n",
       "      <td>3754</td>\n",
       "      <td>0.129362</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FRAUD</th>\n",
       "      <td>2599</td>\n",
       "      <td>2349</td>\n",
       "      <td>2560</td>\n",
       "      <td>2513</td>\n",
       "      <td>2656</td>\n",
       "      <td>2756</td>\n",
       "      <td>2698</td>\n",
       "      <td>2752</td>\n",
       "      <td>2988</td>\n",
       "      <td>3110</td>\n",
       "      <td>0.170934</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BRIBERY</th>\n",
       "      <td>36</td>\n",
       "      <td>56</td>\n",
       "      <td>49</td>\n",
       "      <td>46</td>\n",
       "      <td>61</td>\n",
       "      <td>47</td>\n",
       "      <td>64</td>\n",
       "      <td>69</td>\n",
       "      <td>56</td>\n",
       "      <td>72</td>\n",
       "      <td>0.180328</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BURGLARY</th>\n",
       "      <td>7004</td>\n",
       "      <td>5454</td>\n",
       "      <td>5679</td>\n",
       "      <td>5379</td>\n",
       "      <td>4966</td>\n",
       "      <td>4987</td>\n",
       "      <td>6244</td>\n",
       "      <td>6195</td>\n",
       "      <td>6070</td>\n",
       "      <td>5925</td>\n",
       "      <td>0.193113</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TRESPASS</th>\n",
       "      <td>1102</td>\n",
       "      <td>1198</td>\n",
       "      <td>1151</td>\n",
       "      <td>1232</td>\n",
       "      <td>1150</td>\n",
       "      <td>1072</td>\n",
       "      <td>1288</td>\n",
       "      <td>1129</td>\n",
       "      <td>1125</td>\n",
       "      <td>1398</td>\n",
       "      <td>0.215652</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>WEAPON LAWS</th>\n",
       "      <td>1324</td>\n",
       "      <td>1318</td>\n",
       "      <td>1419</td>\n",
       "      <td>1433</td>\n",
       "      <td>1349</td>\n",
       "      <td>1329</td>\n",
       "      <td>1460</td>\n",
       "      <td>1536</td>\n",
       "      <td>1581</td>\n",
       "      <td>1652</td>\n",
       "      <td>0.224611</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SEX OFFENSES, FORCIBLE</th>\n",
       "      <td>599</td>\n",
       "      <td>631</td>\n",
       "      <td>682</td>\n",
       "      <td>682</td>\n",
       "      <td>733</td>\n",
       "      <td>735</td>\n",
       "      <td>791</td>\n",
       "      <td>760</td>\n",
       "      <td>845</td>\n",
       "      <td>908</td>\n",
       "      <td>0.238745</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>NON-CRIMINAL</th>\n",
       "      <td>13368</td>\n",
       "      <td>12677</td>\n",
       "      <td>12303</td>\n",
       "      <td>12395</td>\n",
       "      <td>13878</td>\n",
       "      <td>15586</td>\n",
       "      <td>16936</td>\n",
       "      <td>21084</td>\n",
       "      <td>19404</td>\n",
       "      <td>19061</td>\n",
       "      <td>0.373469</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>STOLEN PROPERTY</th>\n",
       "      <td>575</td>\n",
       "      <td>527</td>\n",
       "      <td>518</td>\n",
       "      <td>660</td>\n",
       "      <td>680</td>\n",
       "      <td>785</td>\n",
       "      <td>932</td>\n",
       "      <td>1224</td>\n",
       "      <td>1086</td>\n",
       "      <td>955</td>\n",
       "      <td>0.404412</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ARSON</th>\n",
       "      <td>240</td>\n",
       "      <td>246</td>\n",
       "      <td>248</td>\n",
       "      <td>222</td>\n",
       "      <td>209</td>\n",
       "      <td>203</td>\n",
       "      <td>237</td>\n",
       "      <td>248</td>\n",
       "      <td>253</td>\n",
       "      <td>311</td>\n",
       "      <td>0.488038</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>RECOVERED VEHICLE</th>\n",
       "      <td>1086</td>\n",
       "      <td>987</td>\n",
       "      <td>833</td>\n",
       "      <td>655</td>\n",
       "      <td>609</td>\n",
       "      <td>693</td>\n",
       "      <td>723</td>\n",
       "      <td>760</td>\n",
       "      <td>NaN</td>\n",
       "      <td>914</td>\n",
       "      <td>0.500821</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>LARCENY/THEFT</th>\n",
       "      <td>27352</td>\n",
       "      <td>25770</td>\n",
       "      <td>25807</td>\n",
       "      <td>25585</td>\n",
       "      <td>24446</td>\n",
       "      <td>25905</td>\n",
       "      <td>30976</td>\n",
       "      <td>36412</td>\n",
       "      <td>38006</td>\n",
       "      <td>41997</td>\n",
       "      <td>0.717950</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>VEHICLE THEFT</th>\n",
       "      <td>7291</td>\n",
       "      <td>6460</td>\n",
       "      <td>6053</td>\n",
       "      <td>5183</td>\n",
       "      <td>4346</td>\n",
       "      <td>4762</td>\n",
       "      <td>6183</td>\n",
       "      <td>6241</td>\n",
       "      <td>7112</td>\n",
       "      <td>7940</td>\n",
       "      <td>0.826967</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GAMBLING</th>\n",
       "      <td>28</td>\n",
       "      <td>37</td>\n",
       "      <td>27</td>\n",
       "      <td>28</td>\n",
       "      <td>10</td>\n",
       "      <td>17</td>\n",
       "      <td>18</td>\n",
       "      <td>22</td>\n",
       "      <td>8</td>\n",
       "      <td>28</td>\n",
       "      <td>1.800000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "year                          2006   2007   2008   2009   2010   2011   2012  \\\n",
       "category                                                                       \n",
       "LOITERING                       96    430    441    126    187    124    135   \n",
       "PROSTITUTION                  1290   1873   1673   1468   1299   1094    690   \n",
       "DRUG/NARCOTIC                 9069  10560  11648  11950   9205   6935   6445   \n",
       "TREA                           NaN    NaN    NaN    NaN      2    NaN      2   \n",
       "LIQUOR LAWS                    248    401    499    394    324    261    226   \n",
       "RUNAWAY                        382    273    259    340    293    320    330   \n",
       "SEX OFFENSES, NON FORCIBLE      29     39     20     17     30     29     28   \n",
       "DISORDERLY CONDUCT             521    581    789    956    827    762    704   \n",
       "EXTORTION                       49     41     52     92     58     41     38   \n",
       "FORGERY/COUNTERFEITING        2306   2592   2468   2209   1089    820    990   \n",
       "BAD CHECKS                      87     69     78     64     54     45     49   \n",
       "FAMILY OFFENSES                 89     79     72     83     95     58     77   \n",
       "DRUNKENNESS                    703    671    710    804    706    652    644   \n",
       "SUSPICIOUS OCC                4775   4800   4751   4627   6004   6207   5860   \n",
       "DRIVING UNDER THE INFLUENCE    266    313    408    579    458    470    421   \n",
       "KIDNAPPING                     318    345    345    478    355    421    282   \n",
       "SUICIDE                         86    111    100     83     82     76     86   \n",
       "OTHER OFFENSES               18306  19763  23457  24693  20990  19552  18648   \n",
       "VANDALISM                     7688   7566   7342   7604   7934   7243   7808   \n",
       "PORNOGRAPHY/OBSCENE MAT          6      4      5    NaN      4      3      2   \n",
       "MISSING PERSON                4253   4024   4335   3657   4513   4758   4373   \n",
       "ASSAULT                      12449  12518  12681  12284  12388  12281  12181   \n",
       "EMBEZZLEMENT                   229    269    242    214    155    168    169   \n",
       "WARRANTS                      6498   7105   5798   5764   6187   6311   6300   \n",
       "SECONDARY CODES               1375   1475   1580   1783   1869   1815   1865   \n",
       "ROBBERY                       4131   4027   4229   3578   3324   3376   3955   \n",
       "FRAUD                         2599   2349   2560   2513   2656   2756   2698   \n",
       "BRIBERY                         36     56     49     46     61     47     64   \n",
       "BURGLARY                      7004   5454   5679   5379   4966   4987   6244   \n",
       "TRESPASS                      1102   1198   1151   1232   1150   1072   1288   \n",
       "WEAPON LAWS                   1324   1318   1419   1433   1349   1329   1460   \n",
       "SEX OFFENSES, FORCIBLE         599    631    682    682    733    735    791   \n",
       "NON-CRIMINAL                 13368  12677  12303  12395  13878  15586  16936   \n",
       "STOLEN PROPERTY                575    527    518    660    680    785    932   \n",
       "ARSON                          240    246    248    222    209    203    237   \n",
       "RECOVERED VEHICLE             1086    987    833    655    609    693    723   \n",
       "LARCENY/THEFT                27352  25770  25807  25585  24446  25905  30976   \n",
       "VEHICLE THEFT                 7291   6460   6053   5183   4346   4762   6183   \n",
       "GAMBLING                        28     37     27     28     10     17     18   \n",
       "\n",
       "year                          2013   2014   2015  delta_2015_2010  \n",
       "category                                                           \n",
       "LOITERING                       54     36     27        -0.855615  \n",
       "PROSTITUTION                   692    449    371        -0.714396  \n",
       "DRUG/NARCOTIC                 6775   5409   4249        -0.538403  \n",
       "TREA                             4      1      1        -0.500000  \n",
       "LIQUOR LAWS                    227    180    163        -0.496914  \n",
       "RUNAWAY                        214    221    149        -0.491468  \n",
       "SEX OFFENSES, NON FORCIBLE      18     20     19        -0.366667  \n",
       "DISORDERLY CONDUCT             464    345    548        -0.337364  \n",
       "EXTORTION                       30     32     39        -0.327586  \n",
       "FORGERY/COUNTERFEITING         913    750    744        -0.316804  \n",
       "BAD CHECKS                      26     34     37        -0.314815  \n",
       "FAMILY OFFENSES                 76     89     66        -0.305263  \n",
       "DRUNKENNESS                    954    620    576        -0.184136  \n",
       "SUSPICIOUS OCC                5677   5230   5453        -0.091772  \n",
       "DRIVING UNDER THE INFLUENCE    448    381    419        -0.085153  \n",
       "KIDNAPPING                     528    523    339        -0.045070  \n",
       "SUICIDE                         73     70     79        -0.036585  \n",
       "OTHER OFFENSES               19481  20743  20240        -0.035731  \n",
       "VANDALISM                     6921   7167   7667        -0.033653  \n",
       "PORNOGRAPHY/OBSCENE MAT          5      2      4         0.000000  \n",
       "MISSING PERSON                4485   4735   4609         0.021272  \n",
       "ASSAULT                      12583  12408  13071         0.055134  \n",
       "EMBEZZLEMENT                   172    150    168         0.083871  \n",
       "WARRANTS                      7362   6728   6716         0.085502  \n",
       "SECONDARY CODES               2001   1879   2031         0.086677  \n",
       "ROBBERY                       4196   3423   3754         0.129362  \n",
       "FRAUD                         2752   2988   3110         0.170934  \n",
       "BRIBERY                         69     56     72         0.180328  \n",
       "BURGLARY                      6195   6070   5925         0.193113  \n",
       "TRESPASS                      1129   1125   1398         0.215652  \n",
       "WEAPON LAWS                   1536   1581   1652         0.224611  \n",
       "SEX OFFENSES, FORCIBLE         760    845    908         0.238745  \n",
       "NON-CRIMINAL                 21084  19404  19061         0.373469  \n",
       "STOLEN PROPERTY               1224   1086    955         0.404412  \n",
       "ARSON                          248    253    311         0.488038  \n",
       "RECOVERED VEHICLE              760    NaN    914         0.500821  \n",
       "LARCENY/THEFT                36412  38006  41997         0.717950  \n",
       "VEHICLE THEFT                 6241   7112   7940         0.826967  \n",
       "GAMBLING                        22      8     28         1.800000  "
      ]
     },
     "execution_count": 109,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "catdf['delta_2015_2010'] = (catdf[2015] - catdf[2010]) / catdf[2010]\n",
    "catdf.sort_values('delta_2015_2010')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 110,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>year</th>\n",
       "      <th>2006</th>\n",
       "      <th>2007</th>\n",
       "      <th>2008</th>\n",
       "      <th>2009</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "      <th>delta_2015_2010</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>category</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>PROSTITUTION</th>\n",
       "      <td>1290</td>\n",
       "      <td>1873</td>\n",
       "      <td>1673</td>\n",
       "      <td>1468</td>\n",
       "      <td>1299</td>\n",
       "      <td>1094</td>\n",
       "      <td>690</td>\n",
       "      <td>692</td>\n",
       "      <td>449</td>\n",
       "      <td>371</td>\n",
       "      <td>-0.714396</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DRUG/NARCOTIC</th>\n",
       "      <td>9069</td>\n",
       "      <td>10560</td>\n",
       "      <td>11648</td>\n",
       "      <td>11950</td>\n",
       "      <td>9205</td>\n",
       "      <td>6935</td>\n",
       "      <td>6445</td>\n",
       "      <td>6775</td>\n",
       "      <td>5409</td>\n",
       "      <td>4249</td>\n",
       "      <td>-0.538403</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DISORDERLY CONDUCT</th>\n",
       "      <td>521</td>\n",
       "      <td>581</td>\n",
       "      <td>789</td>\n",
       "      <td>956</td>\n",
       "      <td>827</td>\n",
       "      <td>762</td>\n",
       "      <td>704</td>\n",
       "      <td>464</td>\n",
       "      <td>345</td>\n",
       "      <td>548</td>\n",
       "      <td>-0.337364</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FORGERY/COUNTERFEITING</th>\n",
       "      <td>2306</td>\n",
       "      <td>2592</td>\n",
       "      <td>2468</td>\n",
       "      <td>2209</td>\n",
       "      <td>1089</td>\n",
       "      <td>820</td>\n",
       "      <td>990</td>\n",
       "      <td>913</td>\n",
       "      <td>750</td>\n",
       "      <td>744</td>\n",
       "      <td>-0.316804</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>DRUNKENNESS</th>\n",
       "      <td>703</td>\n",
       "      <td>671</td>\n",
       "      <td>710</td>\n",
       "      <td>804</td>\n",
       "      <td>706</td>\n",
       "      <td>652</td>\n",
       "      <td>644</td>\n",
       "      <td>954</td>\n",
       "      <td>620</td>\n",
       "      <td>576</td>\n",
       "      <td>-0.184136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SUSPICIOUS OCC</th>\n",
       "      <td>4775</td>\n",
       "      <td>4800</td>\n",
       "      <td>4751</td>\n",
       "      <td>4627</td>\n",
       "      <td>6004</td>\n",
       "      <td>6207</td>\n",
       "      <td>5860</td>\n",
       "      <td>5677</td>\n",
       "      <td>5230</td>\n",
       "      <td>5453</td>\n",
       "      <td>-0.091772</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>OTHER OFFENSES</th>\n",
       "      <td>18306</td>\n",
       "      <td>19763</td>\n",
       "      <td>23457</td>\n",
       "      <td>24693</td>\n",
       "      <td>20990</td>\n",
       "      <td>19552</td>\n",
       "      <td>18648</td>\n",
       "      <td>19481</td>\n",
       "      <td>20743</td>\n",
       "      <td>20240</td>\n",
       "      <td>-0.035731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>VANDALISM</th>\n",
       "      <td>7688</td>\n",
       "      <td>7566</td>\n",
       "      <td>7342</td>\n",
       "      <td>7604</td>\n",
       "      <td>7934</td>\n",
       "      <td>7243</td>\n",
       "      <td>7808</td>\n",
       "      <td>6921</td>\n",
       "      <td>7167</td>\n",
       "      <td>7667</td>\n",
       "      <td>-0.033653</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MISSING PERSON</th>\n",
       "      <td>4253</td>\n",
       "      <td>4024</td>\n",
       "      <td>4335</td>\n",
       "      <td>3657</td>\n",
       "      <td>4513</td>\n",
       "      <td>4758</td>\n",
       "      <td>4373</td>\n",
       "      <td>4485</td>\n",
       "      <td>4735</td>\n",
       "      <td>4609</td>\n",
       "      <td>0.021272</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ASSAULT</th>\n",
       "      <td>12449</td>\n",
       "      <td>12518</td>\n",
       "      <td>12681</td>\n",
       "      <td>12284</td>\n",
       "      <td>12388</td>\n",
       "      <td>12281</td>\n",
       "      <td>12181</td>\n",
       "      <td>12583</td>\n",
       "      <td>12408</td>\n",
       "      <td>13071</td>\n",
       "      <td>0.055134</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>WARRANTS</th>\n",
       "      <td>6498</td>\n",
       "      <td>7105</td>\n",
       "      <td>5798</td>\n",
       "      <td>5764</td>\n",
       "      <td>6187</td>\n",
       "      <td>6311</td>\n",
       "      <td>6300</td>\n",
       "      <td>7362</td>\n",
       "      <td>6728</td>\n",
       "      <td>6716</td>\n",
       "      <td>0.085502</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SECONDARY CODES</th>\n",
       "      <td>1375</td>\n",
       "      <td>1475</td>\n",
       "      <td>1580</td>\n",
       "      <td>1783</td>\n",
       "      <td>1869</td>\n",
       "      <td>1815</td>\n",
       "      <td>1865</td>\n",
       "      <td>2001</td>\n",
       "      <td>1879</td>\n",
       "      <td>2031</td>\n",
       "      <td>0.086677</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ROBBERY</th>\n",
       "      <td>4131</td>\n",
       "      <td>4027</td>\n",
       "      <td>4229</td>\n",
       "      <td>3578</td>\n",
       "      <td>3324</td>\n",
       "      <td>3376</td>\n",
       "      <td>3955</td>\n",
       "      <td>4196</td>\n",
       "      <td>3423</td>\n",
       "      <td>3754</td>\n",
       "      <td>0.129362</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>FRAUD</th>\n",
       "      <td>2599</td>\n",
       "      <td>2349</td>\n",
       "      <td>2560</td>\n",
       "      <td>2513</td>\n",
       "      <td>2656</td>\n",
       "      <td>2756</td>\n",
       "      <td>2698</td>\n",
       "      <td>2752</td>\n",
       "      <td>2988</td>\n",
       "      <td>3110</td>\n",
       "      <td>0.170934</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BURGLARY</th>\n",
       "      <td>7004</td>\n",
       "      <td>5454</td>\n",
       "      <td>5679</td>\n",
       "      <td>5379</td>\n",
       "      <td>4966</td>\n",
       "      <td>4987</td>\n",
       "      <td>6244</td>\n",
       "      <td>6195</td>\n",
       "      <td>6070</td>\n",
       "      <td>5925</td>\n",
       "      <td>0.193113</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TRESPASS</th>\n",
       "      <td>1102</td>\n",
       "      <td>1198</td>\n",
       "      <td>1151</td>\n",
       "      <td>1232</td>\n",
       "      <td>1150</td>\n",
       "      <td>1072</td>\n",
       "      <td>1288</td>\n",
       "      <td>1129</td>\n",
       "      <td>1125</td>\n",
       "      <td>1398</td>\n",
       "      <td>0.215652</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>WEAPON LAWS</th>\n",
       "      <td>1324</td>\n",
       "      <td>1318</td>\n",
       "      <td>1419</td>\n",
       "      <td>1433</td>\n",
       "      <td>1349</td>\n",
       "      <td>1329</td>\n",
       "      <td>1460</td>\n",
       "      <td>1536</td>\n",
       "      <td>1581</td>\n",
       "      <td>1652</td>\n",
       "      <td>0.224611</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SEX OFFENSES, FORCIBLE</th>\n",
       "      <td>599</td>\n",
       "      <td>631</td>\n",
       "      <td>682</td>\n",
       "      <td>682</td>\n",
       "      <td>733</td>\n",
       "      <td>735</td>\n",
       "      <td>791</td>\n",
       "      <td>760</td>\n",
       "      <td>845</td>\n",
       "      <td>908</td>\n",
       "      <td>0.238745</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>NON-CRIMINAL</th>\n",
       "      <td>13368</td>\n",
       "      <td>12677</td>\n",
       "      <td>12303</td>\n",
       "      <td>12395</td>\n",
       "      <td>13878</td>\n",
       "      <td>15586</td>\n",
       "      <td>16936</td>\n",
       "      <td>21084</td>\n",
       "      <td>19404</td>\n",
       "      <td>19061</td>\n",
       "      <td>0.373469</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>STOLEN PROPERTY</th>\n",
       "      <td>575</td>\n",
       "      <td>527</td>\n",
       "      <td>518</td>\n",
       "      <td>660</td>\n",
       "      <td>680</td>\n",
       "      <td>785</td>\n",
       "      <td>932</td>\n",
       "      <td>1224</td>\n",
       "      <td>1086</td>\n",
       "      <td>955</td>\n",
       "      <td>0.404412</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>RECOVERED VEHICLE</th>\n",
       "      <td>1086</td>\n",
       "      <td>987</td>\n",
       "      <td>833</td>\n",
       "      <td>655</td>\n",
       "      <td>609</td>\n",
       "      <td>693</td>\n",
       "      <td>723</td>\n",
       "      <td>760</td>\n",
       "      <td>NaN</td>\n",
       "      <td>914</td>\n",
       "      <td>0.500821</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>LARCENY/THEFT</th>\n",
       "      <td>27352</td>\n",
       "      <td>25770</td>\n",
       "      <td>25807</td>\n",
       "      <td>25585</td>\n",
       "      <td>24446</td>\n",
       "      <td>25905</td>\n",
       "      <td>30976</td>\n",
       "      <td>36412</td>\n",
       "      <td>38006</td>\n",
       "      <td>41997</td>\n",
       "      <td>0.717950</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>VEHICLE THEFT</th>\n",
       "      <td>7291</td>\n",
       "      <td>6460</td>\n",
       "      <td>6053</td>\n",
       "      <td>5183</td>\n",
       "      <td>4346</td>\n",
       "      <td>4762</td>\n",
       "      <td>6183</td>\n",
       "      <td>6241</td>\n",
       "      <td>7112</td>\n",
       "      <td>7940</td>\n",
       "      <td>0.826967</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "year                     2006   2007   2008   2009   2010   2011   2012  \\\n",
       "category                                                                  \n",
       "PROSTITUTION             1290   1873   1673   1468   1299   1094    690   \n",
       "DRUG/NARCOTIC            9069  10560  11648  11950   9205   6935   6445   \n",
       "DISORDERLY CONDUCT        521    581    789    956    827    762    704   \n",
       "FORGERY/COUNTERFEITING   2306   2592   2468   2209   1089    820    990   \n",
       "DRUNKENNESS               703    671    710    804    706    652    644   \n",
       "SUSPICIOUS OCC           4775   4800   4751   4627   6004   6207   5860   \n",
       "OTHER OFFENSES          18306  19763  23457  24693  20990  19552  18648   \n",
       "VANDALISM                7688   7566   7342   7604   7934   7243   7808   \n",
       "MISSING PERSON           4253   4024   4335   3657   4513   4758   4373   \n",
       "ASSAULT                 12449  12518  12681  12284  12388  12281  12181   \n",
       "WARRANTS                 6498   7105   5798   5764   6187   6311   6300   \n",
       "SECONDARY CODES          1375   1475   1580   1783   1869   1815   1865   \n",
       "ROBBERY                  4131   4027   4229   3578   3324   3376   3955   \n",
       "FRAUD                    2599   2349   2560   2513   2656   2756   2698   \n",
       "BURGLARY                 7004   5454   5679   5379   4966   4987   6244   \n",
       "TRESPASS                 1102   1198   1151   1232   1150   1072   1288   \n",
       "WEAPON LAWS              1324   1318   1419   1433   1349   1329   1460   \n",
       "SEX OFFENSES, FORCIBLE    599    631    682    682    733    735    791   \n",
       "NON-CRIMINAL            13368  12677  12303  12395  13878  15586  16936   \n",
       "STOLEN PROPERTY           575    527    518    660    680    785    932   \n",
       "RECOVERED VEHICLE        1086    987    833    655    609    693    723   \n",
       "LARCENY/THEFT           27352  25770  25807  25585  24446  25905  30976   \n",
       "VEHICLE THEFT            7291   6460   6053   5183   4346   4762   6183   \n",
       "\n",
       "year                     2013   2014   2015  delta_2015_2010  \n",
       "category                                                      \n",
       "PROSTITUTION              692    449    371        -0.714396  \n",
       "DRUG/NARCOTIC            6775   5409   4249        -0.538403  \n",
       "DISORDERLY CONDUCT        464    345    548        -0.337364  \n",
       "FORGERY/COUNTERFEITING    913    750    744        -0.316804  \n",
       "DRUNKENNESS               954    620    576        -0.184136  \n",
       "SUSPICIOUS OCC           5677   5230   5453        -0.091772  \n",
       "OTHER OFFENSES          19481  20743  20240        -0.035731  \n",
       "VANDALISM                6921   7167   7667        -0.033653  \n",
       "MISSING PERSON           4485   4735   4609         0.021272  \n",
       "ASSAULT                 12583  12408  13071         0.055134  \n",
       "WARRANTS                 7362   6728   6716         0.085502  \n",
       "SECONDARY CODES          2001   1879   2031         0.086677  \n",
       "ROBBERY                  4196   3423   3754         0.129362  \n",
       "FRAUD                    2752   2988   3110         0.170934  \n",
       "BURGLARY                 6195   6070   5925         0.193113  \n",
       "TRESPASS                 1129   1125   1398         0.215652  \n",
       "WEAPON LAWS              1536   1581   1652         0.224611  \n",
       "SEX OFFENSES, FORCIBLE    760    845    908         0.238745  \n",
       "NON-CRIMINAL            21084  19404  19061         0.373469  \n",
       "STOLEN PROPERTY          1224   1086    955         0.404412  \n",
       "RECOVERED VEHICLE         760    NaN    914         0.500821  \n",
       "LARCENY/THEFT           36412  38006  41997         0.717950  \n",
       "VEHICLE THEFT            6241   7112   7940         0.826967  "
      ]
     },
     "execution_count": 110,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# filter the list to types of crime that have had more than a 1000 reported incidents\n",
    "# total for 2010 and 2015\n",
    "majorcatdf = catdf[catdf[2015] + catdf[2010] > 1000]\n",
    "majorcatdf.sort_values('delta_2015_2010')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Larceny/Thefts\n",
    "\n",
    "Go back to the original table, now facet by descript\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 111,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "thefts_df = df[df['category'] == 'LARCENY/THEFT']\n",
    "thefts_pivot = thefts_df.pivot_table(index='descript', columns='year', values='pdid', aggfunc=len)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 112,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "thefts_pivot['delta_2015_2010'] = (thefts_pivot[2015] - thefts_pivot[2010]) / thefts_pivot[2010] "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 113,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>year</th>\n",
       "      <th>2006</th>\n",
       "      <th>2007</th>\n",
       "      <th>2008</th>\n",
       "      <th>2009</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "      <th>delta_2015_2010</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>descript</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT WITH PRIOR</th>\n",
       "      <td>865</td>\n",
       "      <td>765</td>\n",
       "      <td>831</td>\n",
       "      <td>756</td>\n",
       "      <td>634</td>\n",
       "      <td>428</td>\n",
       "      <td>403</td>\n",
       "      <td>453</td>\n",
       "      <td>370</td>\n",
       "      <td>8</td>\n",
       "      <td>-0.987382</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT COIN OPERATED MACHINE</th>\n",
       "      <td>6</td>\n",
       "      <td>5</td>\n",
       "      <td>6</td>\n",
       "      <td>12</td>\n",
       "      <td>13</td>\n",
       "      <td>10</td>\n",
       "      <td>3</td>\n",
       "      <td>2</td>\n",
       "      <td>2</td>\n",
       "      <td>1</td>\n",
       "      <td>-0.923077</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ATTEMPTED THEFT COIN OPERATED MACHINE</th>\n",
       "      <td>8</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>4</td>\n",
       "      <td>10</td>\n",
       "      <td>4</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>-0.800000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT AUTO STRIP</th>\n",
       "      <td>108</td>\n",
       "      <td>78</td>\n",
       "      <td>169</td>\n",
       "      <td>97</td>\n",
       "      <td>87</td>\n",
       "      <td>100</td>\n",
       "      <td>76</td>\n",
       "      <td>30</td>\n",
       "      <td>47</td>\n",
       "      <td>20</td>\n",
       "      <td>-0.770115</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>THEFT, GRAND, BY FIDUCIARY, &gt;$400 IN 12 MONTHS</th>\n",
       "      <td>1</td>\n",
       "      <td>1</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1</td>\n",
       "      <td>7</td>\n",
       "      <td>9</td>\n",
       "      <td>1</td>\n",
       "      <td>3</td>\n",
       "      <td>5</td>\n",
       "      <td>2</td>\n",
       "      <td>-0.714286</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "year                                            2006  2007  2008  2009  2010  \\\n",
       "descript                                                                       \n",
       "PETTY THEFT WITH PRIOR                           865   765   831   756   634   \n",
       "GRAND THEFT COIN OPERATED MACHINE                  6     5     6    12    13   \n",
       "ATTEMPTED THEFT COIN OPERATED MACHINE              8     1   NaN     4    10   \n",
       "GRAND THEFT AUTO STRIP                           108    78   169    97    87   \n",
       "THEFT, GRAND, BY FIDUCIARY, >$400 IN 12 MONTHS     1     1   NaN     1     7   \n",
       "\n",
       "year                                            2011  2012  2013  2014  2015  \\\n",
       "descript                                                                       \n",
       "PETTY THEFT WITH PRIOR                           428   403   453   370     8   \n",
       "GRAND THEFT COIN OPERATED MACHINE                 10     3     2     2     1   \n",
       "ATTEMPTED THEFT COIN OPERATED MACHINE              4     1     3     1     2   \n",
       "GRAND THEFT AUTO STRIP                           100    76    30    47    20   \n",
       "THEFT, GRAND, BY FIDUCIARY, >$400 IN 12 MONTHS     9     1     3     5     2   \n",
       "\n",
       "year                                            delta_2015_2010  \n",
       "descript                                                         \n",
       "PETTY THEFT WITH PRIOR                                -0.987382  \n",
       "GRAND THEFT COIN OPERATED MACHINE                     -0.923077  \n",
       "ATTEMPTED THEFT COIN OPERATED MACHINE                 -0.800000  \n",
       "GRAND THEFT AUTO STRIP                                -0.770115  \n",
       "THEFT, GRAND, BY FIDUCIARY, >$400 IN 12 MONTHS        -0.714286  "
      ]
     },
     "execution_count": 113,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "thefts_pivot.sort_values('delta_2015_2010').head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 114,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>year</th>\n",
       "      <th>2006</th>\n",
       "      <th>2007</th>\n",
       "      <th>2008</th>\n",
       "      <th>2009</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "      <th>delta_2015_2010</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>descript</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT WITH PRIOR</th>\n",
       "      <td>865</td>\n",
       "      <td>765</td>\n",
       "      <td>831</td>\n",
       "      <td>756</td>\n",
       "      <td>634</td>\n",
       "      <td>428</td>\n",
       "      <td>403</td>\n",
       "      <td>453</td>\n",
       "      <td>370</td>\n",
       "      <td>8</td>\n",
       "      <td>-0.987382</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT AUTO STRIP</th>\n",
       "      <td>108</td>\n",
       "      <td>78</td>\n",
       "      <td>169</td>\n",
       "      <td>97</td>\n",
       "      <td>87</td>\n",
       "      <td>100</td>\n",
       "      <td>76</td>\n",
       "      <td>30</td>\n",
       "      <td>47</td>\n",
       "      <td>20</td>\n",
       "      <td>-0.770115</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT AUTO STRIP</th>\n",
       "      <td>56</td>\n",
       "      <td>56</td>\n",
       "      <td>127</td>\n",
       "      <td>164</td>\n",
       "      <td>99</td>\n",
       "      <td>77</td>\n",
       "      <td>148</td>\n",
       "      <td>46</td>\n",
       "      <td>46</td>\n",
       "      <td>34</td>\n",
       "      <td>-0.656566</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT PURSESNATCH</th>\n",
       "      <td>178</td>\n",
       "      <td>145</td>\n",
       "      <td>149</td>\n",
       "      <td>107</td>\n",
       "      <td>129</td>\n",
       "      <td>74</td>\n",
       "      <td>57</td>\n",
       "      <td>59</td>\n",
       "      <td>64</td>\n",
       "      <td>56</td>\n",
       "      <td>-0.565891</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>LOST PROPERTY, GRAND THEFT</th>\n",
       "      <td>112</td>\n",
       "      <td>131</td>\n",
       "      <td>144</td>\n",
       "      <td>107</td>\n",
       "      <td>72</td>\n",
       "      <td>89</td>\n",
       "      <td>77</td>\n",
       "      <td>60</td>\n",
       "      <td>86</td>\n",
       "      <td>51</td>\n",
       "      <td>-0.291667</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT FROM A BUILDING</th>\n",
       "      <td>1472</td>\n",
       "      <td>1417</td>\n",
       "      <td>1611</td>\n",
       "      <td>1639</td>\n",
       "      <td>1695</td>\n",
       "      <td>1994</td>\n",
       "      <td>1528</td>\n",
       "      <td>1220</td>\n",
       "      <td>1131</td>\n",
       "      <td>1221</td>\n",
       "      <td>-0.279646</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT OF PROPERTY</th>\n",
       "      <td>1476</td>\n",
       "      <td>1781</td>\n",
       "      <td>2189</td>\n",
       "      <td>2554</td>\n",
       "      <td>2747</td>\n",
       "      <td>1766</td>\n",
       "      <td>2001</td>\n",
       "      <td>1950</td>\n",
       "      <td>1975</td>\n",
       "      <td>2071</td>\n",
       "      <td>-0.246087</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>THEFT OF CHECKS OR CREDIT CARDS</th>\n",
       "      <td>NaN</td>\n",
       "      <td>1</td>\n",
       "      <td>2</td>\n",
       "      <td>3</td>\n",
       "      <td>115</td>\n",
       "      <td>126</td>\n",
       "      <td>94</td>\n",
       "      <td>111</td>\n",
       "      <td>77</td>\n",
       "      <td>89</td>\n",
       "      <td>-0.226087</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>THEFT FROM MERCHANT OR LIBRARY</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>1</td>\n",
       "      <td>113</td>\n",
       "      <td>151</td>\n",
       "      <td>205</td>\n",
       "      <td>155</td>\n",
       "      <td>134</td>\n",
       "      <td>90</td>\n",
       "      <td>-0.203540</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT BICYCLE</th>\n",
       "      <td>295</td>\n",
       "      <td>298</td>\n",
       "      <td>366</td>\n",
       "      <td>366</td>\n",
       "      <td>443</td>\n",
       "      <td>424</td>\n",
       "      <td>348</td>\n",
       "      <td>319</td>\n",
       "      <td>321</td>\n",
       "      <td>412</td>\n",
       "      <td>-0.069977</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>THEFT OF COMPUTERS OR CELL PHONES</th>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>2</td>\n",
       "      <td>183</td>\n",
       "      <td>272</td>\n",
       "      <td>339</td>\n",
       "      <td>260</td>\n",
       "      <td>213</td>\n",
       "      <td>178</td>\n",
       "      <td>-0.027322</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT SHOPLIFTING</th>\n",
       "      <td>423</td>\n",
       "      <td>407</td>\n",
       "      <td>446</td>\n",
       "      <td>395</td>\n",
       "      <td>312</td>\n",
       "      <td>343</td>\n",
       "      <td>232</td>\n",
       "      <td>246</td>\n",
       "      <td>222</td>\n",
       "      <td>335</td>\n",
       "      <td>0.073718</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT FROM PERSON</th>\n",
       "      <td>831</td>\n",
       "      <td>931</td>\n",
       "      <td>1054</td>\n",
       "      <td>1167</td>\n",
       "      <td>1282</td>\n",
       "      <td>1237</td>\n",
       "      <td>1603</td>\n",
       "      <td>1806</td>\n",
       "      <td>1265</td>\n",
       "      <td>1384</td>\n",
       "      <td>0.079563</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>ATTEMPTED THEFT FROM LOCKED VEHICLE</th>\n",
       "      <td>627</td>\n",
       "      <td>433</td>\n",
       "      <td>442</td>\n",
       "      <td>320</td>\n",
       "      <td>259</td>\n",
       "      <td>188</td>\n",
       "      <td>195</td>\n",
       "      <td>227</td>\n",
       "      <td>220</td>\n",
       "      <td>291</td>\n",
       "      <td>0.123552</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT PICKPOCKET</th>\n",
       "      <td>994</td>\n",
       "      <td>896</td>\n",
       "      <td>827</td>\n",
       "      <td>765</td>\n",
       "      <td>681</td>\n",
       "      <td>778</td>\n",
       "      <td>819</td>\n",
       "      <td>850</td>\n",
       "      <td>848</td>\n",
       "      <td>780</td>\n",
       "      <td>0.145374</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT SHOPLIFTING</th>\n",
       "      <td>1326</td>\n",
       "      <td>1264</td>\n",
       "      <td>1411</td>\n",
       "      <td>1412</td>\n",
       "      <td>1430</td>\n",
       "      <td>1535</td>\n",
       "      <td>1533</td>\n",
       "      <td>1736</td>\n",
       "      <td>1625</td>\n",
       "      <td>1953</td>\n",
       "      <td>0.365734</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT FROM A BUILDING</th>\n",
       "      <td>1187</td>\n",
       "      <td>1336</td>\n",
       "      <td>1277</td>\n",
       "      <td>1396</td>\n",
       "      <td>1401</td>\n",
       "      <td>1499</td>\n",
       "      <td>2263</td>\n",
       "      <td>2378</td>\n",
       "      <td>2012</td>\n",
       "      <td>1997</td>\n",
       "      <td>0.425410</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>LOST PROPERTY, PETTY THEFT</th>\n",
       "      <td>205</td>\n",
       "      <td>187</td>\n",
       "      <td>195</td>\n",
       "      <td>152</td>\n",
       "      <td>148</td>\n",
       "      <td>165</td>\n",
       "      <td>188</td>\n",
       "      <td>213</td>\n",
       "      <td>285</td>\n",
       "      <td>254</td>\n",
       "      <td>0.716216</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT OF PROPERTY</th>\n",
       "      <td>1417</td>\n",
       "      <td>1527</td>\n",
       "      <td>1737</td>\n",
       "      <td>2072</td>\n",
       "      <td>2152</td>\n",
       "      <td>3557</td>\n",
       "      <td>4544</td>\n",
       "      <td>4762</td>\n",
       "      <td>4691</td>\n",
       "      <td>4400</td>\n",
       "      <td>1.044610</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT FROM LOCKED AUTO</th>\n",
       "      <td>10467</td>\n",
       "      <td>9890</td>\n",
       "      <td>9003</td>\n",
       "      <td>8956</td>\n",
       "      <td>8043</td>\n",
       "      <td>8596</td>\n",
       "      <td>10232</td>\n",
       "      <td>12599</td>\n",
       "      <td>14934</td>\n",
       "      <td>17716</td>\n",
       "      <td>1.202661</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT FROM LOCKED AUTO</th>\n",
       "      <td>4172</td>\n",
       "      <td>3263</td>\n",
       "      <td>2930</td>\n",
       "      <td>2312</td>\n",
       "      <td>1474</td>\n",
       "      <td>1458</td>\n",
       "      <td>2621</td>\n",
       "      <td>3539</td>\n",
       "      <td>3592</td>\n",
       "      <td>4297</td>\n",
       "      <td>1.915197</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT FROM UNLOCKED AUTO</th>\n",
       "      <td>424</td>\n",
       "      <td>300</td>\n",
       "      <td>291</td>\n",
       "      <td>273</td>\n",
       "      <td>221</td>\n",
       "      <td>259</td>\n",
       "      <td>431</td>\n",
       "      <td>577</td>\n",
       "      <td>631</td>\n",
       "      <td>660</td>\n",
       "      <td>1.986425</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PETTY THEFT BICYCLE</th>\n",
       "      <td>143</td>\n",
       "      <td>168</td>\n",
       "      <td>146</td>\n",
       "      <td>133</td>\n",
       "      <td>136</td>\n",
       "      <td>162</td>\n",
       "      <td>353</td>\n",
       "      <td>469</td>\n",
       "      <td>400</td>\n",
       "      <td>519</td>\n",
       "      <td>2.816176</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>GRAND THEFT FROM UNLOCKED AUTO</th>\n",
       "      <td>349</td>\n",
       "      <td>277</td>\n",
       "      <td>253</td>\n",
       "      <td>224</td>\n",
       "      <td>235</td>\n",
       "      <td>269</td>\n",
       "      <td>196</td>\n",
       "      <td>1952</td>\n",
       "      <td>2422</td>\n",
       "      <td>2780</td>\n",
       "      <td>10.829787</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "year                                  2006  2007  2008  2009  2010  2011  \\\n",
       "descript                                                                   \n",
       "PETTY THEFT WITH PRIOR                 865   765   831   756   634   428   \n",
       "GRAND THEFT AUTO STRIP                 108    78   169    97    87   100   \n",
       "PETTY THEFT AUTO STRIP                  56    56   127   164    99    77   \n",
       "GRAND THEFT PURSESNATCH                178   145   149   107   129    74   \n",
       "LOST PROPERTY, GRAND THEFT             112   131   144   107    72    89   \n",
       "GRAND THEFT FROM A BUILDING           1472  1417  1611  1639  1695  1994   \n",
       "GRAND THEFT OF PROPERTY               1476  1781  2189  2554  2747  1766   \n",
       "THEFT OF CHECKS OR CREDIT CARDS        NaN     1     2     3   115   126   \n",
       "THEFT FROM MERCHANT OR LIBRARY         NaN   NaN   NaN     1   113   151   \n",
       "GRAND THEFT BICYCLE                    295   298   366   366   443   424   \n",
       "THEFT OF COMPUTERS OR CELL PHONES      NaN   NaN   NaN     2   183   272   \n",
       "GRAND THEFT SHOPLIFTING                423   407   446   395   312   343   \n",
       "GRAND THEFT FROM PERSON                831   931  1054  1167  1282  1237   \n",
       "ATTEMPTED THEFT FROM LOCKED VEHICLE    627   433   442   320   259   188   \n",
       "GRAND THEFT PICKPOCKET                 994   896   827   765   681   778   \n",
       "PETTY THEFT SHOPLIFTING               1326  1264  1411  1412  1430  1535   \n",
       "PETTY THEFT FROM A BUILDING           1187  1336  1277  1396  1401  1499   \n",
       "LOST PROPERTY, PETTY THEFT             205   187   195   152   148   165   \n",
       "PETTY THEFT OF PROPERTY               1417  1527  1737  2072  2152  3557   \n",
       "GRAND THEFT FROM LOCKED AUTO         10467  9890  9003  8956  8043  8596   \n",
       "PETTY THEFT FROM LOCKED AUTO          4172  3263  2930  2312  1474  1458   \n",
       "PETTY THEFT FROM UNLOCKED AUTO         424   300   291   273   221   259   \n",
       "PETTY THEFT BICYCLE                    143   168   146   133   136   162   \n",
       "GRAND THEFT FROM UNLOCKED AUTO         349   277   253   224   235   269   \n",
       "\n",
       "year                                  2012   2013   2014   2015  \\\n",
       "descript                                                          \n",
       "PETTY THEFT WITH PRIOR                 403    453    370      8   \n",
       "GRAND THEFT AUTO STRIP                  76     30     47     20   \n",
       "PETTY THEFT AUTO STRIP                 148     46     46     34   \n",
       "GRAND THEFT PURSESNATCH                 57     59     64     56   \n",
       "LOST PROPERTY, GRAND THEFT              77     60     86     51   \n",
       "GRAND THEFT FROM A BUILDING           1528   1220   1131   1221   \n",
       "GRAND THEFT OF PROPERTY               2001   1950   1975   2071   \n",
       "THEFT OF CHECKS OR CREDIT CARDS         94    111     77     89   \n",
       "THEFT FROM MERCHANT OR LIBRARY         205    155    134     90   \n",
       "GRAND THEFT BICYCLE                    348    319    321    412   \n",
       "THEFT OF COMPUTERS OR CELL PHONES      339    260    213    178   \n",
       "GRAND THEFT SHOPLIFTING                232    246    222    335   \n",
       "GRAND THEFT FROM PERSON               1603   1806   1265   1384   \n",
       "ATTEMPTED THEFT FROM LOCKED VEHICLE    195    227    220    291   \n",
       "GRAND THEFT PICKPOCKET                 819    850    848    780   \n",
       "PETTY THEFT SHOPLIFTING               1533   1736   1625   1953   \n",
       "PETTY THEFT FROM A BUILDING           2263   2378   2012   1997   \n",
       "LOST PROPERTY, PETTY THEFT             188    213    285    254   \n",
       "PETTY THEFT OF PROPERTY               4544   4762   4691   4400   \n",
       "GRAND THEFT FROM LOCKED AUTO         10232  12599  14934  17716   \n",
       "PETTY THEFT FROM LOCKED AUTO          2621   3539   3592   4297   \n",
       "PETTY THEFT FROM UNLOCKED AUTO         431    577    631    660   \n",
       "PETTY THEFT BICYCLE                    353    469    400    519   \n",
       "GRAND THEFT FROM UNLOCKED AUTO         196   1952   2422   2780   \n",
       "\n",
       "year                                 delta_2015_2010  \n",
       "descript                                              \n",
       "PETTY THEFT WITH PRIOR                     -0.987382  \n",
       "GRAND THEFT AUTO STRIP                     -0.770115  \n",
       "PETTY THEFT AUTO STRIP                     -0.656566  \n",
       "GRAND THEFT PURSESNATCH                    -0.565891  \n",
       "LOST PROPERTY, GRAND THEFT                 -0.291667  \n",
       "GRAND THEFT FROM A BUILDING                -0.279646  \n",
       "GRAND THEFT OF PROPERTY                    -0.246087  \n",
       "THEFT OF CHECKS OR CREDIT CARDS            -0.226087  \n",
       "THEFT FROM MERCHANT OR LIBRARY             -0.203540  \n",
       "GRAND THEFT BICYCLE                        -0.069977  \n",
       "THEFT OF COMPUTERS OR CELL PHONES          -0.027322  \n",
       "GRAND THEFT SHOPLIFTING                     0.073718  \n",
       "GRAND THEFT FROM PERSON                     0.079563  \n",
       "ATTEMPTED THEFT FROM LOCKED VEHICLE         0.123552  \n",
       "GRAND THEFT PICKPOCKET                      0.145374  \n",
       "PETTY THEFT SHOPLIFTING                     0.365734  \n",
       "PETTY THEFT FROM A BUILDING                 0.425410  \n",
       "LOST PROPERTY, PETTY THEFT                  0.716216  \n",
       "PETTY THEFT OF PROPERTY                     1.044610  \n",
       "GRAND THEFT FROM LOCKED AUTO                1.202661  \n",
       "PETTY THEFT FROM LOCKED AUTO                1.915197  \n",
       "PETTY THEFT FROM UNLOCKED AUTO              1.986425  \n",
       "PETTY THEFT BICYCLE                         2.816176  \n",
       "GRAND THEFT FROM UNLOCKED AUTO             10.829787  "
      ]
     },
     "execution_count": 114,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# remove noise\n",
    "majorthefts_pivot = thefts_pivot[thefts_pivot[2015] + thefts_pivot[2010] > 100]\n",
    "majorthefts_pivot.sort_values('delta_2015_2010')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Vehicle thefts\n",
    "\n",
    "http://www.sfgate.com/crime/article/Car-thefts-surging-in-San-Francisco-6516607.php"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 115,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "autothefts_df = df[df['category'] == 'VEHICLE THEFT']\n",
    "autothefts_piv = autothefts_df.pivot_table(index='descript', columns='year', values='pdid', aggfunc=len)\n",
    "autothefts_piv['delta_2015_2010'] = (autothefts_piv[2015] - autothefts_piv[2010]) / autothefts_piv[2010]\n",
    "major_autothefts_piv = autothefts_piv[autothefts_piv[2015] + autothefts_piv[2010] > 100]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 116,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>year</th>\n",
       "      <th>2006</th>\n",
       "      <th>2007</th>\n",
       "      <th>2008</th>\n",
       "      <th>2009</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "      <th>delta_2015_2010</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>descript</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>ATTEMPTED STOLEN VEHICLE</th>\n",
       "      <td>91</td>\n",
       "      <td>72</td>\n",
       "      <td>73</td>\n",
       "      <td>62</td>\n",
       "      <td>55</td>\n",
       "      <td>50</td>\n",
       "      <td>50</td>\n",
       "      <td>45</td>\n",
       "      <td>54</td>\n",
       "      <td>68</td>\n",
       "      <td>0.236364</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>STOLEN AUTOMOBILE</th>\n",
       "      <td>4881</td>\n",
       "      <td>4291</td>\n",
       "      <td>3953</td>\n",
       "      <td>3494</td>\n",
       "      <td>2817</td>\n",
       "      <td>3294</td>\n",
       "      <td>4289</td>\n",
       "      <td>3935</td>\n",
       "      <td>4567</td>\n",
       "      <td>4985</td>\n",
       "      <td>0.769613</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>STOLEN AND RECOVERED VEHICLE</th>\n",
       "      <td>384</td>\n",
       "      <td>348</td>\n",
       "      <td>340</td>\n",
       "      <td>269</td>\n",
       "      <td>264</td>\n",
       "      <td>261</td>\n",
       "      <td>309</td>\n",
       "      <td>350</td>\n",
       "      <td>415</td>\n",
       "      <td>472</td>\n",
       "      <td>0.787879</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>STOLEN TRUCK</th>\n",
       "      <td>1540</td>\n",
       "      <td>1393</td>\n",
       "      <td>1355</td>\n",
       "      <td>1029</td>\n",
       "      <td>867</td>\n",
       "      <td>858</td>\n",
       "      <td>1136</td>\n",
       "      <td>1423</td>\n",
       "      <td>1472</td>\n",
       "      <td>1578</td>\n",
       "      <td>0.820069</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>STOLEN MOTORCYCLE</th>\n",
       "      <td>343</td>\n",
       "      <td>318</td>\n",
       "      <td>290</td>\n",
       "      <td>291</td>\n",
       "      <td>296</td>\n",
       "      <td>259</td>\n",
       "      <td>342</td>\n",
       "      <td>410</td>\n",
       "      <td>550</td>\n",
       "      <td>785</td>\n",
       "      <td>1.652027</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "year                          2006  2007  2008  2009  2010  2011  2012  2013  \\\n",
       "descript                                                                       \n",
       "ATTEMPTED STOLEN VEHICLE        91    72    73    62    55    50    50    45   \n",
       "STOLEN AUTOMOBILE             4881  4291  3953  3494  2817  3294  4289  3935   \n",
       "STOLEN AND RECOVERED VEHICLE   384   348   340   269   264   261   309   350   \n",
       "STOLEN TRUCK                  1540  1393  1355  1029   867   858  1136  1423   \n",
       "STOLEN MOTORCYCLE              343   318   290   291   296   259   342   410   \n",
       "\n",
       "year                          2014  2015  delta_2015_2010  \n",
       "descript                                                   \n",
       "ATTEMPTED STOLEN VEHICLE        54    68         0.236364  \n",
       "STOLEN AUTOMOBILE             4567  4985         0.769613  \n",
       "STOLEN AND RECOVERED VEHICLE   415   472         0.787879  \n",
       "STOLEN TRUCK                  1472  1578         0.820069  \n",
       "STOLEN MOTORCYCLE              550   785         1.652027  "
      ]
     },
     "execution_count": 116,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "major_autothefts_piv.sort_values('delta_2015_2010')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# By district"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 117,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "v_df = df[df['category'] == 'VEHICLE THEFT']\n",
    "v_piv = v_df.pivot_table(index='pddistrict', columns='year', values='pdid', aggfunc=len)\n",
    "v_piv['delta_2014_2010'] = (v_piv[2014] - v_piv[2010]) / v_piv[2010]\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 118,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>year</th>\n",
       "      <th>2006</th>\n",
       "      <th>2007</th>\n",
       "      <th>2008</th>\n",
       "      <th>2009</th>\n",
       "      <th>2010</th>\n",
       "      <th>2011</th>\n",
       "      <th>2012</th>\n",
       "      <th>2013</th>\n",
       "      <th>2014</th>\n",
       "      <th>2015</th>\n",
       "      <th>delta_2014_2010</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>pddistrict</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>CENTRAL</th>\n",
       "      <td>583</td>\n",
       "      <td>637</td>\n",
       "      <td>489</td>\n",
       "      <td>434</td>\n",
       "      <td>303</td>\n",
       "      <td>403</td>\n",
       "      <td>490</td>\n",
       "      <td>441</td>\n",
       "      <td>556</td>\n",
       "      <td>550</td>\n",
       "      <td>0.834983</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>NORTHERN</th>\n",
       "      <td>836</td>\n",
       "      <td>702</td>\n",
       "      <td>765</td>\n",
       "      <td>610</td>\n",
       "      <td>462</td>\n",
       "      <td>562</td>\n",
       "      <td>707</td>\n",
       "      <td>760</td>\n",
       "      <td>809</td>\n",
       "      <td>944</td>\n",
       "      <td>0.751082</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>MISSION</th>\n",
       "      <td>994</td>\n",
       "      <td>830</td>\n",
       "      <td>881</td>\n",
       "      <td>766</td>\n",
       "      <td>572</td>\n",
       "      <td>675</td>\n",
       "      <td>850</td>\n",
       "      <td>812</td>\n",
       "      <td>993</td>\n",
       "      <td>1199</td>\n",
       "      <td>0.736014</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>INGLESIDE</th>\n",
       "      <td>1223</td>\n",
       "      <td>966</td>\n",
       "      <td>840</td>\n",
       "      <td>865</td>\n",
       "      <td>830</td>\n",
       "      <td>754</td>\n",
       "      <td>1308</td>\n",
       "      <td>1286</td>\n",
       "      <td>1432</td>\n",
       "      <td>1368</td>\n",
       "      <td>0.725301</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>PARK</th>\n",
       "      <td>542</td>\n",
       "      <td>429</td>\n",
       "      <td>440</td>\n",
       "      <td>365</td>\n",
       "      <td>303</td>\n",
       "      <td>383</td>\n",
       "      <td>525</td>\n",
       "      <td>377</td>\n",
       "      <td>518</td>\n",
       "      <td>640</td>\n",
       "      <td>0.709571</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>RICHMOND</th>\n",
       "      <td>500</td>\n",
       "      <td>603</td>\n",
       "      <td>464</td>\n",
       "      <td>316</td>\n",
       "      <td>282</td>\n",
       "      <td>339</td>\n",
       "      <td>488</td>\n",
       "      <td>518</td>\n",
       "      <td>440</td>\n",
       "      <td>561</td>\n",
       "      <td>0.560284</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>SOUTHERN</th>\n",
       "      <td>646</td>\n",
       "      <td>621</td>\n",
       "      <td>594</td>\n",
       "      <td>538</td>\n",
       "      <td>372</td>\n",
       "      <td>418</td>\n",
       "      <td>494</td>\n",
       "      <td>452</td>\n",
       "      <td>574</td>\n",
       "      <td>794</td>\n",
       "      <td>0.543011</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TARAVAL</th>\n",
       "      <td>927</td>\n",
       "      <td>787</td>\n",
       "      <td>674</td>\n",
       "      <td>523</td>\n",
       "      <td>470</td>\n",
       "      <td>463</td>\n",
       "      <td>505</td>\n",
       "      <td>643</td>\n",
       "      <td>701</td>\n",
       "      <td>788</td>\n",
       "      <td>0.491489</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>BAYVIEW</th>\n",
       "      <td>907</td>\n",
       "      <td>785</td>\n",
       "      <td>804</td>\n",
       "      <td>684</td>\n",
       "      <td>657</td>\n",
       "      <td>679</td>\n",
       "      <td>755</td>\n",
       "      <td>836</td>\n",
       "      <td>952</td>\n",
       "      <td>983</td>\n",
       "      <td>0.449011</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>TENDERLOIN</th>\n",
       "      <td>133</td>\n",
       "      <td>100</td>\n",
       "      <td>102</td>\n",
       "      <td>82</td>\n",
       "      <td>95</td>\n",
       "      <td>86</td>\n",
       "      <td>61</td>\n",
       "      <td>116</td>\n",
       "      <td>137</td>\n",
       "      <td>113</td>\n",
       "      <td>0.442105</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "year        2006  2007  2008  2009  2010  2011  2012  2013  2014  2015  \\\n",
       "pddistrict                                                               \n",
       "CENTRAL      583   637   489   434   303   403   490   441   556   550   \n",
       "NORTHERN     836   702   765   610   462   562   707   760   809   944   \n",
       "MISSION      994   830   881   766   572   675   850   812   993  1199   \n",
       "INGLESIDE   1223   966   840   865   830   754  1308  1286  1432  1368   \n",
       "PARK         542   429   440   365   303   383   525   377   518   640   \n",
       "RICHMOND     500   603   464   316   282   339   488   518   440   561   \n",
       "SOUTHERN     646   621   594   538   372   418   494   452   574   794   \n",
       "TARAVAL      927   787   674   523   470   463   505   643   701   788   \n",
       "BAYVIEW      907   785   804   684   657   679   755   836   952   983   \n",
       "TENDERLOIN   133   100   102    82    95    86    61   116   137   113   \n",
       "\n",
       "year        delta_2014_2010  \n",
       "pddistrict                   \n",
       "CENTRAL            0.834983  \n",
       "NORTHERN           0.751082  \n",
       "MISSION            0.736014  \n",
       "INGLESIDE          0.725301  \n",
       "PARK               0.709571  \n",
       "RICHMOND           0.560284  \n",
       "SOUTHERN           0.543011  \n",
       "TARAVAL            0.491489  \n",
       "BAYVIEW            0.449011  \n",
       "TENDERLOIN         0.442105  "
      ]
     },
     "execution_count": 118,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "v_piv.sort_values('delta_2014_2010', ascending=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.1"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}