Assignment3.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#  <span style=\"text-decoration:underline;\">Assignment 3</span>: Predicting Salaries via Classification"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introduction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this assignment, you will be working with [US census data](https://raw.githubusercontent.com/lapets/course-data-science/master/assignment-2018-12-03-data.tsv). You can find the schema for the data set [here](https://raw.githubusercontent.com/lapets/course-data-science/master/assignment-2018-12-03-schema.txt). The data is stored in a tab-separated value file in which each line represents an individual person. The data set was extracted from the 1994 US census data. Your goal is to evaluate different models for determining whether a person has an annual salary that is $50,000 or above.  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Submission"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Please use the following invitation link to create your assignment repository for this assignment: [https://classroom.github.com/a/3Af24wlA](https://classroom.github.com/a/3Af24wlA). Include your BU username within your submission by adding it here: **<asadeg02;**.\n",
    "\n",
    "Do not delete the output of your code cells. This assignment must be completed **individually** by each student."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## <span style=\"text-decoration:underline;\">Problem 1</span>: Feature Dimension Representations"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**<span style=\"text-decoration:underline;\">Part A</span> (20 points):** This data set contains categorical values in its feature dimensions. Most of the algorithms that were presented during lectures can only handle numeric quantities. Thus, it is necessary to create a new feature dimension for every unique value of each categorical variable. To accomplish this, you can use `pandas.get_dummies`. An example is provided below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>age</th>\n",
       "      <th>salary</th>\n",
       "      <th>edu_Bachelor</th>\n",
       "      <th>edu_Jd</th>\n",
       "      <th>edu_Masters</th>\n",
       "      <th>edu_PhD</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>23</td>\n",
       "      <td>60000</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>62</td>\n",
       "      <td>100000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>31</td>\n",
       "      <td>120000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>48</td>\n",
       "      <td>150000</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>59</td>\n",
       "      <td>95000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   age  salary  edu_Bachelor  edu_Jd  edu_Masters  edu_PhD\n",
       "0   23   60000             1       0            0        0\n",
       "1   62  100000             0       0            1        0\n",
       "2   31  120000             0       0            0        1\n",
       "3   48  150000             0       1            0        0\n",
       "4   59   95000             0       0            1        0"
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "raw_data = {'age': [23, 62, 31, 48, 59],\n",
    "        'salary': [60000, 100000, 120000, 150000, 95000],\n",
    "        'education': ['Bachelor', 'Masters', 'PhD', 'Jd', 'Masters']}\n",
    "df = pd.DataFrame(raw_data, columns = ['age', 'salary', 'education'])\n",
    "df_edu = pd.get_dummies(df['education'], prefix = 'edu')\n",
    "df_new = pd.concat([df, df_edu], axis=1)\n",
    "df_new = df_new.drop( ['education'], axis = 1 )\n",
    "df_new"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Convert all categorical feature dimensions within the data set in this way, storing the result as a new data frame."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>age</th>\n",
       "      <th>fnlwgt</th>\n",
       "      <th>education-num</th>\n",
       "      <th>capital-gain</th>\n",
       "      <th>capital-loss</th>\n",
       "      <th>hours-per-week</th>\n",
       "      <th>class</th>\n",
       "      <th>workclass_Federal-gov</th>\n",
       "      <th>workclass_Local-gov</th>\n",
       "      <th>workclass_Private</th>\n",
       "      <th>...</th>\n",
       "      <th>nativecountry_Portugal</th>\n",
       "      <th>nativecountry_Puerto-Rico</th>\n",
       "      <th>nativecountry_Scotland</th>\n",
       "      <th>nativecountry_South</th>\n",
       "      <th>nativecountry_Taiwan</th>\n",
       "      <th>nativecountry_Thailand</th>\n",
       "      <th>nativecountry_Trinadad&amp;Tobago</th>\n",
       "      <th>nativecountry_United-States</th>\n",
       "      <th>nativecountry_Vietnam</th>\n",
       "      <th>nativecountry_Yugoslavia</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>39</td>\n",
       "      <td>77516</td>\n",
       "      <td>13</td>\n",
       "      <td>2174</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>50</td>\n",
       "      <td>83311</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>38</td>\n",
       "      <td>215646</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>53</td>\n",
       "      <td>234721</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>28</td>\n",
       "      <td>338409</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>37</td>\n",
       "      <td>284582</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>49</td>\n",
       "      <td>160187</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>16</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>52</td>\n",
       "      <td>209642</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>45</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>31</td>\n",
       "      <td>45781</td>\n",
       "      <td>14</td>\n",
       "      <td>14084</td>\n",
       "      <td>0</td>\n",
       "      <td>50</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>42</td>\n",
       "      <td>159449</td>\n",
       "      <td>13</td>\n",
       "      <td>5178</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>37</td>\n",
       "      <td>280464</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>80</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>30</td>\n",
       "      <td>141297</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>23</td>\n",
       "      <td>122272</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>30</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>32</td>\n",
       "      <td>205019</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>50</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>34</td>\n",
       "      <td>245487</td>\n",
       "      <td>4</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>45</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>25</td>\n",
       "      <td>176756</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>35</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>32</td>\n",
       "      <td>186824</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>38</td>\n",
       "      <td>28887</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>50</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>43</td>\n",
       "      <td>292175</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>45</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>40</td>\n",
       "      <td>193524</td>\n",
       "      <td>16</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>60</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>54</td>\n",
       "      <td>302146</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>20</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>35</td>\n",
       "      <td>76845</td>\n",
       "      <td>5</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>43</td>\n",
       "      <td>117037</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>2042</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>59</td>\n",
       "      <td>109015</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>56</td>\n",
       "      <td>216851</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>19</td>\n",
       "      <td>168294</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>39</td>\n",
       "      <td>367260</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>80</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>49</td>\n",
       "      <td>193366</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>23</td>\n",
       "      <td>190709</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>52</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>20</td>\n",
       "      <td>266015</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>44</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46478</th>\n",
       "      <td>57</td>\n",
       "      <td>161964</td>\n",
       "      <td>8</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46479</th>\n",
       "      <td>30</td>\n",
       "      <td>34572</td>\n",
       "      <td>15</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>80</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46480</th>\n",
       "      <td>21</td>\n",
       "      <td>198259</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>30</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46481</th>\n",
       "      <td>57</td>\n",
       "      <td>161944</td>\n",
       "      <td>10</td>\n",
       "      <td>7688</td>\n",
       "      <td>0</td>\n",
       "      <td>60</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46482</th>\n",
       "      <td>51</td>\n",
       "      <td>29887</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>1590</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46483</th>\n",
       "      <td>37</td>\n",
       "      <td>238980</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>42</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46484</th>\n",
       "      <td>42</td>\n",
       "      <td>275677</td>\n",
       "      <td>11</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>50</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46485</th>\n",
       "      <td>32</td>\n",
       "      <td>24529</td>\n",
       "      <td>11</td>\n",
       "      <td>5178</td>\n",
       "      <td>0</td>\n",
       "      <td>60</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46486</th>\n",
       "      <td>51</td>\n",
       "      <td>311631</td>\n",
       "      <td>13</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46487</th>\n",
       "      <td>24</td>\n",
       "      <td>374763</td>\n",
       "      <td>7</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46488</th>\n",
       "      <td>25</td>\n",
       "      <td>242136</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46489</th>\n",
       "      <td>31</td>\n",
       "      <td>112115</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46490</th>\n",
       "      <td>49</td>\n",
       "      <td>77132</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46492</th>\n",
       "      <td>60</td>\n",
       "      <td>117909</td>\n",
       "      <td>11</td>\n",
       "      <td>7688</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46493</th>\n",
       "      <td>38</td>\n",
       "      <td>149347</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>50</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46494</th>\n",
       "      <td>43</td>\n",
       "      <td>23157</td>\n",
       "      <td>14</td>\n",
       "      <td>0</td>\n",
       "      <td>1902</td>\n",
       "      <td>50</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46495</th>\n",
       "      <td>23</td>\n",
       "      <td>93977</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46496</th>\n",
       "      <td>73</td>\n",
       "      <td>159691</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46497</th>\n",
       "      <td>35</td>\n",
       "      <td>176967</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46498</th>\n",
       "      <td>66</td>\n",
       "      <td>344436</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>8</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46499</th>\n",
       "      <td>40</td>\n",
       "      <td>202168</td>\n",
       "      <td>15</td>\n",
       "      <td>15024</td>\n",
       "      <td>0</td>\n",
       "      <td>55</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46500</th>\n",
       "      <td>51</td>\n",
       "      <td>82720</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46501</th>\n",
       "      <td>22</td>\n",
       "      <td>269623</td>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46502</th>\n",
       "      <td>64</td>\n",
       "      <td>136405</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>32</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46504</th>\n",
       "      <td>55</td>\n",
       "      <td>224655</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>32</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46505</th>\n",
       "      <td>58</td>\n",
       "      <td>292710</td>\n",
       "      <td>12</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>36</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46506</th>\n",
       "      <td>32</td>\n",
       "      <td>173449</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46507</th>\n",
       "      <td>48</td>\n",
       "      <td>285570</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46508</th>\n",
       "      <td>61</td>\n",
       "      <td>89686</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>48</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46509</th>\n",
       "      <td>31</td>\n",
       "      <td>440129</td>\n",
       "      <td>9</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>40</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>...</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>43065 rows × 105 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       age  fnlwgt  education-num  capital-gain  capital-loss  hours-per-week  \\\n",
       "0       39   77516             13          2174             0              40   \n",
       "1       50   83311             13             0             0              13   \n",
       "2       38  215646              9             0             0              40   \n",
       "3       53  234721              7             0             0              40   \n",
       "4       28  338409             13             0             0              40   \n",
       "5       37  284582             14             0             0              40   \n",
       "6       49  160187              5             0             0              16   \n",
       "7       52  209642              9             0             0              45   \n",
       "8       31   45781             14         14084             0              50   \n",
       "9       42  159449             13          5178             0              40   \n",
       "10      37  280464             10             0             0              80   \n",
       "11      30  141297             13             0             0              40   \n",
       "12      23  122272             13             0             0              30   \n",
       "13      32  205019             12             0             0              50   \n",
       "15      34  245487              4             0             0              45   \n",
       "16      25  176756              9             0             0              35   \n",
       "17      32  186824              9             0             0              40   \n",
       "18      38   28887              7             0             0              50   \n",
       "19      43  292175             14             0             0              45   \n",
       "20      40  193524             16             0             0              60   \n",
       "21      54  302146              9             0             0              20   \n",
       "22      35   76845              5             0             0              40   \n",
       "23      43  117037              7             0          2042              40   \n",
       "24      59  109015              9             0             0              40   \n",
       "25      56  216851             13             0             0              40   \n",
       "26      19  168294              9             0             0              40   \n",
       "28      39  367260              9             0             0              80   \n",
       "29      49  193366              9             0             0              40   \n",
       "30      23  190709             12             0             0              52   \n",
       "31      20  266015             10             0             0              44   \n",
       "...    ...     ...            ...           ...           ...             ...   \n",
       "46478   57  161964              8             0             0              40   \n",
       "46479   30   34572             15             0             0              80   \n",
       "46480   21  198259              9             0             0              30   \n",
       "46481   57  161944             10          7688             0              60   \n",
       "46482   51   29887             13             0          1590              40   \n",
       "46483   37  238980             14             0             0              42   \n",
       "46484   42  275677             11             0             0              50   \n",
       "46485   32   24529             11          5178             0              60   \n",
       "46486   51  311631             13             0             0              40   \n",
       "46487   24  374763              7             0             0              40   \n",
       "46488   25  242136              9             0             0              40   \n",
       "46489   31  112115              9             0             0              40   \n",
       "46490   49   77132              9             0             0              40   \n",
       "46492   60  117909             11          7688             0              40   \n",
       "46493   38  149347             14             0             0              50   \n",
       "46494   43   23157             14             0          1902              50   \n",
       "46495   23   93977              9             0             0              40   \n",
       "46496   73  159691             10             0             0              40   \n",
       "46497   35  176967             10             0             0              40   \n",
       "46498   66  344436              9             0             0               8   \n",
       "46499   40  202168             15         15024             0              55   \n",
       "46500   51   82720              9             0             0              40   \n",
       "46501   22  269623             10             0             0              40   \n",
       "46502   64  136405              9             0             0              32   \n",
       "46504   55  224655              9             0             0              32   \n",
       "46505   58  292710             12             0             0              36   \n",
       "46506   32  173449              9             0             0              40   \n",
       "46507   48  285570              9             0             0              40   \n",
       "46508   61   89686              9             0             0              48   \n",
       "46509   31  440129              9             0             0              40   \n",
       "\n",
       "       class  workclass_Federal-gov  workclass_Local-gov  workclass_Private  \\\n",
       "0          0                      0                    0                  0   \n",
       "1          0                      0                    0                  0   \n",
       "2          0                      0                    0                  1   \n",
       "3          0                      0                    0                  1   \n",
       "4          0                      0                    0                  1   \n",
       "5          0                      0                    0                  1   \n",
       "6          0                      0                    0                  1   \n",
       "7          1                      0                    0                  0   \n",
       "8          1                      0                    0                  1   \n",
       "9          1                      0                    0                  1   \n",
       "10         1                      0                    0                  1   \n",
       "11         1                      0                    0                  0   \n",
       "12         0                      0                    0                  1   \n",
       "13         0                      0                    0                  1   \n",
       "15         0                      0                    0                  1   \n",
       "16         0                      0                    0                  0   \n",
       "17         0                      0                    0                  1   \n",
       "18         0                      0                    0                  1   \n",
       "19         1                      0                    0                  0   \n",
       "20         1                      0                    0                  1   \n",
       "21         0                      0                    0                  1   \n",
       "22         0                      1                    0                  0   \n",
       "23         0                      0                    0                  1   \n",
       "24         0                      0                    0                  1   \n",
       "25         1                      0                    1                  0   \n",
       "26         0                      0                    0                  1   \n",
       "28         0                      0                    0                  1   \n",
       "29         0                      0                    0                  1   \n",
       "30         0                      0                    1                  0   \n",
       "31         0                      0                    0                  1   \n",
       "...      ...                    ...                  ...                ...   \n",
       "46478      0                      0                    0                  1   \n",
       "46479      1                      0                    0                  1   \n",
       "46480      0                      0                    0                  1   \n",
       "46481      1                      0                    0                  1   \n",
       "46482      0                      0                    0                  1   \n",
       "46483      0                      1                    0                  0   \n",
       "46484      0                      0                    0                  1   \n",
       "46485      1                      0                    0                  1   \n",
       "46486      1                      0                    0                  0   \n",
       "46487      0                      0                    0                  1   \n",
       "46488      0                      0                    0                  1   \n",
       "46489      0                      0                    0                  1   \n",
       "46490      1                      0                    0                  0   \n",
       "46492      1                      0                    0                  1   \n",
       "46493      1                      0                    0                  1   \n",
       "46494      1                      0                    1                  0   \n",
       "46495      0                      0                    0                  1   \n",
       "46496      0                      0                    0                  0   \n",
       "46497      0                      0                    0                  1   \n",
       "46498      0                      0                    0                  1   \n",
       "46499      1                      0                    0                  1   \n",
       "46500      0                      0                    0                  1   \n",
       "46501      0                      0                    0                  1   \n",
       "46502      0                      0                    0                  0   \n",
       "46504      0                      0                    0                  1   \n",
       "46505      0                      0                    0                  1   \n",
       "46506      0                      0                    0                  1   \n",
       "46507      0                      0                    0                  1   \n",
       "46508      0                      0                    0                  1   \n",
       "46509      0                      0                    0                  1   \n",
       "\n",
       "                 ...             nativecountry_Portugal  \\\n",
       "0                ...                                  0   \n",
       "1                ...                                  0   \n",
       "2                ...                                  0   \n",
       "3                ...                                  0   \n",
       "4                ...                                  0   \n",
       "5                ...                                  0   \n",
       "6                ...                                  0   \n",
       "7                ...                                  0   \n",
       "8                ...                                  0   \n",
       "9                ...                                  0   \n",
       "10               ...                                  0   \n",
       "11               ...                                  0   \n",
       "12               ...                                  0   \n",
       "13               ...                                  0   \n",
       "15               ...                                  0   \n",
       "16               ...                                  0   \n",
       "17               ...                                  0   \n",
       "18               ...                                  0   \n",
       "19               ...                                  0   \n",
       "20               ...                                  0   \n",
       "21               ...                                  0   \n",
       "22               ...                                  0   \n",
       "23               ...                                  0   \n",
       "24               ...                                  0   \n",
       "25               ...                                  0   \n",
       "26               ...                                  0   \n",
       "28               ...                                  0   \n",
       "29               ...                                  0   \n",
       "30               ...                                  0   \n",
       "31               ...                                  0   \n",
       "...              ...                                ...   \n",
       "46478            ...                                  0   \n",
       "46479            ...                                  0   \n",
       "46480            ...                                  0   \n",
       "46481            ...                                  0   \n",
       "46482            ...                                  0   \n",
       "46483            ...                                  0   \n",
       "46484            ...                                  0   \n",
       "46485            ...                                  0   \n",
       "46486            ...                                  0   \n",
       "46487            ...                                  0   \n",
       "46488            ...                                  0   \n",
       "46489            ...                                  0   \n",
       "46490            ...                                  0   \n",
       "46492            ...                                  0   \n",
       "46493            ...                                  0   \n",
       "46494            ...                                  0   \n",
       "46495            ...                                  0   \n",
       "46496            ...                                  0   \n",
       "46497            ...                                  0   \n",
       "46498            ...                                  0   \n",
       "46499            ...                                  0   \n",
       "46500            ...                                  0   \n",
       "46501            ...                                  0   \n",
       "46502            ...                                  0   \n",
       "46504            ...                                  0   \n",
       "46505            ...                                  0   \n",
       "46506            ...                                  0   \n",
       "46507            ...                                  0   \n",
       "46508            ...                                  0   \n",
       "46509            ...                                  0   \n",
       "\n",
       "       nativecountry_Puerto-Rico  nativecountry_Scotland  nativecountry_South  \\\n",
       "0                              0                       0                    0   \n",
       "1                              0                       0                    0   \n",
       "2                              0                       0                    0   \n",
       "3                              0                       0                    0   \n",
       "4                              0                       0                    0   \n",
       "5                              0                       0                    0   \n",
       "6                              0                       0                    0   \n",
       "7                              0                       0                    0   \n",
       "8                              0                       0                    0   \n",
       "9                              0                       0                    0   \n",
       "10                             0                       0                    0   \n",
       "11                             0                       0                    0   \n",
       "12                             0                       0                    0   \n",
       "13                             0                       0                    0   \n",
       "15                             0                       0                    0   \n",
       "16                             0                       0                    0   \n",
       "17                             0                       0                    0   \n",
       "18                             0                       0                    0   \n",
       "19                             0                       0                    0   \n",
       "20                             0                       0                    0   \n",
       "21                             0                       0                    0   \n",
       "22                             0                       0                    0   \n",
       "23                             0                       0                    0   \n",
       "24                             0                       0                    0   \n",
       "25                             0                       0                    0   \n",
       "26                             0                       0                    0   \n",
       "28                             0                       0                    0   \n",
       "29                             0                       0                    0   \n",
       "30                             0                       0                    0   \n",
       "31                             0                       0                    0   \n",
       "...                          ...                     ...                  ...   \n",
       "46478                          0                       0                    0   \n",
       "46479                          0                       0                    0   \n",
       "46480                          0                       0                    0   \n",
       "46481                          0                       0                    0   \n",
       "46482                          0                       0                    0   \n",
       "46483                          0                       0                    0   \n",
       "46484                          0                       0                    0   \n",
       "46485                          0                       0                    0   \n",
       "46486                          0                       0                    0   \n",
       "46487                          0                       0                    0   \n",
       "46488                          0                       0                    0   \n",
       "46489                          0                       0                    0   \n",
       "46490                          0                       0                    0   \n",
       "46492                          0                       0                    0   \n",
       "46493                          0                       0                    0   \n",
       "46494                          0                       0                    0   \n",
       "46495                          0                       0                    0   \n",
       "46496                          0                       0                    0   \n",
       "46497                          0                       0                    0   \n",
       "46498                          0                       0                    0   \n",
       "46499                          0                       0                    0   \n",
       "46500                          0                       0                    0   \n",
       "46501                          0                       0                    0   \n",
       "46502                          0                       0                    0   \n",
       "46504                          0                       0                    0   \n",
       "46505                          0                       0                    0   \n",
       "46506                          0                       0                    0   \n",
       "46507                          0                       0                    0   \n",
       "46508                          0                       0                    0   \n",
       "46509                          0                       0                    0   \n",
       "\n",
       "       nativecountry_Taiwan  nativecountry_Thailand  \\\n",
       "0                         0                       0   \n",
       "1                         0                       0   \n",
       "2                         0                       0   \n",
       "3                         0                       0   \n",
       "4                         0                       0   \n",
       "5                         0                       0   \n",
       "6                         0                       0   \n",
       "7                         0                       0   \n",
       "8                         0                       0   \n",
       "9                         0                       0   \n",
       "10                        0                       0   \n",
       "11                        0                       0   \n",
       "12                        0                       0   \n",
       "13                        0                       0   \n",
       "15                        0                       0   \n",
       "16                        0                       0   \n",
       "17                        0                       0   \n",
       "18                        0                       0   \n",
       "19                        0                       0   \n",
       "20                        0                       0   \n",
       "21                        0                       0   \n",
       "22                        0                       0   \n",
       "23                        0                       0   \n",
       "24                        0                       0   \n",
       "25                        0                       0   \n",
       "26                        0                       0   \n",
       "28                        0                       0   \n",
       "29                        0                       0   \n",
       "30                        0                       0   \n",
       "31                        0                       0   \n",
       "...                     ...                     ...   \n",
       "46478                     0                       0   \n",
       "46479                     0                       0   \n",
       "46480                     0                       0   \n",
       "46481                     0                       0   \n",
       "46482                     0                       0   \n",
       "46483                     0                       0   \n",
       "46484                     0                       0   \n",
       "46485                     0                       0   \n",
       "46486                     0                       0   \n",
       "46487                     0                       0   \n",
       "46488                     0                       0   \n",
       "46489                     0                       0   \n",
       "46490                     0                       0   \n",
       "46492                     0                       0   \n",
       "46493                     0                       0   \n",
       "46494                     0                       0   \n",
       "46495                     0                       0   \n",
       "46496                     0                       0   \n",
       "46497                     0                       0   \n",
       "46498                     0                       0   \n",
       "46499                     0                       0   \n",
       "46500                     0                       0   \n",
       "46501                     0                       0   \n",
       "46502                     0                       0   \n",
       "46504                     0                       0   \n",
       "46505                     0                       0   \n",
       "46506                     0                       0   \n",
       "46507                     0                       0   \n",
       "46508                     0                       0   \n",
       "46509                     0                       0   \n",
       "\n",
       "       nativecountry_Trinadad&Tobago  nativecountry_United-States  \\\n",
       "0                                  0                            1   \n",
       "1                                  0                            1   \n",
       "2                                  0                            1   \n",
       "3                                  0                            1   \n",
       "4                                  0                            0   \n",
       "5                                  0                            1   \n",
       "6                                  0                            0   \n",
       "7                                  0                            1   \n",
       "8                                  0                            1   \n",
       "9                                  0                            1   \n",
       "10                                 0                            1   \n",
       "11                                 0                            0   \n",
       "12                                 0                            1   \n",
       "13                                 0                            1   \n",
       "15                                 0                            0   \n",
       "16                                 0                            1   \n",
       "17                                 0                            1   \n",
       "18                                 0                            1   \n",
       "19                                 0                            1   \n",
       "20                                 0                            1   \n",
       "21                                 0                            1   \n",
       "22                                 0                            1   \n",
       "23                                 0                            1   \n",
       "24                                 0                            1   \n",
       "25                                 0                            1   \n",
       "26                                 0                            1   \n",
       "28                                 0                            1   \n",
       "29                                 0                            1   \n",
       "30                                 0                            1   \n",
       "31                                 0                            1   \n",
       "...                              ...                          ...   \n",
       "46478                              0                            1   \n",
       "46479                              0                            1   \n",
       "46480                              0                            1   \n",
       "46481                              0                            1   \n",
       "46482                              0                            1   \n",
       "46483                              0                            1   \n",
       "46484                              0                            1   \n",
       "46485                              0                            1   \n",
       "46486                              0                            1   \n",
       "46487                              0                            0   \n",
       "46488                              0                            1   \n",
       "46489                              0                            1   \n",
       "46490                              0                            0   \n",
       "46492                              0                            1   \n",
       "46493                              0                            1   \n",
       "46494                              0                            1   \n",
       "46495                              0                            1   \n",
       "46496                              0                            1   \n",
       "46497                              0                            1   \n",
       "46498                              0                            1   \n",
       "46499                              0                            1   \n",
       "46500                              0                            1   \n",
       "46501                              0                            1   \n",
       "46502                              0                            1   \n",
       "46504                              0                            1   \n",
       "46505                              0                            1   \n",
       "46506                              0                            1   \n",
       "46507                              0                            1   \n",
       "46508                              0                            1   \n",
       "46509                              0                            1   \n",
       "\n",
       "       nativecountry_Vietnam  nativecountry_Yugoslavia  \n",
       "0                          0                         0  \n",
       "1                          0                         0  \n",
       "2                          0                         0  \n",
       "3                          0                         0  \n",
       "4                          0                         0  \n",
       "5                          0                         0  \n",
       "6                          0                         0  \n",
       "7                          0                         0  \n",
       "8                          0                         0  \n",
       "9                          0                         0  \n",
       "10                         0                         0  \n",
       "11                         0                         0  \n",
       "12                         0                         0  \n",
       "13                         0                         0  \n",
       "15                         0                         0  \n",
       "16                         0                         0  \n",
       "17                         0                         0  \n",
       "18                         0                         0  \n",
       "19                         0                         0  \n",
       "20                         0                         0  \n",
       "21                         0                         0  \n",
       "22                         0                         0  \n",
       "23                         0                         0  \n",
       "24                         0                         0  \n",
       "25                         0                         0  \n",
       "26                         0                         0  \n",
       "28                         0                         0  \n",
       "29                         0                         0  \n",
       "30                         0                         0  \n",
       "31                         0                         0  \n",
       "...                      ...                       ...  \n",
       "46478                      0                         0  \n",
       "46479                      0                         0  \n",
       "46480                      0                         0  \n",
       "46481                      0                         0  \n",
       "46482                      0                         0  \n",
       "46483                      0                         0  \n",
       "46484                      0                         0  \n",
       "46485                      0                         0  \n",
       "46486                      0                         0  \n",
       "46487                      0                         0  \n",
       "46488                      0                         0  \n",
       "46489                      0                         0  \n",
       "46490                      0                         0  \n",
       "46492                      0                         0  \n",
       "46493                      0                         0  \n",
       "46494                      0                         0  \n",
       "46495                      0                         0  \n",
       "46496                      0                         0  \n",
       "46497                      0                         0  \n",
       "46498                      0                         0  \n",
       "46499                      0                         0  \n",
       "46500                      0                         0  \n",
       "46501                      0                         0  \n",
       "46502                      0                         0  \n",
       "46504                      0                         0  \n",
       "46505                      0                         0  \n",
       "46506                      0                         0  \n",
       "46507                      0                         0  \n",
       "46508                      0                         0  \n",
       "46509                      0                         0  \n",
       "\n",
       "[43065 rows x 105 columns]"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "file_name = 'US_sensus_data.tsv'\n",
    "column_names = ['age', 'workclass','fnlwgt','education','education-num','marital-status','occupation',\n",
    "                'relationship', 'race','sex','capital-gain','capital-loss','hours-per-week','nativecountry','class']\n",
    "df1 = pd.read_table(file_name, header = None, names = column_names, index_col=False)\n",
    "\n",
    "#clean data remove rows having ? as value for one of their columns\n",
    "df1 = df1[df1.workclass != '?']\n",
    "df1 = df1[df1.occupation != '?']\n",
    "df1 = df1[df1.nativecountry != '?']\n",
    "\n",
    "categorical_variables = ['workclass', 'education', 'marital-status', 'occupation', 'relationship','race','sex','nativecountry']\n",
    "\n",
    "def convert_to_numerical(df, categorical_variables):\n",
    "    for variable in categorical_variables:\n",
    "        df_variable = pd.get_dummies(df[variable], prefix = variable)\n",
    "        df = pd.concat([df, df_variable], axis=1)\n",
    "        df = df.drop([variable], axis = 1 )\n",
    "    return df    \n",
    "          \n",
    "df1 = convert_to_numerical(df1, categorical_variables)\n",
    "\n",
    "#convert class column to 0 for <=50 and 1 for >50K\n",
    "df1['class'] = df1['class'].map(lambda x: 0 if x=='<=50K' else 1)\n",
    "df1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## <span style=\"text-decoration:underline;\">Problem 2</span>: Classification Methods"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "For each part below, you may use either the data in its original form or the transformed representation of the data that you generated in Problem 1."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**<span style=\"text-decoration:underline;\">Part A</span> (20 points):** Use $k$-nearest neighbors to implement an algorithm that predicts the whether an individual has an annual salary of 50,000 dollars or above. Note that the target feature dimension is discrete; you may use a boolean value or $\\{0,1\\}$. Explain how you chose $k$ and report the accuracy of your model on the data. Using `KNeighborsClassifier` is permitted."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Accuracy on test data: 0.791710205503309\n",
      "Accuracy on training data: 0.7986764193660746\n",
      "Accuracy on entire data: 0.7972831765935214\n"
     ]
    }
   ],
   "source": [
    "####################readme######################################################\n",
    "#for the first 2 parts I have tried multiple approaches for getting scores \n",
    "#the first approach is by first shuffling the data and then getting the first 80% of the records \n",
    "#as the train set data and for knn the scores obtained from diffrent approchaes is\n",
    "#almost the same\n",
    "\n",
    "#for choosing k i have tried knn with defferent values of k and the value \n",
    "# 25 has given a resaoble score. while doing that the train set has been the same \n",
    "############################################################\n",
    "\n",
    "from sklearn.neighbors import KNeighborsClassifier\n",
    "import sklearn.utils as utils\n",
    "\n",
    "labels = df1['class'] #store class column as a seperate data frame\n",
    "\n",
    "data = df1.drop(columns=['class'])#remove the class column from data\n",
    "\n",
    "(data, labels) = utils.shuffle(data, labels, random_state=1)#shuffling data\n",
    "\n",
    "num_rows, num_columns = (df1.shape)#getting total number of data entries in data set\n",
    "\n",
    "train_set_size = int((num_rows * 80)/100)\n",
    "test_set_size = num_rows - train_set_size\n",
    "data_train = data[:train_set_size]\n",
    "labels_train = labels[:train_set_size]\n",
    "data_test = data[train_set_size:]\n",
    "labels_test = labels[train_set_size:]\n",
    "\n",
    "k = 25\n",
    "knn = KNeighborsClassifier(n_neighbors=k)\n",
    "knn.fit(data_train, labels_train)\n",
    "\n",
    "labels_pred_test = knn.predict(data_test)\n",
    "print('Accuracy on test data: {}'.format(knn.score(data_test, labels_test)))\n",
    "\n",
    "y_pred_train = knn.predict(data_train)\n",
    "print('Accuracy on training data: {}'.format(knn.score(data_train, labels_train)))\n",
    "\n",
    "y_pred_data = knn.predict(data)\n",
    "print('Accuracy on entire data: {}'.format(knn.score(data, labels)))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0.79057349 0.79463664 0.79600604 0.79133767 0.7970274 ]\n",
      "Accuracy: 0.79 (+/- 0.01)\n"
     ]
    }
   ],
   "source": [
    "################readme##################################\n",
    "#here we get the scores by calling cross val score \n",
    "#here we can't run it seperately on test and train data\n",
    "################################################################\n",
    "\n",
    "import sklearn.model_selection as cross_validation\n",
    "import sklearn.utils as utils\n",
    "\n",
    "#first shuffle the data:\n",
    "(data, labels) = utils.shuffle(data, labels, random_state=1)\n",
    "k = 25\n",
    "knn = KNeighborsClassifier(n_neighbors=k)\n",
    "scores = cross_validation.cross_val_score(knn, data, labels, cv=5)\n",
    "print(scores)\n",
    "print(\"Accuracy: %0.2f (+/- %0.2f)\" % (scores.mean(), scores.std() * 2))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'test_scores': [0.7989086264948334, 0.7958899338209683, 0.7991408336235922, 0.7893881342157204, 0.8022756298618368], 'train_scores': [0.797979797979798, 0.7973992801579008, 0.7978346685243237, 0.799373040752351, 0.7964123998606757]}\n",
      " knn Accuracy on test data: 0.80 (+/- 0.01)\n",
      " knn Accuracy on train data: 0.80 (+/- 0.00)\n"
     ]
    }
   ],
   "source": [
    "################readme##################################\n",
    "# here i get random samples from train-test-split \n",
    "# and run knn 5 times and report the avarega score as the score\n",
    "################################################################\n",
    "import numpy as np\n",
    "\n",
    "test_size = 0.2\n",
    "k = 25\n",
    "knn = KNeighborsClassifier(n_neighbors=k)\n",
    "\n",
    "def get_scores(data, labels, estimator, test_size):\n",
    "    scores = {}\n",
    "    scores['test_scores'] = []\n",
    "    scores['train_scores'] = []\n",
    "    for i in range(0,5):\n",
    "        (X_train, X_test, y_train, y_test) = cross_validation.train_test_split(data, labels, test_size=test_size)\n",
    "        estimator.fit(X_train, y_train)\n",
    "        scores['test_scores'].append(estimator.score(X_test, y_test))\n",
    "        scores['train_scores'].append(estimator.score(X_train, y_train))\n",
    "    return scores \n",
    "\n",
    "scores = get_scores(data, labels, knn, test_size)\n",
    "test_scores = np.asarray(scores['test_scores'])\n",
    "train_scores = np.asarray(scores['train_scores'])\n",
    "knn_mean_score_on_tests = test_scores.mean()\n",
    "knn_mean_score_on_trains = train_scores.mean()\n",
    "print(scores)\n",
    "print(\" knn Accuracy on test data: %0.2f (+/- %0.2f)\" % (test_scores.mean(), test_scores.std() * 2))\n",
    "print(\" knn Accuracy on train data: %0.2f (+/- %0.2f)\" % (train_scores.mean(), train_scores.std() * 2))\n",
    "   "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**<span style=\"text-decoration:underline;\">Part B</span> (20 points):** Use [decision trees](http://scikit-learn.org/stable/modules/tree.html) to build a model that predicts the same target feature dimension (income of 50,000 or above). Report your accuracy and compare it to your results from part (a). Using `tree` from `sklearn` is permitted."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "DT accuracy on test data:  0.8036688726343899\n",
      "DT accuracy on training data: 0.9998838964356206\n",
      "DT accuracy on entire data: 0.9606408916753745\n"
     ]
    }
   ],
   "source": [
    "from sklearn import tree\n",
    "dtc = tree.DecisionTreeClassifier()\n",
    "dtc.fit(data_train, labels_train)\n",
    "\n",
    "y_pred_test = dtc.predict(data_test)\n",
    "print('DT accuracy on test data: ', dtc.score(data_test, labels_test))\n",
    "\n",
    "y_pred_train = dtc.predict(data_train)\n",
    "print('DT accuracy on training data: {}'.format(dtc.score(data_train, labels_train)))\n",
    "\n",
    "y_pred_data = dtc.predict(data)\n",
    "print('DT accuracy on entire data: {}'.format(dtc.score(data, labels)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0.81448804 0.81274669 0.80726808 0.81444496 0.81351602]\n",
      "DTC Accuracy: 0.81 (+/- 0.01)\n"
     ]
    }
   ],
   "source": [
    "dtc = tree.DecisionTreeClassifier()\n",
    "dtc.fit(data_train, labels_train)\n",
    "\n",
    "scores = cross_validation.cross_val_score(dtc, data, labels, cv=5)\n",
    "print(scores)\n",
    "print(\"DTC Accuracy: %0.2f (+/- %0.2f)\" % (scores.mean(), scores.std() * 2))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'test_scores': [0.8110995007546732, 0.8073841866945315, 0.8036688726343899, 0.8102867758040172, 0.8101706722396378], 'train_scores': [0.9999419482178102, 0.9999419482178102, 0.9999129223267155, 0.9998838964356206, 0.9999419482178102]}\n",
      " dtc Accuracy on test data: 0.81 (+/- 0.01)\n",
      " dtc Accuracy on train data: 1.00 (+/- 0.00)\n"
     ]
    }
   ],
   "source": [
    "test_size = 0.2\n",
    "dtc = tree.DecisionTreeClassifier()\n",
    "dtc.fit(data_train, labels_train)\n",
    "\n",
    "\n",
    "scores = get_scores(data, labels, dtc, test_size)\n",
    "test_scores = np.asarray(scores['test_scores'])\n",
    "train_scores = np.asarray(scores['train_scores'])\n",
    "dtc_mean_score_on_tests = test_scores.mean()\n",
    "dtc_mean_score_on_train = train_scores.mean()\n",
    "print(scores)\n",
    "print(\" dtc Accuracy on test data: %0.2f (+/- %0.2f)\" % (test_scores.mean(), test_scores.std() * 2))\n",
    "print(\" dtc Accuracy on train data: %0.2f (+/- %0.2f)\" % (train_scores.mean(), train_scores.std() * 2))\n",
    "\n",
    "#####################comparison with knn########################\n",
    "#the scores from runing dtc on train set is 100% perecent where \n",
    "# knn accuracy on training data is 80% it's probably bacuase dtc has \n",
    "# created the dicision tree on training data\n",
    "#dtc Accuracy on test data is 0.81 where knn Accuracy on test data is  0.80\n",
    "#so both of them have almost the same accuracy on test data \n",
    "#########################################################"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**<span style=\"text-decoration:underline;\">Part C</span> (20 points):** Build a support vector machine model that solves the same problem. Report your accuracy and compare it to your results from parts (a) and (b). "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/arezoo/repos/cs506/env/lib/python3.6/site-packages/sklearn/svm/base.py:196: FutureWarning: The default value of gamma will change from 'auto' to 'scale' in version 0.22 to account better for unscaled features. Set gamma explicitly to 'auto' or 'scale' to avoid this warning.\n",
      "  \"avoid this warning.\", FutureWarning)\n"
     ]
    }
   ],
   "source": [
    "import sklearn.svm as svm\n",
    "import sklearn.utils as utils\n",
    "\n",
    "C=1.0\n",
    "(data, labels) = utils.shuffle(data, labels, random_state=1)#shuffling data\n",
    "train_set_size = num_rows - test_set_size\n",
    "test_set_size = 43000\n",
    "data_train = data[:train_set_size]\n",
    "labels_train = labels[:train_set_size]\n",
    "data_test = data[train_set_size:]\n",
    "labels_test = labels[train_set_size:]\n",
    "svc = svm.SVC(kernel='rbf', C=C)\n",
    "svc.fit(data_train, labels_train)\n",
    "print(\"here\")\n",
    "#y_pred_test = svc.predict(data_test)\n",
    "print(\"Accuracy of SVM on test set:\", svc.score(data_test, labels_test))\n",
    "\n",
    "'''y_pred_train = dtc.predict(data_train)\n",
    "print('Accuracy of SVM on training data: {}'.format(svc.score(data_train, labels_train)))\n",
    "\n",
    "y_pred_data = dtc.predict(data)\n",
    "print('Accuracy of SVM on entire data: {}'.format(svc.score(data, labels)))\n",
    "'''\n",
    "##############################readme####################################\n",
    "#results for this part are on the branch svc-results\n",
    "#svm Accuracy on test data: 0.75 svm Accuracy on train data 0.98 is \n",
    "\n",
    "####################################################################"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'(data, labels) = utils.shuffle(data, labels, random_state=1)\\nscores = cross_validation.cross_val_score(svc, data, labels, cv=5)\\nprint(scores)\\nprint(\"SVC Accuracy: %0.2f (+/- %0.2f)\" % (scores.mean(), scores.std() * 2))\\n'"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "'''(data, labels) = utils.shuffle(data, labels, random_state=1)\n",
    "scores = cross_validation.cross_val_score(svc, data, labels, cv=5)\n",
    "print(scores)\n",
    "print(\"SVC Accuracy: %0.2f (+/- %0.2f)\" % (scores.mean(), scores.std() * 2))\n",
    "'''"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'import sklearn.svm as svm\\nC=1.0\\ntest_size = 30000\\nsvc = svm.SVC(kernel=\\'rbf\\', C=C)\\n\\nscores = get_scores(data, labels, svc, test_size)\\ntest_scores = np.asarray(scores[\\'test_scores\\'])\\ntrain_scores = np.asarray(scores[\\'train_scores\\'])\\nsvm_mean_score_on_tests = test_scores.mean()\\nsvm_mean_score_on_train = train_scores.mean()\\nprint(scores)\\nprint(\"svm Accuracy on test data: %0.2f (+/- %0.2f)\" % (test_scores.mean(), test_scores.std() * 2))\\nprint(\"svm Accuracy on train data: %0.2f (+/- %0.2f)\" % (train_scores.mean(), train_scores.std() * 2))\\n'"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import sklearn.svm as svm\n",
    "C=1.0\n",
    "test_size = 30000\n",
    "svc = svm.SVC(kernel='rbf', C=C)\n",
    "\n",
    "scores = get_scores(data, labels, svc, test_size)\n",
    "test_scores = np.asarray(scores['test_scores'])\n",
    "train_scores = np.asarray(scores['train_scores'])\n",
    "svm_mean_score_on_tests = test_scores.mean()\n",
    "svm_mean_score_on_train = train_scores.mean()\n",
    "print(scores)\n",
    "print(\"svm Accuracy on test data: %0.2f (+/- %0.2f)\" % (test_scores.mean(), test_scores.std() * 2))\n",
    "print(\"svm Accuracy on train data: %0.2f (+/- %0.2f)\" % (train_scores.mean(), train_scores.std() * 2))\n",
    "#----------------------readme---------------------------\n",
    "#results from this part are on the branch svs-results\n",
    "#--------------------------------------------------------\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**<span style=\"text-decoration:underline;\">Part D</span> (20 points):** Build a logistic regression model that solves the same problem. Report your accuracy and compare it to your results from parts (a), (b), and (c). "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Precision on test data: 0.7306434023991276\n",
      "recall on test data: 0.6121516674280494\n",
      "F1 score on test data: 0.6661695252299279\n",
      "Precision on train data: 0.738544474393531\n",
      "recall on train data: 0.6118227758843577\n",
      "F1 score on train data: 0.6692376912199511\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table class=\"simpletable\">\n",
       "<tr>\n",
       "        <td>Model:</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                            <td>Logit</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                    <td>Pseudo R-squared:</td>    <td>0.426</td>  \n",
       "</tr>\n",
       "<tr>\n",
       "  <td>Dependent Variable:</td> <td>30939    False\n",
       "35449    False\n",
       "12562    False\n",
       "31408    False\n",
       "25631    False\n",
       "39147    False\n",
       "19257     True\n",
       "14898     True\n",
       "899       True\n",
       "2896      True\n",
       "26476     True\n",
       "36172    False\n",
       "13367     True\n",
       "18904    False\n",
       "27314     True\n",
       "6165      True\n",
       "40598    False\n",
       "41967    False\n",
       "17928    False\n",
       "6928     False\n",
       "18168    False\n",
       "36449    False\n",
       "45167    False\n",
       "7282     False\n",
       "40183     True\n",
       "31475     True\n",
       "26537    False\n",
       "42974    False\n",
       "20911     True\n",
       "5804     False\n",
       "         ...  \n",
       "27185    False\n",
       "19890    False\n",
       "33359     True\n",
       "31183    False\n",
       "11891    False\n",
       "37811    False\n",
       "10814     True\n",
       "32301     True\n",
       "8230     False\n",
       "6892     False\n",
       "15157    False\n",
       "27655     True\n",
       "37974    False\n",
       "45635     True\n",
       "32629    False\n",
       "18148     True\n",
       "31991    False\n",
       "4937     False\n",
       "24137     True\n",
       "38347    False\n",
       "35619    False\n",
       "41440    False\n",
       "35104     True\n",
       "8280      True\n",
       "15488     True\n",
       "27337    False\n",
       "40793    False\n",
       "31712    False\n",
       "28085     True\n",
       "414       True\n",
       "Length: 8613, dtype: bool</td>       <td>AIC:</td>        <td>22317.2902</td>\n",
       "</tr>\n",
       "<tr>\n",
       "         <td>Date:</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      <td>2018-12-07 22:17</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     <td>BIC:</td>        <td>23128.2332</td>\n",
       "</tr>\n",
       "<tr>\n",
       "   <td>No. Observations:</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      <td>34452</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     <td>Log-Likelihood:</td>    <td>-11063.</td> \n",
       "</tr>\n",
       "<tr>\n",
       "       <td>Df Model:</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           <td>95</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          <td>LL-Null:</td>        <td>-19258.</td> \n",
       "</tr>\n",
       "<tr>\n",
       "     <td>Df Residuals:</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        <td>34356</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      <td>LLR p-value:</td>      <td>0.0000</td>  \n",
       "</tr>\n",
       "<tr>\n",
       "      <td>Converged:</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         <td>0.0000</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         <td>Scale:</td>         <td>1.0000</td>  \n",
       "</tr>\n",
       "<tr>\n",
       "    <td>No. Iterations:</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                      <td>35.0000</td>                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           <td></td>               <td></td>     \n",
       "</tr>\n",
       "</table>\n",
       "<table class=\"simpletable\">\n",
       "<tr>\n",
       "                      <td></td>                      <th>Coef.</th>   <th>Std.Err.</th>      <th>z</th>     <th>P>|z|</th>    <th>[0.025</th>      <th>0.975]</th>   \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>age</th>                                      <td>0.0262</td>    <td>0.0016</td>    <td>16.2780</td> <td>0.0000</td>    <td>0.0230</td>      <td>0.0293</td>   \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>fnlwgt</th>                                   <td>0.0000</td>    <td>0.0000</td>    <td>4.8135</td>  <td>0.0000</td>    <td>0.0000</td>      <td>0.0000</td>   \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education-num</th>                            <td>0.2572</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>capital-gain</th>                             <td>0.0003</td>    <td>0.0000</td>    <td>32.4837</td> <td>0.0000</td>    <td>0.0003</td>      <td>0.0004</td>   \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>capital-loss</th>                             <td>0.0007</td>    <td>0.0000</td>    <td>18.2643</td> <td>0.0000</td>    <td>0.0006</td>      <td>0.0007</td>   \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>hours-per-week</th>                           <td>0.0293</td>    <td>0.0016</td>    <td>18.5573</td> <td>0.0000</td>    <td>0.0262</td>      <td>0.0324</td>   \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>workclass_Federal-gov</th>                    <td>-1.0069</td> <td>438218.1226</td> <td>-0.0000</td> <td>1.0000</td> <td>-858892.7445</td> <td>858890.7306</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>workclass_Local-gov</th>                      <td>-1.5374</td> <td>467462.4713</td> <td>-0.0000</td> <td>1.0000</td> <td>-916211.1453</td> <td>916208.0705</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>workclass_Private</th>                        <td>-1.3828</td> <td>471799.6333</td> <td>-0.0000</td> <td>1.0000</td> <td>-924711.6720</td> <td>924708.9063</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>workclass_Self-emp-inc</th>                   <td>-1.2475</td> <td>429807.3713</td> <td>-0.0000</td> <td>1.0000</td> <td>-842408.2155</td> <td>842405.7205</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>workclass_Self-emp-not-inc</th>               <td>-1.9459</td> <td>459195.5284</td> <td>-0.0000</td> <td>1.0000</td> <td>-900008.6434</td> <td>900004.7516</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>workclass_State-gov</th>                      <td>-1.6950</td> <td>451673.7622</td> <td>-0.0000</td> <td>1.0000</td> <td>-885266.0017</td> <td>885262.6117</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>workclass_Without-pay</th>                    <td>-2.7754</td> <td>454000.9883</td> <td>-0.0000</td> <td>1.0000</td> <td>-889828.3615</td> <td>889822.8107</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_10th</th>                           <td>-0.1351</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_11th</th>                           <td>-0.2203</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_12th</th>                           <td>-0.1387</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_1st-4th</th>                        <td>0.4517</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_5th-6th</th>                        <td>0.4492</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_7th-8th</th>                        <td>-0.0578</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_9th</th>                            <td>-0.2456</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Assoc-acdm</th>                     <td>-0.2112</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Assoc-voc</th>                      <td>0.0429</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Bachelors</th>                      <td>0.1133</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Doctorate</th>                      <td>0.3888</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_HS-grad</th>                        <td>-0.0126</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Masters</th>                        <td>0.1429</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Preschool</th>                      <td>-4.0142</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Prof-school</th>                    <td>0.6853</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>education_Some-college</th>                   <td>0.1147</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>marital-status_Divorced</th>                  <td>-1.6054</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>marital-status_Married-AF-spouse</th>         <td>1.1309</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>marital-status_Married-civ-spouse</th>        <td>0.6798</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>marital-status_Married-spouse-absent</th>     <td>-1.5117</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>marital-status_Never-married</th>             <td>-1.9927</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>marital-status_Separated</th>                 <td>-1.6611</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>marital-status_Widowed</th>                   <td>-1.4661</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Adm-clerical</th>                  <td>-0.3234</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Armed-Forces</th>                  <td>0.4411</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Craft-repair</th>                  <td>-0.2879</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Exec-managerial</th>               <td>0.4337</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Farming-fishing</th>               <td>-1.4368</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Handlers-cleaners</th>             <td>-1.1462</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Machine-op-inspct</th>             <td>-0.6583</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Other-service</th>                 <td>-1.1862</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Priv-house-serv</th>               <td>-2.1707</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Prof-specialty</th>                <td>0.1572</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Protective-serv</th>               <td>0.1282</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Sales</th>                         <td>-0.0798</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Tech-support</th>                  <td>0.1703</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>occupation_Transport-moving</th>              <td>-0.4673</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>relationship_Husband</th>                     <td>-1.2002</td> <td>318075.8777</td> <td>-0.0000</td> <td>1.0000</td> <td>-623418.4649</td> <td>623416.0644</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>relationship_Not-in-family</th>               <td>-0.7370</td> <td>311752.5809</td> <td>-0.0000</td> <td>1.0000</td> <td>-611024.5676</td> <td>611023.0936</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>relationship_Other-relative</th>              <td>-1.6396</td> <td>328751.4472</td> <td>-0.0000</td> <td>1.0000</td> <td>-644342.6359</td> <td>644339.3568</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>relationship_Own-child</th>                   <td>-1.8905</td> <td>324040.0741</td> <td>-0.0000</td> <td>1.0000</td> <td>-635108.7652</td> <td>635104.9843</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>relationship_Unmarried</th>                   <td>-0.8697</td> <td>327532.6566</td> <td>-0.0000</td> <td>1.0000</td> <td>-641953.0803</td> <td>641951.3409</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>relationship_Wife</th>                        <td>-0.0892</td> <td>313093.1675</td> <td>-0.0000</td> <td>1.0000</td> <td>-613651.4213</td> <td>613651.2429</td>\n",
       "</tr>\n",
       "<tr>\n",
       "  <th>race_Amer-Indian-Eskimo</th>                  <td>-1.6675</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>race_Asian-Pac-Islander</th>                  <td>-0.7976</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>race_Black</th>                               <td>-1.3826</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>race_Other</th>                               <td>-1.4289</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>race_White</th>                               <td>-1.1497</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>sex_Female</th>                               <td>-3.5637</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>sex_Male</th>                                 <td>-2.8625</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Cambodia</th>                   <td>1.0473</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Canada</th>                     <td>0.6415</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_China</th>                      <td>-0.4836</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Columbia</th>                   <td>-1.5490</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Cuba</th>                       <td>0.3427</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Dominican-Republic</th>         <td>-0.5116</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Ecuador</th>                    <td>0.5793</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_El-Salvador</th>                <td>-0.4962</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_England</th>                    <td>0.7353</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_France</th>                     <td>0.7190</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Germany</th>                    <td>0.2751</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Greece</th>                     <td>-0.1260</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Guatemala</th>                  <td>0.1183</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Haiti</th>                      <td>0.6109</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Holand-Netherlands</th>         <td>-8.5572</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Honduras</th>                   <td>0.5261</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Hong</th>                       <td>-0.6709</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Hungary</th>                    <td>1.0409</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_India</th>                      <td>-0.1362</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Iran</th>                       <td>0.5564</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Ireland</th>                    <td>1.1239</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Italy</th>                      <td>0.9411</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Jamaica</th>                    <td>0.3275</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Japan</th>                      <td>-0.1136</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Laos</th>                       <td>-0.1379</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Mexico</th>                     <td>-0.4052</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Nicaragua</th>                  <td>-0.7090</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Outlying-US(Guam-USVI-etc)</th> <td>0.1673</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Peru</th>                       <td>-0.7419</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Philippines</th>                <td>0.4075</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Poland</th>                     <td>0.4735</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Portugal</th>                   <td>1.2870</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Puerto-Rico</th>                <td>0.0456</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Scotland</th>                   <td>-0.9487</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_South</th>                      <td>-1.3118</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Taiwan</th>                     <td>0.1693</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Thailand</th>                   <td>-0.9022</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Trinadad&Tobago</th>            <td>-0.7616</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_United-States</th>              <td>0.4270</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Vietnam</th>                    <td>-1.3874</td>     <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "<tr>\n",
       "  <th>nativecountry_Yugoslavia</th>                 <td>0.9615</td>      <td>nan</td>       <td>nan</td>     <td>nan</td>       <td>nan</td>         <td>nan</td>    \n",
       "</tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<class 'statsmodels.iolib.summary2.Summary'>\n",
       "\"\"\"\n",
       "                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       Results: Logit\n",
       "=============================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================\n",
       "Model:              Logit                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        Pseudo R-squared: 0.426     \n",
       "Dependent Variable: 30939    False\n",
       "35449    False\n",
       "12562    False\n",
       "31408    False\n",
       "25631    False\n",
       "39147    False\n",
       "19257     True\n",
       "14898     True\n",
       "899       True\n",
       "2896      True\n",
       "26476     True\n",
       "36172    False\n",
       "13367     True\n",
       "18904    False\n",
       "27314     True\n",
       "6165      True\n",
       "40598    False\n",
       "41967    False\n",
       "17928    False\n",
       "6928     False\n",
       "18168    False\n",
       "36449    False\n",
       "45167    False\n",
       "7282     False\n",
       "40183     True\n",
       "31475     True\n",
       "26537    False\n",
       "42974    False\n",
       "20911     True\n",
       "5804     False\n",
       "         ...  \n",
       "27185    False\n",
       "19890    False\n",
       "33359     True\n",
       "31183    False\n",
       "11891    False\n",
       "37811    False\n",
       "10814     True\n",
       "32301     True\n",
       "8230     False\n",
       "6892     False\n",
       "15157    False\n",
       "27655     True\n",
       "37974    False\n",
       "45635     True\n",
       "32629    False\n",
       "18148     True\n",
       "31991    False\n",
       "4937     False\n",
       "24137     True\n",
       "38347    False\n",
       "35619    False\n",
       "41440    False\n",
       "35104     True\n",
       "8280      True\n",
       "15488     True\n",
       "27337    False\n",
       "40793    False\n",
       "31712    False\n",
       "28085     True\n",
       "414       True\n",
       "Length: 8613, dtype: bool AIC:              22317.2902\n",
       "Date:               2018-12-07 22:17                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                             BIC:              23128.2332\n",
       "No. Observations:   34452                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        Log-Likelihood:   -11063.   \n",
       "Df Model:           95                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                           LL-Null:          -19258.   \n",
       "Df Residuals:       34356                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        LLR p-value:      0.0000    \n",
       "Converged:          0.0000                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       Scale:            1.0000    \n",
       "No. Iterations:     35.0000                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  \n",
       "--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------\n",
       "                                                                                                                                                                                                                               Coef.                                                                                                                                                                                     Std.Err.                                                                                                                                                                                      z                                                                                                                                                                                     P>|z|                                                                                                                                                                                      [0.025                                                                                                                                                                                        0.975]  \n",
       "--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------\n",
       "age                                                                                                                                                                                                                            0.0262                                                                                                                                                                                       0.0016                                                                                                                                                                                  16.2780                                                                                                                                                                                  0.0000                                                                                                                                                                                        0.0230                                                                                                                                                                                       0.0293\n",
       "fnlwgt                                                                                                                                                                                                                         0.0000                                                                                                                                                                                       0.0000                                                                                                                                                                                   4.8135                                                                                                                                                                                  0.0000                                                                                                                                                                                        0.0000                                                                                                                                                                                       0.0000\n",
       "education-num                                                                                                                                                                                                                  0.2572                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "capital-gain                                                                                                                                                                                                                   0.0003                                                                                                                                                                                       0.0000                                                                                                                                                                                  32.4837                                                                                                                                                                                  0.0000                                                                                                                                                                                        0.0003                                                                                                                                                                                       0.0004\n",
       "capital-loss                                                                                                                                                                                                                   0.0007                                                                                                                                                                                       0.0000                                                                                                                                                                                  18.2643                                                                                                                                                                                  0.0000                                                                                                                                                                                        0.0006                                                                                                                                                                                       0.0007\n",
       "hours-per-week                                                                                                                                                                                                                 0.0293                                                                                                                                                                                       0.0016                                                                                                                                                                                  18.5573                                                                                                                                                                                  0.0000                                                                                                                                                                                        0.0262                                                                                                                                                                                       0.0324\n",
       "workclass_Federal-gov                                                                                                                                                                                                         -1.0069                                                                                                                                                                                  438218.1226                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -858892.7445                                                                                                                                                                                  858890.7306\n",
       "workclass_Local-gov                                                                                                                                                                                                           -1.5374                                                                                                                                                                                  467462.4713                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -916211.1453                                                                                                                                                                                  916208.0705\n",
       "workclass_Private                                                                                                                                                                                                             -1.3828                                                                                                                                                                                  471799.6333                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -924711.6720                                                                                                                                                                                  924708.9063\n",
       "workclass_Self-emp-inc                                                                                                                                                                                                        -1.2475                                                                                                                                                                                  429807.3713                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -842408.2155                                                                                                                                                                                  842405.7205\n",
       "workclass_Self-emp-not-inc                                                                                                                                                                                                    -1.9459                                                                                                                                                                                  459195.5284                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -900008.6434                                                                                                                                                                                  900004.7516\n",
       "workclass_State-gov                                                                                                                                                                                                           -1.6950                                                                                                                                                                                  451673.7622                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -885266.0017                                                                                                                                                                                  885262.6117\n",
       "workclass_Without-pay                                                                                                                                                                                                         -2.7754                                                                                                                                                                                  454000.9883                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -889828.3615                                                                                                                                                                                  889822.8107\n",
       "education_10th                                                                                                                                                                                                                -0.1351                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_11th                                                                                                                                                                                                                -0.2203                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_12th                                                                                                                                                                                                                -0.1387                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_1st-4th                                                                                                                                                                                                              0.4517                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_5th-6th                                                                                                                                                                                                              0.4492                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_7th-8th                                                                                                                                                                                                             -0.0578                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_9th                                                                                                                                                                                                                 -0.2456                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Assoc-acdm                                                                                                                                                                                                          -0.2112                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Assoc-voc                                                                                                                                                                                                            0.0429                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Bachelors                                                                                                                                                                                                            0.1133                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Doctorate                                                                                                                                                                                                            0.3888                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_HS-grad                                                                                                                                                                                                             -0.0126                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Masters                                                                                                                                                                                                              0.1429                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Preschool                                                                                                                                                                                                           -4.0142                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Prof-school                                                                                                                                                                                                          0.6853                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "education_Some-college                                                                                                                                                                                                         0.1147                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "marital-status_Divorced                                                                                                                                                                                                       -1.6054                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "marital-status_Married-AF-spouse                                                                                                                                                                                               1.1309                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "marital-status_Married-civ-spouse                                                                                                                                                                                              0.6798                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "marital-status_Married-spouse-absent                                                                                                                                                                                          -1.5117                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "marital-status_Never-married                                                                                                                                                                                                  -1.9927                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "marital-status_Separated                                                                                                                                                                                                      -1.6611                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "marital-status_Widowed                                                                                                                                                                                                        -1.4661                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Adm-clerical                                                                                                                                                                                                       -0.3234                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Armed-Forces                                                                                                                                                                                                        0.4411                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Craft-repair                                                                                                                                                                                                       -0.2879                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Exec-managerial                                                                                                                                                                                                     0.4337                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Farming-fishing                                                                                                                                                                                                    -1.4368                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Handlers-cleaners                                                                                                                                                                                                  -1.1462                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Machine-op-inspct                                                                                                                                                                                                  -0.6583                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Other-service                                                                                                                                                                                                      -1.1862                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Priv-house-serv                                                                                                                                                                                                    -2.1707                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Prof-specialty                                                                                                                                                                                                      0.1572                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Protective-serv                                                                                                                                                                                                     0.1282                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Sales                                                                                                                                                                                                              -0.0798                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Tech-support                                                                                                                                                                                                        0.1703                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "occupation_Transport-moving                                                                                                                                                                                                   -0.4673                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "relationship_Husband                                                                                                                                                                                                          -1.2002                                                                                                                                                                                  318075.8777                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -623418.4649                                                                                                                                                                                  623416.0644\n",
       "relationship_Not-in-family                                                                                                                                                                                                    -0.7370                                                                                                                                                                                  311752.5809                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -611024.5676                                                                                                                                                                                  611023.0936\n",
       "relationship_Other-relative                                                                                                                                                                                                   -1.6396                                                                                                                                                                                  328751.4472                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -644342.6359                                                                                                                                                                                  644339.3568\n",
       "relationship_Own-child                                                                                                                                                                                                        -1.8905                                                                                                                                                                                  324040.0741                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -635108.7652                                                                                                                                                                                  635104.9843\n",
       "relationship_Unmarried                                                                                                                                                                                                        -0.8697                                                                                                                                                                                  327532.6566                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -641953.0803                                                                                                                                                                                  641951.3409\n",
       "relationship_Wife                                                                                                                                                                                                             -0.0892                                                                                                                                                                                  313093.1675                                                                                                                                                                                  -0.0000                                                                                                                                                                                  1.0000                                                                                                                                                                                  -613651.4213                                                                                                                                                                                  613651.2429\n",
       "race_Amer-Indian-Eskimo                                                                                                                                                                                                       -1.6675                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "race_Asian-Pac-Islander                                                                                                                                                                                                       -0.7976                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "race_Black                                                                                                                                                                                                                    -1.3826                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "race_Other                                                                                                                                                                                                                    -1.4289                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "race_White                                                                                                                                                                                                                    -1.1497                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "sex_Female                                                                                                                                                                                                                    -3.5637                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "sex_Male                                                                                                                                                                                                                      -2.8625                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Cambodia                                                                                                                                                                                                         1.0473                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Canada                                                                                                                                                                                                           0.6415                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_China                                                                                                                                                                                                           -0.4836                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Columbia                                                                                                                                                                                                        -1.5490                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Cuba                                                                                                                                                                                                             0.3427                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Dominican-Republic                                                                                                                                                                                              -0.5116                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Ecuador                                                                                                                                                                                                          0.5793                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_El-Salvador                                                                                                                                                                                                     -0.4962                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_England                                                                                                                                                                                                          0.7353                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_France                                                                                                                                                                                                           0.7190                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Germany                                                                                                                                                                                                          0.2751                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Greece                                                                                                                                                                                                          -0.1260                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Guatemala                                                                                                                                                                                                        0.1183                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Haiti                                                                                                                                                                                                            0.6109                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Holand-Netherlands                                                                                                                                                                                              -8.5572                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Honduras                                                                                                                                                                                                         0.5261                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Hong                                                                                                                                                                                                            -0.6709                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Hungary                                                                                                                                                                                                          1.0409                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_India                                                                                                                                                                                                           -0.1362                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Iran                                                                                                                                                                                                             0.5564                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Ireland                                                                                                                                                                                                          1.1239                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Italy                                                                                                                                                                                                            0.9411                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Jamaica                                                                                                                                                                                                          0.3275                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Japan                                                                                                                                                                                                           -0.1136                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Laos                                                                                                                                                                                                            -0.1379                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Mexico                                                                                                                                                                                                          -0.4052                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Nicaragua                                                                                                                                                                                                       -0.7090                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Outlying-US(Guam-USVI-etc)                                                                                                                                                                                       0.1673                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Peru                                                                                                                                                                                                            -0.7419                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Philippines                                                                                                                                                                                                      0.4075                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Poland                                                                                                                                                                                                           0.4735                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Portugal                                                                                                                                                                                                         1.2870                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Puerto-Rico                                                                                                                                                                                                      0.0456                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Scotland                                                                                                                                                                                                        -0.9487                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_South                                                                                                                                                                                                           -1.3118                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Taiwan                                                                                                                                                                                                           0.1693                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Thailand                                                                                                                                                                                                        -0.9022                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Trinadad&Tobago                                                                                                                                                                                                 -0.7616                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_United-States                                                                                                                                                                                                    0.4270                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Vietnam                                                                                                                                                                                                         -1.3874                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "nativecountry_Yugoslavia                                                                                                                                                                                                       0.9615                                                                                                                                                                                          nan                                                                                                                                                                                      nan                                                                                                                                                                                     nan                                                                                                                                                                                           nan                                                                                                                                                                                          nan\n",
       "=============================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================================\n",
       "\n",
       "\"\"\""
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import warnings\n",
    "warnings.filterwarnings('ignore')\n",
    "import statsmodels.api as sm\n",
    "import sklearn.metrics as metrics\n",
    "\n",
    "X_train, X_test, y_train, y_test = cross_validation.train_test_split(data, labels,test_size=0.2)\n",
    "logit = sm.Logit(y_train, X_train)\n",
    "result = logit.fit(disp=False)\n",
    "\n",
    "y_pred_test = result.predict(X_test)\n",
    "y_pred_test = y_pred_test > 0.5\n",
    "\n",
    "y_pred_train = result.predict(X_train)\n",
    "y_pred_train = y_pred_train > 0.5\n",
    "\n",
    "precision_test = metrics.precision_score(y_test, y_pred_test)\n",
    "recall_test = metrics.recall_score(y_test, y_pred_test)\n",
    "F1score_test = metrics.f1_score(y_test, y_pred_test)  \n",
    "print(\"Precision on test data: \" + str(precision_test))\n",
    "print(\"recall on test data: \" + str(recall_test))\n",
    "print(\"F1 score on test data: \" + str(F1score_test))\n",
    "\n",
    "precision_train = metrics.precision_score(y_train, y_pred_train)\n",
    "recall_train = metrics.recall_score(y_train, y_pred_train)\n",
    "F1score_train = metrics.f1_score(y_train, y_pred_train) \n",
    "print(\"Precision on train data: \" + str(precision_train))\n",
    "print(\"recall on train data: \" + str(recall_train))\n",
    "print(\"F1 score on train data: \" + str(F1score_train))\n",
    "\n",
    "result.summary2(y_pred) #get information about model\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>test</th>\n",
       "      <th>train</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>knn:</th>\n",
       "      <td>0.80</td>\n",
       "      <td>0.80</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>dtc</th>\n",
       "      <td>0.81</td>\n",
       "      <td>1.00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>svc</th>\n",
       "      <td>0.75</td>\n",
       "      <td>0.98</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>logistic- regresion:</th>\n",
       "      <td>0.67</td>\n",
       "      <td>0.67</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                      test  train\n",
       "knn:                  0.80   0.80\n",
       "dtc                   0.81   1.00\n",
       "svc                   0.75   0.98\n",
       "logistic- regresion:  0.67   0.67"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "data = {\"knn:\": [0.80, 0.80],\n",
    "                     \"dtc\": [0.81, 1.00],\n",
    "                      \"svc\": [0.75, 0.98],\n",
    "                      \"logistic- regresion:\": [0.67,0.67]}\n",
    "columns = [\"test\", \"train\"]\n",
    "comparison_table = pd.DataFrame.from_dict(data, orient='index', columns=columns)\n",
    "comparison_table"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}