{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Analysis of the risk of failure of the O-rings on the Challenger shuttle" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "On January 27, 1986, the day before the takeoff of the shuttle _Challenger_, had\n", "a three-hour teleconference was held between \n", "Morton Thiokol (the manufacturer of one of the engines) and NASA. The\n", "discussion focused on the consequences of the\n", "temperature at take-off of 31°F (just below\n", "0°C) for the success of the flight and in particular on the performance of the\n", "O-rings used in the engines. Indeed, no test\n", "had been performed at this temperature.\n", "\n", "The following study takes up some of the analyses carried out that\n", "night with the objective of assessing the potential influence of\n", "the temperature and pressure to which the O-rings are subjected\n", "on their probability of malfunction. Our starting point is \n", "the results of the experiments carried out by NASA engineers\n", "during the six years preceding the launch of the shuttle\n", "Challenger." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Loading the data\n", "We start by loading this data:" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
DateCountTemperaturePressureMalfunction
04/12/81666500
111/12/81670501
23/22/82669500
311/11/82668500
44/04/83667500
56/18/82672500
68/30/836731000
711/28/836701000
82/03/846572001
94/06/846632001
108/30/846702001
1110/05/846782000
1211/08/846672000
131/24/856532002
144/12/856672000
154/29/856752000
166/17/856702000
177/29/856812000
188/27/856762000
1910/03/856792000
2010/30/856752002
2111/26/856762000
221/12/866582001
\n", "
" ], "text/plain": [ " Date Count Temperature Pressure Malfunction\n", "0 4/12/81 6 66 50 0\n", "1 11/12/81 6 70 50 1\n", "2 3/22/82 6 69 50 0\n", "3 11/11/82 6 68 50 0\n", "4 4/04/83 6 67 50 0\n", "5 6/18/82 6 72 50 0\n", "6 8/30/83 6 73 100 0\n", "7 11/28/83 6 70 100 0\n", "8 2/03/84 6 57 200 1\n", "9 4/06/84 6 63 200 1\n", "10 8/30/84 6 70 200 1\n", "11 10/05/84 6 78 200 0\n", "12 11/08/84 6 67 200 0\n", "13 1/24/85 6 53 200 2\n", "14 4/12/85 6 67 200 0\n", "15 4/29/85 6 75 200 0\n", "16 6/17/85 6 70 200 0\n", "17 7/29/85 6 81 200 0\n", "18 8/27/85 6 76 200 0\n", "19 10/03/85 6 79 200 0\n", "20 10/30/85 6 75 200 2\n", "21 11/26/85 6 76 200 0\n", "22 1/12/86 6 58 200 1" ] }, "execution_count": 1, "metadata": {}, "output_type": "execute_result" } ], "source": [ "import numpy as np\n", "import pandas as pd\n", "data = pd.read_csv(\"shuttle.csv\")\n", "data" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The data set shows us the date of each test, the number of O-rings (there are 6 on the main launcher), the temperature (in Fahrenheit) and pressure (in psi), and finally the number of identified malfunctions." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Graphical inspection\n", "Flights without incidents do not provide any information\n", "on the influence of temperature or pressure on malfunction.\n", "We thus focus on the experiments in which at least one O-ring\n", "was defective. --> this is stupid! so:" ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [], "source": [ "#data = data[data.Malfunction>0]\n", "#data" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We have a high temperature variability but\n", "the pressure is almost always 200, which should\n", "simplify the analysis.\n", "\n", "How does the frequency of failure vary with temperature?" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "data": { "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEKCAYAAAAfGVI8AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjEsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+j8jraAAAYAElEQVR4nO3dfZRddX3v8fdnkiEPJEJMvCMlQbBErlRyEYaHXGqd1IcGu0xq4Sp0IeoV4r2X3Cq6KtTrolyqaxVapVcvVVNKFbQOD7E4rWlRiqPYK5BEQoDQ4BQwTMAAYwgZCMlM5nv/OHv0zHBmZp/J7HPmnN/ntVZWzt77d/b5/s6eM5/ZD+e3FRGYmVm6WupdgJmZ1ZeDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscYUFgaQbJD0j6aExlkvSFyT1SNoq6ZSiajEzs7EVuUfwVWDlOMvPBpZm/9YAXyqwFjMzG0NhQRARPwR+MU6T1cCNUXIPcKSko4qqx8zMKptZx9c+GniybLo3m/f06IaS1lDaa2DOnDmnLlmypCYF5jU0NERLS/OdbmnWfkHz9s39ajy16tujjz76XES8ptKyegZBbhGxDlgH0N7eHps2bapzRSN1d3fT0dFR7zKmXLP2C5q3b+5X46lV3yT9bKxl9YzYnUD5n/aLs3lmZlZD9QyCLuDC7OqhM4E9EfGKw0JmZlaswg4NSfom0AEsktQL/AnQChARXwY2AO8CeoCXgA8VVYuZmY2tsCCIiPMnWB7AJUW9vpmZ5dOcp+HNzCw3B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiSs0CCStlLRdUo+kyyssP0bS9yXdL2mrpHcVWY+Zmb1SYUEgaQZwHXA2cCJwvqQTRzX7NHBLRLwZOA/4q6LqMTOzyorcIzgd6ImIxyLiANAJrB7VJoBXZY+PAJ4qsB4zM6tAEVHMiqVzgZURcVE2/X7gjIhYW9bmKOC7wALgcODtEbG5wrrWAGsA2traTu3s7Cyk5snq7+9n3rx59S5jyjVrv6B5++Z+NZ5a9W3FihWbI6K90rKZhb/6+M4HvhoRn5O0HLhJ0psiYqi8UUSsA9YBtLe3R0dHR+0rHUd3dzfTraap0Kz9gubtm/vVeKZD34o8NLQTWFI2vTibV+7DwC0AEfFjYDawqMCazMxslCKDYCOwVNJxkg6jdDK4a1SbHcDbACS9kVIQPFtgTWZmNkphQRARg8Ba4A7gEUpXBz0s6SpJq7JmnwAulvQA8E3gg1HUSQszM6uo0HMEEbEB2DBq3hVlj7cBZxVZg5mZjc/fLDYzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscYUGgaSVkrZL6pF0+Rht3itpm6SHJf1dkfWYmdkrzSxqxZJmANcB7wB6gY2SuiJiW1mbpcAfA2dFxG5J/6GoeszMrLJcewSSTprEuk8HeiLisYg4AHQCq0e1uRi4LiJ2A0TEM5N4HTMzOwSKiIkbSXcDs4CvAt+IiD05nnMusDIiLsqm3w+cERFry9rcDjwKnAXMAK6MiH+usK41wBqAtra2Uzs7OyfuWQ319/czb968epcx5Zq1X9C8fXO/Gk+t+rZixYrNEdFeaVmuQ0MR8ZbsMM5/BTZLug/424j43iHWNhNYCnQAi4EfSjopIp4f9frrgHUA7e3t0dHRcYgvO7W6u7uZbjVNhWbtFzRv39yvxjMd+pb7ZHFE/BT4NHAZ8FbgC5L+TdLvj/GUncCSsunF2bxyvUBXRAxExOOU9g6W5q3JzMwOXd5zBMskXQs8Avw28O6IeGP2+NoxnrYRWCrpOEmHAecBXaPa3E5pbwBJi4A3AI9V2wkzM5u8vFcNfRG4HvhUROwbnhkRT0n6dKUnRMSgpLXAHZSO/98QEQ9LugrYFBFd2bJ3StoGHAT+KCL6DqE/ZmZWpbxB8LvAvog4CCCpBZgdES9FxE1jPSkiNgAbRs27ouxxAB/P/pmZWR3kPUdwJzCnbHpuNs/MzBpc3iCYHRH9wxPZ47nFlGRmZrWUNwhelHTK8ISkU4F947Q3M7MGkfccwceAWyU9BQh4LfC+wqoyM7OayfuFso2S/iNwQjZre0QMFFeWmZnVSjWDzp0GHJs95xRJRMSNhVRlZmY1kysIJN0E/DqwhdL1/gABOAjMzBpc3j2CduDEyDNCnZmZNZS8Vw09ROkEsZmZNZm8ewSLgG3ZqKP7h2dGxKpCqjIzs5rJGwRXFlmEmZnVT97LR38g6XXA0oi4U9JcSgPJmZlZg8s7DPXFwG3AV7JZR1MaQtrMzBpc3pPFl1C6neQL8Mub1PhG82ZmTSBvEOzPbkAPgKSZlL5HYGZmDS5vEPxA0qeAOZLeAdwK/ENxZZmZWa3kDYLLgWeBB4GPULrZTMU7k5mZWWPJe9XQEPDX2T8zM2sieccaepwK5wQi4vVTXpGZmdVUNWMNDZsN/Bfg1VNfjpmZ1VqucwQR0Vf2b2dE/CWlG9qbmVmDy3to6JSyyRZKewjV3MvAzMymqby/zD9X9ngQeAJ475RXY2ZmNZf3qqEVRRdiZmb1kffQ0MfHWx4Rn5+acszMrNaquWroNKArm343cB/w0yKKMjOz2skbBIuBUyJiL4CkK4HvRMQFRRVmZma1kXeIiTbgQNn0gWyemZk1uLx7BDcC90n6+2z694CvFVOSmZnVUt6rhj4r6Z+At2SzPhQR9xdXlpmZ1UreQ0MAc4EXIuL/AL2SjiuoJjMzq6G8t6r8E+Ay4I+zWa3A14sqyszMaifvHsF7gFXAiwAR8RQwv6iizMysdvIGwYGICLKhqCUdXlxJZmZWS3mD4BZJXwGOlHQxcCe+SY2ZWVOYMAgkCbgZuA1YD5wAXBERX8zx3JWStkvqkXT5OO3OkRSS2sdqY2ZmxZjw8tGICEkbIuIk4Ht5VyxpBnAd8A6gF9goqSsito1qNx/4KHBvVZWbmdmUyHto6CeSTqty3acDPRHxWEQcADqB1RXa/SlwNfByles3M7MpkPebxWcAF0h6gtKVQ6K0s7BsnOccDTxZNt2breeXshveLImI70j6o7FWJGkNsAagra2N7u7unGXXRn9//7SraSo0a7+gefvmfjWe6dC3cYNA0jERsQP4nal+YUktwOeBD07UNiLWAesA2tvbo6OjY6rLOSTd3d1Mt5qmQrP2C5q3b+5X45kOfZtoj+B2SqOO/kzS+og4p4p17wSWlE0vzuYNmw+8CegunY/mtUCXpFURsamK1zEzs0Mw0TkClT1+fZXr3ggslXScpMOA8/jV/QyIiD0RsSgijo2IY4F7AIeAmVmNTRQEMcbjCUXEILAWuAN4BLglIh6WdJWkVdWVaWZmRZno0NB/kvQCpT2DOdlj+NXJ4leN9+SI2ABsGDXvijHaduSq2MzMptS4QRARM2pViJmZ1Uc1w1CbmVkTchCYmSXOQWBmljgHgZlZ4pIJgr7+/Tzw5PP09e+vdylmVoW+/v3sGzjoz26BkgiCb2/ZyVlX38UF19/LWVffRdeWnRM/yczqbviz+/izL/qzW6CmD4K+/v1ctn4rLw8MsXf/IC8PDPHJ9Vv914XZNFf+2T0Y4c9ugZo+CHp376O1ZWQ3W1ta6N29r04VmVke/uzWTtMHweIFcxgYGhoxb2BoiMUL5tSpIjPLw5/d2mn6IFg4bxbXnLOM2a0tzJ81k9mtLVxzzjIWzptV79LMbBzln90Zkj+7Bcp7Y5qGturkoznr+EX07t7H4gVz/INk1iCGP7v3/fhH/Ouq3/RntyBJBAGU/rrwD5FZ41k4bxZzWmf481ugpj80ZGZm43MQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiXMQmJklzkFgZpY4B4GZWeIcBGZmiSs0CCStlLRdUo+kyyss/7ikbZK2SvoXSa8rsh4zM3ulwoJA0gzgOuBs4ETgfEknjmp2P9AeEcuA24BriqrHzMwqK3KP4HSgJyIei4gDQCewurxBRHw/Il7KJu8BFhdYj5mZVaCIKGbF0rnAyoi4KJt+P3BGRKwdo/3/BX4eEZ+psGwNsAagra3t1M7OzkJqnqz+/n7mzZtX7zKmXLP2C5q3b+5X46lV31asWLE5ItorLZtZ+KvnIOkCoB14a6XlEbEOWAfQ3t4eHR0dtSsuh+7ubqZbTVOhWfsFzds396vxTIe+FRkEO4ElZdOLs3kjSHo78L+At0bE/gLrMTOzCoo8R7ARWCrpOEmHAecBXeUNJL0Z+AqwKiKeKbAWMzMbQ2FBEBGDwFrgDuAR4JaIeFjSVZJWZc3+HJgH3Cppi6SuMVZnZmYFKfQcQURsADaMmndF2eO3F/n6jayvfz+9u/exeMEcFs6bNWVtG0mz9qsoPbv2svulAXp27eX4tvn1LscayLQ4WWwjfXvLTi5bv5XWlhYGhoa45pxlrDr56ENu20iatV9FueL2B7nxnh184qRBLr32h1y4/BiuWn1SvcuyBuEhJqaZvv79XLZ+Ky8PDLF3/yAvDwzxyfVb6et/5Xn0ato2kmbtV1F6du3lxnt2jJh344930LNrb50qskbjIJhmenfvo7Vl5GZpbWmhd/e+Q2rbSJq1X0XZ8uTzVc03G81BMM0sXjCHgaGhEfMGhoZYvGDOIbVtJM3ar6KcvOTIquabjeYgmGYWzpvFNecsY3ZrC/NnzWR2awvXnLOs4snSato2kmbtV1GOb5vPhcuPGTHvwuXH+ISx5eaTxdPQqpOP5qzjF+W6Yqaato2kWftVlKtWn8SFZx7Lg5vv4c5Lz3QIWFUcBNPUwnmzcv/yq6ZtI2nWfhXl+Lb59M5tdQhY1XxoyMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS1yhQSBppaTtknokXV5h+SxJN2fL75V0bJH1mFWrr38/Dzz5PH39+8dtt+nxPj7/3e1serxvytZZbdueXXvZ/dIAPbv2Tti2GkXVW83r7xs4mPs9uG3Tk033HhS5XoCZU77GjKQZwHXAO4BeYKOkrojYVtbsw8DuiDhe0nnA1cD7iqrJrBrf3rKTy9ZvpbWlhYGhIa45ZxmrTj76Fe0uuP4eftRTCoAv3NXDW45fyE0XnXlI66y27RW3P8iN9+zgEycNcum1P+TC5cdw1eqTJtnz4uut9vX/8I0DXHr1Xbneg2HN8h4Uud5hRe4RnA70RMRjEXEA6ARWj2qzGvha9vg24G2SVGBNZrn09e/nsvVbeXlgiL37B3l5YIhPrt/6ir/GNj3e98sQGHZ3T1/FPYO866y2bc+uvSN+AQLc+OMdh/xXcVH1Tub1D0Yk+R4Uud5yiogpW9mIFUvnAisj4qJs+v3AGRGxtqzNQ1mb3mz637M2z41a1xpgTTZ5ArC9kKInbxHw3IStGk+z9gsm6Jta58ydueCoN6ilZcbwvBgaOji4++lHY2DfS8PzZsxf9GszDj/yqNHPP/ji808f3PvcU5NZZ7VtW+YesXDmq15zLMDBl/YwY+4RAAy+8OwTQy/tmfhY1SG+B9W2nczrD/crz3tQrkHegyn5WczhdRHxmkoLCjs0NJUiYh2wrt51jEXSpohor3cdU61Z+wXN2zdJmwb3PON+NZDp8LNY5KGhncCSsunF2byKbSTNBI4AJp3eZmZWvSKDYCOwVNJxkg4DzgO6RrXpAj6QPT4XuCuKOlZlZmYVFXZoKCIGJa0F7gBmADdExMOSrgI2RUQX8DfATZJ6gF9QCotGNG0PWx2iZu0XNG/f3K/GU/e+FXay2MzMGoO/WWxmljgHgZlZ4hwEVZL0hKQHJW2RtCmbd6Wkndm8LZLeVe86J0PSkZJuk/Rvkh6RtFzSqyV9T9JPs/8X1LvOao3Rr4bfZpJOKKt/i6QXJH2s0bfZOP1qhm12qaSHJT0k6ZuSZmcX1NybDbVzc3ZxTW3r8jmC6kh6Amgv/9KbpCuB/oj4i3rVNRUkfQ24OyKuz34Y5wKfAn4REX+WjRe1ICIuq2uhVRqjXx+jCbbZsGxIl53AGcAlNPg2GzaqXx+igbeZpKOBHwEnRsQ+SbcAG4B3Ad+KiE5JXwYeiIgv1bI27xEYAJKOAH6L0pVcRMSBiHiekcOAfA34vfpUODnj9KvZvA3494j4GQ2+zUYp71czmAnMyb43NRd4GvhtSkPsQJ22l4OgegF8V9LmbOiLYWslbZV0Q6PtimeOA54F/lbS/ZKul3Q40BYRT2dtfg601a3CyRmrX9D426zcecA3s8eNvs3KlfcLGnibRcRO4C+AHZQCYA+wGXg+IgazZr3A1I0ml5ODoHq/GRGnAGcDl0j6LeBLwK8DJ1PawJ+rY32TNRM4BfhSRLwZeBEYMXR49mW/RjuWOFa/mmGbAZAd7loF3Dp6WYNuM6Bivxp6m2XBtZrSHye/BhwOrKxrURkHQZWyVCcingH+Hjg9InZFxMGIGAL+mtLIq42mF+iNiHuz6dso/QLdJekogOz/Z+pU32RV7FeTbLNhZwM/iYhd2XSjb7NhI/rVBNvs7cDjEfFsRAwA3wLOAo7MDhVB5aF4CucgqIKkwyXNH34MvBN4aPhDl3kP8FA96jsUEfFz4ElJJ2Sz3gZsY+QwIB8Avl2H8iZtrH41wzYrcz4jD5809DYrM6JfTbDNdgBnSporSfzqM/Z9SkPsQJ22l68aqoKk11PaC4DSIYe/i4jPSrqJ0u5qAE8AHyk7RtswJJ0MXA8cBjxG6SqNFuAW4BjgZ8B7I+IXdStyEsbo1xdojm12OKVfMK+PiD3ZvIU0/jar1K+G/5xJ+t+Ubr41CNwPXETpnEAn8Ops3gURMfW3IRuvLgeBmVnafGjIzCxxDgIzs8Q5CMzMEucgMDNLnIPAzCxxDXHzerO8sksn/yWbfC1wkNIQE1D68t+BuhRWgaQO4EBE/L9612JpcxBYU4mIPkrXmk+LUWElzSwbR2a0DqAfyB0EE6zPbFJ8aMianqRTJf0gGyjwjrLhF7olXStpU3afgtMkfSsbx/8zWZtjs/sYfCNrc5ukuTnW+5cq3a/io5LenY03f7+kOyW1SToW+G/ApdnY+m+R9FVJ55bV3Z/93yHpbkldlL4VPUPSn0vamA3A9pFavp/WfBwE1uwEfBE4NyJOBW4APlu2/EBEtANfpvTV/kuANwEfzA4zAZwA/FVEvBF4AfgfklonWO9hEdEeEZ+jNAb9mdmgd53AJyPiiew1r42IkyPi7gn6cQrw0Yh4A/BhYE9EnAacBlws6bjq3xqzEh8asmY3i9Iv9u+VhndhBqWRK4d1Zf8/CDw8PGSBpMeAJcDzwJMR8a9Zu68Dfwj88wTrvbns8WLg5myP4TDg8Un0476IGH7eO4FlZXsPRwBLJ7leMweBNT1R+gW/fIzlw2O6DJU9Hp4e/nyMHoclcqz3xbLHXwQ+HxFd2QniK8d4ziDZXrqkFkqhUWl9Av5nRNwxxnrMquJDQ9bs9gOvkbQcQFKrpN+och3HDD8f+ANKh3q2V7HeI/jV0MIfKJu/F5hfNv0EcGr2eBXQOsb67gD+e3Z4CklvKLvZjlnVHATW7IYoDfF7taQHgC3Af65yHdsp3YToEWABpZvcHKhivVcCt0raDDxXNv8fgPcMnyymNMb+W7P1LWfkXkC56ykNX/wTSQ8BX8F793YIPPqo2Tiyq3v+MSLeVOdSzArjPQIzs8R5j8DMLHHeIzAzS5yDwMwscQ4CM7PEOQjMzBLnIDAzS9z/Bxqb4z828mHUAAAAAElFTkSuQmCC\n", "text/plain": [ "
" ] }, "metadata": { "needs_background": "light" }, "output_type": "display_data" } ], "source": [ "%matplotlib inline\n", "pd.set_option('mode.chained_assignment',None) # this removes a useless warning from pandas\n", "import matplotlib.pyplot as plt\n", "\n", "data[\"Frequency\"]=data.Malfunction/data.Count\n", "data.plot(x=\"Temperature\",y=\"Frequency\",kind=\"scatter\",ylim=[0,1])\n", "plt.grid(True)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "At first glance, the dependence does not look very important, but let's try to\n", "estimate the impact of temperature $t$ on the probability of O-ring malfunction." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Estimation of the temperature influence\n", "\n", "Suppose that each of the six O-rings is damaged with the same\n", "probability and independently of the others and that this probability\n", "depends only on the temperature. If $p(t)$ is this probability, the\n", "number $D$ of malfunctioning O-rings during a flight at\n", "temperature $t$ follows a binomial law with parameters $n=6$ and\n", "$p=p(t)$. To link $p(t)$ to $t$, we will therefore perform a\n", "logistic regression." ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "ename": "ImportError", "evalue": "cannot import name 'factorial'", "output_type": "error", "traceback": [ "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", "\u001b[0;31mImportError\u001b[0m Traceback (most recent call last)", "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[0;32m----> 1\u001b[0;31m \u001b[0;32mimport\u001b[0m \u001b[0mstatsmodels\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mapi\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0msm\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 2\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 3\u001b[0m \u001b[0mdata\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"Success\"\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mdata\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mCount\u001b[0m\u001b[0;34m-\u001b[0m\u001b[0mdata\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mMalfunction\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 4\u001b[0m \u001b[0mdata\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"Intercept\"\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;36m1\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 5\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m/opt/conda/lib/python3.6/site-packages/statsmodels/api.py\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 14\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0;34m.\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mrobust\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 15\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0;34m.\u001b[0m\u001b[0mrobust\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mrobust_linear_model\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mRLM\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 16\u001b[0;31m from .discrete.discrete_model import (Poisson, Logit, Probit,\n\u001b[0m\u001b[1;32m 17\u001b[0m \u001b[0mMNLogit\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mNegativeBinomial\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 18\u001b[0m \u001b[0mGeneralizedPoisson\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m/opt/conda/lib/python3.6/site-packages/statsmodels/discrete/discrete_model.py\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 43\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 44\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mstatsmodels\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mbase\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0ml1_slsqp\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mfit_l1_slsqp\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 45\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mstatsmodels\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdistributions\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mgenpoisson_p\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 46\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 47\u001b[0m \u001b[0;32mtry\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m/opt/conda/lib/python3.6/site-packages/statsmodels/distributions/__init__.py\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 1\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0;34m.\u001b[0m\u001b[0mempirical_distribution\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mECDF\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mmonotone_fn_inverter\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mStepFunction\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 2\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0;34m.\u001b[0m\u001b[0medgeworth\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mExpandedNormal\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 3\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0;34m.\u001b[0m\u001b[0mdiscrete\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mgenpoisson_p\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mzipoisson\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mzigenpoisson\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mzinegbin\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m/opt/conda/lib/python3.6/site-packages/statsmodels/distributions/edgeworth.py\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 5\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mnumpy\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mnp\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 6\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mnumpy\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpolynomial\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mhermite_e\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mHermiteE\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 7\u001b[0;31m \u001b[0;32mfrom\u001b[0m \u001b[0mscipy\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mmisc\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mfactorial\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 8\u001b[0m \u001b[0;32mfrom\u001b[0m \u001b[0mscipy\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mstats\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mrv_continuous\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 9\u001b[0m \u001b[0;32mimport\u001b[0m \u001b[0mscipy\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mspecial\u001b[0m \u001b[0;32mas\u001b[0m \u001b[0mspecial\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;31mImportError\u001b[0m: cannot import name 'factorial'" ] } ], "source": [ "import statsmodels.api as sm\n", "\n", "data[\"Success\"]=data.Count-data.Malfunction\n", "data[\"Intercept\"]=1\n", "\n", "logmodel=sm.GLM(data['Frequency'], data[['Intercept','Temperature']], family=sm.families.Binomial(sm.families.links.logit)).fit()\n", "\n", "logmodel.summary()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The most likely estimator of the temperature parameter is 0.0014\n", "and the standard error of this estimator is 0.122, in other words we\n", "cannot distinguish any particular impact and we must take our\n", "estimates with caution." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Estimation of the probability of O-ring malfunction\n", "\n", "The expected temperature on the take-off day is 31°F. Let's try to\n", "estimate the probability of O-ring malfunction at\n", "this temperature from the model we just built:" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [ "%matplotlib inline\n", "data_pred = pd.DataFrame({'Temperature': np.linspace(start=30, stop=90, num=121), 'Intercept': 1})\n", "data_pred['Frequency'] = logmodel.predict(data_pred[['Intercept','Temperature']])\n", "data_pred.plot(x=\"Temperature\",y=\"Frequency\",kind=\"line\",ylim=[0,1])\n", "plt.scatter(x=data[\"Temperature\"],y=data[\"Frequency\"])\n", "plt.grid(True)" ] }, { "cell_type": "markdown", "metadata": { "hideCode": false, "hidePrompt": false, "scrolled": true }, "source": [ "As expected from the initial data, the\n", "temperature has no significant impact on the probability of failure of the\n", "O-rings. It will be about 0.2, as in the tests\n", "where we had a failure of at least one joint. Let's get back\n", "to the initial dataset to estimate the probability of failure:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "0.06521739130434782\n" ] } ], "source": [ "data = pd.read_csv(\"shuttle.csv\")\n", "print(np.sum(data.Malfunction)/np.sum(data.Count))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "This probability is thus about $p=0.065$. Knowing that there is\n", "a primary and a secondary O-ring on each of the three parts of the\n", "launcher, the probability of failure of both joints of a launcher\n", "is $p^2 \\approx 0.00425$. The probability of failure of any one of the\n", "launchers is $1-(1-p^2)^3 \\approx 1.2%$. That would really be\n", "bad luck.... Everything is under control, so the takeoff can happen\n", "tomorrow as planned.\n", "\n", "But the next day, the Challenger shuttle exploded and took away\n", "with her the seven crew members. The public was shocked and in\n", "the subsequent investigation, the reliability of the\n", "O-rings was questioned. Beyond the internal communication problems\n", "of NASA, which have a lot to do with this fiasco, the previous analysis\n", "includes (at least) a small problem.... Can you find it?\n", "You are free to modify this analysis and to look at this dataset\n", "from all angles in order to to explain what's wrong." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### My Analysis" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "celltoolbar": "Hide code", "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.6.4" } }, "nbformat": 4, "nbformat_minor": 2 }