In this project, we gather reproduction attempts from the Challenger
study. In particular, we try to reperform some of the analysis provided
in *Risk Analysis of the Space Shuttle: Pre-Challenger Prediction of
Failure* by *Siddhartha R. Dalal, Edward B. Fowlkes, Bruce Hoadley*
published in *Journal of the American Statistical Association*, Vol. 84,
No. 408 (Dec., 1989), pp. 945-957 and available at
[here](https://studies2.hec.fr/jahia/webdav/site/hec/shared/sites/czellarv/acces_anonyme/OringJASA_1989.pdf)
(here is [the official JASA
webpage](http://www.jstor.org/stable/2290069)).

On the fourth page of this article, they indicate that the maximum
likelihood estimates of the logistic regression using only temperature
are: $`\hat{\alpha}=5.085`$ and $`\hat{\beta}=-0.1156`$ and their
asymptotic standard errors are $`s_{\hat{\alpha}}=3.052`$ and
$`s_{\hat{\beta}}=0.047`$. The Goodness of fit indicated for this model
was $`G^{2} = 18.086`$ with 21 degrees of freedom. Our goal is to
reproduce the computation behind these values and the Figure 4 of this
article, possibly in a nicer looking way.


[*Here is our successful replication of Dalal et al. results using
R*](challenger.pdf).

1.  Try to **replicate the computation** from Dalal et al. In case it
    helps, we provide you with two implementations of this case study
    but we encourage you to **reimplement them by yourself** using both
    your favourite language and an other language you do not know yet.
    -   A [Jupyter Python3 notebook](src/Python3/challenger.ipynb)
    -   An [Rmarkdown document](src/R/challenger.Rmd)
2.  Then **update the following table with your own results by
    indicating in each column:**
	-   Language: R, Python3, Julia, Perl, C...
	-   Language version:
	-   Main libraries: please indicate the versions of all the loaded
		libraries
    -   Tool: Jupyter, Rstudio, Emacs
	-   Operating System: Linux, Mac OS X, Windows, Android, ... along with
      its version
	-   $`\hat{\alpha}`$ and $`\hat{\beta}`$: Identical, Similar, Different,
Non functional (expected values are $`5.085`$ and $`-0.1156`$)
	-   $`s_{\hat{\alpha}}`$ and $`s_{\hat{\beta}}`$: Identical, Similar,
			Different, Non functional (expected values are $`3.052`$ and $`0.047`$)
	-   $`G^2`$ and degree of freedom: Identical, Similar, Different, Non
		functional (expected values are $`18.086`$ and $`21`$).
	-   Figure: Similar, Different, Non functional, Did not succeed
	-   Confidence region: Identical (to [the one obtained with R](challenger.pdf)), Similar, Quite Different, Did not succeed
 
| Language | Language version | Main libraries                                                | Tool    | Operating System               | $`\hat{\alpha}= 5.085`$ $`\hat{\beta} = -0.1156`$ | $`s_{\hat{\alpha}} = 3.052`$ $`s_{\hat{\beta}} = 0.047`$ | $`G^{2} = 18.086`$ $`dof = 21`$ | Figure    | Confidence Region | Link to the document                                                                                                                                                                                                                                                                                                         | Author      |
| -------- | ---------------- | ------------------------------------------------------------- | ------- | ----------------------------   | -------------                                     | ----------                                                | ----------                     | --------- | ----------        | -----------------------------------------------------------------                                                                                                                                                                                                                                                                                            | ----------- |
| R        |    3.4.4         |  gglplot2-2.21 Epi 2.19  rmarkdown-1.10                      | RStudio  |  Ubuntu 14.04 LTS              | Identical                                         |  Identical                                                | Identical                      |figure 4 OK| Partly succeeded  |[Rmd](https://app-learninglab.inria.fr/gitlab/fd68a867f507580bd9ec9421cac0e770/mooc-rr/blob/master/module4/SpaceShuttle.Rmd) [pdf](https://app-learninglab.inria.fr/gitlab/fd68a867f507580bd9ec9421cac0e770/mooc-rr/blob/master/module4/SpaceShuttle.pdf)                                                                                                                                                             |JC Thalabard|                                                                                                                 |  JC Thalabard |
| R        |            3.5.1 | ggplot2 3.0.0                                                 | RStudio | Debian GNU/Linux buster/sid    | Identical                                | Identical                                 | Identical                    | Identical | Identical   | [Rmd](src/R/challenger.Rmd), [pdf](src/R/challenger_debian_alegrand.pdf)                                                                                                                                                                                                                                                                                     | A. Legrand  |
| R        |            3.5.1 | ggplot2 3.0.0 rmarkdown 1.8                                   | RStudio | Windows 7 32 bits              | Identical                                | Identical                                 | Identical                    | Identical | Identical   | [pdf](src/R/challenger_R_Rmd_Windows_32bits_rmarkdown_1_8.pdf)                                                                                                                                                                                                                                                                                                | M.G. Dondon |
| R        |            3.5.1 | ggplot2 3.0.0 rmarkdown 1.10                                  | RStudio | Windows 7 32 bits              | Identical                                | Identical                                 | Identical                    | Identical | Identical   | [pdf](src/R/challenger_R_Rmd_Windows_32bits_rmarkdown_1_10.pdf)                                                                                                                                                                                                                                                                                               | M.G. Dondon | 
| R        |            3.5.1 | ggplot2 3.0.0 rmarkdown 1.10                                  | RStudio | Windows 7 x64                  | Identical                                | Identical                                 | Identical                    | Identical | Identical   | [html](src/R/Challenger.html)                                                                                                                                                                                                                                                                                                                                | ????        |
| R        |            3.5.1 | ggplot2 3.1.0 rmarkdown 1.10                                  | RStudio | GNU/Linux Manjaro 4.18.17-1    | Identical                                | Identical                                 | Identical                    | Identical | Identical   | [Rmd](https://app-learninglab.inria.fr/gitlab/0ff5ec0ebf4e500d1aa4b14c0d8efd67/mooc-rr/blob/e4db1956911a37407fe8a0718a34d9ff4b3ee33b/module4/re-analyse_shuttle_sguyader.Rmd), [PDF](https://app-learninglab.inria.fr/gitlab/0ff5ec0ebf4e500d1aa4b14c0d8efd67/mooc-rr/blob/e4db1956911a37407fe8a0718a34d9ff4b3ee33b/module4/re-analyse_shuttle_sguyader.pdf) | S. Guyader  |
| R        |            3.5.1 | ggplot2_3.0.0                                                 | org-mode | GNU/Linux OpenSuse Leap 15.0  | don't know                               | don't know                                | don't know                   | don't know | don't kn   | [org](https://app-learninglab.inria.fr/gitlab/moocrr-session1/moocrr-reproducibility-study/blob/master/src/R/challenger_R_org.org), [pdf](https://app-learninglab.inria.fr/gitlab/moocrr-session1/moocrr-reproducibility-study/blob/master/src/R/challenger_R_org.pdf)                                                                                       | JFM         |
| R        |            3.5.1 | ggplot2 3.0.0 rmarkdown 1.10                                  | RStudio | Windows 7 x64                  | Identical                                | Identical                                 | Identical                    | Identical | Identical   | [html](src/R/study_vd.html)                                                                                                                                                                                                                                                                                                                                | V.Dordonnat        |
| R         |       3.5.1   | ggplot2_3.1.0 rmarkdown 1.10                                  | RStudio| Windows 8 x64                    | Identical                                 | Identical                                 | Identical                     | Identical | Identical  |   [Rmd] (src/R/challenger_VL.Rmd)[html] (src/R/Challenger_VL.html)                                                                                                                                                                                                                                                                                            | V Laucou  |
| R        |            3.4.3 | ggplot2 2.2.1                                                 | RStudio | macOS 10.14.1                  | Identical                                | Identical                                 | Identical                    | Identical | Identical         | [Rmd](https://app-learninglab.inria.fr/gitlab/08e11bfd74562785ba326e1579ddc8bb/mooc-rr/blob/master/module4/Exo%201.Rmd)                                                                                                                                                                                                                                   | J. Simo,  | 
| R        |            3.2.3 | ggplot2 3.1.0                                                 | RStudio | Linux Ubuntu 16.04 LTS         | Identical                                | Identical                                 | Identical                    | Identical | Identical         | [pdf](https://app-learninglab.inria.fr/gitlab/ebe7629811d8feda9db361e15271ad4c/mooc-rr/blob/211ee2405e925c08ece1dc20febd0c63f566400a/module4/challenger_repro_lbouvier.pdf)                                                                                                                                                                                  | L. Bouvier  | 
| R        |           3.5.1  |ggplot2_3.1.0                                                  | RStudio | mac OS 10.11.6                 | Identical                                | Identica                                  | Identical                    | Identical | Identical         | [pdf](https://app-learninglab.inria.fr/gitlab/8c37cd50d492bf77c8fb094346707768/mooc-rr/blob/master/module4/Essai_challenger.pdf), [Rmd](https://app-learninglab.inria.fr/gitlab/8c37cd50d492bf77c8fb094346707768/mooc-rr/blob/master/module4/Challenger.rmd)                                                                                                 | J. Chantreau |
| R        |           3.2.3  | ggplot2_2.0.0                                                 | Rstudio | Trisquel GNU/Linux Flidas (8.0)| Identical                                | Identical                                 | Identical                    | Identical | Identical         | [pdf](https://app-learninglab.inria.fr/gitlab/moocrr-session1/moocrr-reproducibility-study/raw/584c4b5edec928b5c65c8e573e96d1873d6cc825/src/R/challenger.pdf)                                                                                                                                                                                                | A. Arias  |
**Python** |                  |                                                               |         |                                |                                          |                                           |                              |           |                   |                                                                                                                                                                                                                                                                                                                                                            |             |
| Python   |            3.6.4 | statsmodels 0.9.0 numpy 1.13.3 pandas 0.22.0 matplotlib 2.2.2 | Jupyter | Linux Ubuntu 4.4.0-116-generic | Identical                                | Identical                                 | Identical                    | Identical | Similar           | [ipynb](src/Python3/challenger.ipynb), [pdf](src/Python3/challenger_ubuntuMOOC_alegrand.pdf)                                                                                                                                                                                                                                                                 | A. Legrand  |
| Python   |            3.6.4 | statsmodels 0.9.0 numpy 1.13.3 pandas 0.22.0 matplotlib 2.2.3 | Jupyter | Linux Ubuntu 4.4.0-116-generic | Identical                                | Identical                                 | Identical                    | Identical | Similar           | [ipynb](https://app-learninglab.inria.fr/gitlab/209efe97d845ea4b57491275c640a3d4/mooc-rr/blob/master/module4/challenger.ipynb), [pdf](https://app-learninglab.inria.fr/gitlab/209efe97d845ea4b57491275c640a3d4/mooc-rr/blob/master/module4/challenger-jupiter.pdf)                                                                                           | N. Maurin   |
| Python   |            3.7.0 | statsmodels 0.9.0 numpy 1.15.4 pandas 0.23.4 matplotlib 2.2.3 | Jupyter | Windows 7 64 bits              | Identical                                | Identical                                 | Identical                    | Identical | Similar           | [ipynb](src/Python3/challenger_Python_ipynb.ipynb), [pdf](src/Python3/challenger_Python_ipynb_Windows_64bits.pdf)                                                                                                                                                                                                                                            | M.G. Dondon |
| Python   |            3.7.0 | statsmodels 0.9.0 numpy 1.15.4 pandas 0.23.4 matplotlib 2.2.3 | Emacs   | Windows 7 64 bits              | Identical                                | Identical                                 | Identical                    | Identical | Similar           | [org](src/Python3/challenger_Python_org.org), [pdf](src/Python3/challenger_Python_org_Windows_64bits.pdf)                                                                                                                                                                                                                                                    | M.G. Dondon |
| Python   |            3.7.0 | statsmodels 0.9.0 numpy 1.15.4 pandas 0.23.4 matplotlib 3.0.2 | Emacs   | Windows 7 64 bits              | Identical                                | Identical                                 | Identical                    | Identical | Similar           | [org](src/Python3/challenger_Python_org.org), [pdf](src/Python3/challenger_Python_org_Windows_64bits_v2.pdf)                                                                                                                                                                                                                                            | M.G. Dondon |
| Python   |            3.6.5 | statsmodels 0.9.0 numpy 1.15.4 pandas 0.23.4 matplotlib 3.0.2 | Vim     | Darwin Kernel Version 16.7.0   | Identical                                | Identical                                 | Identical                    | Identical | Similar           |[pdf](https://app-learninglab.inria.fr/gitlab/c914387a7e6f10f1216e1bc16a239ade/mooc-rr/blob/master/module4/exo1.pdf), [Rmd](https://app-learninglab.inria.fr/gitlab/c914387a7e6f10f1216e1bc16a239ade/mooc-rr/blob/master/module4/exo1.Rmd), [py](https://app-learninglab.inria.fr/gitlab/c914387a7e6f10f1216e1bc16a239ade/mooc-rr/blob/master/module4/test.py) | Anne C. |
| Python   |            3.6.7 | statsmodels 0.8.0 numpy 1.15.4 pandas 0.23.3 matplotlib 2.2.2 | Emacs   | Debian GNU/Linux buster/sid    | Identical                                | Different                                 | Different                    | Different | Similar           | [org](https://app-learninglab.inria.fr/gitlab/e108dddfe1a07ebd6ae763f9c4cdd901/mooc-rr/blob/master/module4/challenger.org), [tar.gz](https://app-learninglab.inria.fr/gitlab/e108dddfe1a07ebd6ae763f9c4cdd901/mooc-rr/blob/master/module4/archive.tar.gz)                                                                                                                                                                                                                                            | R. Letot |
| Python   |            3.7.1 | statsmodels 0.9.0 numpy 1.15.4 pandas 0.23.3 matplotlib 2.2.3 | Emacs   | Debian GNU/Linux buster/sid    | Identical                                | Identical                                 | Identical                    | Different | Similar           | [org](https://app-learninglab.inria.fr/gitlab/e108dddfe1a07ebd6ae763f9c4cdd901/mooc-rr/blob/master/module4/challenger2.org), [tar.gz](https://app-learninglab.inria.fr/gitlab/e108dddfe1a07ebd6ae763f9c4cdd901/mooc-rr/blob/master/module4/archive2.tar.gz)                                                                                                                                                                                                                                            | R. Letot |
| **SAS**    |                  |                                                               |         |                                |                                          |                                           |                              |           |                   |                                                                                                                                                                                                                                                                                                                                                            |             |
| SAS      |              9.4 |                                                               | Jupyter | Windows 7                      | Identical                                | Identical                                 | Identical                    | Identical | Identical         | [ipynb](src/SAS/challenger_SAS_ipynb.ipynb), [pdf](src/SAS/challenger_SAS_ipynb.pdf)                                                                                                                                                                                                                                                                         | M.G. Dondon |

