Awesome
Who
- Nitin Borwankar - primary developer
Sponsored by Pivotal Inc. and Alpine Data Labs
Community forming at Google Group "learnds"
What
- A collection of Data Science Learning materials in the form of IPython Notebooks.
- Associated data sets.
The initial beta release consists of four major topics
- Linear Regression
- Logistic Regression
- Random Forests
- K-Means Clustering
Each of the above has at least three IPython Notebooks covering
- Overview (an exposition of the technique for the math-wary)
- Data Exploration (the nuts and bolts of real world data wrangling)
- Analysis (using the technique to get results)
One or more of these may have supplementary material. Each of these have worksheets that contain mostly the code sections so you can iteratively explore the code.
Three openly available data sets are used.
- For the Linear and Logistic Regression we use a data set on loans and interest rates provided by Lending Club http://lendingclub.com
- For Random Forests we use a data set of Android accelerometer and gyroscope readings used to predict body position and motion from the Human Activity Recognition project http://archive.ics.uci.edu/ml/datasets/Human+Activity+Recognition+Using+Smartphones
- UN data on economic indicators of countries
Why
There's a need for open content to raise the level of awareness and training in basics, in the Data Science field (circa early 2013).
IPython Notebook provides an appropriate platform for rapid iterative exploration and learning.
When
Starting in 2013 and intended to extend for a long while.
Where
Today github, tomorrow the world. Google Group "learnds"
How
Learn Data Science is based on content developed by me (Nitin Borwankar) for the Open Data Science Training project http://opendst.org Most of the content (circa July 2013) is copyright (c) Alpine Data Labs as per the license at opendst.org, and is freely available. Extensions to the content embodied in this projects content are also released under the same license - see the LICENSE.txt file.
IPython Notebooks at Beta.
- A0. Before You Begin <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- A1. Linear Regression - Overview <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- A2. Linear Regression - Data Exploration - Lending Club <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- A3. Linear Regression - Analysis <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- B1. Logistic Regression - Overview <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- B1a. Odds, LogOdds and Logit Function <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- B2. Logistic Regression - Data Exploration <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- B3. Logistic Regression - Analysis <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- C1. Random Forests - Overview <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- C2. Random Forests - Data Exploration <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- C3. Random Forests - Analysis <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- D1. K-Means Clustering - Overview <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- D2. K-Means Clustering - Data Exploration <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- D3. K-Means Clustering Analysis <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WA1. Linear Regression Overview Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WA2. Linear Regression - Data Exploration - Lending Club Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WA3. Linear Regression - Analysis Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WA4. Linear Regression - Data Cleanup Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WB3. Logistic Regression - Analysis- Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WC3. Random Forests - Analysis - Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WC4. Random Forests - Data Cleanup Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WD2. K-Means Clustering - Data Exploration-Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- WD3. K-Means Clustering Analysis - Worksheet <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- Z0. A quick tour of the IPython notebook <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
- Z1. Appendix 1 Plotting code snippets <img align="right" height="24" src="https://beta.deepnote.org/buttons/launch-in-deepnote.svg">
Background
If you are unfamiliar with IPython Notebook you can start with http://ipython.org/notebook
Installation
-
Prerequisites
One of the following distributions is needed. Please note that even if you have Python installed it is important to have one of these distributions installed and the binary for this installation in your path. This is because these distributions come packaged with all the supplementary libraries needed and these have been historically difficult to install separately.- EPD Free Enthought Python Distribution from http://enthought.com
- Anaconda Python from http://continuum.io
- Development has been done on v 1.5 of Anaconda distribution but EPD Free should work just as well.
-
The following steps assume you have installed one of the distributions mentioned in prerequisites.
-
From a zip or tar file
- download the zip or tar file
- unpack the file to a directory called learnds
- cd to the 'notebooks' subdirectory
- start IPython Notebook 'ipython notebook --pylab=inline'
-
From the git repo
- clone the repo
- cd to 'notebooks'
- start IPython Notebook 'ipython notebook --pylab=inline'