Machine Learning

K-means clustering

• https://en.wikipedia.org/wiki/K-means_clustering

It aims to partition n observations into k cluster. It's an unsupervised k-means algorithm

• PSPP contains k-means, The QUICK CLUSTER command performs k-means clustering on the dataset.
• Weka contains k-means and x-means.
• Octave contains k-means.
• OpenCV contains a k-means implementation.
• Spark MLlib implements a distributed k-means algorithm.

K-NN classifier

• https://en.wikipedia.org/wiki/K-nearest_neighbors_algorithm

k-nearest neighbors algorithm allows classification and regression

A confusion matrix or "matching matrix" is often used as a tool to validate the accuracy of k-NN classification.

• https://en.wikipedia.org/wiki/Confusion_matrix

Decision trees

• https://en.wikipedia.org/wiki/Decision_tree_learning

Createa a model that predicts the value of a target variable based on several input variables. Classification tree outcome is the class (discrete) to which the data belongs. Regression tree outcome can be considered a real number

Notable decision tree algorithms include:

• ID3 (Iterative Dichotomiser 3)
• C4.5 (successor of ID3)
• CART (Classification And Regression Tree)
• Chi-square automatic interaction detection (CHAID)
• MARS

ID3

• https://en.wikipedia.org/wiki/ID3_algorithm

Algorithm invented by Ross Quinlan[1] used to generate a decision tree from a dataset.

Naive Bayes classifier

• https://en.wikipedia.org/wiki/Naive_Bayes_classifier

Document classification Here is a worked example of naive Bayesian classification to the document classification problem. Consider the problem of classifying documents by their content, for example into spam and non-spam e-mails.

Apriori algorithm

https://en.wikipedia.org/wiki/Apriori_algorithm association rule learning market basket analysis

Libraries/frameworks

• scikit-learn
• R (an open-source software environment for statistical computing, which includes several CART implementations such as rpart, party and randomForest packages),
• Weka (a free and open-source data-mining suite, contains many decision tree algorithms),
• Orange
• KNIME
• OpenCV

w3schools python ML

• https://www.w3schools.com/python/python_ml_getting_started.asp

  • matplotlib.pyplot.scatter
  • matplotlib.pyplot.hist
  • numpy.mean
  • numpy.median
  • numpy.std
  • numpy.var
  • numpy.percentile
  • numpy.random.uniform
  • numpy.random.normal
  • numpy.poly1d
  • numpy.polyfit
  • pandas.read_csv
  • scipy.stats.mode
  • scipy.stats.linregress
  • scipy.cluster.hierarchy.dendrogram
  • scipy.cluster.hierarchy.linkage
  • sklearn.metrics.r2_score
  • sklearn.linear_model

  • sklearn.preprocessing.StandardScaler

  • sklearn.tree

  • sklearn.tree.DecisionTreeClassifier

  • sklearn.metrics.confusion_matrix
  • sklearn.metrics.accuracy_score
  • sklearn.metrics.precision_score
  • sklearn.metrics.recall_score
  • sklearn.metrics.f1_score

  • sklearn.cluster.AgglomerativeClustering

  • sklearn.linear_model.LogisticRegression

  • sklearn.cluster.KMeans
  • sklearn.neighbors.KNeighborsClassifier