Understanding Machine Learning Basics

Duration: 5 min

This module provides an introduction to the fundamental concepts of machine learning using Scikit-Learn, including linear models, support vector machines (SVM), decision trees, ensemble methods, cross-validation, and pipelines. Understanding these basics is crucial for building and evaluating machine learning models effectively.

Linear Models

Linear models are a fundamental type of machine learning algorithm that assumes a linear relationship between the input variables (features) and the target variable. They are simple yet powerful tools for regression and classification tasks. Scikit-Learn provides several linear models, including Linear Regression, Logistic Regression, and Ridge Regression.

from sklearn.linear_model import LinearRegression
from sklearn.datasets import load_boston
import numpy as np

# Load the Boston housing dataset
boston = load_boston()
X = boston.data
y = boston.target

# Create a linear regression model
model = LinearRegression()

# Fit the model to the data
model.fit(X, y)

# Predict using the model
predictions = model.predict(X[:5])

# Print the predictions
print(predictions)

Try it in Google Colab:

[ 24.07536625  21.69553802  35.02526737  29.03577607  23.24074529]

Support Vector Machines (SVM)

Support Vector Machines (SVM) are a set of supervised learning methods used for classification and regression. SVM works by finding the optimal hyperplane that separates the data points of different classes with the maximum margin. Scikit-Learn provides the SVC class for SVM classification.

from sklearn import svm, datasets
from sklearn.model_selection import train_test_split
from sklearn.metrics import accuracy_score

# Load the iris dataset
iris = datasets.load_iris()
X = iris.data
y = iris.target

# Split the dataset into training and testing sets
X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.3, random_state=42)

# Create an SVM classifier
clf = svm.SVC(kernel='linear')

# Train the model
clf.fit(X_train, y_train)

# Make predictions
y_pred = clf.predict(X_test)

# Calculate accuracy
accuracy = accuracy_score(y_test, y_pred)

# Print the accuracy
print(f'Accuracy: {accuracy:.2f}')

💡 Tip: When using SVM, it's important to scale your features to ensure that the algorithm performs optimally. Use StandardScaler or MinMaxScaler from Scikit-Learn to preprocess your data.

Key Concepts

Check Your Understanding