Grouping and Aggregation

Duration: 5 min

This module covers the essential techniques of grouping and aggregation in data science using NumPy and Pandas. Understanding these concepts is crucial for summarizing data, performing complex data transformations, and gaining insights from large datasets efficiently.

Grouping Data with Pandas

Grouping data allows you to split your dataset into separate groups based on one or more keys. This is particularly useful for performing operations on subsets of data. The groupby function in Pandas is a powerful tool that enables you to group data and apply aggregate functions to each group.

import pandas as pd

# Sample DataFrame
data = {'Category': ['A', 'B', 'A', 'B', 'A', 'B'], 'Values': [10, 20, 30, 40, 50, 60]}
df = pd.DataFrame(data)

# Grouping by 'Category' and calculating the sum of 'Values'
grouped = df.groupby('Category')['Values'].sum()
print(grouped)

Try it in Google Colab:

A    90
B   120
Name: Values, dtype: int64

Aggregation Functions

Aggregation functions are used to perform calculations on grouped data. Common aggregation functions include sum, mean, count, min, max, and standard deviation. These functions help in summarizing the data within each group, providing valuable insights.

import pandas as pd

# Sample DataFrame
data = {'Category': ['A', 'B', 'A', 'B', 'A', 'B'], 'Values': [10, 20, 30, 40, 50, 60]}
df = pd.DataFrame(data)

# Grouping by 'Category' and applying multiple aggregation functions
aggregations = df.groupby('Category')['Values'].agg(['sum','mean', 'count'])
print(aggregations)

💡 Tip: When using the agg method, ensure that the aggregation functions you choose are appropriate for the type of data you are working with to avoid incorrect results.

Key Concepts

Check Your Understanding