How can I remove outliers from my dataset in Python?

How can I remove outliers from my dataset in Python?

You can use libraries like Pandas and NumPy to identify and remove outliers. Would you like a code example?

Yes, please provide a code example using Pandas.

Sure! You can use the IQR method. Here's a sample code:

import pandas as pd

# Sample data
data = {'value': [10, 12, 12, 13, 12, 100, 14, 15]}
df = pd.DataFrame(data)

# Calculate Q1 and Q3
Q1 = df['value'].quantile(0.25)
Q3 = df['value'].quantile(0.75)
IQR = Q3 - Q1

# Filter out the outliers
filtered_df = df[(df['value'] >= (Q1 - 1.5 * IQR)) & (df['value'] <= (Q3 + 1.5 * IQR))]
print(filtered_df)

What if I want to use the Z-score method instead?

You can use the Z-score method to identify outliers based on standard deviations. Here's how:

from scipy import stats
import numpy as np
import pandas as pd

# Sample data
data = {'value': [10, 12, 12, 13, 12, 100, 14, 15]}
df = pd.DataFrame(data)

# Calculate Z-scores
z_scores = np.abs(stats.zscore(df['value']))

# Filter out the outliers
filtered_df = df[(z_scores < 3)]
print(filtered_df)