Data Science sirf model banana nahi hai. Ek project kai steps me chalta hai, aur har step ka apna kaam hai. Is lesson me hum ek example lenge aur poora lifecycle samjhenge.
Example problem: Ek e-commerce company janna chahti hai ki kaunse customers agle mahine uska app use karna band kar denge (isko churn kehte hain), taaki unhe pehle se discount ya offer bheja ja sake.
Step 1: Problem ko samajhna
Sabse pehla aur sabse important step. Galat sawaal ka sahi jawab bhi bekaar hai. Yaha hum decide karte hain:
- Business goal kya hai? — churn kam karna
- Success kaise measure hoga? — jaise churn rate 20% se 15% pe laana
- Output kya chahiye? — har customer ke liye churn ka probability score
Step 2: Data collection
Ab zaroori data jama karte hain — orders ki table (SQL database se), app login history, support tickets, customer profile. Real life me ye data alag-alag jagah hota hai aur hume usse join karna padta hai.
Step 3: Data cleaning
Raw data kabhi saaf nahi hota: missing values, duplicate rows, galat dates, spelling mistakes. Ek common kehna hai ki Data Scientist ka 60-80% time cleaning me jaata hai.
Step 4: EDA (Exploratory Data Analysis)
Data ko explore karke patterns dhoondhte hain. Chaliye ek chhote dataset pe dekhte hain ki churn karne wale customers kaise alag hain:
Example
import pandas as pd
customers = pd.DataFrame({
"customer": ["A", "B", "C", "D", "E", "F"],
"orders_last_3m": [12, 0, 5, 1, 8, 0],
"churned": [0, 1, 0, 1, 0, 1],
})
print(customers)
print()
print("Churn rate:", customers["churned"].mean())
Output
customer orders_last_3m churned
0 A 12 0
1 B 0 1
2 C 5 0
3 D 1 1
4 E 8 0
5 F 0 1
Churn rate: 0.5
Ab dekhte hain ki churn karne wale aur na karne wale customers ne average kitne orders kiye:
Example
print(customers.groupby("churned")["orders_last_3m"].mean())
Output
churned
0 8.333333
1 0.333333
Name: orders_last_3m, dtype: float64
Pattern saaf hai: jin customers ne pichhle 3 mahine me kam orders kiye, wahi churn kar rahe hain. Ye ek insight hai, aur isi tarah ke patterns aage model ke liye features bante hain.
Step 5: Feature engineering
Raw columns se naye, zyada useful columns banana. Jaise: last order kitne din pehle hua, average order value, pichhle mahine ke mukable orders kitne gire.
Step 6: Modeling
Ab Machine Learning model train karte hain — jaise Logistic Regression ya Random Forest — jo in features se churn predict karna seekhe.
Step 7: Evaluation
Model kitna accha hai? Isko hum aise data pe test karte hain jo model ne training me kabhi nahi dekha. Accuracy, precision, recall jaise metrics dekhte hain.
Step 8: Deployment aur monitoring
Model ko app ya dashboard me lagate hain, taaki roz naye predictions milein. Aur samay-samay pe check karte hain ki model ki performance gir to nahi rahi.
Poora lifecycle ek table me
Step | Main sawaal | Tools |
|---|---|---|
Problem definition | Hume kya solve karna hai? | Business meetings, KPIs |
Data collection | Data kaha se aayega? | SQL, APIs, CSV/Excel |
Data cleaning | Data me kya galat hai? | Pandas |
EDA | Data kya kehta hai? | Pandas, Matplotlib, Seaborn |
Feature engineering | Model ko kya dikhaayein? | Pandas, scikit-learn |
Modeling | Kaunsa model best hai? | scikit-learn |
Evaluation | Model pe kitna bharosa karein? | scikit-learn metrics |
Deployment | Model kaam me kaise aaye? | APIs, Cloud, Dashboards |
Is process ko industry me CRISP-DM (Cross-Industry Standard Process for Data Mining) bhi kehte hain. Ye ek cycle hai — evaluation ke baad aksar wapas cleaning ya feature engineering pe jaana padta hai.
Summary
- Project hamesha business problem se shuru hota hai, model se nahi.
- Cleaning aur EDA me sabse zyada time lagta hai — aur ye sabse important bhi hain.
- Lifecycle ek cycle hai; results dekh ke steps repeat hote hain.