Bosh sahifa Wiki Supervised

Supervised

Supervised — input sample va unga mos to‘g‘ri target yoki label juftliklari asosida model o‘qitiladigan machine-learning yondashuvi. To‘liq nomi Supervised Learning. Model featurelardan labelga mapping o‘rganadi va yangi, ko‘rilmagan sample uchun prediction chiqaradi.

Classification va regression supervised learningning asosiy vazifalaridir.

Labeled dataset

Har sample:

x — input feature
y — target

juftligiga ega.

Masalan:

email matni → spam
uy xususiyatlari → narx
rasm → object class

Label sifati model sifatining yuqori chegarasini belgilashi mumkin.

Training

Model training sample uchun prediction qiladi.

Prediction target bilan loss orqali solishtiriladi.

Gradient yoki boshqa optimization usuli parameterlarni yangilaydi.

Jarayon ko‘p batch va epoch davomida takrorlanadi.

Classification

Target category.

Vazifalar:

  • binary;
  • multi-class;
  • multi-label;
  • ordinal;
  • hierarchical.

Loss va output label tuzilishiga mos tanlanadi.

Evaluation precision, recall, F1 va boshqa metriclardan foydalanadi.

Regression

Target numeric qiymat.

Misollar:

  • narx;
  • vaqt;
  • talab;
  • risk;
  • harorat.

MAE, RMSE, R² va task-specific metric ishlatiladi.

Feature va label

Feature prediction vaqtida mavjud bo‘lishi kerak.

Label esa model o‘rganadigan natija.

Targetdan keyin paydo bo‘ladigan feature trainingga tushsa leakage yuz beradi.

Feature va label cutoff va lineage bilan boshqariladi.

Train split

Training set parameterlarni o‘zgartiradi.

Validation set hyperparameter va checkpoint tanlaydi.

Test set yakuniy mustaqil baho.

Bir entity yoki juda o‘xshash sample turli splitga tushmasligi kerak.

Generalization

Model training data’ni yodlash emas, yangi samplega to‘g‘ri prediction berishni o‘rganishi kerak.

Generalizationga:

  • data diversity;
  • regularization;
  • model capacity;
  • split;
  • noise;
  • distribution

ta’sir qiladi.

Overfitting

Training score yuqori, validation score past.

Model training sample detailiga ortiqcha moslashgan.

Yechimlar:

  • ko‘proq data;
  • augmentation;
  • regularization;
  • kichik model;
  • early stopping;
  • leakage cleanup.

Underfitting

Train va validation natijasi ikkalasi ham past.

Model capacity, feature yoki training yetarli emas.

Juda kuchli regularization va noto‘g‘ri objective ham sabab bo‘ladi.

Murakkab modelga o‘tishdan oldin data va label tekshiriladi.

Algorithm

Supervised algorithm misollari:

Tanlov data hajmi, feature turi va deployment talabiga bog‘liq.

Loss

Model training objective’i.

Classification:

  • cross-entropy;
  • focal loss;
  • hinge loss.

Regression:

  • MSE;
  • MAE;
  • Huber;
  • quantile loss.

Loss business xarajatni yetarli ifodalashi kerak.

Class imbalance

Kam class muhim bo‘lishi mumkin.

Accuracy misleading.

Class weight, resampling, threshold va mos metric ishlatiladi.

Training sample distributioni production prevalence’dan farq qilishi mumkin.

Data augmentation

Original sample’dan labelni saqlaydigan transformlar yaratiladi.

Image:

  • crop;
  • flip;
  • color.

Audio:

  • noise;
  • speed.

Text augmentation ehtiyotkor, chunki ma’no va label o‘zgarishi mumkin.

Active learning

Model eng noaniq yoki foydali samplelarni annotation uchun tanlaydi.

Bu label xarajatini kamaytirishi mumkin.

Faqat uncertainty tanlash outlierlarni ko‘p olib kelishi mumkin.

Diversity va business priority ham hisobga olinadi.

Transfer learning

Pretrained model feature representation bilan boshlanadi.

Kichik labeled datasetda fine-tuning qilinadi.

Vision, text va speechda keng tarqalgan.

Pretraining domaini juda farqli bo‘lsa foyda kamayadi.

Calibration

Classification probabilitysi real ehtimolga mos bo‘lishi kerak.

Risk va threshold qarorida calibration muhim.

Regressionda prediction interval uncertainty’ni ko‘rsatadi.

Point predictionning o‘zi yetarli emas.

Distribution shift

Production input training data’dan farq qilishi mumkin.

Sabablar:

Input va prediction drift monitoring qilinadi.

Label kechiksa sifatni baholash ham kechikadi.

Interpretability

Linear coefficient, tree importance, SHAP va local explanation model qarorini tahlil qilishga yordam beradi.

Explanation sababiy isbot emas.

Sensitive qarorlar domain ekspert va huquqiy talab bilan tekshiriladi.

Baseline

Murakkab neural modeldan oldin oddiy baseline quriladi. Classificationda majority class yoki logistic regression, regressionda mean yoki linear model ishlatilishi mumkin. Murakkab model baseline’dan sezilarli yaxshilanmasa qo‘shimcha infrastructure o‘zini oqlamasligi mumkin.

Hyperparameter tuning

Model depth, regularization, learning rate va boshqa setting validation setda tanlanadi. Juda ko‘p experiment validationga overfit qilishi mumkin. Yakuniy test set faqat tanlov tugagandan keyin ishlatiladi.

Error analysis

Noto‘g‘ri predictionlar categorylarga ajratiladi:

  • label xatosi;
  • feature yetishmasligi;
  • yangi class;
  • noaniq sample;
  • preprocessing;
  • model xatosi.

Keyingi improvement eng katta va tuzatiladigan xato guruhiga qaratiladi.

Production feedback

Real label keyinroq kelganda monitoring datasetiga qo‘shiladi. Model faqat o‘z predictioni bilan qayta train qilinmaydi.

Labeling cost

Supervised learningning asosiy cheklovlaridan biri sifatli label yaratish xarajati. Expert annotation, review va disagreement resolution vaqt talab qiladi. Label budget eng foydali samplelarga sarflanishi uchun active learning va stratified sampling ishlatilishi mumkin.

Pipeline reproducibility

Dataset versioni, split, preprocessing, feature mapping va model config birga saqlanadi. Faqat model weightini saqlash prediction qanday olinganini qayta tiklash uchun yetarli emas.

Fairness

Model xatosi barcha guruhlarda bir xil bo‘lmasligi mumkin. Overall accuracy yaxshi bo‘lsa ham ma’lum region, til yoki device’da sifat past bo‘lishi ehtimoli bor. Metriclar subgroup bo‘yicha tekshiriladi va data coverage bilan bog‘lanadi.

Bog‘liq tushunchalar

Supervised Learning, Labeled dataset, Feature, Label, Classification, Regression, Generalization, Overfitting, Validation, Transfer learning