Tuning Parameters for Boosting/Bagging/Random Forest
조회 수: 4 (최근 30일)
이전 댓글 표시
Hello
I want to use tree-based classifiers for my classifiaction problem. I'm thinking about bagging, boosting (AdaBoost, LogitBoost, RUSBoost) and Random Forest but I'm unsure about the tuning parameters, i.e. which range I should search.
I'm using the TreeBagger and fitensemble method from Matlab. I'm unsure about the following parameters:
- Number of iterations / Trees
- Sampling with or without replacement? If without replacement what in bag fraction to take?
- Minimum Leaf Size
- Minimum Parent Size
- Maximum number of decision splits
- Learning rate for shrinkage
- RatioToSmallest (Every element of this vector is the sampling proportion for this class with respect to the class with fewest observations). I have highly imbalanced classes.
- MarginPrecision
- (The level of pruning and value of the pruning cost the tree should pruned to (alpha))
I would be very happy if somebody could give a quick help.
댓글 수: 0
답변 (0개)
참고 항목
카테고리
Help Center 및 File Exchange에서 Classification에 대해 자세히 알아보기
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!