c*1
2 楼
刚拿到的一个Project:11 features,200 observations.The response variable (
ordinal and categorical) takes on only three possible values. The goal is to
learn if there are some common characteristics which help predict the
classification of the response variable.
I apply filter-based feature selection first: I run pairwise statistic tests
for all combinations of response and predictors. I select those significant
features, run VIF tests to get rid of multicollinearity, and fit the data
to an ordered logistic regression model (with significant features).
Unfortunately it turns out almost all features are insignificant (p_value>0.
05). Hence the ordered logistic regression might not be a good choice.
因为最终目的是要找出对response有显著影响的feature并且最好能够给出magnitude
of impact，所以random forest和SVM都不适合。我正在考虑用decision tree。不知道
版上各位大牛有没有更好的建议？
ordinal and categorical) takes on only three possible values. The goal is to
learn if there are some common characteristics which help predict the
classification of the response variable.
I apply filter-based feature selection first: I run pairwise statistic tests
for all combinations of response and predictors. I select those significant
features, run VIF tests to get rid of multicollinearity, and fit the data
to an ordered logistic regression model (with significant features).
Unfortunately it turns out almost all features are insignificant (p_value>0.
05). Hence the ordered logistic regression might not be a good choice.
因为最终目的是要找出对response有显著影响的feature并且最好能够给出magnitude
of impact，所以random forest和SVM都不适合。我正在考虑用decision tree。不知道
版上各位大牛有没有更好的建议？
E*e
3 楼
3个response level，可以用multinomial logistic regresion， following standard
model variable selections。
to
tests
significant
0.
【在 c********1 的大作中提到】
: 刚拿到的一个Project:11 features,200 observations.The response variable (
: ordinal and categorical) takes on only three possible values. The goal is to
: learn if there are some common characteristics which help predict the
: classification of the response variable.
: I apply filter-based feature selection first: I run pairwise statistic tests
: for all combinations of response and predictors. I select those significant
: features, run VIF tests to get rid of multicollinearity, and fit the data
: to an ordered logistic regression model (with significant features).
: Unfortunately it turns out almost all features are insignificant (p_value>0.
: 05). Hence the ordered logistic regression might not be a good choice.
model variable selections。
to
tests
significant
0.
【在 c********1 的大作中提到】
: 刚拿到的一个Project:11 features,200 observations.The response variable (
: ordinal and categorical) takes on only three possible values. The goal is to
: learn if there are some common characteristics which help predict the
: classification of the response variable.
: I apply filter-based feature selection first: I run pairwise statistic tests
: for all combinations of response and predictors. I select those significant
: features, run VIF tests to get rid of multicollinearity, and fit the data
: to an ordered logistic regression model (with significant features).
: Unfortunately it turns out almost all features are insignificant (p_value>0.
: 05). Hence the ordered logistic regression might not be a good choice.
E*g
4 楼
randomforest为啥不行？
randomforest -> important features
输出每个feature的影响概率，而不是category
to
tests
significant
0.
【在 c********1 的大作中提到】
: 刚拿到的一个Project:11 features,200 observations.The response variable (
: ordinal and categorical) takes on only three possible values. The goal is to
: learn if there are some common characteristics which help predict the
: classification of the response variable.
: I apply filter-based feature selection first: I run pairwise statistic tests
: for all combinations of response and predictors. I select those significant
: features, run VIF tests to get rid of multicollinearity, and fit the data
: to an ordered logistic regression model (with significant features).
: Unfortunately it turns out almost all features are insignificant (p_value>0.
: 05). Hence the ordered logistic regression might not be a good choice.
randomforest -> important features
输出每个feature的影响概率，而不是category
to
tests
significant
0.
【在 c********1 的大作中提到】
: 刚拿到的一个Project:11 features,200 observations.The response variable (
: ordinal and categorical) takes on only three possible values. The goal is to
: learn if there are some common characteristics which help predict the
: classification of the response variable.
: I apply filter-based feature selection first: I run pairwise statistic tests
: for all combinations of response and predictors. I select those significant
: features, run VIF tests to get rid of multicollinearity, and fit the data
: to an ordered logistic regression model (with significant features).
: Unfortunately it turns out almost all features are insignificant (p_value>0.
: 05). Hence the ordered logistic regression might not be a good choice.
c*1
5 楼
Feature importance我也考虑过。因为project的client是基本不懂统计和ML的，
feature importance的output很难向他们解释清楚：只能笼统地说哪几个feature重要
，有多重要还真的很难解释。不像Linear regression可以用one unit change in
independent variables lead to how much change in the dependent variables, 直
观易懂。
而且我用的是R，愣是没看懂help document里对importance的output的解释，但能肯定
不是影响概率。
【在 E*********g 的大作中提到】
: randomforest为啥不行？
: randomforest -> important features
: 输出每个feature的影响概率，而不是category
:
: to
: tests
: significant
: 0.
feature importance的output很难向他们解释清楚：只能笼统地说哪几个feature重要
，有多重要还真的很难解释。不像Linear regression可以用one unit change in
independent variables lead to how much change in the dependent variables, 直
观易懂。
而且我用的是R，愣是没看懂help document里对importance的output的解释，但能肯定
不是影响概率。
【在 E*********g 的大作中提到】
: randomforest为啥不行？
: randomforest -> important features
: 输出每个feature的影响概率，而不是category
:
: to
: tests
: significant
: 0.
m*u
6 楼
lasso ?
c*1
7 楼
Good idea! Thanks!
【在 m*******u 的大作中提到】
: lasso ?
【在 m*******u 的大作中提到】
: lasso ?
E*e
8 楼
lasso 是对应于linear regression把。 你的response variables 是categorical
ones。 恐怕不行啊吧
【在 c********1 的大作中提到】
: Good idea! Thanks!
ones。 恐怕不行啊吧
【在 c********1 的大作中提到】
: Good idea! Thanks!
e*9
9 楼
Lasso可以用到Logistic regression上。。。
E*e
10 楼
oh,yes. just learned regularized logistic regression.
：Lasso可以用到Logistic regression上。。。
：Lasso可以用到Logistic regression上。。。
h*d
11 楼
to
tests
significant
0.
【在 c********1 的大作中提到】
: 刚拿到的一个Project:11 features,200 observations.The response variable (
: ordinal and categorical) takes on only three possible values. The goal is to
: learn if there are some common characteristics which help predict the
: classification of the response variable.
: I apply filter-based feature selection first: I run pairwise statistic tests
: for all combinations of response and predictors. I select those significant
: features, run VIF tests to get rid of multicollinearity, and fit the data
: to an ordered logistic regression model (with significant features).
: Unfortunately it turns out almost all features are insignificant (p_value>0.
: 05). Hence the ordered logistic regression might not be a good choice.
相关阅读
big data一般用到的硬件会是什么架构data scientist 的 code test是不是集中在数据寻找上团结内推,从我开始 (转载)numerical recipe里的快速傅立叶变换 (转载)微软data scientist positions open也来报个OFFER,大家帮忙看看要不要接 (转载)是不是IT公司的DS都不用SAS的？职业方向求建议 (转载)最近听说的两个笑话Cloudera training VM: sudo apt-get command not found问一个R的问题问个问题：一堆（1M）二维座标系的点，每个点有weight，怎么做clustering？correlation coefficient (转载)T家在线题2道跪求一篇文献感觉已经把market上的data scientist投遍了Bayesian inference一道time series的预测题data scientists 都要求 PhD吗？hive table 转换成csv文件丢数据是什么情况？