Measures of association, Concordant and Discordant

Ordinal trends and finding concordant and discordant pairs


Should covariates that are not statistically significant be 'kept in' when creating a model?


Characteristic function of $Y=X_1X_2$, where $X_1$ and $X_2$ are standard normal

Moment generating function of the inner product of two gaussian random vectors


Kruskal-Wallis test for factorial design

What is the non-parametric equivalent of a two-way ANOVA that can include interactions?


How are final model coefficients estimated when using k-fold cross validation?

Training on the full dataset after cross-validation?


exact percentage change for the estimated COOP effect

Am I interpreting this coefficient correctly?


Poisson random variable conditioned on sum

Regression model for proportion or count when counts of outcome and total events are often zero


How to extract "average polyline" from a set of polylines

Managing error with GPS routes (theoretical framework?)


Newton Raphson Algorithm: negative semi definiteness

Can the empirical Hessian of an M-estimator be indefinite?


Error trying to reduce my data dimentions


How can I interpret interaction effect in my response surface results?

Is it meaningful to identify interaction effect when a main effect in a model (main effects only, without interaction terms) is not significant?


Interpretation of Linear SVM Coefficients

How does one interpret SVM feature weights?


How can adding a 2nd IV make the 1st IV significant?


Normality test with p-value equal to zero

Is normality testing 'essentially useless'?


Intuition behind why Stein's paradox only applies in dimensions $\ge 3$


How to show via Delta method that the Linear Taylor series expansion of a normal random vector results in NORMAL DISTRIBUTION

Linear combination of two dependent multivariate normal random variables


Is a model including a square root of a variable linear in the parameters?

Why is polynomial regression considered a special case of multiple linear regression?


Is it better to use MAE or MSE for perfomance measure?

Which performance measure to use when using SVM: MSE or MAE?


Principal Components, Canonical Correlation and Eigenvalue problems


In the standard deviation formula, why do you divide by n before taking the square root?

Why is the standard deviation defined as sqrt of the variance and not as the sqrt of sum of squares over N?


Q: what book on Bayesian statistics, preferably with R?

What is the best introductory Bayesian statistics textbook?


Test hypothesis point process is Poisson


Difference between Kernel classifier and linear classifier

Linear kernel and non-linear kernel for support vector machine?


Why linear regression one variable uses squared cost function?

Why do we usually choose to minimize the sum of square errors (SSE) when fitting a model?


How to Calculate F distribution given R squared?

Whats the relationship between $R^2$ and F-Test?


How can maximum likelihood be used to estimate parameters for a Weibull distribution?

EM maximum likelihood estimation for Weibull distribution


Independence of iid samples when function is applied to to one member of sample

Functions of Independent Random Variables


Is statistics is the same as mathematical modeling or is it about sophisticated guessing of a pattern between the data?

How to describe statistics in one sentence?


Trying to migrate from P values to CI... how to know when to reject null hypothesis?

Relation between confidence interval and testing statistical hypothesis for t-test


Why is controlling FDR less stringent than controlling FWER?

Power of FDR vs. FWER approaches in multiple comparisons


What does Density mean on Y-axis in qplot()?

"The total area underneath a probability density function is 1" - relative to what?


Regression with categorical predictors - use only some dummy variables

Is it advisable to drop certain levels of a categorical variable?


Reference for this claim: important features in data can be "hidden" in the higher PCA axes that are typically thrown out

Examples of PCA where PCs with low variance are "useful"


How to apply coefficient term for factors and interactive terms in a linear equation?


Cross validation before or after stepwise modeling


Large value of exp (B) in binary logistic regression SPSS what is wrong?

How to deal with perfect separation in logistic regression?


What to do when I have expected count <5 warning for a chi squared test?


Calculation of Pearson's Chi-squared statistic


Percentage of overlapping regions of two normal distributions


Why does Type I error of a test occur? Is NHST too weak to tell the truth?

Why does Type I error always occur in a NHST? Or, is NHST too weak to tell the truth?


Interpretation of the Odds-Ratio for percentage value in logistic regression

Help me understand adjusted odds ratio in logistic regression


Are two variables that are dependent also correlated? / Can two dependent variables not be correlated?


Which model fit best for semi sinusoidal data?

How to find a good fit for semi-sinusoidal model in R?


Interpretation of the regression coefficient of a proportion type independent variable


How do I make sense between difference in Eigenvalue variance and extracted some of squares variance?

What's the relationship between initial eigenvalues and sums of squared loadings in factor analysis?


conditional expectation with two signals


Bootstrap: How to do a Confidence interval for the difference of two means? (Different sample distributions)

Resampling / simulation methods: monte carlo, bootstrapping, jackknifing, cross-validation, randomization tests, and permutation tests


Why is Bayes Classifier the ideal classifier?


I want to get a Ph.D. in statistics. What books should I read after Elementary Statistics?

Advanced statistics books recommendation


Include prior knowledge in regression model


Binomial confidence interval estimation - why is it not symmetric?


The distribution of the linear combination of Gamma random variables


Multivariable logistic regression analysis and EPV (events per variable) in clinical journals?

Logistic Regression : 10 events per predictor rule


Distance between two independent normal random variable

Distribution of distance from center of sample group


Numerical sampling in hierarchical Bayesian models (HBM)

Marginalising over standard deviation of normal to get the posterior on mean


How does centering the data get rid of the intercept in regression and PCA?


Unbiased estimator of standard deviation of a normal distribution, using gamma function

Why is sample standard deviation a biased estimator of $\sigma$?


How to reverse the sign of factor loadings in factor analysis?

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Getting PCA eigenvectors with the values of opposite sign


PCA scores in my own implementation have different sign from the ones computed in R


Relationship between SVD and PCA. How to use SVD to perform PCA?


Is anything wrong with this approach to PCA?


Are categorical variables standardized differently in penalized regression?

whether to rescale indicator / binary / dummy predictors for LASSO


Why does not ridge regression perform feature selection although it makes use of regularization?

Why does the Lasso provide Variable Selection?


Are first passage times in a Brownian motion the same as the ARL in a CUSUM?


Testing Cointegration at level or with first differences?


Box plot for Likert scale 1 to 5: How is maximum equal to upper quartile?

Boxplot interpretation: is it correct that a boxplot is missing a whisker?


Computing eigenvectors for PCA: what to do about the freedom to choose the sign?


$X_i, X_j$ independent when $i≠j$, but $X_1, X_2, X_3$ dependent?

Flipping a fair coin three times: How to find independent/dependent events?


How to find straight line minimizing the sum of squares of Euclidean distances from the points?

How to perform orthogonal regression (total least squares) via PCA?


What if my overall ANOVA is significant but my poct hoc independent t-tests aren't?

Interpreting a significant 2-way interaction with post-hoc tests


How to interpolate for degrees of freedom from a $ \chi^{2} $ table

How do I find values not given in (interpolate in) statistical tables?


How do I select the number of components for independent components analysis?


Estimating process standard deviation for a quality control chart. What is $s/(c4)$ and how to calculate it in R?

Why is sample standard deviation a biased estimator of $\sigma$?


$\chi^2$ distance and multivariate gaussian distribution

What is the distribution of the Euclidean distance between two normally distributed random variables?


can ordinal variables be used as predictor for linear multiple regression analysis?


Comparing smoothing splines vs loess for smoothing?


Best performance evaluation measure for GARCH model?

Evaluate forecasting ability of GARCH models with RMSE and MAE


Mann Whitney test with unequal variances

Reporting Mann-Whitney U-Test without homogenity of variance


Understanding scipy Kolmogorov-Smirnov test

Why are p-values uniformly distributed under the null hypothesis?


What is the difference between the Mann-Whitney and Wilcoxon rank-sumtest?

Is the W statistic output by wilcox.test() in R the same as the U statistic?


Solving linear regression with weights and constraints

References for weighted linear regression with linear constraints on the coefficients?


Using principal component analysis (PCA) for feature selection in regression


Standardizing data in Principal Component Analysis?


Is there a name for this simple discrete distribution?

Understanding the parameters inside the Negative Binomial Distribution


Conceptual distinction between heteroscedasticity and non-stationarity


How to deal with an error such as "Coefficients: 14 not defined because of singularities" in R?


Removal of statistically significant intercept term increases $R^2$ in linear model


How to compute $\mathbb{P}(3x > -y > x \land x > 0 \land y < 0)$?

Find the probability of an event determined by an inequality on exponential random variables


How to interpret coefficients from a polynomial model fit?


Constructing confidence intervals for mean of means, using standard errors

How to calculate the confidence interval of the mean of means?


How to reconstruct an image after performing PCA on face image dataset (eigenfaces)?

How to perform dimensionality reduction with PCA in R


PCA on train and test datasets: do I need to merge them?


PCA on train and test datasets: should I run one PCA on train+test or two separate on train and on test?


Question about PCA: how are PC scores generated using PC eigenvectors?

How to compute PCA scores from eigendecomposition of the covariance matrix?


PCA vs SVD - understanding difference and preference of SVD over PCA


Understanding the output of SVD when used for PCA

Relationship between SVD and PCA. How to use SVD to perform PCA?


Find matching samples via Canonical Correlation Analysis (CCA)

Using canonical correlation analysis (CCA) to find matches


How do you choose the order p and q for ARMA(p,q) process for modeling a time series?


Are there any approximation for ratios of factorials (and other similar high-precision ratios with rounding issues?)

How can I prevent Overflow for the Gamma function?


Prove that this exponential kernel is positive definite


How do I normalize a vector of numbers so they are between 0 and 1?


What is regressive about a regression line?

Why are regression problems called "regression" problems?


The F-test is a test for variance so why do we use F-test in ANOVA?


Regression through origin - closed form of slope estimator?


What is the difference between residual and null deviance?

Interpreting Residual and Null Deviance in GLM R


Why is it bad to use Pearson distance in K-means clustering?

Why does k-means clustering algorithm use only Euclidean distance metric?


When does it make sense to log-transform input variables in multi-variable logistic regression?

In linear regression, when is it appropriate to use the log of an independent variable instead of the actual values?


Grouping 1D data to find intervals with most data points

How do you find a cutting point / strong slope within one-dimensional data


correlation b/w continuous and binary variables

Correlation between dichotomous and continuous variable


Non significant main effect after controlling for covariates

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


How to work out complicated forms in probability?

Can't understand probability calculation appeared in "Mining of Massive Dataset" book


Showing DF Times S-squared / sigma-squared is a chi-square

How is MSE divided by $\sigma^2$ always a chi-square distribution?


Why do we resample in bootstrap estimation?

Explaining to laypeople why bootstrapping works


Why lower order term is necessary when higher order term is compulsory

Including the interaction but not the main effects in a model


Is there a situation when one would use L1 norm over L2 norm in k-means algorithm?

Why does k-means clustering algorithm use only Euclidean distance metric?


Smaller p-values on a selective multiple regression analysis

Significant predictors become non-significant in multiple logistic regression


Is the machine learning community abusing "conditioned on" and "parametrized by"?


Why is using centered or uncentered data equivalent in ridge regression?


Proof for Irreducible Error statement in ISLR page 19

Proof/Derivation of Residual Sum of Squares (Based on Introduction to Statistical Learning)


Which optimization algorithm to use for problems with many local optima and expensive goal function?

Optimization when Cost Function Slow to Evaluate


What is the difference between the probabilistic and non-probabilistic learning methods?


Cox Regression - IVs have different hazard ratios when modelled alone than all together

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


How to determine similarity between histograms? (Which metric to use?!)

How to assess the similarity of two histograms?


First difference estimation with time dummy

Is adding a time dummy the same as estimating by within-time fixed effects?


How to calculate standard errors of the sample standard deviation (in excel)

What is the standard error of the sample standard deviation?


How to prove biased estimator with SVD of X

The proof of shrinking coefficients using ridge regression through "spectral decomposition"


For a Gaussian kernel, what is the sigma value, and how is it calculated?

Where can I read about gamma coefficient in SVM in scikit-learn?


How to formulate equation for ARIMA models?


How can it be that almost all the variance is explained by the first PC?


If I have two random variables, $X_1, X_2 \sim N(\mu, \sigma^2)$, what can I say about $X_1-X_2$?

Find the distribution of (X, X+Y) when X and Y have a given joint Normal distribution


Help with a bimodal IV - multiple regression

How would you deal with a bimodally distributed predictor variable in bivariate logistic regression?


Is likert type scale interval or ordinal?

Under what conditions should Likert scales be used as ordinal or interval data?


Taxonomy of statistical methods and bayesian techniques


Setting the conventional null hypothesis as the alternative?

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


Statistical test for one paired observation

Confidence Interval for variance given one observation


What is the expected norm $\mathbb E \lVert X \rVert$ for a multivariate normal $X \sim \mathcal N(\mu, \Sigma)$?

What is the distribution of the Euclidean distance between two normally distributed random variables?


How to plot ROC for LOOCV by hand based on output probabilities returned by SVM?

How to calculate Area Under the Curve (AUC), or the c-statistic, by hand


How can I obtain all variables from model.matrix.And not without a couple of variables?

Omitted dummy variable coefficient in OLS


What is the difference between Pearson's correlation coefficients and the correlations in linear regression analysis?

Similarities and differences between correlation and regression


Are there algorithms for computing "running" linear or logistic regression parameters?


Logistic Regression Vs Simple Regression

Logistic Regression - Error Term and its Distribution


What is the trade-off in the bias-variance trade-off?


Intepreting 'one-unit' Change in Logistic Regression

Interpretation of simple predictions to odds ratios in logistic regression


Maximum Likelihood Estimation (MLE) in layman terms


What is meant by the standard error of a maximum likelihood estimate?


Interpreting regression coefficients with a multi-level categorical variable

How to apply coefficient term for factors and interactive terms in a linear equation?


How to calculate inter-rater reliability with multiple raters and multiple categories per item?

which statistic should I use for inter-rater agreement on nominal data, multiple responses


error in SMOTE function for categorical data

R: Trouble using SMOTE package "invalid 'labels'"


A question about Latent Dirichlet Allocation model


Calculating ratio of sample data used for model fitting/training and validation


Interpreting coefficients in Linear Regression Y|X1, X2, X3

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


Using repeated-measures ANOVA to test Rater disagreement

Intraclass correlation coefficient vs. F-test (one-way ANOVA)?


Reproduce a confidence interval of linear regression in Excel

Obtaining a formula for prediction limits in a linear model (i.e.: prediction intervals)


Representing a distance matrix in the plane

What's the difference between principal component analysis and multidimensional scaling?


Adding new item to recommender's options?

How to treat rare / new items in the validation of a recommender system?


Interpretation of correlations in multilevel anallysis

How do I interpret the 'correlations of fixed effects' in my glmer output?


How do I add a "confidence rating" to something?


Standard error on median for exponential distribution


Range of successes for multivariate hypergeometric distribution

Multivariate Hypergeometric Distribution with "or more" Successes


How does controlling for variables work in multiple regression?

How exactly does one “control for other variables”?


Identify original features corresponding to high singular/principal component values

Using principal component analysis (PCA) for feature selection


Imputation of missing values for doing PCA in R


How does a uniform prior lead to the same estimates from maximum likelihood and mode of posterior?


When normalization is counter-productive

Is normalizing the features always good for classification?


What does $(X'X)^{-1}$ matrix mean in regression?

Are estimates of regression coefficients uncorrelated?


What exactly is the actual coverage probability?

Is calculating "actual coverage probability" the same thing as calculating a "credible interval"?


Regression analysis with binary independent variables

Only binary predictors -- ANOVA, regression, or other?


How to use the same PCA on test as on training in Weka?


What is the minimum sample size for using exploratory factor analysis to reduce a pool of questionnaire items?

Minimum sample size for PCA or FA when the main goal is to estimate only few components?


Does it mean anything when all items load negatively on one factor?

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


How to use SVD for dimensionality reduction to reduce the number of columns (features) of the data matrix?

Relationship between SVD and PCA. How to use SVD to perform PCA?


What is the meaning of p values and t values in statistical tests?


How to simplify $P (X|Y, Z)$ when $X$ is independent of $Y$ but not $Z$?


Positive correlation coefficient, but negative Beta weights in multiple regression

Positive correlation and negative regressor coefficient sign


Transforming the dummy values to be able to take logs


Derive squared exponential covariance function

How to prove that the radial basis function is a kernel?


what possile balancing method can I apply on a imbalanced data set?

What balancing method can I apply to an imbalanced data set?


Interpretation of p-value in hypothesis testing


Repeated Measures ANOVA and the Bonferroni post hoc test different results of significantly

Anova repeated measures is significant, but all the multiple comparisons with Bonferroni correction are not?


Can a moment generating function exist for some non-zero if the moments do not all exist?

Existence of the moment generating function and variance


How do I interpret the completeness in Statistics in practice?


Method to predict outcome as percentage of two categories?

Regression for an outcome (ratio or fraction) between 0 and 1


The density of the law of cosines applied on two normally distributed random variables

Finding the distribution of $5X_{1}^2+2X_{1}X_{2}+X_{2}^2$


Check whether a sample correlation matrix is valid

Bound for the correlation of three random variables


Are there techniques to stop learning neural network when error start growing?

Most common method for deciding when to stop training a neural net on a batch


Approximating a discrete distribution with a continuous distribution: why add/subtract 0.5/N?

Why does the continuity correction (say, the normal approximation to the binomial distribution) work?


Cointegration test with I(1) and I(0) variables

Time series: one I(1) and one I(0) variable, should I use VAR/VEC, test for cointegration?


Linear regression including categorical variables with hundreds of levels

Preprocess categorical variables with many values


categorical data Analysis with too many levels


Natural Occurrences of Normal Distribution

Can we see shape of normal curve somewhere in nature?


Why should boostrap sample size equal the original sample size?

Choosing the number of bootstrap resamples


When would a 3-layer Neural Network perform better than a 2-layer with the same number of parameters?

What is the difference between a neural network and a deep neural network, and why do the deep ones work better?


Why do residuals in linear regression always sum to zero when an intercept is included?


How to test whether $R^2 \geq c$ where $c \neq 0$?

Formula for 95% confidence interval for $R^2$


Intuition for Euclidean Distance as a measure of spread (Standard Deviation)

Why square the difference instead of taking the absolute value in standard deviation?


Mapping a value in a normal distribution

Transforming arbitrary distributions to distributions on $[0,1]$


How to do imbalanced classification in deep learning (tensorflow, RNN)?

Class imbalance in Supervised Machine Learning


Definition of symmetric random variable [in terms of distribution function ]

What is the definition of a symmetric distribution?


Does optimizing parameters of a function f(x) and of the log(f(x)) yelds the same result?

Example how maximizing and minimizing a function can be equivalent?


interpreting density function when all the values are the same

Why is my R density plot a bell curve when all datapoints are 0?


Please convince me why I should bother correcting p values with multiple comparisons, because I don't see the point

Explain the xkcd jelly bean comic: What makes it funny?


statistical test for 3 response answer satisfied , not satisfied , can't say

What are good basic statistics to use for ordinal data?


How to avoid NaN in using ReLU + Cross-Entropy?

How to apply Cross Entropy on Rectified Linear Units


What is the difference between ROC curve and Confusion matrix?

ROC curve and confusion matrix in classifier performance evaluation


How can I get cut-off point in multivariated ROC analysis

ROC and multiROC analysis: how to calculate optimal cutpoint?


Square root of inverse gamma distribution?


Inverse linear model doesn't seem exact inverse

What is the difference between linear regression on y with x and x with y?


Confidence interval for odds ratio only just containing 1

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


What is the meaning of super script 2 subscript 2 within the context of norms?


Independent assessment of a selected model


MLE for normal distribution with same mean and variance/standard deviation

$N(\theta,\theta)$: MLE for a Normal where mean=variance


Correlation between numerical and categorical data in R

Correlations with unordered categorical variables


How to interpret the variance inflation factors?

Which variance inflation factor should I be using: $\text{GVIF}$ or $\text{GVIF}^{1/(2\cdot\text{df})}$?


Understanding cost-complexity pruning in regression trees

How to choose $\alpha$ in cost-complexity pruning?


Is clustering (kmeans) appropriate for partitioning a one-dimensional array?


What violates the assumptions of regression analysis?

What is a complete list of the usual assumptions for linear regression?


Principal Component Analysis handled multicolinearity in data

Making sense of principal component analysis, eigenvectors & eigenvalues


How can I calculate the average age of survey respondents?

How to find average and median age from an aggregated frequency table


Why is cross validation better than training once with the whole data set?


Sample size for logistic regression. How to determine the number need for positive and negative cases?


How to bias a classifier for a particular class

Suggestions for cost-sensitive learning in a highly imbalanced setting


Do t-test of two sample groups with variance 0

T-test with sample standard deviation of zero. Possible?


Normalization of 'change variables' in logistic regression

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Calculating the entropy of an attribute in the ID3 algorithm when a split is perfectly classified

Alternative to Shannon's entropy when probability equal to zero


What's the conception of "linear" in linear models? Is it the same as in mathematics?

How to tell the difference between linear and non-linear regression models?


Generate data if parameters for population are known

How to simulate data that satisfy specific constraints such as having specific mean and standard deviation?


Sum and difference of independent normal variables are independent?

Independence of linear combination of multivariate distribution


Cross validation step by step description


Why is K-fold cross validation bad for time series?

Cross-validation techniques for time series data


Confusion on one-sided mannwhitney test parameters (alternative hypothesis)

Interpretation of p-value in Mann-Whitney rank test


AUC Scores greater than 1 with multi class classification in R?

How to compute precision/recall for multiclass-multilabel classification?


Multinomial logistic regression and interaction

Interpretation of main effect when interaction term is significant (ex. lme)


Why is the normalization necesary in Bayesian inference?

Why Normalizing Factor is Required in Bayes Theorem?


Transforming variables for multiple regression in R


Mathematics required for data scientist?

What math subjects would you suggest to prepare for data mining and machine learning?


What is the difference between a 2x2x2 split plot ANOVA and a 2-way repeated measures ANOVA?

Is a "split plot" ANOVA with two factors the same as two-way ANOVA with repeated measures in one factor?


Should I use ANOVA or MANOVA for this repeated measures experiment?

How to run Repeated Measures to find difference between gender (without change of condition)?


Clustering from similarity/distance matrix


Is a null model the same thing as a null hypothesis?

What is a null model in regression and how does it relate to the null hypothesis?


Family in GLM - how to choose the right one?


How is the F-Stat in a regression in R calculated


Somebody explain Training, Testing and Validation Test of Artificial Neural Network

Why only three partitions? (training, validation, test)


If KL-divergence's asymmetrical should I minimize KL(P||Q) or KL(Q||P)?

Intuition on the Kullback-Leibler (KL) Divergence


How to measure and interpret correlation between non-normal variables

Pearson's or Spearman's correlation with non-normal data


Binomial regression does not give coefficients for all IVs

Regression based for example on days of week


Why moments of expectation are known as “moments”

What exactly are moments? How are they derived?


Appropriate Test for Statistical Significant Change in Values Over Time

Is there a rising trend in Number Series


Confidence interval syntax in frequentist probability

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


A proof of total sum of squares being equal to within-cluster sum of squares and between cluster sum of squares?


How to estimate the the optimal number of clusters in a dataset by Clustering quality measures?

How to decide on the correct number of clusters?


Chosing optimal k and optimal distance-metric for k-means


what is the meaning of RMSE in caret::train


What is the difference between confidence intervals and hypothesis testing?


In boosting, if the base learner is a linear model, does the final model is just a simple linear model?

Gradient Boosting for Linear Regression - why does it not work?


How to Deal with Large Number of Dummy Variables in Machine Learning?

Principled way of collapsing categorical variables with many levels?


Categorical logit Predictor with too many different levels


Understanding values of variable importance of Random Forest in R

Interpreting output of importance of a random forest object in R


What happens when merging random variables in Dirichlet distribution?


difference between RAW regression coefficient of slope vs. Pearson's correlation (with two variables)?

How does the correlation coefficient differ from regression slope?


Why do people use standard deviation instead of variance?

What's the difference between variance and standard deviation?


How does different ways of scaling/ normalising variables in K -Means clustering effect clustering

How to understand the drawbacks of K-means


Independence of points from same underlying function


Is it realistic to achieve better results when doing PCA before neural network classification?

How can top principal components retain the predictive power on a dependent variable (or even lead to better predictions)?


Maximum likelihood estimator compared to least squares

Equivalence between least squares and MLE in Gaussian model


What does the notation like 8.6e-28 mean? What is the 'e' for?


SIgnificance Testing of an Opinion before and after an intervention

What are good basic statistics to use for ordinal data?


Does standardization compromises Principal Component Analysis?


Why is it that a variable is only significant when it is in a multivariate regression?

How can adding a 2nd IV make the 1st IV significant?


How does PCA represent all data with just a few principal components?

Making sense of principal component analysis, eigenvectors & eigenvalues


How to choose a machine learning algorithm

How to choose between learning algorithms


Asymptotic distribution of a weighted sum of chi squared variables beyond CLT?


Is it appropriate to use paired t-test for comparing two means from the same sample obtained from two different methods?

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


Why does the mean have $n-1$ degrees of freedom?

What is the difference between N and N-1 in calculating population variance?


What is the expected value and the mean of sample standard deviation?

Why is sample standard deviation a biased estimator of $\sigma$?


PCA before Random Forest Regression provide better predictive scores for my dataset than just Random Forest Regression, how to explain it?

How can top principal components retain the predictive power on a dependent variable (or even lead to better predictions)?


Share of variance explained by individual predictor

How to split r-squared between predictor variables in multiple regression?


Why is the reconstruction error for my training set larger than my test error using PCA on the MNIST data set?

Is it possible for test error to be lower than training error


How to fit a distribution of censored data?

Modelling when the dependent variable has a "cut-off"


Significant model but not the predictors? (Logistic regression)

How can a regression be significant yet all predictors be non-significant?


Why is optimisation solved with gradient descent rather than with an analytical solution?

Why use gradient descent with neural networks?


Does White noise has a Normal (Gaussian) Distribution?


My density plot in R has values beyond 1! How can I fix this?

Can a probability distribution value exceeding 1 be OK?


Hourly electricity demand data finding AR and MA terms


Find pdf for minimum of 4 random variables


Vector Calculus and Support vector machines (SVM)

Differentiation in support vector machine


Feature selection vs regulation in supervised learning

Do we still need to do feature selection while using Regularization algorithms?


Variance of a set of sample S from the means and variances of 2 partitions S1 and S2 (S=S1 U S2)

Is there a name or reference in a published journal/book for the following variance formula?


How does PCA improve the accuracy of a predictive model?

How can top principal components retain the predictive power on a dependent variable (or even lead to better predictions)?


How to interprete results from Poisson random coefficients analysis?

How to interpret the results from random coefficient Poisson data analysis


Correlation with non-normal distribution

Correlation between vegetation and erosion


How many random to get n unique integers

How often do you have to roll a 6-sided die to obtain every number at least once?


Coefficients are all zero for lasso regression

Why are all Lasso coefficients in model 0.0?


Community Detection for Complete Weighted Network


Linear Regression on sorted Dependent variable

What happens if the explanatory and response variables are sorted independently before regression?


What is proportion of variance explained in PCA?

PCA and proportion of variance explained


Why do we use zero-truncated poisson regression and do not just call outcome 1 outcome 0?

Difference between shifted distribution and zero-truncated distribution


Error function in simulation of normal random variates

Advantages of Box-Muller over inverse CDF method for simulating Normal distribution?


wilcox.test in R: W stat and p value seem to disagree

Different ways of performing the Wilcoxon rank sum test and the interpretation of the resulting W-statistic


How to choose between t-test or non-parametric test e.g. Wilcoxon in small samples


Scientific P Value with adjusted R Square

Understanding the p-value in Spearman's rank correlation


What is the relationship between a chi squared test and test of equal proportions?


Why signs of coefficients change when doing multivariate vs. univariate logit regression?

Coefficient changes sign when adding a variable in logistic regression


Dropping dummies from regression by putting them into the reference group

Can I ignore coefficients for non-significant levels of factors in a linear model?


How should one call a variable which values can be summed?

What is the terminology for data aggregated via summed totals versus data aggregated via means?


Which way of regression modelling is correct among below options, when the predictor is a product term?

Including the interaction but not the main effects in a model


Logistic regression, separating variable (moderator) true in population!

Logistic regression in R resulted in perfect separation (Hauck-Donner phenomenon). Now what?


Inference from the posterior predictive distribution


Unequal Variances: Satterthwaite vs Welch

Should I use Welch's (1947) approximate degrees of freedom or Satterthwaite's (1946)?


What size standard deviation is considered uncommonly large or small?

What does the size of the standard deviation mean?


How to interpolate for the normal distribution (or any other distribution)?

How do I find values not given in (interpolate in) statistical tables?


Why square the difference instead of taking the absolute value in standard deviation?


Suppose every family makes babies until a boy is born: will this result in gender bias in the society?

Expected number of ratio of girls vs boys birth


Is there a hypothesis test for B1 > B2 in multiple regression?

Testing whether two regression coefficients are significantly different (in R ideally)


Convergence in probability: show sequence converges


What follows if we fail to reject the null hypothesis?


Checking multivariate normality in linear regression using R

Multiple Regression, Normal distribution and Normalization


interpreting R plot of 100 t-confidence intervals on same graph.

Given a 95% confidence level, how do I demonstrate 95% of the intervals actually contain the population mean?


What is p-value in simple words and good non-mathematical examples?

What is the meaning of p values and t values in statistical tests?


Evidence for data mining (specification search) in published results

How much do we know about p-hacking "in the wild"?


Plain words (non-mathematical) explanation of the difference between Confidence Intervals, Standard Error of the Mean, and Standard Deviation?

Difference between standard error and standard deviation


Good algorithm to compute the sample mean and variance

Robust mean estimation with O(1) update efficiency


What is the correct way of standardizing data when there are training, validation and test set

How to apply standardization/normalization to train- and testset if prediction is the goal?


Can a variable become statistically significant after the addition of another variable?

How can adding a 2nd IV make the 1st IV significant?


How difficult is it to collect the full set of toys from McDonald's Happy Meal?

Probability associated with experiencing all outcomes


Explanation of statistic seen on TV (related to elections)

How to interpret the margin of error in a poll?


Multiple regression in R results different to simple linear regression?

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


Why degree of freedom in statistics is so useful?


Comparing two groups with different size on multiple continuous variables

Does one need to adjust for multiple comparisons when using MANOVA?


How to test the significant difference of two confusion matrices?

Compare classification performance of two heuristics


Confidence interval of linear regression variable calculation

Should confidence intervals for linear regression coefficients be based on the normal or $t$ distribution?


Intuition behind (statistical) completeness

What is the intuition behind defining completeness in a statistic as being impossible to form an unbiased estimator of $0$ from it?


Sum of multiple probability distributions


Do the principal components change if we apply PCA more than once (recursively) on data?


Why is there usually no correction for multiple comparisons in Bayesian statistics?

Why don't Bayesian methods require multiple testing corrections?


Calculating interrater agreement for multiple choice questions

which statistic should I use for inter-rater agreement on nominal data, multiple responses


Computing SD for function of two RV's in R gives wrong results

What is the demonstration of the variance of the difference of two dependent variables?


Does the variance of a sum equal the sum of the variances?


Why leverage measure the distance of the ith observation from the center of the x space?

Prove the relation between Mahalanobis distance and Leverage?


What's so 'moment' about 'moments' of a probability distribution?


How to deal with implausible answers to filter questions?

How do I clean up inconsistent survey data?


How can the density of a truncated normal distribution be greater than one?

Can a probability distribution value exceeding 1 be OK?


Is there a mathematical expression that shows how LASSO shrinks coefficients (including some to zero)?

Why does the Lasso provide Variable Selection?


Formal proof that a subsample of a random sample is representative

Subsample of a random sample: random sample?


How can I handle autocorrelated residuals?

Residual autocorrelation versus lagged dependent variable


Hypothesis testing on ratio of poisson means/rates with four parameters

Poisson Hypothesis Testing for Two Parameters


What is the difference between jackknifing and LOOCV?


What are the benefits of a "deep" over a "shallow" architectures?

Why are neural networks becoming deeper, but not wider?


what type of hypotheses does "goodness of fit" signifies , i.e is it single tailed or two tailed?


Why score test, Wald test, Likelihood Ratio Test etc?

Why do my p-values differ between logistic regression output, chi-squared test, and the confidence interval for the OR?


Theory: Logistic Regression MLE does not exist when data are perfectly separable?

Understanding complete separation for logistic regression


How does SVD work for recommender systems (in the presence of missing data)?

How do I use the SVD in collaborative filtering?


Likelihood simplex distribution and model simulation

Simulating draws from a Uniform Distribution using draws from a Normal Distribution


How does one evaluate a prediction confidence for an SVM?

How to estimate confidence level for SVM or Random Forest?


How to obtain Beta distribution's shape parameter given its quantiles

Determining beta distribution parameters $\alpha$ and $\beta$ from two arbitrary points (quantiles)


Approximate order statistics for Half-normal probability plot


Software for drawing bayesian networks (graphical models)


Dropping main effect while retaining interaction effect

Including the interaction but not the main effects in a model


If someone has been diagnosed with a disease does he actually have the disease?

Interpretation of Bayes Theorem applied to positive mammography results


What is the good use for t-SNE, apart from data visualization?


PCA on data having more dimensions than observations

Why are there only $n-1$ principal components for $n$ data if the number of dimensions is $\ge n$?


How to interpret coefficients in a Poisson regression?


R - Analysis of a Qualitative Predictor with 30 levels

Can I ignore coefficients for non-significant levels of factors in a linear model?


Family in GLM - how to choose the right one?


Is it possible to have a point estimate outside of confidence interval?

How can the confidence interval for standard deviation not include the sample standard deviation?


How do I calculate the running variance?

Online estimation of variance with limited memory


PCA rotation and principal component scores

How to compute varimax-rotated principal components in R?


What is the probability that a coin is a loaded coin?


Generating i.i.d samples in MATLAB: large p-values

What is the meaning of p values and t values in statistical tests?


How can I find the distribution of sample mean of Cauchy distribution?

What is the distribution of sample means of a Cauchy distribution?


How often do you have to roll a 6-sided die to obtain every number at least once?


On standardizing features for glmnet during a nested CV


Is R's glm function useless in a big data / machine learning setting?

Logistic regression in R resulted in perfect separation (Hauck-Donner phenomenon). Now what?


Calculate expected values using logistic regression coefficients


Computing 1st principal direction of 3 points in 2D

Making sense of principal component analysis, eigenvectors & eigenvalues


overdispersion test for poisson distribution in generalized linear model

Overdispersion and Underdispersion in Negative Binomial/Poisson Regression


Clustering unrelated (with no correlation) data


What to do with a very big sample size? (effect size)

Are large data sets inappropriate for hypothesis testing?


Sampling from matrix-variate normal distribution with singular covariances?

Generate normally distributed random numbers with non positive-definite covariance matrix


When finding outliers from the Interquartile range why I have to multiply by 1.5?


Simulating survival times following a Weibull (or lognormal) distribution with ?% of right-censored observation


Questions on PCA: when are PCs independent? why is PCA sensitive to scaling? why are PCs constrained to be orthogonal?


What's the difference between a confidence interval and a credible interval?


Logistic regression in R ; glm.fit: fitted probabilities numerically 0 or 1 occurred

How to deal with perfect separation in logistic regression?


Problem with one variable in a binary logistic regression


Must the graph of a linear model always be a straight line of the form $y=mx+b$?

Why is polynomial regression considered a special case of multiple linear regression?


Question regarding two independent Poisson processess

Two independent Poisson process question


With X being a continous random variable, what prove satisfies Var(X)≤1/4


How to calculate percentiles from z-scores

Evaluate definite interval of normal distribution


OLS / MLS estimation with sum of the beta = 1?

References for weighted linear regression with linear constraints on the coefficients?


Advantages of using centroids vs component-wise medians during clustering


In clustering, what is the analogous of the centroid that uses the median instead of the mean?

Representative point of a cluster with L1 distance


What is the intuition on fixed and random effects models?

What is the difference between fixed effect, random effect and mixed effect models?


Tools to measure the nonrandomness of databases


Are the predictions from Random Forest Regression bounded by the max and min in the data set?

Random forest regression not predicting higher than training data


Matrix Identity Related to the Gauss-Markov Theorem

Interpretation of $\mathbf{y}^T(\mathbf{I}-\mathbf{H})\mathbf{y}$ in OLS


Calculate expected values using logistic regression coefficients

Output of Logistic Regression Prediction


P-value (statistics) T-test Analysis of Variance (statistics) +2 What does p-value of 0.7624 mean in a t test with two groups of relevation?

What is the meaning of p values and t values in statistical tests?


Check whether a sample correlation matrix is valid

Completing a 3x3 correlation matrix: two coefficients of the three given


How does iterative reweighted least squares actually produce estimates that maximise likelihood?

Can you give a simple intuitive explanation of IRLS method to find the MLE of a GLM?


Goodness of fit and which model to choose linear regression or Poisson


Cosine Distance as Similarity Measure in KMeans

Why does k-means clustering algorithm use only Euclidean distance metric?


Where does the Kullback-Leibler come from?

Intuition on the Kullback-Leibler (KL) Divergence


How to convert fully connected layer into convolutional layer?

A few clarifications regarding convolutional neural networks


Average of all data vs. average of group averages

Should I make decisions based on micro-averaged or macro-averaged evaluation measures?


why three-way interaction is not significant

Why two-way interaction is significant, but three-way interaction is not


Calculating covariance of a linear combination of random variables, negative random variable?

Covariance of a variable and a linear combination of other variables


Choosing the best method to test how random are P/RNGs


Multiple Regression - Significant model but one variable does not significantly predict the behaviour.

Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


How does the Rectified Linear Unit (ReLU) activation function produce non-linear interaction of its inputs?

Why are rectified linear units considered non-linear?


What, precisely, is a confidence interval?


What is the meaning of p values and t values in statistical tests?


How to get loadings and scores of a matrix basing of PCA

Making sense of principal component analysis, eigenvectors & eigenvalues


How do we determine the Cut off Probability percent in logistic Regression to segregate customer into good and bad?

Logistic regression: class probabilities


what does the length of arrows represent in the correlation circle plot in pca analysis?


Sklearn - Choosing the right model for supervised learning/classification task


Partial derivative of normal cdf w.r.t sigma

How to get the derivative of a normal distribution w.r.t its parameters?


Rare events modelling - value of coefficients


How to correctly tell the cumulative probability of a 3sf value from a 2sf normal dist. table?

What do the remaining columns (after column 2) in a Z table mean


What is a complete list of the usual assumptions for linear regression?


Binary logistic regression: Wrong labels for the regression coefficients

R linear regression categorical variable "hidden" value


Regression with percentage response variable (ratio of two counts but the counts themselves are not available) in R

Regression for an outcome (ratio or fraction) between 0 and 1


Finding residual and error term of a regression model

Definition of residuals versus prediction errors?


About SVM cost and gamma parameters tuning


Simulate Geometric Brownian Motion Path with Fixed Starting AND Ending Points

Simulating a Brownian Excursion using a Brownian Bridge?


What is the distribution of the sum of non i.i.d. gaussian variates?


Why probability distribution function gives "~.40" probability when it should have been 1.0?

Can a probability distribution value exceeding 1 be OK?


Generating random number based on random samples

Given a series of numbers, generate new numbers that are "similar" to the original numbers


Explaining to laypeople why bootstrapping works


Is there a minimum sample size required for the t-test to be valid?


Interpreting matrices of SVD in practical applications

Relationship between SVD and PCA. How to use SVD to perform PCA?


Are there examples of more informative PCA plots?


Boundaries on correlation coefficient given five other correlations

Bound for the correlation of three random variables


Questions on PCA: when are PCs independent? why is PCA sensitive to scaling? why are PCs constrained to be orthogonal?


A problem with deriving posterior of particle filter

Why $p(y_n|y_{0:n-1})$ is a constant in Kalman filter derivation?


Can averaging all the variables be seen as a crude form of PCA?


What exactly is weakly informative prior?


Correlation between a continuous variable and a discrete quantitative, count variable

Correlation between continuous data and count data


dropping number of levels in nominal features

Principled way of collapsing categorical variables with many levels?


Examples of a statistical result being counterintuitive


Why are principal components in PCA (eigenvectors of the covariance matrix) mutually orthogonal?


Resolving skew and determining the back transformation function

How small a quantity should be added to x to avoid taking the log of zero?


What is the meaning of p values and t values in statistical tests?


What is wrong with this self-made array shuffling algorithm?

What is wrong with this "naive" shuffling algorithm?


How to remove the NA from summary of glm?

Interpreting linear regression with NA for estimates


About inversing the logistic transformation and get a closed form solution for logistic regression

Why is GLM different than an LM with transformed variable


Correlation of linear combination of random variables

Question on the correlation between two dependent variables


Why there are two different logistic loss formulation / notations?


Calculating probabilities using cox regression


Handling datasets with categorical variables of many levels


Chi Square and t test to select variables for logistic regression

Algorithms for automatic model selection


using mixed effect logistic regression properly

How to build a Mixed Effects Logistic regression Model?


problems in doing logistic regression with unbalanced sample, give me some references

Does an unbalanced sample matter when doing logistic regression?


Inverse CDF of a Student's t-Distribution

Mathematically, how are the critical t values calculated?


How to interpret ggbiplot() visualization of PCA in R?


Unsure about repeated error in Poisson GML offset model

Should I use an offset for my Poisson GLM?


how do you determine the growth rate in from the linear model?


High Level Elementary Statistics Textbook

Introduction to statistics for mathematicians


Are Bayesian and Frequentists approaches mutually exclusive, contradictory?

Examples of Bayesian and frequentist approach giving different answers


What justifies this calculation of the derivative of a matrix function?


Completing a 3x3 correlation matrix: two coefficients of the three given


Minimum covariance of 2 random variables given the covariance of each with a third random variable


Why is median age a better statistic than mean age?


Calculating a composite index in PCA using several principal components

Creating a single index from several principal components or factors retained from PCA/FA


Calculating agreement (Cohen's kappa) when each rater can choose a different number of codes

which statistic should I use for inter-rater agreement on nominal data, multiple responses


If $Y| \mu \sim N(\mu, A)$ and $\mu \sim N(\mu_0, B)$, showing the marginal of $Y$ is $Y \sim N(\mu_0, A+B)$

completing the square for Gaussian multivariate estimation


Correlation and significance testing between continuous and discrete data

How to correctly assess the correlation between ordinal and a continuous variable?


Is a strong background in maths a total requisite for ML?


Is that true Newton's Method / Quasi Newton Method are not widely used in deep neutral network training?

Why use gradient descent with neural networks?


What is the minimum number of "cases" for minority class to perform logistic regression?


Definition of autocorrelation time (for effective sample size)


What is the meaning of p values and t values in statistical tests?


Sampling from marginal distribution using joint sample?

Sampling from marginal distribution using conditional distribution?


How can I tell if my variable is discrete or continuous?

What is the difference between discrete data and continuous data?


why the diagonal elements of the inverted correlation matrix is related to correlation with all other variables

Why does inversion of a covariance matrix yield partial correlations between random variables?


Fitting to an Exponential Decay with Constant Background


Clustering variables of mixed types in R

How to use both binary and continuous variables together in clustering?


How to measure clustering algorithm performance?

How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?


Formula for B values in Multiple Regression

How to derive the least square estimator for multiple linear regression?


Is there a database for non time series data sets?


Is R output reliable (specially IRT package ltm)

Is the R language reliable for the field of economics?


White test confirms heteroskedasticity while Breusch-Pagan test doesn't

Breusch–Pagan test for heteroscedasticity contradicts White's test?


What is the difference between Restricted Maximum Likelihood (REML) and Maximum Likelihood (ML)?

What is "restricted maximum likelihood" and when should it be used?


Good algorithm to compute the sample mean and variance

How do I compute/estimate the variance of sequential data?


Calculate p-value for difference between ICC values

How to test whether ICCs from different groups are significantly different?


Does a confidence interval for an estimator allow me to evaluate a hypothesis?

What is the difference between confidence intervals and hypothesis testing?


Boxplot interpretation: is it correct that a boxplot is missing a whisker?


Does the cost function for logistic regression use log base 10 or natural logarithm?

In statistics, should I assume $\log$ to mean $\log_{10}$ or the natural logarithm $\ln$?


Intuition behind a conditional probability problem

How to develop intuition for conditional probability?


Testing normality of variables for large set of observations

Testing large dataset for normality - how and is it reliable?


Justifying an early equation from *Introduction to Statistical Learning*

Proof/Derivation of Residual Sum of Squares (Based on Introduction to Statistical Learning)


Why autocorrelation affects OLS coefficient standard errors?


How to deal with big data sets (big $n$) in R? (beginner question)

What to do when your likelihood function has a double product with small values near zero - log transform doesn't work?


How to obtain the equation of a predictive interval around the regression line in R?


How is interpolation related to the concept of regression?


Is it accepted to fit model with standardized data and predict on non-standardized data?

Implementing linear regression with standardization


What to do first when there are violations of assumption in Simple Regression?

In what order should you do linear regression diagnostics?


Transformation methods : cumulative distribution function

Probability density of sum of two beta random variables


Questions concerning GARCH modelling in R (mean equation, forecast evaluation)

ARMA lag selection for ARMA-GARCH models


What do the four coloured areas of this p-value distribution actually represent?

What is the link (discrepancy?) between these PDF/CDF and p-value distributions?


Caret gives non-zero test R-squared with linear model without predictors: why?


Where do the assumptions for linear regression come from?

What is a complete list of the usual assumptions for linear regression?


Two or more time series. What is the best way to test whether one of them is leading and by what time period?


Random effect equal to 0 in generalized linear mixed model

Why do I get zero variance of a random effect in my mixed model, despite some variation in the data?


Is there an online / incremental / parallel version of t-SNE

Are there any versions of t-SNE for streaming data?


Correlation between scale and categorical variable

Correlations between continuous and categorical (nominal) variables


Practical description of LOESS and smoothing splines?


Difference between multinomial and one vs rest schemes in logistic regression

Multinomial logistic regression vs one-vs-rest binary logistic regression


Correlations with unordered categorical variables


Closed form and gradient calculation for linear regression


Bivariate normal distribution contour plot, density values

How to determine quantiles (isolines?) of a multivariate normal distribution


Connection between adjusted R-squared and t-ratio

How is adjusted coefficient of determination ($R^2$) linked to the F-values of a test against zero when adding a new variable?


class imbalance problem in machine learning

Class imbalance in Supervised Machine Learning


Looking for candidate functions for a "flat top" bell-shaped curve


Classification where we are more confident in some training samples than others

Supervised learning with uncertain data?


Distance between two probability distributions

Motivation for Kolmogorov distance between distributions


How does word co-occurrence let two words from the same topic link together in LDA topic model?

Topic models and word co-occurrence methods


Chi Square Tests throws varying p-value results

Why are p-values uniformly distributed under the null hypothesis?


What are the effects of depth and width in deep neural networks?

What is the difference between a neural network and a deep neural network, and why do the deep ones work better?


How to calculate the optimal number of bins for severly skewed data

Calculating the optimal number of bins for severely skewed data


Can Mann Whitney U test be used for uneven sample sizes?

Mann-Whitney U test with unequal sample sizes


Why I should use Bayesian inference with uninformative prior?

Why would someone use a Bayesian approach with a 'noninformative' improper prior instead of the classical approach?


How to test the statistical significance for categorical variable in linear regression?


What is the importance of the concept of probability space?

Why do we need sigma-algebras to define probability spaces?


Principal axes, what are they and how to decide them?

Making sense of principal component analysis, eigenvectors & eigenvalues


Does "Markov Chain Monte Carlo" method really need "Markov Chain"?

What is the connection between Markov chain and Markov chain monte carlo


Breakthrough/Cutting Edge Statistical Methods

What are the breakthroughs in Statistics of the past 15 years?


What references should be cited to support using 30 as a large enough sample size?


"Frequency" value for seconds/minutes intervals data in R


Optimal seasonality (frequency) value for Holt-Winters in time series prediction

Period detection of a generic time series


Random Forest after PCA results don't make sense

What can cause PCA to worsen results of a classifier?


Reversing SVD back to the original variables

How to reverse PCA and reconstruct original variables from several principal components?


How do I remove the first principal component from a data set, while keeping it in the original coordinates?


Given Bernoulli probability, how to draw a Bernoulli from a uniform distribution

Simple scheme to sample from the Bernoulli distribution


Why P>0.5 cutoff is not "optimal" for logistic regression?

How do you report percentage accuracy for glmnet logistic regression?


Contradiction between the Law of Large Numbers and the Gambler's Fallacy?

Does 10 heads in a row increase the chance of the next toss being a tail?


How to determine whether a given likelihood function has a conjugate prior?

Having a conjugate prior: Deep property or mathematical accident?


Is it possible to prove a null hypothesis?


Find confidence level when sampled Bernoulli trials are all successes

How to tell the probability of failure if there were no failures?


Chi2 test on big uniformly random sample

Why are p-values uniformly distributed under the null hypothesis?


PCA standard deviations reported by princomp() in R do not match eigenvalues of the covariance matrix

Why do the R functions 'princomp' and 'prcomp' give different eigenvalues?


What does the cost (C) parameter mean in SVM?


The central limit theorem, What it means

What intuitive explanation is there for the central limit theorem?


Why do we use expectation in reinforcement learning?


Can PCA help me in determining effect of multiple variables on other variable?

Can I use PCA (or should I use regression) for testing the effect of multiple variables on one dependent variable?


If P(a,b|c) is known, how do I find P(a|c) and P(b|c)

How to compute a marginal probability function from a joint probability function?


Is there a difference between a bivariate VAR and an AR?

What is the difference between AR and VAR?


Non-Normal data in multiple linear regression

Normality of dependent variable = normality of residuals?


Principal Component Analysis PCA Terms and relationships: eigenvalues, eigenvectors, loadings, score matrix, and SVD

Relationship between SVD and PCA. How to use SVD to perform PCA?


Is it unusual for the MEAN to outperform ARIMA?


Predicting values in a given range [0, 1] (not probability)

Regression for an outcome (ratio or fraction) between 0 and 1


x amount of people drink coffee, y amount of people drink tea, z amount of people drink both


Number of lags to use in Engle's ARCH-LM test


What is the difference between a correlation coefficient and a regression coefficient?

Similarities and differences between correlation and regression


Which type of data are answers to this question, and which test should I use?

What are good basic statistics to use for ordinal data?


What is meant by the variance of *functions* in *Introduction to Statistical Learning*?


Generalized linear model - confused by definition


When is $\mathbb{E}\left[\frac{1}{\sum X_{i}}\right] = \frac{1}{\mathbb{E}\left[\sum X_{i}\right]}$?

Constructing example showing $\mathbb{E}(X^{-1})=(\mathbb{E}(X))^{-1}$


What are the differences between Ridge regression using R's glmnet and Python's scikit-learn?


How to take population size into account when running a Poisson regression?

When to use an offset in a Poisson regression?


Interpretation of the Mann-Whiteny U test

Why is the Mann–Whitney U test significant when the medians are equal?


What does the notation like 8.6e-28 mean? What is the 'e' for?


extremely strange logistic regression results

How to deal with perfect separation in logistic regression?


Evaluate the probability of my experiment being deteministic AKA what tis the chance of something which has never happened happening?

Confidence interval around binomial estimate of 0 or 1


How does a Support Vector Machine (SVM) work?


Clustering coordinates into groups of size n

Clustering procedure where each cluster has an equal number of points?


Interpretation of significant interaction term, but insignificant joint effect

How to interpret the significant interaction of two non-significant main predictors?


How to find the correlation between two lines over a time range?

How to use Pearson correlation correctly with time series


What does it mean by independently and identically distributed random variables?

Are "random sample" and "iid random variable" synonyms?


Kaiser Rule to select best principal components

The advantages and disadvantages of using Kaiser Rule to select the number of principal components


Using Kaiser rule to select the best principal components: pros and cons


Analytical solution to marginal likelihood/normalizing constant

How to compute the marginal likelihood given two multivariate Normal distribution?


What is the meaning of p values and t values in statistical tests?


Converting (normalizing) very small likelihood values to probability


What do the subscripts in expectations mean in loss function


Interpeting residuals in a binary model (logistic regression, glm)


In residual sum of squares, why do we need to square?

Why squared residuals instead of absolute residuals in OLS estimation?


K-means clustering: is data set standardization strongly advised?

Are mean normalization and feature scaling needed for k-means clustering?


Can principal component analysis be applied to datasets containing a mix of Ordinal and binary variables?

Doing principal component analysis or factor analysis on binary data


Neural Network, questions on DropOut process

How to explain dropout regularization in simple terms?


How to do Time Series analysis with only 10 data points


When wouldn't I use LASSO for model selection?

What are disadvantages of using the lasso for variable selection for regression?


N/A (Not Applicable) cases, How to deal with it?

How is missing data calculated on Likert Scale?


Implementation of PCA using SVD without creating covariance matrix

Relationship between SVD and PCA. How to use SVD to perform PCA?


Approximate likelihood of covariance matrix by bootstrapping?

Questions on parametric and non-parametric bootstrap


Should word embedding vectors be normalized before being used as inputs?

Should I normalize word2vec's word vectors before using them?


Correct way to perform cross-validation when PCA is involved


How to justify the usage of "Radial Basis Function" as a kernel for SVM


Understanding the weights of a neural network


Why do loadings of princomp in R report identical proportion of variance for all principal components?

What is the difference between summary() and loadings() for princomp() object in R?


Reconstruction of original dataset through loadings in PCA

How to reverse PCA and reconstruct original variables from several principal components?


Can I ignore multicolinearity problem if all the regression coefficients are highly significant?

Is multicolinearity problem ignorable under this situation?


What is maximum likelihood estimation in logistic regression?

Maximum Likelihood Estimation (MLE) in layman terms


Non-Parametric ANOVA: Repeated Measures with Replication

Non-parametric test for repeated measures and post-hoc single comparisons in R?


Is the LogSumExp trick really necessary for Naive Bayes?

Example of how the log-sum-exp trick works in Naive Bayes


How to use log probabilities for Gaussian Naive Bayes?


Intuition on the Kullback-Leibler (KL) Divergence


How to randomly sample values given the extremly small and large log-probabilities?

How do I sample from a discrete (categorical) distribution in log space?


Which one would perform better: logistic regression or discriminant analysis?

Discriminant analysis vs logistic regression


How do I test whether means are equal when I have summary stats for 2 samples from one population and for 1 sample from a second?

How to calculate pooled variance of two or more groups given known group variances, means, and sample sizes?


How come ""mathematically"" that lasso shrinks the coefficient towards zero whereas ridge does not?

Why will ridge regression not shrink some coefficients to zero like lasso?


Does the range of a variable make a difference to its weight in principle component analysis?


Identify outliers using statistics methods

Detecting outliers using standard deviations


how do you show that the average number of periods is 1/(1-a)

Waiting time for successive occurrences of a result, when rolling a die


How does one interpret the last two symbols/letters "E4" in an arithmetic mean?

What does the notation like 8.6e-28 mean? What is the 'e' for?


Are the coordinates of a multinomial distributed as binomials?

Can multinomial distribution be simulated by a sequence of binomial draws?


What is the expected number of occurrences of a 9-mer in 500 random DNA strings, each of length 1000?

Probability of finding a particular sequence of base pairs


Proving Independence of Functions of Random Variables

Functions of Independent Random Variables


Does PCA create new features or give weights to old ones?

Making sense of principal component analysis, eigenvectors & eigenvalues


What is the difference between generalized estimating equations and GLMM?


What does the matrix $\frac{1}{n-1} X^{t}X$ represent?

Is there an intuitive interpretation of $A^TA$ for a data matrix $A$?


How did you learn Bayesian statistics and what would you recommend as a reliable source?

What is the best introductory Bayesian statistics textbook?


Discovering interactions and transformations

Discovering transformations and interactions


Simple Analysis of Likert Result with Mode and Median


Interpreting results of cubic regression

How to interpret coefficients from a polynomial model fit?


What do the parameters A, B, and C do in an equation of the form $Y = A + Be^{CX}$?

Why is nls() giving me "singular gradient matrix at initial parameter estimates" errors?


Why square the difference instead of taking the absolute value in standard deviation?


Estimating the error in the standard deviation

What is the standard error of the sample standard deviation?


My dataset has only positive values. Why do I get some negative PCA scores?

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Difference between correlation and covariance: is covariance only useful if the relation is linear?

How would you explain covariance to someone who understands only the mean?


Is there a minimum number of sample size when running an independent sample t-test?

Is there a minimum sample size required for the t-test to be valid?


why correlation coefficient is an indicator of a linear relationship?


How to remove technical noise by discarding several leading PCA components?

How to reverse PCA and reconstruct original variables from several principal components?


How to interpret the R2 in univariate regression analysis?


Clustering on a data set with mixed variables

How to use both binary and continuous variables together in clustering?


Adding more features improves the variance explained by PCA but the prediction model performs worse

How can top principal components retain the predictive power on a dependent variable (or even lead to better predictions)?


How to cope with class over-representation

Opinions about Oversampling in general, and the SMOTE algorithm in particular


If you normalise a likelihood function, does it become a valid and probability distribution.

What is the reason that a likelihood function is not a pdf?


Goodness-of-fit tests for logistic regression

Goodness-of-fit test in Logistic regression; which 'fit' do we want to test?


deriving z score for 95% confidence interval

Why the CDF for the Normal Distribution can not be expressed as a closed form function?


Support Vector Machines: C-parameters and the number of Support Vectors

SVM: Why does the number of support vectors decrease when C is increased?


How to improve a model which shows a drift effect in the residual plot?

Residuals correlated positively with response variable strongly in linear regression


Why do we use logistic regression instead of linear regression?


What is the point of putting two lstm cells one after another?

What are the advantages of stacking multiple LSTMs?


Using offset in binomial model to account for increased numbers of patients


Interpreting coefficients for multinomial regression with >2 classes?

Interpreting exp(B) in multinomial logistic regression


Bootstrapping as a way of learning about the population


Can I use OLS to estimate an ARX(1) model?

What's wrong if I fit the auto-regression with OLS?


The formula of a coefficient from a regression with 3 independent variables (not in matrix form)

Explicit solution for linear regression with two predictors


Is it good practice to add 1 to 0 scores in log-normalization?

How small a quantity should be added to x to avoid taking the log of zero?


Understanding the significance of very small p-values

How should tiny $p$-values be reported? (and why does R put a minimum on 2.22e-16?)


Does it make sense to add the principal components together to produce a single index?

Creating a single index from several principal components or factors retained from PCA/FA


Linear Regression: Consequences of Violating Assumptions?

What is a complete list of the usual assumptions for linear regression?


Source of least square estimator of Poisson parameter

Least Squares Estimation of Poisson Parameter


Regression proof for decomposition of sums of squares


Variance of log($X_{\lambda}$) where $X_{\lambda}$ is a exponential function?

Expected log value of noncentral exponential distribution


Maximum likelihood estimator of the exponential distribution with two same parameter

It is required to obtain the method of moment estimator and maximum likelihood estimator of a exponential distribution with two parameters


Book on designing clinical trials in oncology


Sum of two independent Student t variables with same dof is t distributed?

What is the distribution of the difference of two-t-distributions


Why is median the solution to absolute difference, but mean is the solution to squared difference?


When to use the Wilcoxon rank-sum test instead of the unpaired t-test?


Time series: Getting from monthly to semi-annually data by summing - how to determine the forecast interval?

Forecast total for a year given monthly time series


Interpreting the value of standard errors

How to interpret coefficient standard errors in linear regression?


how to interpret Interaction term in generalized linear model


How to proof relationship between inverse covariance matrix and linear regression coefficients?

Proof of normal equation in regression using tensor notation


How to draw ROC curve with three response variable?

How to plot ROC curves in multiclass classification?


Rule of thumb for number of bootstrap samples


Where can I find useful R tutorials with various implementations?


Books covering how to conduct a meta-anlysis

Looking for good introductory treatment of meta-analysis


How to compute probabilities of normally distributed variables?


normalising constant on exponential of exponential

Normalising Constant for exponentiated function


In R, how do I fit a student-t distribution to a set of empirical data?

Fitting t distribtution to financial data


Analyzing reflected and transformed variables II

How do we interpret the results of regression for log transformed data containing negative values, $\log(Y-\min(Y)+1)$?


What are the pros and cons of standardizing variable in presence of an interaction?

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Explaining p-value to a sophisticated layman

What is the meaning of p values and t values in statistical tests?


Where can I find a citable reference for the formula for inverse distributions?

Intuitive explanation for density of transformed variable?


Correlation between binary data and ordinal data

How do you estimate correlations between ordinal and binary data in SPSS?


how can I predict a variable using a correlated variable?

Using x to predict y when they are highly correlated


Constraining predicted probabilities of a poisson regression with a binary outcome

How to estimate Relative Risks in Multivariate Binary Logistic Regression Models, instead of Odds Ratios?


Multilabel classification versus yes/no classification for each class (with label priority)?

Training N classifiers for N labels vs one classifier with N labels


Distribution of quadratic form of multivariate normal with linear term

What is the moment generating function of the generalized (multivariate) chi-square distribution?


How are statistics on scientific papers inferred?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Problem with Mann-Whitney U-test for large samples

Are large data sets inappropriate for hypothesis testing?


How does Principal Coordinate Analysis (PCoA) work, as compared to PCA?

What's the difference between principal component analysis and multidimensional scaling?


PCA: Eigenvectors of opposite sign and not being able to compute eigenvectors with `solve` in R


Power calculation in a Bayesian approach

Power analysis from Bayesian point of view


How to add two dependent random variables?


Is there such thing as a case-weighted PCA?


Cluster robust standard errors in plm package

Standard error clustering in R (either manually or in plm)


which is the probability that $Y_1>Y_2$ with $Y_1, Y_2$ i.i.d

Proof that the probability of one RV being larger than $n-1$ others is $\frac{1}{n}$


Good introductory material for bootstrap?

Best suggested textbooks on Bootstrap resampling?


'68–95–99.7 rule' equivalent for multivariate normal distribution


BoxCox transformation suggest natural logarithm transformation. Can log10 transformation be used instead?


Usefulness of Z-normalization in Machine Learning

Is it a good practice to always scale/normalize data for machine learning?


Anscombe-like datasets with the same box and whiskers plot (mean/std/median/MAD/min/max)

Datasets constructed for a purpose similar to that of Anscombe's quartet


Using principal component analysis (PCA) for feature selection


Prove that sum of uniform distribution (-1,1) is also uniform (-n,n)?

Consider the sum of $n$ uniform distributions on $[0,1]$, or $Z_n$. Why does the cusp in the PDF of $Z_n$ disappear for $n \geq 3$?


Significant correlation but in regression analysis Beta is insignificant. How come?

Significant predictors become non-significant in multiple logistic regression


Why include insignificant main term when interaction term is included?

Including the interaction but not the main effects in a model


Why do we need to normalize data before applying penalizing methods in the framework of regression?

Question about standardizing in ridge regression


Better way to normalize this kind of data where samples are very similar to each other?

How to deal with a data-set having all the samples with every feature-point almost similar?


How can $R^2$ have two different values for the same regression (without an intercept)

Removal of statistically significant intercept term increases $R^2$ in linear model


What references should be cited to support using 30 as a large enough sample size?


Fitting models in R where coefficients are subject to linear restriction(s)?


Can collinearity of variables impact Principal Components

Is PCA unstable under multicollinearity?


Interpretation of ADF(Augmented Dickey-Fuller) and KPSS(Kwiatkowski–Phillips–Schmidt–Shin) tests for time series

Interpretation of ADF(Augmented Dickey-Fuller) and KPSS (Kwiatkowski–Phillips–Schmidt–Shin) tests for time series


SVD for PCA: Why would one standardize the data matrix?


Trying to understand the fitted vs residual plot?

What does this residuals versus fitted plot mean about my model?


Why have deep neural networks risen in popularity?

Why are neural networks becoming deeper, but not wider?


Is this a reverse Birthday Problem problem?

A reverse birthday problem: no pair out of 1 million aliens shares a birthday; what is their year length?


After running SVD, how do I project new data onto the lower-rank space?

Rotating a new matrix into the same basis as another using SVD


Derive the distribution of $X +\frac{a Y}{Y+b}$, with $X$ and $Y$ are exp. r.v

CDF of $\frac{X_1X_2}{X_1+X_2+a}$, where $X_1$ and $X_2$ have exp. distributions


Pearson's test of Correlation or Spearman's test?

Pearson's or Spearman's correlation with non-normal data


Am I approaching low probability events in my neural network correctly?

Binary classification with strongly unbalanced classes


How do I choose the right loss function , logarithmic loss for 0/1 or exponential loss for -1/1?

Is the logit function always the best for regression modeling of binary data?


Understanding "we lose degrees of freedom in product deviations"?

Why shouldn't the denominator of the covariance estimator be n-2 rather than n-1?


Why does computing product derivations eliminate degrees of freedom?


Standardized coefficients larger than 1 - a layman explanation?

Magnitude of standardized coefficients (beta) in multiple linear regression


Closed-form solution for an integral involving the p.d.f. and c.d.f. of a $N(0, 1)$-distributed random variable

How can I calculate $\int^{\infty}_{-\infty}\Phi\left(\frac{w-a}{b}\right)\phi(w)\,\mathrm dw$


Checking if two geometric distributions have the same mean

Hypothesis testing with the geometric distribution for dummies


Continuous variable for logistic regression

I need both quadratic and linear coefficients in a GLM with binary response. What's the best option?


How to calculate mean and variance correctly when data is in frequency "bins"?

Standard deviation of binned observations


Do I need to standardize data before doing regression with python statsmodels.OLS

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Factoring the likelihood function of a sample $X_1, ...,X_n$ where $X_i \sim N(\mu ,\sigma^2 )$ and iid to include $\bar{x} $


Election modeling : How is this a valid approach?

Probability of a single real-life future event: What does it mean when they say that "Hillary has a 75% chance of winning"?


Academic reference for the claim that outliers should not be removed


How do I fit a constrained regression in R so all coefficients are positive and above 0

Linear regression polynomial slope constraint in R


Some bibliography of an introduction to Bayesian Data Analysis

Learn Bayesian inference applied to astronomy / astrophysics?


Overlap between two lists, hypergeometric test

Calculating the probability of gene list overlap between an RNA seq and a ChIP-chip data set


Visualization problem of 15 attributes which is clustered into 2 cluster

How to produce a pretty plot of the results of k-means cluster analysis?


T-test with equal variance but large, unequal sample sizes

T-test equal variances, unequal sample sizes


How to analyze trend in non-periodic time series


NULL imputation in training and testing data set

Imputation before or after splitting into train and test?


Two interactions are individually signifcant, but not when included together

Significant predictors become non-significant in multiple logistic regression


How to deal with Features having high cardinality

Principled way of collapsing categorical variables with many levels?


Practical hyperparameter optimization: Random vs. grid search


Distribution of X-U(0,1) conditioned on sigma algebra of Y/X, where is Y is U(0,1)?

Distribution of ratio between two independent uniform random variables


In R how to you modify a logistic regression where the cost of selecting one of the classes is much higher than the other.

Bias the classification in logistic regression


How to deal with Class imbalance problem for classification algorithms?

Binary classification with strongly unbalanced classes


What is the tetrachoric correlation coefficient?

Differences between tetrachoric and Pearson correlation


Family in GLM - how to choose the right one?


Interpreting Residual plots: Linear Regression

How should I interpret this residual plot?


Can I fit logistic regression over a dataset with only categorical data?

Logistic regression with categorical predictors


Why do we need a final validation set (training / testing / validation)?

What is the difference between test set and validation set?


Interpretation of simple predictions to odds ratios in logistic regression


State space representation of ARMA(p,q) from Hamilton


Expected value of latent utility in logistic regression

Expectation of the Maximum of iid Gumbel Variables


Examples of meta-analyses where individual associatons are reported as odds ratios, risk ratios, or hazard ratios

How to conduct a meta-analysis on studies that report results variously as odds ratios, hazards ratios, or rate ratios?


Can an unstandarized Beta distribution have a negative domain?

Difference between standard beta and unstandard beta distributions?


Get quantile function of dynamic mixture model


Are canonical link functions and link functions the same thing?

What is the difference between a "link function" and a "canonical link function" for GLM


How do I generate numbers according to a Robust Soliton distribution?

How do I generate numbers according to a Soliton distribution?


The meaning of tensors in the neural network community

Tensors in neural network literature: what's the simplest definition out there?


How to normalize data to let each feature lie between [-1,1]?


Reversing PCA back to the original variables

How to reverse PCA and reconstruct original variables from several principal components?


Reconstruct the data using first principal component


variance of a mixture in terms of the mean and variance of each component

What is the variance of the weighted mixture of two gaussians?


How do you use a ROC curve to optimize a random forest classifier?


Why must kernel functions be scalar products

What is a kernel and what sets it apart from other functions


What does the height represent in a probability density function?


Data set size, how many to have a significant result?

What is a reasonable sample size for correlation analysis for both overall and sub-group analyses?


Challenges in interpretation of variable selection from LASSO and OLS

For linear classifiers, do larger coefficients imply more important features?


Existence of data when mean vector and covariance matrix (p.s.d.) is fixed?

Generating data with a given sample covariance matrix


Two-sample Kolmogorov–Smirnov test with unequal samples

Mann-Whitney U test and K-S test with unequal sample sizes


Frequentist approach to prior information


Why confidence interval is important when point estimator is close to zero?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Choosing subsample size (helping a friend analysing a smaller data set)


Variable changes from not significant to significant, don't know why, please help

How can adding a 2nd IV make the 1st IV significant?


Are there any non exponential family distributions with conjugate priors?

Aside from the exponential family, where else can conjugate priors come from?


Mahalanobis distance: What if S is not invertible?

Ways to measure distance from multivariate Gaussian (Mahalanobis distance)


Is it meaningful to combine relative risks and hazard ratio data in meta-analysis?

How to conduct a meta-analysis on studies that report results variously as odds ratios, hazards ratios, or rate ratios?


How can I compute statistical significance with cross-validation?

For model selection/comparison, what kind of test should I use?


Is there a way to approximate mean from summary information with open interval?

How to find average and median age from an aggregated frequency table


If we have a uniform prior probability distribution across all ranges of $ \theta $, does maximum a posteriori become maximum likelihood estimation?

How does a uniform prior lead to the same estimates from maximum likelihood and mode of posterior?


What is the statistical method that I should use for the following problem?


Method comparisons for trees and forests

Predictive model developement for logistic regression?


What would you do with the following QQ-plot?

Box-Cox transformation vs. predictor transformation in multiple linear regression


Standard Error for a Parameter in Ordinary Least Squares

How to derive variance-covariance matrix of coefficients in linear regression


Can a confidence interval straddle the zero mark?

Is rejecting the hypothesis using p-value equivalent to hypothesis not belonging to the confidence interval?


Johansen Cointegration on a stationary time series?


Covariance Between $\hat{\beta_0}$ and $\hat{\beta_1}$

Correlation between OLS estimators for intercept and slope


how does the beta function make the total probability of Dirichlet distribution integrate to 1?

Construction of Dirichlet distribution with Gamma distribution


Historical data appears seasonal, but forecasts from auto.arima are linear


Unbalanced sample size and average estimates logistic regressions

Does an unbalanced sample matter when doing logistic regression?


Logistic Regression with Unbalanced Data


Explaining to laypeople why bootstrapping works


What is the general procedure or general rules for grouping factor levels?

Principled way of collapsing categorical variables with many levels?


Post Hoc test for time*group interactions of one way multiple measures ANOVA

Post-hoc tests for MANOVA: univariate ANOVAs or discriminant analysis?


Does zero correlation mean no causation?

Why zero correlation does not necessarily imply independence


How to calculate the weighted standard deviation

How do I calculate a weighted standard deviation? In Excel?


What is the meaning of the density of a distribution at a point?


Can feature with high positive correlation have opposite weights sign?

Correlated features produce strange weights in Logistic Regression


Variable standardization / scaling for PCA when all dimensions already have same scale


What is the connection between CRF and Logistics Regression?

How Conditional Random Fields and Logistic Regression could be the same?


How to interpret a log transformed (x+c)?

Interpretation of log(1 + x) transformed predictor


Expected time to get all four unique coupons

How often do you have to roll a 6-sided die to obtain every number at least once?


PCA and proportion of variance explained


Inference/regression if we only observe the value is too high or too low

Statistical methods for data where only a minimum/maximum value is known


What's the value of f1 score when true positives are zero?

Denominator is Zero for Matthews correlation coefficient and F-measure


Linear regression with log transformed data - large error

Back transforming regression results when modeling log(y)


Should I be using the Combination interpretation or the Permutation interpretation?

Learning probability bad reasoning. Conditional and unconditional


How to profile, visualise and understand large number of groups/classes/clusters in data

How to determine variables that make certain cluster different from others?


Can removing predictors increase predictive power in large sample cases?


What are the recommended over-sampling or under-sampling techniques to handle multi-class imbalanced datasets for machine learning?

Opinions about Oversampling in general, and the SMOTE algorithm in particular


Inter-rater reliability measure with multiple categories per item

which statistic should I use for inter-rater agreement on nominal data, multiple responses


How to interpret when a variable is not significant in logistic regression while having the highest variable importance in a tree-based model

Can a random forest be used for feature selection in multiple linear regression?


Calculating the probability of two consecutive heads occuring N times in M coin tosses?

Probability of a run of k successes in a sequence of n Bernoulli trials


Why is standard deviation defined as sqrt(var(x)) and not as abs(X-u)?

Why square the difference instead of taking the absolute value in standard deviation?


Why doesn't multiplication by constant affect MLE?

What does "likelihood is only defined up to a multiplicative constant of proportionality" mean in practice?


numpy.linalg.cholesky of correlation matrix with small eigenvalue gives error

Is removing duplicate data necessary for Gaussian Process Regression (GPR)?


In linear regression, how to prove the equivalence of F-test and t-test?


R model developing & validating - Open to Discussion


Derivation of Equation of Reducible and Irreducible Error

Proof for Irreducible Error statement in ISLR page 19


How to make Random Forests more interpretable?


Are there analytically derivable posteriors that save from doing MCMC other than conjugate priors?

Do conjugate priors just lead to a posterior that is a modification of the parameters of the prior?


Minimum amount of explained variance after Principal Component Analysis

Is there any required amount of variance captured by PCA in order to do later analyses?


How to combine Euclidean and Cosine distance?

Converting similarity matrix to (euclidean) distance matrix


Optimization when Cost Function Slow to Evaluate


Cross Validation - purpose, need and utility


EFA: interpreting negative factor loadings

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Modern successor to Exploratory Data Analysis by Tukey?


Understanding Probability Density Functions

Can a probability distribution value exceeding 1 be OK?


Why is smaller the p-value, larger is the significance?

What is the meaning of p values and t values in statistical tests?


How does one choose a random isotropic direction and then have the vector have norm 1?

How to generate uniformly distributed points on the surface of the 3-d unit sphere?


Obtaining marginal distributions from the bivariate normal


Test if the distribution of a discret sample came from a known distribution

Testing Whether a Binomial Distribution Fits Data


What does the p value mean for Cox hazard ratio?


What's the difference between Normalization and Standardization?


how to get polynomial equation for given data in regression analysis?

Why is polynomial regression considered a special case of multiple linear regression?


How SVD is used for dimensionality reduction?

Relationship between SVD and PCA. How to use SVD to perform PCA?


What is the connection between binomial and poisson distribution?

Convergence of moments of binomial to Poisson


Getting P value with mixed effect with lme4 package

How to obtain the p-value (check significance) of an effect in a lme4 mixed model?


Estimating binomial distribution from small sample

Confidence interval for Bernoulli sampling


Why does the SSR have 1 degree of freedom in simple linear regression?

Why does the degree of freedom of SSR equals 1 in simple linear regression


How do I write a mathematical equation for ARIMA (0,2,1) x (0,0,1) period 12

How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


What should I do when my neural network doesn't learn?


Why are these formulas for the variance equal?

How to derive this version of variance formula


Variance of hierarchy of two random variables

What is the variance of the weighted mixture of two gaussians?


Complete and sufficient statistics of Laplace Distribution

A sufficient statistic for Laplace distribution


Online estimation of variance with limited memory


What causes a regression model to have positive error when output is large and negative error when output is small?

Trend in residuals vs dependent - but not in residuals vs fitted


Principled way of collapsing categorical variables with many levels?


Practically speaking, how do people handle ANOVA when the data doesn't quite meet assumptions?


Average Precision or FBeta & Decision Threshold Tuning for Binary Classifier

Why is accuracy not the best measure for assessing classification models?


Why do some formulas have the coefficient in the front in logistic regression likelihood, and some don't?

What does "likelihood is only defined up to a multiplicative constant of proportionality" mean in practice?


Optimization algorithm where calculating the function is very costly

Optimization when Cost Function Slow to Evaluate


Why the sudden fascination with tensors?


Is adf.test is one of the ways to know whether the time series is stationary or not?

Confusion with Augmented Dickey Fuller test