Finding and using a single (best) decision tree from random forest to evalute a sample

Making a single decision tree from a random forest


Introduction to statistics for mathematicians


Unbalanced logistic regression: correction for intercept term and report

Does an unbalanced sample matter when doing logistic regression?


Backprop working on output layer but not hidden layer

What should I do when my neural network doesn't learn?


Statistical interpretation of Maximum Entropy Distribution


Can someone explain Gibbs sampling in very simple words?


Is there any method for learning regularization parameter?

Optimization when Cost Function Slow to Evaluate


Random forest: Out of bag error increases with number of treees

Do we have to tune the number of trees in a random forest?


Meta Analysis With Percentages in Studies

Logit or arcsine transformation for proportion in meta-analysis


improving fitting results of neural network


Are unequal groups a problem for one-way ANOVA?


Correlation (and significance test) with ordinal predictor and continuous response

How to correctly assess the correlation between ordinal and a continuous variable?


Finding statistical significant difference between multiple linear regressions (in R)?


Neural Networks -- How to design for multiple outputs

Neural Network: For Binary Classification use 1 or 2 output neurons?


Reference request on multivariate statistics

Recommendations for mathematical multivariate statistics with exercises


How to interpret results of GLM with a beta distribution in R?


Should there be bands in this chart of random p-values?

Non-uniform distribution of p-values when simulating binomial tests under the null hypothesis


Updating a Normal Prior with Realized Data

Question about deriving posterior distribution from normal prior and likelihood


Calculating P-Value of a Z-Score without using Z-Table

Evaluate definite interval of normal distribution


Showing that ridge regression is a solution to the following optimization problem

How to find regression coefficients $\beta$ in ridge regression?


Why are the eigenvalues of $X'X$ equal to that of $XX'$ when $X$ is a design matrix?

What is the duality relationship between eigensystems of X X' vs X' X?


proof that p-value is uniformly distributed when the null hypothesis is true


Which pseudo-$R^2$ measure is the one to report for logistic regression (Cox & Snell or Nagelkerke)?


How to interpret multiple regression coefficients

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


Why not using the R squared to measure forecast accuracy?


Sum of squares of residuals instead of sum of residuals


Probability of two people meeting when the arrival intervals and wait times are different


Q-Q plot - Why do we choose the empirical distribution $F_n(x) = \frac {\#\{y \in S \mid y \le x\}} n$, $S$ is sample, for comparison with normal?

Calculating the 95th percentile: Comparing normal distribution, R Quantile, and Excel approaches


Expected value of $X$ which follows a normal distribution, between a certain interval

Expected value of x in a normal distribution, GIVEN that it is below a certain value


Regarding three R packages for Bayesian analysis

Optimal software package for bayesian analysis


How to fit data that looks like a gaussian?

Linear regression best polynomial (or better approach to use)?


Calculate AUC of a logistic regression model

Can someone sort me out regarding the calculation of AUC?


When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


How to calculate Area Under the Curve (AUC), or the c-statistic, by hand


Intuitve examples of importance sampling

Intuitive examples of importance sampling


Help me understand Support Vector Machines


Get random numbers that sum to a value N and have a specific variance

How to simulate data that satisfy specific constraints such as having specific mean and standard deviation?


How to fit a lognormal distribution in Python?


How to express fitted ARIMA model output by a mathematical equation?

How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


notation conditional normal distribution

Meaning of syntax $N(\mathbf{y} \mid \mathbf{0}, \mathbf{K})$ (multivariate normal distribution)


Interpretation of p-value in hypothesis testing


Is it possible that all parameters are highly significant?

Why is "statistically significant" not enough?


What is the difference between fixed effect and random effect model of ANOVA and when these should apply?

What is the difference between fixed effect, random effect and mixed effect models?


Comparison between hierarchical clustering and principal component analysis (PCA)

What is the relation between k-means clustering and PCA?


How to choose a good batch size for a powerful CPU

What is the trade-off between batch size and number of iterations to train a neural network?


Are two random variables X and Y independent of each other if their covariance and correlation are both zero?

Question about correlations and independence


Calculating the maximum likelihood estimate for a binomial parameter

Maximum likelihood estimation of p in a Binomial sample


How to fit gamma distribution to events not happen?

ML estimate of exponential distribution (with censored data)


What are the axes of a t-SNE scatterplot?

What is the meaning of the axes in t-SNE?


Proper use of the coefficient of variation

How to interpret the coefficient of variation?


Difference of two Gamma random variables with the same scale parameters?


Interpreting glmnet Lasso coefficients on dummy variables (multiple levels)


Measure the strength of association between two categorical variables

Correlations with unordered categorical variables


How does pca() function in Matlab fix the sign of principal components?

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


What are the advantages of ReLU over sigmoid function in deep neural networks?


The graphical intuiton of the LASSO in case p=2


First eigenvector of covariance matrix as the direction of largest variance

What is an intuitive explanation for how PCA turns from a geometric problem (with distances) to a linear algebra problem (with eigenvectors)?


Can a dummy variable only take the values 1 or 0

Why is gender typically coded 0/1 rather than 1/2, for example?


Why cannot I obtain a valid SVD of X via eigenvalue decomposition of XX' and X'X?


What does "Normal Distribution is conjugate to Normal" mean?


Transform random numbers into a valid covariance matrix

How to create an arbitrary covariance matrix


What is the best way to identify outliers in multivariate data?


How to determine the model order from ACF and PACF?


Poor recurrent neural network performance on sequential data

What should I do when my neural network doesn't learn?


Is that possible to estimate the VC dimension for GBM (or more specific XGBoost)?

What is the VC dimension of a decision tree?


Neural Network in classification task behaves "weird"


For a Fisher Information matrix $I(\theta)$ of multiple variables, is it true that $I(\theta) = nI_1(\theta)$?


Why are my drop-out values NOT affecting the accuracy in my recurrent neural model? (IMDB dataset, TFLearn)


Loss function can not converge during training neural network


What should be examined when feedforward neural network does not fit the training set well?


binary logistic regression with large sample size

Logistic regression with poor goodness of fit (hosmer lemeshow)?


Logistic regression understanding variable nature

Coefficient changes sign when adding a variable in logistic regression


Difference between multinomial logistic regression and multiple independent binary logistic regressions

Multinomial logistic regression vs one-vs-rest binary logistic regression


Are standardized betas in multiple linear regression partial correlations?

Multiple regression or partial correlation coefficient? And relations between the two


Is there a constructive approach to creating a distribution achieving the Chebyshev lower bound?

Random variables for which Markov, Chebyshev inequalities are tight


Simulate the critical values of Dickey-Fuller test statistic with R

How is the augmented Dickey–Fuller test (ADF) table of critical values calculated?


What is the difference between S (singular values) returned by SVD function and latent returned by PCA function in matlab?

Relationship between SVD and PCA. How to use SVD to perform PCA?


product of square of two independent variables

Functions of Independent Random Variables


What is the meaning of the different links in the binomial family of a GLM model in R?

Difference between logit and probit models


Mathematician wants the equivalent knowledge to a quality stats degree


Software needed to scrape data from graph


Machine learning cookbook / reference card / cheatsheet?


Is there a difference between the $R^2$ statistic of a linear regression and pearson correlation?

The equivalence of sample correlation and R statistic for simple linear regression


How is ANOVA related to general linear models?

How are regression, the t-test, and the ANOVA all versions of the general linear model?


How to compare my slope to 1 rather than 0 using regression analysis and t distribution?

Testing a regression coefficient against 1 rather than 0


What is the meaning of p values and t values in statistical tests?


Difference between Prior/Posterior density and Prior/Posterior distribution

Distribution function terminology (PDF, CDF, PMF, etc.)


Can someone explain the simple intution between Principal component 1, 2, ... etc in PCA?

Making sense of principal component analysis, eigenvectors & eigenvalues


How can we consider only unbiased estimator of zero 'based on sufficient statistic'?

What is the intuitive sense behind the purpose and mechanics of Sufficient Statistics?


How to calculate FP and TN in precision and recall for multiclass word sense disambiguation?

How do you calculate precision and recall for multiclass classification using confusion matrix?


How many decimal places should be used for which purposes?

Number of significant figures to put in a table?


minimum data size required for good performance of mini batch gradient descent

What is the trade-off between batch size and number of iterations to train a neural network?


Where are MLE equations such as $\sum_{i=1}^n \bigg(y_i - \frac{e^{x_i^T \beta}}{1+e^{x_i^T \beta}} \bigg)x_{ij}=0$ derived?

How to estimate coefficients of logistic model


Use BIC or AIC as approximation for Bayesian Model Averaging

Is there any reason to prefer the AIC or BIC over the other?


How to get Normal(Gauss) distribution from unifrom distribution?

Advantages of Box-Muller over inverse CDF method for simulating Normal distribution?


Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Chi-squared test for three-way contingency table (i.e., array) in R


Logistic regression normality and homoscedasticity

Heteroskedasticity in logistic regression


Showing p-th sample quantile is asymptotically normal

Central limit theorem for sample medians


How to prove some statistical model to be dominated?

"Absolutely continuous random variable" vs. "Continuous random variable"?


Why do we use density scale when constructing histograms with unequal class widths?

Why does the area of a bar in a histogram represent the frequency of that particular class


Are sufficient statistics for regression equivalent in the frequentist and Bayesian cases?

Is there a difference between Bayesian and Classical sufficiency?


What does P>0.05; 0.025 < P ≤ 0.05 ; Yes, 0.01 < P ≤ 0.025 and, P ≤ 0.01 mean ? hypothesis testing p-values

What is the meaning of p values and t values in statistical tests?


train_accuracy and train_loss are not consistent in binary classification


Dunn.test - interpretation p-value and Ho rejection

Dunn's test p-values in R are exactly half those in SPSS and GraphPad for the same data


In matching procedures in causal inference, will matching on more covariates always decrease the bias? Can the bias ever increase?

Overmatching bias and confounding variables


What GLM family and link function to use with similarity index as response variable?

Regression for an outcome (ratio or fraction) between 0 and 1


Why use Convolution of probability function instead of cross-correlation?

Why is the sum of two random variables a convolution?


Why exactly can't beta regression deal with 0s and 1s in the response variable?


Calculating the confidence interval for simple linear regression coefficient estimates

Should confidence intervals for linear regression coefficients be based on the normal or $t$ distribution?


Posterior derivation with prior as Normal-Gamma distribution

Help with Bayesian derivation of normal model with conjugate prior


How can we detect seasonality in a time series without looking at its plot?

Period detection of a generic time series


Getting a combined variance, given two variances

How to calculate pooled variance of two or more groups given known group variances, means, and sample sizes?


two way ANOVA with heteroscedastic data: test and reference?

How to run two-way ANOVA on data with neither normality nor equality of variance in R?


Propensity score methods versus GLM for cost comparisons between treatment groups

How are propensity scores different from adding covariates in a regression, and when are they preferred to the latter?


How do I calculate the running covariance of 2 data sets?


How to make Random Forests more interpretable?

Obtaining knowledge from a random forest


K-means : choose Optimum number of clusters based on graph

How to decide on the correct number of clusters?


Significant interaction but non-significant slopes?

How to interpret the significant interaction of two non-significant main predictors?


How can change in cost function be positive?


How to scale a variable to a specific mean and standard deviation

Transform Data to Desired Mean and Standard Deviation


Is Fisher's exact test right for this problem?


Why would parametric statistics ever be preferred over nonparametric?


Relationship between SVD and PCA. How to use SVD to perform PCA?


Adding a quadratic term flips the signs of the coefficients

Coefficient changes sign when adding a variable in logistic regression


When is good to bin variables in regression setting?

What is the benefit of breaking up a continuous predictor variable?


How many stickers do I need to complete my FIFA Panini album?


Understanding PCA from the perspective of eigenspaces

Making sense of principal component analysis, eigenvectors & eigenvalues


What to do with an insignificant intercept in a GARCH model?

Should I keep a non-significant intercept in a GARCH model?


How can I perform a t-test (or another hypothesis test) on NPS (Net Promoter Score) results?


How to choose between Pearson and Spearman correlation?


How to choose critical F value from statistical tables when the df is large?

How do I find values not given in (interpolate in) statistical tables?


Prove that AUROC is an improper scoring rule

What does it mean that AUC is a semi-proper scoring rule?


When is logistic regression solved in closed form?


In what step should I try to find a best thread cut-off point for binary classification?

Reduce Classification Probability Threshold


Difference between 95% of confidence intervals containing mean vs 95% probability of one interval containing the mean?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Definition and delimitation of regression model


Similarity measure between training and testing loss to identify overfitting

How to Identify Overfitting in Convolutional Neural network?


Accuracy, Sensitivity, Specificity, & ROC AUC

Why is accuracy not the best measure for assessing classification models?


Is any quantitative property of the population a "parameter"?


Books for self-studying time series analysis?


How to generate a random number from normal distribution (not allowed to use built in functions)


Is standard deviation always larger than mean deviation?

Prove that $E(X^n)^{1/n}$ is non-decreasing for non-negative random variables


When/why is the sqroot of the variance not a good estimator of the standard deviation?

Why are we using a biased and misleading standard deviation formula for $\sigma$ of a normal distribution?


analyzing Likert-scale data with mean and standard deviation

What are good basic statistics to use for ordinal data?


How to interpret OR (odds ratio) decimals? Are they percentages?


Is there any Good comprehensive reference for tensor calculus?

Why the sudden fascination with tensors?


Fitting data to multimodal distributions with scipy, matplotlib

How to test if my distribution is multimodal?


average number of tossing coins till 'Head-Tail-Head' series of observation comes up

Time taken to hit a pattern of heads and tails in a series of coin-tosses


How to generate a uniform random variable from [1,7] if given a uniform[1,5] RV generator?

Draw integers independently & uniformly at random from 1 to $N$ using fair d6?


Training loss low, but testing loss is high


Is a confidence interval the inverse of a p-value?

Is rejecting the hypothesis using p-value equivalent to hypothesis not belonging to the confidence interval?


How can we model a continuous coin tossing system to predict next tossing result and having a variable bias in the coin

How to define prior for beta-binomial A/B test


Understanding the R implementation of negative binomial distribution

Understanding the parameters inside the Negative Binomial Distribution


Mix of paired and independent data analysis

t-test for partially paired and partially unpaired data


Confidence interval for shift parameter of a shifted exponential distribution

Confidence interval for the "shift parameter" of a non-central exponential distribution


Relative importance of a set of predictors in a random forests classification in R


normal approximation to the binomial distribution: why np>5?


Decide for three Bernoulli samples are some of them from the same distribution (or non of them) ? (do not use t-stat )

Principled way of collapsing categorical variables with many levels?


Can data generated by generative models be used for training unsupervised learning models?

Can a GAN be used for data augmentation?


Getting variance of function of two uniform RVs

Computing variance of squared difference of i.i.d. uniform random variables


For any three random variables $X,Y,Z$, prove or disprove that $\langle XY\rangle$, $\langle XZ\rangle$, $\langle YZ\rangle$ can't all be negative

Bound for the correlation of three random variables


Fitting data to a log-normal distribution

Is normality testing 'essentially useless'?


Levels or First Differences, VECM or VAR for Ultimate Impulse Response Functions?


Why is Gaussian distribution used for Maximum Likelihood estimation with Linear Regression and not some other distribution?

How does linear regression use the normal distribution?


How correctly overcome problem with an infinity MAPE?

Why use a certain measure of forecast error (e.g. MAD) as opposed to another (e.g. MSE)?


Why, oh why, does R automatically eliminate variables from my dataset when running lm?

Understanding dummy (manual or automated) variable creation in GLM


Correlation between a continuous and multinomial variable

Correlations between continuous and categorical (nominal) variables


How can change in cost function be positive?


Input vector representation vs output vector representation in word2vec


Intuitive understanding of Extreme Learning Machine

Extreme learning machine: what's it all about?


Equation of a fitted smooth spline and its analytical derivative


How to find out seasonality in Time Series Data without looking at the graph?

Period detection of a generic time series


Why is Kullback-Leilbler divergence a better metric for measuring distance between two probability distributions than squared error?

Intuition on the Kullback-Leibler (KL) Divergence


Do these plots imply a good fit of a linear model with normal errors?


How to derive a ranking function from observations

How to derive a ranking function by analysing feature correlations


Resample random forest OOB to choose number of trees?

Do we have to tune the number of trees in a random forest?


What are good basic statistics to use for ordinal data?


Number of valid weight combinations in an ANN

Identifiability of neural network models


R: different predictor p-value in linear and multi-linear models


How does Feature Scaling help Gradient Descent?

Neural Networks input data normalization and centering


What do we mean when we say that an approach is "Bayesian"?


Ridge and Lasso Regression: Should I drop one reference category like in OLS?

Dropping one of the columns when using one-hot encoding


Interpreting p value in SciPy Welch's T-Test

What does the notation like 8.6e-28 mean? What is the 'e' for?


Neural Network is not predicting the results

What should I do when my neural network doesn't learn?


Cleaning Up the Data with Mahalanobis Distance


Moments of the truncated normal distribution (univariate) away from the mean


Fisher information for double exponential distribution

Fisher's Information for Laplace distribution


Is there any advantage in K-Fold over leave-one-subject-out cross validation?

Optimal number of folds in $K$-fold cross-validation: is leave-one-out CV always the best choice?


An example of a bivariate distribution with normal marginals and a nonlinear conditional mean curve?

Conditional expectation of two identical marginal normal random variables


exponential of Covariance of two variables in logs, cov(X,Y)=exp(X)*exp(Y)*cov[ln(X),ln(Y)]

Expectation, Variance and Correlation of a bivariate Lognormal distribution


How is the weibull distribution parameterised in survreg() in R

r survival::survreg parameter estimation by formula


Is it possible to have a pair of Gaussian random variables for which the joint distribution is not Gaussian?


Why is accuracy not the best measure for assessing classification models?


Why the leverage is the diagonal elements of the Hat matrix?

Hat matrix and leverages in classical multiple regression


what is the meaning of the word "regression" in "linear regression"?

Why are regression problems called "regression" problems?


Improving MSE: Feed forward network predicting only same output within batches (MSE error)

What should I do when my neural network doesn't learn?


Why fixed design analysis for observational data

What is the difference between conditioning on regressors vs. treating them as fixed?


Sample size for logistic regression with categorical independent variables


Where can I read about the theory behind GLMs in their most general form?


Deriving stochastic independence of vector valued Random variables

Functions of Independent Random Variables


How's Monte Carlo different from random sampling with replacement?

Resampling / simulation methods: monte carlo, bootstrapping, jackknifing, cross-validation, randomization tests, and permutation tests


What is the equation for Multiple Linear Regression (through the origin)

Regression without intercept: deriving $\hat{\beta}_1$ in least squares (no matrices)


Computing p-value using bootstrap with R


Log transformation in R (Precipitation Data)

Good methods for density plots of non-negative variables in R?


Difference between Kernel ridge regression and normal regression


Can I calculate prediction intervals in scikit-learn for a linear model without bootstrapping?


How is Y Normally Distributed in Linear Regression

What if residuals are normally distributed, but y is not?


Difference between PLS regression and PLS path modeling. Criticism of PLS


Ranking two models based on ROC-AUC and PR-AUC


Mars attack (probability to destroy $n$ spaceships with $k \cdot n$ missiles)


Examples (and how to generate them) of various conceptually different datasets to throw at PCA to gain better intuition for it

Making sense of principal component analysis, eigenvectors & eigenvalues


Discrepency between p value and confidence interval in glm

Why is there a difference between manually calculating a logistic regression 95% confidence interval, and using the confint() function in R?


Why Standard deviation formula has n-1 in the denominator but Variance only n?

Intuitive explanation for dividing by $n-1$ when calculating standard deviation?


Does alpha (the significance level) represent the probability of making a Type I error?

Comparing and contrasting, p-values, significance levels and type I error


Statistics: orthogonality vs uncorrelatedness vs independence

What does orthogonal mean in the context of statistics?


How is the minimum of a random set of random variables distributed?

How is the minimum of a set of IID random variables distributed?


Difference between one-way ANOVA and all pairwise comparisons with Bonferroni correction

Relation between omnibus test and multiple comparison?


Confusion about testing hypothesis for tossing 2 coins

Difference estimate & confidence intervals for $\chi^2$ test between 2 proportions


Most mathematically rigorous books to learn statistics from?

rigorous statistical-inference book recommendation


How do you know if a distribution is normal?


Are there any situations in which an OLS estimation of probability (with a binary dependent variable) might come in handy?

Are there any reasons to use the identity link in logistic regression (or any other glm)?


Difference in randomForestSRC and randomForest package / increasing OOB-Error curve

Do we have to tune the number of trees in a random forest?


Interpretation of coefficient of inverse Mills ratio


Logistic regression and unbalanced sample

Does an unbalanced sample matter when doing logistic regression?


Three-way ANOVA: How to interptret a significant three-way interaction with no significant post-hocs?

In three-way ANOVA, how to interpret the three-way interaction?


How to know if GBM or XGBOOST are overfitting?


Keras "Set" identifier not learning as expected

What should I do when my neural network doesn't learn?


GLM: verifying a choice of distribution and link function


What are some good resources to understand Hierarchical Statistical Models like Mixed Models?

What is a good internet based source of information on Hierarchical Modeling?


Fitting an empirical pdf with a mixture of distributions

Fitting mixture distributions and computing goodness-of-fit?


Adding two distributions with proportional means and standard deviations

Finding the distribution of sum of Lognormal Random Variables


Non-parametric alternative for 2-way ANOVA

Is there an equivalent to Kruskal Wallis one-way test for a two-way model?


Why bother with the dual problem when fitting SVM?


Choosing better samples for downsampling

When is unbalanced data really a problem in Machine Learning?


How to test if there is any significance difference between the areas under under two curves

Statistical significance (p-value) for comparing two classifiers with respect to (mean) ROC AUC, sensitivity and specificity


Diagnostic accuracy test done using mada package. How can I compare the AUC of SROC curves?


What are the multidimensional versions of median

Is there an accepted definition for the median of a sample on the plane, or higher ordered spaces?


Do I center an already transformed variable?

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Learning a simple sequence with RNN (Keras)

What should I do when my neural network doesn't learn?


simple repeated measures syntax - lme vs. lmer


How to interpret a meta-analytic Confidence Interval through the lens of Frequentism

Statistical inference when the sample "is" the population


Is it valid to include several interaction terms but exclude main effects because only interaction effects are significant?

Including the interaction but not the main effects in a model


Logistic regression cost surface not convex

What is happening here, when I use squared loss in logistic regression setting?


positive and negative sample count for ConvNets

Classification/evaluation metrics for highly imbalanced data


Algorithms for automatic model selection


Training a decision tree against unbalanced data


How to fit maximum likelihood estimates of normal distribution using subset of dataset in R?

Maximum likelihood estimators for a truncated distribution


How is a ROCAUC=1.0 possible with imperfect accuracy?


How to apply standardization when using the model to predict (not testing phase)?

Standardize Training and Validation Data


How to read R program P-Value for Logistic Regression

What is the meaning of p values and t values in statistical tests?


How do I know my k-means clustering algorithm is suffering from the curse of dimensionality?


How to compare the performance of different feature subsets with the same classifier?

Feature selection for "final" model when performing cross-validation in machine learning


How to do logistic regression with unequal groups in the dependent variable?

Does an unbalanced sample matter when doing logistic regression?


How to compare 2 series of ROC curves with AUC?

Statistical significance (p-value) for comparing two classifiers with respect to (mean) ROC AUC, sensitivity and specificity


Are mathematical functions "easier" for a neural network to learn?

Can a neural network learn a functional, and its functional derivative?


What types of situations would linear regression outperform randomforest?

Can Tree-based regression perform worse than plain linear regression?


Are unequal groups a problem for one-way ANOVA?


Rigorous definitions of sample and population

What is the difference between a population and a sample?


Restricted least squares: condition is that the parameter vector is greater or equal zero

Linear Regression with individual constraints in R


Confidence Interval - Binary classification


Deep NNs, backpropagation and error calculation


how to correlate categorical and interval scaled data in R

How to correctly assess the correlation between ordinal and a continuous variable?


Imputing missing observation in multivariate time series


Should you tune 'ntree' in the Random Forest algorithm?

Do we have to tune the number of trees in a random forest?


Can Independent T-test be performed on data obtained on same people by 2 different investigator?

Analysing pre-and-post intervention study with anonymous responses


statistical modelling for imbalanced data

Does an unbalanced sample matter when doing logistic regression?


Ridge Regression: When should the intercept be included ? What is the purpose of the intercept term?

When is it ok to remove the intercept in a linear regression model?


Interpreting of difference between R lm() with intercept and without it?

Removal of statistically significant intercept term increases $R^2$ in linear model


direction of association (beta value) using lm in R


Principled way of collapsing categorical variables with many levels?


Is there a boxplot variant for Poisson distributed data?


What does it mean to say that a neural network was "fine-tuned end-to-end"?

What does "end to end" mean in deep learning methods?


How can a predictor be significant, only on the presence of non-significant ones?

How can adding a 2nd IV make the 1st IV significant?


Understanding parameters of Beta distribution

What is the intuition behind beta distribution?


Intuition for why the sum of Bernoulli trials is a sufficient statistic via cancellations on numerator and denominator?


Characteristic function of uniform random variable

Consider the sum of $n$ uniform distributions on $[0,1]$, or $Z_n$. Why does the cusp in the PDF of $Z_n$ disappear for $n \geq 3$?


How is the t value of a regression coefficient computed?

How are the standard errors of coefficients calculated in a regression?


DBSCAN clustering - How to choose "Distance" parameter

A routine to choose eps and minPts for DBSCAN


Normalization of eigenvector $\alpha$ of kernel PCA by eigenvalue $\lambda$

How to project a new vector onto the PC space using kernel PCA?


Residuals in a linear model are independent but sum to zero; isn't it a contradiction?


What is the difference between multiple regression & mutivariate regression?

Explain the difference between multiple regression and multivariate regression, with minimal use of symbols/math


will a correlation between a percentage variable and a numerical variable work?

Correlation between a percentage and a real number


Why orthogonal polynomial can be used for ordered factor encoding?


What is the meaning of p values and t values in statistical tests?


Logistic regression: class probabilities


What test do I use for two variables that are ordinal and seem to have a non monotonic relationship?

Curvilinear relationship between two Likert-Scales - is there any coefficient to measure it?


Output of aov() in R varies with changing order of independent variables

How to interpret type I, type II, and type III ANOVA and MANOVA?


Zero-inflated model does not produce zeroes in fitted values?

Can a model for non-negative data with clumping at zeros (Tweedie GLM, zero-inflated GLM, etc.) predict exact zeros?


Why sample with replacement in bootstrap?

Bootstrap methodology. Why resample "with replacement" instead of random subsampling?


Principled way of collapsing categorical variables with many levels?


Intuition behind Besel's correction for an unbiased estimate of the variance

Intuitive explanation for dividing by $n-1$ when calculating standard deviation?


What causes the tendency for two non-stationary time series to be highly correlated to each other?


Best graphical representation of t-test data

How to visualize independent two sample t-test?


How to interpret A:B in linear regression? How to calculate A:B


Compute mean and variance of a normal random variable that is conditional on the outcome of a Bernoulli trial

What is the variance of the weighted mixture of two gaussians?


How skewed does a distribution have to be before we use the median as the best measure of central tendency?

When does the amount of skew or prevalence of outliers make the median preferable to the mean?


Definition of moments and the different approaches to compute them

Why the first moment is standardized before computing higher moments, but higher moments are not?


For normalized X and Y, how can the slope be equal in lm(Y~X) and lm(X~Y)

What is the difference between linear regression on y with x and x with y?


what's the need of confidence intervals?


are there citations for normalization data to the range [ a, b]?

Changing the scale of a variable to 0-100


Kolmogorov - Smirnov Test in Python Example

My distribution is normal; Kolmogorov-Smirnov test doesn't agree


Formula symbols for mixed model using lme4


Use of this positive semi-definite matrix in optimization?

Why are symmetric positive definite (SPD) matrices so important?


What is the meaning of p values and t values in statistical tests?


Interpretation of fitted probabilites in binary logistic regression

Help me understand adjusted odds ratio in logistic regression


Help figuring out this Standard Normal Problem

Evaluate definite interval of normal distribution


Deriving Marginal Distribution of Poisson

Calculate posterior distribution (gamma-prior, poisson-likelihood)


Random Explanatory / Independent Variables

What are the differences between stochastic and fixed regressors in linear regression model?


Doubts regarding the Completeness of an estimator

Are complete statistics always sufficient?


Optimization when Cost Function Slow to Evaluate


ROC vs Precision-recall curves on imbalanced dataset


PCA on Wine data with only one binary data(white/red wine) and other quantitative data

Can principal component analysis be applied to datasets containing a mix of continuous and categorical variables?


What exactly is a quasi-likelihood model?

Idea and intuition behind quasi maximum likelihood estimation (QMLE)


If a factor variable is to be dropped in model selection, should all levels be dropped simultaneously? If so, why?

Can I ignore coefficients for non-significant levels of factors in a linear model?


For PCA, the best axis for the projection of the points is the one who has the minimal or the maximal inertia?

Making sense of principal component analysis, eigenvectors & eigenvalues


Machine Learning VS Statistical Learning vs Statistics

The Two Cultures: statistics vs. machine learning?


Confusion about refit model after cross-validation

How to choose a predictive model after k-fold cross-validation?


Why does differencing a time series remove its memory?

Is it a valid claim, that by differencing a time series, it loses its memory, and as a result its predictive power?


Not sure about the interpretation of this residual plot


One hot encoding for images ( 40x10 images)


Why should we use IRLS in logistic regression?

Choosing IRLS over gradient descent in logistic regression


How to explain the differences between lasso, ridge, and elastic net to a layman?


testing whether data comes from a bi-modal distribution (python)


Pros and cons of python and R for machine learning?

How do R and Python complement each other in data science?


US Election results 2016: What went wrong with prediction models?


How to Improve the accuracy of my Cancer Prediction Model?

How to know that your machine learning problem is hopeless?


correlation coefficient in pandas (pearson)


incremental $R^2$ update at every new sample


Can we detect the existence of outliers using Min and Max?

Can we detect the existence of outliers using mean and median?


Statistical inference when the sample "is" the population


Can someone explain intuitively what does 0 mean and unit variance mean?

What is the difference between normal distribution and standard normal distribution?


glm binary variable using family= gaussian instead of binomial is it wrong?

What is the difference between linear regression and logistic regression?


How do I construct a variance-covariance matrix from a matrix formulation of a MLR?

Basic question about Fisher Information matrix and relationship to Hessian and standard errors


Prove that $E(X^n)^{1/n}$ is non-decreasing for non-negative random variables


Where can I learn more about neural network optimization?

Guideline to select the hyperparameters in Deep Learning


Co-integration relationships mixed with stationary variables. Correct specification?

VAR or VECM for a mix of stationary and nonstationary variables


Can I compare non-nested models with AIC?


How can a regression be significant yet all predictors be non-significant?

Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


Interpreting the significance in multiple regression

How can adding a 2nd IV make the 1st IV significant?


Machine Learning with Skewed Classes in R

When is unbalanced data really a problem in Machine Learning?


how do I calculate effect size for data based on Wilcoxon signed ranks test

Effect size to Wilcoxon signed rank test?


In linear regression, any intuitive explanation why duplicating samples will reduce coefficients' std-dev?

What are the consequences of "copying" a data set for OLS?


Is a rating in a set range a categorical or numerical variable?


Distribution of $X=\binom m Y \left(\frac 1 2\right)^Y \left(\frac 1 2\right)^{m-Y}$ where $Y$ is a Binomial variable?


Confidence Interval of a bounded variable

What does a confidence interval with a negative endpoint mean?


Why could centering independent variables change the main effects with moderation?


Correlation between continuous variable and nominal variable

Correlation between a nominal (IV) and a continuous (DV) variable


What does it mean when a distribution is "INDEXED" by something?


Sample Selection Bias in Logistic Regression

Does an unbalanced sample matter when doing logistic regression?


Neural Net vs Multiple Linear regression?

What is the difference between 'regular' linear regression and deep learning linear regression?


Is this just a consequence of Publication bias or has a name of its own?

Is this really how p-values work? Can a million research papers per year be based on pure randomness?


Why is my density plot just a line on the bottom?


How do I get the sample mean and standard deviation?

Standard deviation of binned observations


Back transforming regression results when modeling log(y)


What is the conjugate prior distribution?

Can anyone explain conjugate priors in simplest possible terms?


Intuitive explanation for dividing by $n-1$ when calculating standard deviation?


Whats the biggest difference in calculating a simple regression model with/without a constant term?

When is it ok to remove the intercept in a linear regression model?


How to extract distribution information from descriptive statistics?

How to do estimation, when only summary statistics are available?


When Bayesian estimator coincides with MLE

How does a uniform prior lead to the same estimates from maximum likelihood and mode of posterior?


computing confidence curves around the fitting line

Shape of confidence interval for predicted values in linear regression


Statistical test for comparing two frequencies with R


R : Which method should I choose for correlation analysis of between two dichotomous variables? and How to?

Is it meaningful to calculate Pearson or Spearman correlation between two Boolean vectors?


How to manually compute response variable using regression with poly

Raw or orthogonal polynomial regression?


Adding more samples to ordinary regression is equall to ridge regression

How to derive the ridge regression solution?


What does gradient with respect to a function mean


Explain sufficient statistic for Poisson distribution

If $Y_1, \ldots, Y_n$ are iid from $Pois(\lambda)$, how to show that the sample mean is a complete sufficient statistic?


The appropriate match ratio between case and controls: the obsession with 1:5

is there a way to find suitable ratio for matches to controls (using "ratio" in Matchit package in R or other programs)


Bounds for common correlation of uncorrelated random variables with another random variable

Bound for the correlation of three random variables


Find the covariance matrix of the random variables

Does the variance of a sum equal a double sum of covariances?


If $X$ and $Y$ are independent Normal variables each with mean zero, then $\frac{XY}{\sqrt{X^2+Y^2}}$ is also a Normal variable


How to determine if my data is discrete or continuous in java?

How to statistically prove if a column has categorical data or not using Python


Why is gradient descent and it's variants used instead of BFGS and L-BFGS for training neural nets?

Why it is popular to use stochastic gradient descent in neural networks rather than the BFGS algorithm?


Multiple regression - singularity issues

"variance matrix is nonsymmetric or highly singular" in Stata; no SEs in table


Proof of K-Means convergence in finite iterations


how to keep covariates when creating a sequence object from a SPELL data


Random forests with bagging and range of feature values

Does random forest need input variables to be scaled or centered?


Second derivative test for machine learning algorithms

Why is Newton's method not widely used in machine learning?


Dependence measure for categorical and numerical

Correlations with unordered categorical variables


Selecting genes that contribute the most to the principal components

Using principal component analysis (PCA) for feature selection


Correlation with Spearman's but nothing on MLR

Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


Simple examples of uncorrelated but not independent $X$ and $Y$


How many times do I have to roll a dice to get six six times in a row?

Time taken to hit a pattern of heads and tails in a series of coin-tosses


Correlation metric for 0-1 vector and real values vector

Correlations between continuous and categorical (nominal) variables


Training the learning model on the log transformed data?

Back transforming regression results when modeling log(y)


Variable selection - K Fold cross-validation or Lasso regression?

Lasso features selection through Crossvalidation


Should SMOTE oversampling be done before or after holdout validation's training/testing split?

Testing Classification on Oversampled Imbalance Data


How to compute the normalized overlap area between two curves

Percentage of overlapping regions of two normal distributions


How to detect interactions in a random forest model?

Obtaining knowledge from a random forest


t-test for partially paired and partially unpaired data


Using a t-test with only 2 discrete values (without a mean)

Checking if two Poisson samples have the same mean


Null hypothesis testing of population mean $\mu = \mu_0$ against $\mu < \mu_0$

Do null and alternative hypotheses have to be exhaustive or not?


Can one use independent t-test to compare percentages?

Why use a z test rather than a t test with proportional data?


Sufficient statistics for Uniform $(-\theta,\theta)$


Why would you want to use a transformation function?

When (and why) should you take the log of a distribution (of numbers)?


Importance of intercept term in regression equation

Is it possible to interpret regression output omitting the intercept?


Minority class misclassification penalty in logistic regression (sklearn)

Does an unbalanced sample matter when doing logistic regression?


unbalaced data set in classification tasks

When is unbalanced data really a problem in Machine Learning?


Difference between (quantitative,qualitative) vs (discrete,continuous)

Explanation of the different variable types in statistics?


How to code values for males when they're only meaningful for females?

How do you deal with "nested" variables in a regression model?


What should be called a linear regression?

How to tell the difference between linear and non-linear regression models?


Monotone, Bounded Local/Spline Regression in R

How to smooth data and force monotonicity


Analogy of Pearson correlation for 3 variables


How to stretch a time series to any length, n, without padding?

Predicting Clothing Size Ratios when different products have different size methodologies


How to interpret these acf and pacf plots


Significance of intercept (as portrayed via an R formula)


How to compute F-statistics for each features of regression models in glmnet?

Lasso and statistical signficance of selected variables


Intuition on One Class Support Vector Machines

What is one class SVM and how does it work?


Does max-pooling increase the receptive field?

How many input pixels influence output pixel in an FCN type architecture?


What is the formula for prediction interval in a multi-variate setting?

How to calculate the prediction interval for an OLS multiple regression?


How to code values for males when they're only meaningful for females?


Variance of a sum of a random number of iid random variables

Variance of sum of random number of random variables (Cambridge University Worksheet)


How to test association in contingency tables with very small numbers and proportions?

Is the chi-squared test appropriate with many small counts in a 5x2 table?


Random forest “certainty / likelihood score” - how to score records in RF mode in R?

Do the predictions of a Random Forest model have a prediction interval?


When estimating variance, why do unbiased estimators divide by n-1 yet maximum likelihood estimates divide by n?


Spikes in loss function of deep neural network training

Explanation of Spikes in training loss vs. iterations with Adam Optimizer


Correlation between log normal variables and a normal variable

Covariance between a normally distributed variable and its exponent


Statistical Learning With Sparsity: Direct Inspection of the LASSO function

Coordinate descent soft-thresholding update operator for LASSO


Hard time interpreting r output, p value confusion?

What does the notation like 8.6e-28 mean? What is the 'e' for?


The limitations of Elastic-net regularization

Any disadvantages of elastic net over lasso?


The reason for saying "5 out of 10" instead of "1 of 2"?


Simulate AR(1) process in R with specified nonzero mean and AR coefficient


How to prevent the keras convolutional neural network model to over-fit?

What should I do when my neural network doesn't generalize well?


How to fit a non-linear expression of type $ Y=A(1-e^{-t/B})$ to the data set without using any package?

How to minimize residual sum of squares of an exponential fit?


Nonlinear relationship in logistic regression

Can I use a variable which has a non-linear relationship to the dependent variable in logistic regression?


How to deal with categorical independent variables with numerous levels

Principled way of collapsing categorical variables with many levels?


Skewness transformation for one but not the other variable?


How to generate a vector that has zero correlation with another vector (in R)?

Generate a random variable with a defined correlation to an existing variable(s)


Derivation of the censoring likelihood function?

How to model this odd-shaped distribution (almost a reverse-J)


How to understand what a high p value indicates

What is the meaning of p values and t values in statistical tests?


Derivation of linear discriminant analysis (LDA) decision boundary


What is the algorithm for computing quantiles?


Sampling distribution of regression coefficients - technical question

Why is a T distribution used for hypothesis testing a linear regression coefficient?


Is there a name for "product divided by arithmetic mean"?


What is effect of increasing number of hidden layers in a Feed Forward NN?

Why are neural networks becoming deeper, but not wider?


Deriving posterior for weights in bayesian linear regression

Why does $P(\theta_1\mid D, \theta_2) \propto P(D \mid \theta_1, \theta_2)P(\theta_1)$ hold?


What does "the denominator does not contain any theta dependence" mean in Bayes' Rule?


What does 1 with an inequality in the subscript mean?


After applying SMOTE, the class distribution doesn't match the real world. Is this a problem?

When is unbalanced data really a problem in Machine Learning?


How do I test for a relationship between two ordinal variables?

Correlation between two ordinal categorical variables


What are the odds of both my Grandmothers passing away on the same 24 hour day?

Determining statistical probability related to a string event of dates


Can dev (development) set be part of a training set in machine learning?

Should final (production ready) model be trained on complete data or just on training set?


What did my neural network just learn? What features does it care about and why?


In GLM, do we make an assumption on the distribution of Y or the distribution of Y | X?

Family of GLM represents the distribution of the response variable or residuals?


Multiple Regression and Pearson Correlation

Why don't the results of testing $H_0 : \beta = 0$ and $H_0 : {\rm cor}(X,Y)=0$ agree?


My F statistic is really high - what does this mean?


How do I get my p value from my F test in Stata


Imbalanced data classification with GLM giving very poor results

What is the root cause of the class imbalance problem?


Calculating Goodness of Fit in Multiple Regression

What does goodness of fit mean in context of linear regression


Manual computation for Fishers exact test for tables larger than 2 x 2

Fisher's Exact Test in contingency tables larger than 2x2


When is unbalanced data really a problem in Machine Learning?


Expected value of E(exp(1/X)) where X~N(0,sigma_x)

I've heard that ratios or inverses of random variables often are problematic, in not having expectations. Why is that?


Estimating Spline curve by OLS. Is a good idea to fix the knots at Chebyshev sites?


Find the distribution function $F$ for $min_{1 \le i \le n}{X_i}$


If I have a 58% chance of winning a point, what's the chance of me winning a ping pong game to 21, win by 2?


Different model result with log-transformed vs. original dependent variable in linear mixed model

Linear mixed effect model interpretation with log transformed dependent variable


How to identify outliers and do model diagnostics for an lme4 model?


Discard features with small variance, how to do in practice?

Should I discard a feature whose max - min is smaller than 1e-5?


Deriving the conditional distributions of a multivariate normal distribution (more than 2)


Symmetric probability density function proof

Central Moments of Symmetric Distributions


How does a Support Vector Machine (SVM) work?


How to use eigenvectors to identify which variables are involved in collinearity?

Testing for linear dependence among the columns of a matrix


Logistic regression on aggregated counts

In using the cbind() function in R for a logistic regression on a $2 \times 2$ table, what is the explicit functional form of the regression equation?


Why isn't accuracy of binary classification model improving?

How to know that your machine learning problem is hopeless?


Plotting the lognormal density function on a logarithmic x axis

How to transform one PDF into another graphically?


Deep networks vs shallow networks: why do we need depth?

What is the difference between a neural network and a deep neural network, and why do the deep ones work better?


INTERPRET A REGRESSION MODEL WHEN OUTCOME VARIABLE IS LOG TRANSFORMED

Interpretation of log transformed predictor and/or response


Why bother with multivariate regression?

Why do we need multivariate regression (as opposed to a bunch of univariate regressions)?


Adjust thresholds in multi-class classification

Reduce Classification Probability Threshold


Why is the squared difference so commonly used?


How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


Interaction Terms (Categorical * Continuous)

How should I implement this interaction between a continuous and categorical predictor?


Deal with highly unbalanced data classes

Binary classification with strongly unbalanced classes


What should I do when my neural network doesn't learn?


Why isn't the least squares predictor $\Phi(\Phi^\top\Phi)^{-1}\Phi^\top$ simply the identity matrix?

Does $\hat{\beta}=(X′X)^{−1}X′ \ Y$ simplify further?


Computing Confidence Intervals for Coefficients in Logistic Regression

Why is there a difference between manually calculating a logistic regression 95% confidence interval, and using the confint() function in R?


Eigenfunctions heuristics for self-conjugate priors

Operator Theoretic Perspectives on Bayesian Inference


What is the standard deviation and mean of the reciprocal of normal distribution in terms of that of the normal distribution?

Mean and variance of inverse of a normal RV


standardized coefficient interpretation in logs from beta function

How to interpret log-log regression coefficients for other than 1 or 10 percent change?


Generating correlated uniform random variable with R

Method for generating correlated non-normal data


How can I calculate $\int^{\infty}_{-\infty}\Phi\left(\frac{w-a}{b}\right)\phi(w)\,\mathrm dw$


VC dimension upper bound for Random Forest

What is the VC dimension of a decision tree?


How to graph the data points of n dimensions?


How to check the quality of clustering results if there is no labels?

How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?


Approximate Bayesian computation: where to start from?

ABC. How can it avoid the likelihood function?


Machine learning cookbook / reference card / cheatsheet?


ROC and multiROC analysis: how to calculate optimal cutpoint?


Does a correlation matrix of two variables always have the same eigenvectors?


Regression with independent variables as level (Low=1, Medium=2, High=3)

How to handle ordinal categorical variable as independent variable


How to calculate Area Under the Curve (AUC), or the c-statistic, by hand


Logistic regression output and probability

Difference between logit and probit models


Show that $1-\Phi(x)$ is approximately $\varphi(x)/x$ for large $x$ (standard-normal random variable)

Evaluate definite interval of normal distribution


Why is scaling the data needed before principal component analysis (PCA)


what is the meaning of 'normality' as a difference between parametric and nonparametric method?


What is a complete list of the usual assumptions for linear regression?


What if do not use any activation function in the neural network?

What is the difference between 'regular' linear regression and deep learning linear regression?


Parameters of beta distribution with a given HDI

Determining beta distribution parameters $\alpha$ and $\beta$ from two arbitrary points (quantiles)


In unbiased data, RMSE and standard deviation is same?

RMSE vs Standard deviation in population


How to choose the structure of a feed-forward neural network?

How to choose the number of hidden layers and nodes in a feedforward neural network?


Can I use Likert scale data to do parametric statistical procedures such as linear regression and ANOVA?

What are good basic statistics to use for ordinal data?


Estimate values from a multivariatie normal distribution

Generating values from a multivariate Gaussian distribution


Is normality test required for original data prior to the principal component analysis?

Applying PCA to data that fail a normality test


Can a probability distribution value exceeding 1 be OK?


How to test hypothesis of no group differences?


What should I do when my neural network doesn't learn?


How can a dnorm probability be larger than a corresponding cumulated pnorm probability


What is the definition of a "feature map" (aka "activation map") in a convolutional neural network?


How are "transforming the data" and GLMs different?

Choosing between LM and GLM for a log-transformed response variable


What is the difference between a neural network and a deep neural network, and why do the deep ones work better?


Why Standard Deviation is more popular than Mean Absolute Deviation?

Why square the difference instead of taking the absolute value in standard deviation?


Intuition of terms P(θ) and P(y) in Bayes' Theorem

What is a very intuitive way to teach the Bayes formula to undergraduates?


Is it possible to find the joint distribution of a random vector if only the distribution of scalar many-to-one transformation is known?

Z is a non-linear transform of X. I know the distribution of Z. Is it possible to sample from X?


State-of-the-art algorithms for the training of neural networks with GRU or LSTM units


Beta regression where fractional response adds up to 100%?

Beta regression of proportion data including 1 and 0


Formulae to Convert between z Critical Value and Confidence Level

What is inverse CDF Normal Distribution Formula


what is the meaning of 'tail' of kurtosis?


Does this normal distribution plot show a good fit?


aov() and lme() give completely different results in analyzing repeated measures

Why do lme and aov return different results for repeated measures ANOVA in R?


Regression problem in data with many zeroes

How to model non-negative zero-inflated continuous data?


Independent and Identically distributed random variables with value at risk

Why is the sum of two random variables a convolution?


The proof of shrinking coefficients using ridge regression through "spectral decomposition"


Performance SVM versus logistic regression


paired t-test, 2 samples of different sizes

t-test for partially paired and partially unpaired data


Confidence interval for single observation from Poisson

Determining confidence interval with one observation (for Poisson distribution)


Proving a linear regression is a multivariate normal

Distribution of linear combination of OLS regression coefficients


Why do stochastic processes involve time?

General definition of stochastic processes


The Minimum CDF of non-independent random variables


Using the rejection sampling with the method of inversion


What makes the mean of some distributions undefined?


how to calculate critical values of Pearson's correlation coefficient for a large data set containing rows greater than 5000?

How to calculate critical values for R for a large dataset


How to infer "groupings" of data points separated alone one dimension?

How can I group numerical data into naturally forming "brackets"? (e.g. income)


Integrate area between two normal distributions

Calculate probability (area) under the overlapping area of two normal distributions


Expected value of a variable that possibly decreases n times

$x_{1}...x_{n}$ are independent continuous random variables with common distribution function $F(x)$,compute $E(F(x_{(n)})-F(x_{(1)}))$


Significance of logistic regression coefficients

Interpretation of simple predictions to odds ratios in logistic regression


Why Do Support Vector Machines Require 3 Support Vectors?

Theoretical: Minimum Number of Support Vectors


Should one scale the full dataset or the training set directly

How to apply standardization/normalization to train- and testset if prediction is the goal?


Why is Training Error lower than Testing Error during the First Epoch?

Validation Error less than training error?


Hypothesis Testing of endpoint of Uniform distribution

Estimating Uniform distribution endpoints using data with errors


For a Gaussian process, how does $\mathcal{N}(\mathbf{f}, {\sigma_n}^2\mathbf{I})$ relate to the Normal PDF?

Meaning of syntax $N(\mathbf{y} \mid \mathbf{0}, \mathbf{K})$ (multivariate normal distribution)


How to fit Decision Tree classifier for highly imbalanced response variable?

Training a decision tree against unbalanced data


Fitting a model to a variable with many zeros and few but large values in right tail

Zero inflated distributions, what are they really?


In a regression model, why does adding variables increase $R^2$ and decrease the SSE?

Why is sum of squared residuals non-increasing when adding explanatory variable?


Regression anatomy: can a multivariate model with K independent variables be broken down into K bivariate models?

Question on how to normalize regression coefficient


Given a coin with unknown bias, generate variates from a fair coin efficiently


Deriving the distribution of the max function

Joint distribution of a Normal and Truncated Normal


What does a truncated distribution mean?

Truncated Gaussian distribution interpretation


Deriving total (within class + between class) scatter matrix


Why halve the objective function for Lasso?


Variance of a linear combination of vectors


Basic question about standard error in predictive model

How to compute prediction bands for non-linear regression?


Can I add several additional variables to my principal component regression?

How to use principal components analysis to select variables for regression?


Sample Size and No. of Events in Logistics Regression Model

Does an unbalanced sample matter when doing logistic regression?


Caret package - Logistic regression how to find Pseudo R square


How do you prove that OLS Estimator must pass through mean of X and Y

Regression Proof that the point of averages (x,y) lies on the estimated regression line


When should an F-test be one sided vs two sided?

Why do we use a one-tailed test F-test in analysis of variance (ANOVA)?


What is the most appropriate way to cluster respondents based on their rankings of some items?


nested mixed effect ANOVA (lme4): can a factor be a fixed effect AND a nesting term for a random effect?

Does it make sense to include a factor as both fixed and random factor in a Linear Mixed Effects Model?


Non-Parametric Test Failed to reject the null


Testing for normality in SPSS: Procedure for two or more independent variables WITHOUT levels/groups

What have to be normally distributed: groups or whole sample?


Why is $\sum{(x_i-\overline{x})^2}$ = $\sum{(x_i-\overline{x})x_i}$ true?

Cross product term in linear regression why is it zero


How to understand 'unit roots' in time series data?


How to generate 5 columns random data with a specified correlation coefficient

How to generate Bernoulli random variables with common correlation $\rho$?


What is the moment of a joint random variable?


The uniform distribution of p-value under null hypothesis

The distribution of the p-values under the null hypothesis is uniform(0, 1)


Finding an association between two methods of medical intervention and a continuous variable

Correlations between continuous and categorical (nominal) variables


Euclidean distance is usually not good for sparse data (and more general case)?


sigma is unknown, so it must be estimated by using sigma approximately equals (1/4) * (range)


Getting marginal distributions from a bivariate probability distribution function

Problem obtaining a marginal from the joint distribution


Show that $E[u(X_1)\mid\sum^n_{i=1}X_i=z]=\Phi \left( \frac{\sqrt n(c-z/n)}{\sqrt{n-1}} \right)$


What is the definition of machine learning (vs classical statistics), and can methods such as MCMC and bootstrapping be considered ML?

The Two Cultures: statistics vs. machine learning?


Joint distribution of least square estimates $(\hat\alpha,\hat\beta)$ in a simple linear regression model

Sampling distribution of regression coefficients


Why use gradient descent with neural networks?


Why do the car::Anova(test="LRT", type=3) and anova(test="LRT") slightly differ in the output (details inside)

Difference between anova and Anova function


Calculate mean and standard deviation of a normal distribution given probabilities at three points only

Estimating a distribution based on three percentiles


Which statistical tests can I use to analyse significant difference between the means of non-random samples?

Can non-random samples be analyzed using standard statistical tests?


What is the intuition behind defining completeness in a statistic as being impossible to form an unbiased estimator of $0$ from it?


Why it is popular to use stochastic gradient descent in neural networks rather than the BFGS algorithm?

Why second order SGD convergence methods are unpopular for deep learning?


Encoding categorical variables with lots of categories

Principled way of collapsing categorical variables with many levels?


Stuck on rejection region for Likelihood ratio test

Obtaining a level-$\alpha$ likelihood ratio test for $H_0: \theta = \theta_0$ vs. $H_1: \theta \neq \theta_0$ for $f_\theta (x) = \theta x^{\theta-1}$


Contribution of each eigenspace's error to the loss

Gradient descent of $f(w)=\frac12w^TAw-b^Tw$ viewed in the space of Eigenvectors of $A$


Where can I find materials for an Advanced Statistics course?

Advanced statistics books recommendation


How can one show mathematically that adding many variables will only increase R-squared?

Why does adding more terms into a linear model always increase the r-squared value?


what's the difference between unconditional quantile and generalized quantile regression？

What is the difference between conditional and unconditional quantile regression?


AUC vs accuracy for model accuracy evaluation

Compare classifiers based on AUROC or accuracy?


KL divergence vs Absolute Difference between two distributions?

Intuition on the Kullback-Leibler (KL) Divergence


random forests variable importance plot - interpretation in R (VarImpPlot)

Measures of variable importance in random forests


Generate two variables with precise pre-specified correlation

Generate a random variable with a defined correlation to an existing variable(s)


What is the VC dimension of a decision tree?


What is happening here, when I use squared loss in logistic regression setting?


Latent variables motivation for ordinal and binary logistic regression

How is Logistic Regression related to Logistic Distribution?


How to evaluate "performance" of my model?

Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


How can I increase the $R^2$ -value of my linear model? Should I increase it?


What is Characteristic Polynomial in Time-series analysis?


What is the general guideline for dropping dummy variables in a regression model?

Dropping one of the columns when using one-hot encoding


Which algorithm for forecasting a binary time series?


Regression coefficients without intercept

Regression without intercept: deriving $\hat{\beta}_1$ in least squares (no matrices)


How good is a model if it can't predict a single positive class?

Why is accuracy not the best measure for assessing classification models?


How do you infer the number of clusters in data using unsupervised learning?

How to decide on the correct number of clusters?


Squaring the $\ell_2$-norm in $\ell_2$-regularization


is there a way to update an already-plotted boxplot in R?

Is it possible to accumulate a set of statistics that describes a large number of samples such that I can then produce a boxplot?


How do I determine the variance of a collection of groups?

How to calculate pooled variance of two or more groups given known group variances, means, and sample sizes?


Examples of convergence in distribution using CDF directly

Extreme Value Theory - Show: Normal to Gumbel


Choosing variables in multiple linear regression

Choosing variables to include in a multiple linear regression model


How to explain the difference between parameter and hyperparameter in machine learning?

What to treat as (hyper-)parameter and why


Distribution of $\sum_{j=1}^n\ln\left(\frac{X_{(j)}}{X_{(1)}}\right)$ when $X_i$'s are i.i.d Pareto variables


Can someone please explain the back-propagation algorithm?

Backpropagation algorithm and error in hidden layer


Can a probability distribution value exceeding 1 be OK?


The likelihood function: Why is it no pdf?

What is the difference between "likelihood" and "probability"?


Machine learning books covering neural networks / cnn / GAN

Neural network references (textbooks, online courses) for beginners


How to normalize the output of a neural network

Softmax vs Sigmoid function in Logistic classifier?


Is it possible for the correlation between principle components to be negative when the correlation of the highest covariant variables is positive?

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


How do I prove: the posterier is proportional to the product of the prior distribution and the likelihood function?

Why is posterior density proportional to prior density times likelihood function?


How to find integral's upper limit using optimize function without knowing the interval where it will occur


How to calculate quartiles and other percentiles?


When is it ok to remove the intercept in a linear regression model?


CLT approximation - how large should sample be so probability is equal to 0.95?


Regression for looping (circular?) variable

How to include time factor in a mixed model (investigating the interaction between two factors and time)?


Significance contradiction in linear regression: significant t-test for a coefficient vs non-significant overall F-statistic


Significance test in trimodal distribution


Determining the distribution of fitted values and residuals

Distribution of linear combination of OLS regression coefficients


How can I represent a randomForest object in a way that "unlocks the black box" in R?

Obtaining knowledge from a random forest


Estimate probability from sample frequency in a binomial distribution

What is the intuition behind beta distribution?


Does 10 heads in a row increase the chance of the next toss being a tail?


Can we have a significant intercept even if the p-value is grater than alpha?


Polar to Cartesian transform of a Gaussian RV


Likelihood function for binomial distribution with label 1 and -1


What are online learning and offline learning in the context of reinforcement learning?


Why does minimizing the MAE lead to forecasting the median and not the mean?


Extracting Marginal Distribution by Monte Carlo

Obtain marginal CDF from joint CDF by simulation


Yet another question about p-value interpretation

What is the meaning of p values and t values in statistical tests?


Using k-fold cross-validation for time-series model selection


When conducting a t-test why would one prefer to assume (or test for) equal variances rather than always use a Welch approximation of the df?


Are ratio response variables problematic in linear regression?

Ratios in Regression, aka Questions on Kronmal


Puzzling contradiction in introductory textbook regarding standard deviation and sample size

Difference between standard error and standard deviation


Does the model $E[Y]=\beta_0 + \beta_1 X_1 + \beta_2 X_1^2 + \beta_3 X_1^3$ meet the assumption of linearity for multiple linear regression?

Why is polynomial regression considered a special case of multiple linear regression?


Is Foreign Direct Investments per capita a count variable?


Interpreting summary function for lm model in R


Curse of dimensionality- does cosine similarity work better and if so, why?

Euclidean distance is usually not good for sparse data (and more general case)?


Do we re-estimate all the ARIMA model when we add GARCH effect?


Are the statistical results of a linear regression affected if I swap IV and DV with each other?

What is the difference between linear regression on y with x and x with y?


Principal component regression: some loadings are null. Is there any problem?

What do empty (missing) values in the output of PCA or factor analysis mean in R?


predicting the color of the next card drawn


What to check in cross-validation - MAE or MSE?

Mean absolute error OR root mean squared error?


Proof that the coefficients in an OLS model follow a t-distribution with (n-k) degrees of freedom


Method to determine outliers with a skewed dataset

Outlier Detection on skewed Distributions


Time pdf of number of poisson proscces events


Choosing a value for random_state argument in scikit-learn linear regression

Am I creating bias by using the same random seed over and over?


what is the close form expression for the update of $x_i$ in coordinate descent?

Derivation of closed form lasso solution


Is it possible for simple RNN to learn infinite sin wave?

How do I make my neural network better at predicting sine waves?


How to improve this simple neural network in keras for non-linear regression?

What should I do when my neural network doesn't learn?


Expected number of tosses until winner in game with two players with two different coins

How to solve this probability problem analytically (instead of using simulation)? Probability of Bill wins the game if he goes first


How should I interpret a non significant intercept in a GARCH model?

Should I keep a non-significant intercept in a GARCH model?


Categorical variables with too many levels in machine learning

Principled way of collapsing categorical variables with many levels?


Is there a relationship between number of covariates and sample size in logistic regression?


Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


How do PCA/SVD Decorrelate the variables

Relationship between SVD and PCA. How to use SVD to perform PCA?


What is the difference between a population and a sample?


Find $E(S)$ and $Var(S)$ of a mixture of distributions


Interpretation of beta Coefficients if Transformed in a Multivariate Cox Regression

Interpretation of log transformed predictor and/or response


Most "statistically sound" method for finding the average of multiple different metrics

Creating an index of quality from multiple variables to enable rank ordering


Amoeba Interview Question: Is the P(N=0) 1 or 1/2?


In what order should you do linear regression diagnostics?


Does the variance of a sum equal a double sum of covariances?

Covariance of a variable and a linear combination of other variables


Algorithms for automatic model selection


Problem of the pdf plot for Weibull distribution

Can a probability distribution value exceeding 1 be OK?


HAC standard error or missing ARMA terms


At which threshold is unbalanced data a problem for a binary classification tree?

When is unbalanced data really a problem in Machine Learning?


Why is accuracy not the best measure for assessing classification models?


Standardize binary variables in cluster analysis?

whether to rescale indicator / binary / dummy predictors for LASSO


Gibbs Sampler for mixture models: shall I skip some samples to avoid to use correlated samples?

How to interpret autocorrelation plot in MCMC


Conditional distribution for 3 variables

Marginal, joint, and conditional distributions of a multivariate normal


Standardizing variables with negative values?

Standardizing variables with negative values in R


Can one use Stouffer's method to integrate t-values?

Is there a t-test equivalent to Stouffer's z-test?


OLS estimator for regression without intercept

Regression without intercept: deriving $\hat{\beta}_1$ in least squares (no matrices)


What heterogeneity test is appropriate for my study? And, what is the use of correlation between median PFS and median OS

Meta-analysis of means and medians in R?


Why I am getting different $R^2$ from R LM and manual calculation?


Is there a general term for minimum, median, maximum, mean, quartiles, etc

What is the name for moments, a parameter that is calculated


The equivalence of sample correlation and R statistic for simple linear regression


What is the meaning of p values and t values in statistical tests?


Fitting data (and getting normal vectors) to planes that can be vertical

Testing for linear dependence among the columns of a matrix


Why were 'Regularization' methods (Lasso, Ridge, Elastic Net) created in the first place?


What does it mean to have a high/low value for a sample in the 1st principal component?

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Determine required sample size with unknown standard deviation

How to calculate a sample size for validating correct/incorrectness of records in a data table?


Appropriate Method for Generating Confidence Intervals for Neural Network

How to determine the confidence of a neural network prediction?


Random Effect Model or Fixed Effect Model in meta-analysis?

How to choose between fixed-effects and random-effects model in meta-analysis?


distribution of the ratio of two gamma random variables

Ratio of Gamma distributed variables with different parameters


Interpreting steep histogram, fitting distribution

Assessing approximate distribution of data based on a histogram


Why does default auto.arima stop at (5,2,5)?


Statistical interpretation of Maximum Entropy Distribution


How to deal with separation in logistic regression?

How to deal with perfect separation in logistic regression?


Good Text for Learning about Multivariate Distributions

Book recommendations for multivariate analysis


Can a probability distribution value exceeding 1 be OK?


How to solve least absolute deviation by simplex method?


Need and best way to determine normality of data

How to choose between t-test or non-parametric test e.g. Wilcoxon in small samples


Getting a constant answer while finding patterns with neuralnet package

What should I do when my neural network doesn't learn?


Alternatives to logistic regression when data is unbalanced

Does an unbalanced sample matter when doing logistic regression?


Transforming variables for multiple regression in R


Neural Network cannot learn a simple function


Neural network hyperparameters don't affect performance


If so many people use set.seed(123) doesn't that affect randomness of world's reporting?

Am I creating bias by using the same random seed over and over?


Convolutional networks: how to deal with duplicate filters?

Wouldn't multiple filters in a convolutional layer learn the same parameter during training?


Bias and variance in leave-one-out vs K-fold cross validation


ANN regression, linear function approximation


Logistic regression model fit assessment

Evaluating logistic regression and interpretation of Hosmer-Lemeshow Goodness of Fit


Can random forests use cross validation?


Criteria for choosing the most appropriate logistic regression model


Is there a reason to plot residuals vs observed values rather than residuals vs fitted values?

Trend in residuals vs dependent - but not in residuals vs fitted


How we can prove this relation for Kendall's tau


Classification and convex optimization of the cost function


A mathematical description of Partial Least Squares (PLS)?

Theory behind partial least squares regression


How to fit a gaussian curve to data for a goodness-of-fit C++?

Is Shapiro–Wilk the best normality test? Why might it be better than other tests like Anderson-Darling?


Converting the mean and std of Normal distribution to the mean and std of lognormal distribution

Can I get the parameters of a lognormal distribution from the sample mean & median?


why maximize likelihood, rather than maximizing the inverse of the likelihood?

Maximum Likelihood Estimation (MLE) in layman terms


Is the practice of doing normality test before doing t test wrong?

Is normality testing 'essentially useless'?


Why should I prefer the standard deviation over other measures of variance?

Why square the difference instead of taking the absolute value in standard deviation?


When hyperparameter tuning, do we train on the whole dataset after finding optimal parameters?

Training on the full dataset after cross-validation?


logistic regression response variable ~ Bernoulli(pi)?

theoretical basis for logistic regression


For i.i.d. random varianbles $X$, $Y$, can $X-Y$ be uniform [0,1]?

Uniform random variable as sum of two random variables


Given a set of bounded integers; find number combinations which sums to S

How to easily determine the results distribution for multiple dice?


Understanding the random effect in linear mixed models (lme4, R)


"A discrete random variable must have a finite range." Is this true? Provide examples where possible

The difference between discrete and continuous variables


What distribution results in adding two Pareto distributions


How to choose number of neurons and hidden layers?

How to choose the number of hidden layers and nodes in a feedforward neural network?


Why does the mean for a beta distribution when input into the scipy beta cdf not return 0.5?

Why are mean and median not equal for asymmetric distributions?


Algorithm to dynamically monitor quantiles


How can I reduce the noise of prediction graph?

What should I do when my neural network doesn't learn?


Dealing with NAs in Poisson Regression estimators


Hypothesis testing on proportions if $H_0: p = 0$

what statistics test should i run to show that something is significantly different from 0?


variance estimator for a symmetrical two-sides censored normal distribution

Maximum likelihood function for mixed type distribution


How can I visually determine the normality of interval data through a Q-Q Plot?

Interpreting QQplot - Is there any rule of thumb to decide for non-normality?


How to find coefficients for Logistic Regression

Why logistic regression cannot be solved by OLS


Under what circumstances can you compare the $ R^2 $ value of two models?

Is R-squared value appropriate for comparing models?


Normal distribution in nature: additive result of multiple variables?

What intuitive explanation is there for the central limit theorem?


Is it possible to estimate prevalence from a given sample size?


What is the relationship between the sum of squares of all weights and lambda in the ridge regression

Showing the Equivalence Between the $ {L}_{2} $ Norm Regularized Regression and $ {L}_{2} $ Norm Constrained Regression Using KKT


Is the linearity of Y and X an assumption for linear regression?

How to tell the difference between linear and non-linear regression models?


How to weight down older data in an OLS fit

How to down-weight older data in time series regression


Why should one scale variables before performing PCA?


Multicollinearity between categorical and continuous predictors

Multicollinearity between categorical and continuous variable


Linearity assumption of logistic regression

How should I check the assumption of linearity to the logit for the continuous independent variables in logistic regression analysis?


Nested ANOVA alternative for heteroscedastic data (Nested Welch ANOVA)

I want to do an nested ANOVA but my variances are very unequal


cumulative distribution functions (CDFs)

can you help me to do a difference of CDF?


Chi-square based tests tending to zero for large sample sizes

Why is 600 out of 1000 more convincing than 6 out of 10?


What stops gradient descent from finding the largest error?

How can change in cost function be positive?


Do OLS residuals tell us anything about the distribution of the error term?

Why do we use residuals to test the assumptions on errors in regression?


Two-sided permutation test vs. two one-sided

Doubling the tails in two-sample permutation test


Proxy for Mahalanobis distance when n < p?


Methods to work around the problem of missing data in machine learning


central limit theorem: do we care about standard deviation within one sample of size n?

Do we use the SD of whole population or SD of just one sample to calculate SE of samples means in central limit theorem?


Using (leaky) ReLU as an activation function


Where to learn the theory behind common statistical techniques

Good resources (online or book) on the mathematical foundations of statistics


In Convolutional networks, how to do input data normalization? is it necessary?

Why do we need to normalize the images before we put them into CNN?


Bayesian approach: ignoring the denominator leads to the conditional density equaling the joint density?

A question about notation of Bayes' Theorem


Interpret a multiple linear regression when Y is log transformed

Interpretation of log transformed predictor and/or response


Prediction interval for log transformed variable in Stata

Back transforming regression results when modeling log(y)


Build multiple regression model with Y as a Factor in R

Multiple Regression in R with y as a Factor


Proving the characteristic function involving sequence of 2 iid variables

Convergence of $U_n=\frac{1}{\sqrt{2n\sigma^2}}\left(\Sigma X_j-\Sigma Y_j\right)$ - central limit theorem


When generating samples using variational autoencoder, we decode samples from $N(0,1)$ instead of $\mu + \sigma N(0,1)$


Understanding d-separation theory in causal Bayesian networks


Fitting power law with loglog or exponential?


Principal component analysis- covariance or correlation matrix


Does the universal approximation theorem for neural networks hold for any activation function?


Definition of Stochastic Time-series Variable

Is a time series the same as a stochastic process?


How does Outliers affect logistic regression?

How does outlier impact logistic regression?


Obtaining knowledge from a random forest


Do I need to perform variable selection before running a ridge regression?

Before running a ridge regression model, do I need to preform variable selection?


Correlate nominal/metric data with ordinal data?

Correlation coefficient between a (non-dichotomous) nominal variable and a numeric (interval) or an ordinal variable


How to compare (probability) predictive ability of models developed from logistic regression?


Why doesn't max cross-correlation equal exactly 1 between two identical vectors with a designed-in lag? (R, ccf)

What makes cross-correlation (R, ccf) different from "sliding" one of the curves by different lags and correlating?


Does significance in correlations matter when I have data for the population?

Statistical inference when the sample "is" the population


What is the difference between model prediction and model estimation?

What is the difference between estimation and prediction?


How to convert Ridge regression into a constraint optimization problem?

How exactly to compute the ridge regression penalty parameter given the constraint?


Why Fisher Information uses Log Likelihood and not Plain Likelihood

Theoretical motivation for using log-likelihood vs likelihood


Estimating population standard deviation from subsample means

Estimate the population variance from a set of means


Can a ratio of random variables be normal?

What Ratio of Independent Distributions gives a Normal Distribution?


Calculating the distribution of maximal value of $n$ draws from a normal distribution

Asymptotic distribution of maximum order statistic of IID random normals


Counting the number of neural network parameters

What does "degree of freedom" mean in neural networks?


how to represent geography or zip code in machine learning model or recommender system?


How to compute and interpret the confidence interval on a QQ plot


What is a good method for short text clustering?


How to deal with variables that are follow ups of prior questions when using panel data?

How do you deal with "nested" variables in a regression model?


multicollinearity in logistic regression

How to detect multicollinearity in a logistic regression where all the independent variables are categorical and binary?


How to describe the support of a joint transformation

Any other way to calculate range of transformed variable?


Discrepancy between `anova` and `summary` outputs with `lmer` in the presence of interactions

Conflicting results of summary() and anova() for a mixed model with interactions in lmer+lmerTest


Panel vector autoregression models in R?

How to estimate vector autoregression & impulse response function with panel data


Whats the difference between logistic regression and fractional response model?

What is the difference between logistic regression and Fractional response regression?


Do I need to select features for XGBoost

Does feature selection help improve the performance of machine learning?


How is the Box-Cox transformation valid?


How to interpret probabilities in logistic regression with interactions?

Interpreting interaction terms in logit regression with categorical variables


Proving no unbiased estimator exists for $\theta^{-1}$ for Poisson Dist. Why is $X_1,...,X_n = \sum{X_i}$?

How does one show that there is no unbiased estimator of $\lambda^{-1}$ for a Poisson distribution with mean $\lambda$?


Why is a random walk not a stationary process?

Why does the variance of the Random walk increase?


Why is the use of the F-Statistic / p-value as a criteria in Stepwise Model Selection outdated?

Algorithms for automatic model selection


Best Resource to learn about internal working of ML algorithms for an absolute beginner?


What is the good method to select initial seeds in K-means?

Initializing K-means centers by the means of random subsamples of the dataset?


On what basis can we combine levels in a factor variable when the target variable is binary?

Penalized methods for categorical data: combining levels in a factor


Why Ridge regularization has the grouping effect

Why Lasso or ElasticNet perform better than Ridge when the features are correlated


probability of sum of 5 dice is a certain number

How to easily determine the results distribution for multiple dice?


Mismatch between analytical and simulation way for Bayesian estimation of binomial data

Discrepancy between calculated and simulated error propagation


Statistical Learning book with theoretical content

Textbook on the *theory* of neural nets/ML algorithms?


Distance in Square between Randomly Selected

How to find the expected distance between two uniformly distributed points?


Maximum Likelihood Estimation Logistic Regression

Why linear and logistic regression coefficients cannot be estimated using same method?


Usage Scenarios for Auto Encoders as alternatives to PCA

What're the differences between PCA and autoencoder?


How does uncertainty of observations propagate through linear regression fits

Understanding shape and calculation of confidence bands in linear regression


Assumption of error of logistic regression

Logistic Regression - Error Term and its Distribution


Sampling from unknown probability distribution

Why is it necessary to sample from the posterior distribution if we already KNOW the posterior distribution?


Is it possible to prove a null hypothesis?


Why do we need Auto-encoder? How is it useful in real life implementation?


Interpretability of the dimensions in t-SNE

What is the meaning of the axes in t-SNE?


What is Hypothesis set in Machine Learning?

What exactly is a hypothesis space in machine learning?


Leave-One-Out-Cross-Validation error for least squares linear regression


Ansombe-quartet-like (pedagogical) examples to demonstrate power of visualizations

Datasets constructed for a purpose similar to that of Anscombe's quartet


Functions of Independent Random Variables


Is the mean of two symmetric, independent random variables also symmetric?

The sum of two symmetric random variables is symmetric


Logistic regression with unbalanced sampling

Does an unbalanced sample matter when doing logistic regression?


Train a neural network for tic tac toe with a genetic algorithm

What should I do when my neural network doesn't learn?


PCA is an autoencoder with linear transfer functions

What're the differences between PCA and autoencoder?


How to test the significant difference between two correlation coefficients?

How to test for a significant difference between several dependent correlation coefficients?


The bias neuron in a neural network : Is my understanding right?

Importance of the bias node in neural networks


Pearson correlation binary vs continuous

Correlations between continuous and categorical (nominal) variables


What is the best way to identify outliers in multivariate data?


What is the best introductory Bayesian statistics textbook?


Why do we conduct one-way ANOVA instead of jumping right into multiple comparisons if we have a simple, single main effect dataset?

Do we need a global test before post hoc tests?


Evaluate definite interval of normal distribution


Does expected value of square of a random variable always exist?

How can a distribution have infinite mean and variance?


How I can work with data set contains both numerical and non-numerical features?

Can principal component analysis be applied to datasets containing a mix of continuous and categorical variables?


What is the meaning of p values and t values in statistical tests?


Interpretation of the t.test and Wilcox.test in R


correlation coefficient between nominal categorical variables and discrete variables in R


Maximum likelihood estimation of parameters

Maximum Likelihood Estimation (MLE) in layman terms


Can I conclude I have outliers when no coefficients are significant but f-test is significant?

Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


In a set of 10 billion possible items, if I have X items what is the probability of two being the same?


Marginal distribution of random variable with multinomial sampling distribution and parameters $(n,\boldsymbol{p})$, where $n \sim $ Poisson


Logistic regression is giving better results compared to SVM. How to explain this?

Why use logistic regression instead of SVM?


Suppose $\mathbf{X, Y}$ are independent random vectors. Are their components independent?

Functions of Independent Random Variables


Should ANOVA be used when the dependent variable is an integer, such as a count of items?


Correlation between a categorical and a continuous (scale) variable

Correlations between continuous and categorical (nominal) variables


Covariance between two products of two different type of random variable

Covariance of products of dependent random variables


Literature references to the "Greene" approach to testing overdispersions in the Poisson regression model

Poisson or quasi poisson in a regression with count data and overdispersion?


Interpretation of two residual QQ plots from poisson regression

Checking residuals for normality in generalised linear models


Choosing between alternate pseudo R squared methods

Which pseudo-$R^2$ measure is the one to report for logistic regression (Cox & Snell or Nagelkerke)?


What is the best way to identify outliers in multivariate data?


Finding $\mathrm{Var}(N)$ if $N=\inf\{n\ge1:\sum_{i=1}^nX_i>1\}$ where $X_i$'s are i.i.d Exponential variables


How outliers influence your results? and what are good and bad leverage points?

Precise meaning of and comparison between influential point, high leverage point, and outlier?


What's a simple way to generate a random sample of a continuous distribution given as a series of trapezoids using scipy?

Sampling from a piecewise linear probability density function


Evaluating goodness of fit for Bernoulli glm

Understanding lack of fit in logistic regression


Why does the standard error of the intercept change when we shift the axis, say by centering?

Why does the standard error of the intercept increase the further $\bar x$ is from 0?


large Bayesian prediction uncertainty for gam (mgcv) logistic regression

Enormous coefficients in logistic regression - what does it mean and what to do?


Independent and identically distributed samples

Are "random sample" and "iid random variable" synonyms?


How is maximum likelihood estimation method defined for non-continuous and non-discrete distributions?

Maximum likelihood function for mixed type distribution


Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


How to know if a time series is stationary or non-stationary?


How do I compute/estimate the variance of sequential data?

Online estimation of variance with limited memory


What are the odds of having all 4 of your children (no multiples) on the same day of the week?

Determining statistical probability related to a string event of dates


Why does this inequality about the false discovery proportion hold?

Why is controlling FDR less stringent than controlling FWER?


How to deal with neural networks when the data is unbalanced (but unlimited)?