How to easily determine the results distribution for multiple dice?


How can we best utilize the knowledge of P(y=1) in classification?

Reduce Classification Probability Threshold


Understanding dummy (manual or automated) variable creation in GLM


PCA to choose variables based on its loadings on PC1

Using principal component analysis (PCA) for feature selection


Are unbalanced datasets problematic, and (how) does oversampling (purport to) help?

When is unbalanced data really a problem in Machine Learning?


How to fit exponential y=A(1-exp(B*X)) function to a given data set? Especially how to determine the initial start parameters?

Why is nls() giving me "singular gradient matrix at initial parameter estimates" errors?


Choice between Type-I, Type-II, or Type-III ANOVA

How to interpret type I, type II, and type III ANOVA and MANOVA?


How is it valid to compare p-value vs alpha-value?

Comparing and contrasting, p-values, significance levels and type I error


Calculating prediction accuracy on ordered categorical data?

How to predict using ordered probit regression and calculate prediction accuracy?


How to "statistically adjust" for variables?

How exactly does one “control for other variables”?


Multicollinearity when individual regressions are significant, but VIFs are low


How can adding a 2nd IV make the 1st IV significant?


Is this weird pattern in my residual plot normal?

Trend in residuals vs dependent - but not in residuals vs fitted


Benefits of Linear Discriminant analysis over Logistic Regression

Discriminant analysis vs logistic regression


Linear regression: Unbiased estimator of the variance of outputs

Proof that regression residual error is an unbiased estimate of error variance


How to specify the ARMA model based on ACFs and PACFs?

What exactly is the Box-Jenkins method for ARIMA processes?


Posterior distribution of normal with gamma prior on the precision

Conjugate prior for a Gamma distribution


Logistic Regression: Bernoulli vs. Binomial Response Variables


How did they simplify normal equations for OLS in linear regression?

How to derive this version of variance formula


Why are multiple simultaneous inferences problematic, but not multiple inferences across time?


Statistical test between two Poisson processes

Checking if two Poisson samples have the same mean


Generate correlated continuous and categorical data in R

How to generate correlated test data that has Bernoulli, categorical, and continuous vectors (in R)?


Why we also consider the opposite signed value of test statistic in two tailed test to calculate P value?


Why is linear regression a convex optimization problem?

Is regression line (for a simple "Y given X" regression, no interaction etc) always unique?


Are there problems with arbitrary application of bootstrap?


Need more intuition for the curse of dimensionality

Why is Euclidean distance not a good metric in high dimensions?


Distribution of lengths of randomly cut string

How can I analytically prove that randomly dividing an amount results in an exponential distribution (of e.g. income and wealth)?


Why are the Degrees of Freedom for multiple regression n - k - 1? For linear regression, why is it n - 2?


interpretation of dummy coded linear regression


Identifiability for time invariant state space models

Identifiability of a state space model (Dynamic Linear Model)


significant in simple linear regression, but not significant in multiple regression, why?

Significant predictors become non-significant in multiple logistic regression


Birthday Problem: Difference between Canonical Solution and Approximation


Real life examples of difference between independence and correlation

Simple examples of uncorrelated but not independent $X$ and $Y$


Confusion regarding "regression by successive orthogonalization"

Question on how to normalize regression coefficient


Is PCA still done via the eigendecomposition of the covariance matrix when dimensionality is larger than the number of observations?


Selecting subset of variables most associated with the principal components of the data

What is the proper association measure of a variable with a PCA component (on a biplot / loading plot)?


Chi-Square-Test: Why is the chi-squared test a one-tailed test?


1% of the global population means roughly 1% in my country?

Subsample of a random sample: random sample?


Why does regularization of coefficient magnitude improve the generalization of linear regression?


Why exactly is a sample of size 142 too small for 11 variables?


Flipping a fair coin three times: How to find independent/dependent events?

$X_i, X_j$ independent when $i≠j$, but $X_1, X_2, X_3$ dependent?


Difference between standard error and standard deviation


Do you merge your validation and training sets?

Training on the full dataset after cross-validation?


Multivariate multiple regression validation


Why is leave-one-out cross-validation (LOOCV) variance about the mean estimate for error high?

Bias and variance in leave-one-out vs K-fold cross validation


How to obtain real observation from simulated pseudo observation? (from the copula)

How do I convert simulated values from a copula to "real" observations? R


Why is $x + x = 2x$, but $X + X \neq 2X$?


Getting Information out of Blackbox Models - RandomForest / XGBoost

Obtaining knowledge from a random forest


What is the distribution for the maximum (minimum) of two independent normal random variables?

Computation of distribution parameters for the maximum of two random variables


is there a geometric interpretation of canoncial correlation analysis?

How to visualize what canonical correlation analysis does (in comparison to what principal component analysis does)?


What is the mathematics definition of the F value in the ANOVA table?

What's the mathematics definition of the F value in Analysis of Variance Table?


Dealing with violations of assumptions of OLS regression, normality and linearity of residuals

In what order should you do linear regression diagnostics?


what is the meaning of 'tail' of kurtosis?


Automatically find the best growth (linear, quadratic, exponential, etc.) to fit the points

Determining best fitting curve fitting function out of linear, exponential, and logarithmic functions


Modelling a censored outcome (tobit) with correlated data (random effect) in R


Can a probability distribution value exceeding 1 be OK?


How to interpret logistic regression output?

Should covariates that are not statistically significant be 'kept in' when creating a model?


Linear regression to minimize the Cost Function


Generating samples from singular Gaussian distribution

Generate normally distributed random numbers with non positive-definite covariance matrix


Sums-of-Squares (total, between, within): how to compute them from a Distance Matrix?


Maximum likelihood estimator for multivariate normal distribution

Need help to understand Maximum Likelihood Estimation for multivariate normal distribution?


Comparing difference between two polynomial regression models in R

Compare the statistical significance of the difference between two polynomial regressions in R


Sample size calculation for Poisson / Binomial type data

Determining sample size when given Confidence Interval and margin of error in a finite population


What are the disadvantages of using Lasso for feature selection in classification problems?

What are disadvantages of using the lasso for variable selection for regression?


how is it possible for a model with maximum AUC to not also have minumum misclassification error?

Why is AUC higher for a classifier that is less accurate than for one that is more accurate?


calculate the ACF of $y_{t}=x_{t}x_{t-1}$

Functions of Independent Random Variables


Interpretation of values contained in a confidence interval

Relation between confidence interval and testing statistical hypothesis for t-test


Interpretation of simple predictions to odds ratios in logistic regression


Estimate ARMA coefficients through ACF and PACF inspection


What is the difference between converges in probability and distribution

Intuitive explanation of convergence in distribution and convergence in probability


Bhattacharya Distance on Distributions (Matrices) with Different Number of Variables (Dimensions)

Combining Bhattacharya Distance (or A Measure of Similarity) --- across Different Variables (Properties)


Regression method if dependent variable is the absolute value of a continous variable


Retrieving minimum width that contains specified fraction of all values


Marginal density and conditional density from joint density

Problem obtaining a marginal from the joint distribution


How to find approximation of variance of $i^{th}$ order statistic

Central limit theorem for sample medians


Shortcut connections (from Deep Residual Learning)

Neural network with skip-layer connections


Cox proportional hazard for multiple groups - meaning?

Understanding dummy (manual or automated) variable creation in GLM


What is the difference between fixed effects model and random effects model for a meta-analysis of sample correlations?

How to choose between fixed-effects and random-effects model in meta-analysis?


Explain the xkcd jelly bean comic: What makes it funny?


Is the Mann-Whitney U Test appropriate for assessing the busiest day of the week?

What is the appropriate statistical test when calculating the busiest day of the week?


Rate at which a Gaussian random variable is the maximum in a set of independent Gaussian random variables

$P(X_1 < \min(X_i,\ldots, X_n))$ across different normal random variables


How to check if two samples come from the same population?

Test of whole distribution for two samples


Is it reasonable to estimate the CDF of a random variable with the help of kernel density estimation?

How do I estimate a smooth cdf from a set of observations?


Cluster analysis on weighted survey data with continuous and categorical variables


How are bayesian probabilities represented in a probability space?

How exactly do Bayesians define (or interpret?) probability?


Unstable projection in LDA space in $n<p$ situation

Does it make sense to combine PCA and LDA?


Show that $\frac{X}{X+Y}\sim Beta(\alpha,\beta)$

What is the intuition behind beta distribution?


Probability of all family members having birth week in series according to their age

Birthday paradox with a (huge) twist: Probability of sharing exact same date of birth with partner?


Power analysis from Bayesian point of view

Is power analysis necessary in Bayesian Statistics?


Should K=2 softmax regression and logistic regression give the same results?

Relationship between logistic regression and Softmax Regression with 2 classes


Statistical inference when the sample "is" the population


How does the Central Limit Theorem show that the Binomial Distribution is approximately Normal for a large value of n?

What intuitive explanation is there for the central limit theorem?


Diagnostics for a negative binomial model


How to perform logistic regression with unbalanced classes?

Does an unbalanced sample matter when doing logistic regression?


How can the formula for the expectation of a log-normal random variable be dimensionally sound?

lognormal distribution, standard-deviation and (physical) units


When is it ok to remove the intercept in a linear regression model?


Simulating a Brownian Excursion Process using Software

Simulating a Brownian Excursion using a Brownian Bridge?


Why under joint least squares direction is it possible for some coefficients to decrease in LARS regression?

Is there a clear set of conditions under which lasso, ridge, or elastic net solution paths are monotone?


How to know where to put bias terms in neural nets?

Why are bias nodes used in neural networks?


What does it mean "being normally distributed"


What to do with dummy variable that is not significant?

Can I ignore coefficients for non-significant levels of factors in a linear model?


How to create a covariate × time interaction term in Cox regression?

What’s wrong with this way of fitting time-dependent coefficients in a Cox regression?


Testing two logistic regression models with same coefficients on different time samples

Test the significant differences between the coefficients obtained by logistic regression on two data sets.


What does it mean to sample a data point from or according to a distribution?


Q-learning algorithm in reinforcement learning

How to fit weights into Q-values with linear function approximation


Relationship between R2 and correlation coefficient

Relationship between $R^2$ and correlation coefficient


How to Simulate Random Multivariate Correlated Data and Uncorrelated Data for a given correlation coefficient and P value in R?

How to simulate data that satisfy specific constraints such as having specific mean and standard deviation?


Explicit solution for linear regression with two predictors

Closed form solution for slope coefficients in bivariate regression


Multi Armed Bandit and Price Optimization


if it rains 75% of days, i take a sample of n=30 days, what is the probability of rain for 20+ days


Why is Training Neural Nets a Non-Convex Optimization Problem?

Cost function of neural network is non-convex?


What's the role of ReLU units in Convolutional neural networks?

Why do we use ReLU in neural networks and how do we use it?


Equivalent of significance in population data?

Test for significance with data representing the whole population?


Combining probabilities/information from different sources


Logistic regression as a special case of softmax regression

Is binary logistic regression a special case of multinomial logistic regression when the outcome has 2 levels?


Do I need to guess a distribution to use MLE?

Is Maximum Likelihood Estimation (MLE) a parametric approach?


What are the assumptions of maximum likelihood estimation for a linear regression?


correlation between a continous variable and categorical variable?

Correlation between a nominal (IV) and a continuous (DV) variable


Does two-sample chi-square test require equal sample sizes?

Chi-squared test when two vectors have different lengths


Calculating the p-value of two independent counts?

Checking if two Poisson samples have the same mean


Multiple binary logit regressions vs multinomial logit regressions?

Multinomial logistic regression vs one-vs-rest binary logistic regression


Understanding the Chi-squared test and the Chi-squared distribution


What is the meaning of p values and t values in statistical tests?


What's the difference between multivariate regression and univariate regression?


When was the k-means clustering algorithm first used?


Does 10 heads in a row increase the chance of the next toss being a tail?


What is way to measure relationship between independent categorical variable on dependent variable (categorical/continuous)?

Correlations between continuous and categorical (nominal) variables


Distribution of samples from a uniform distribution

Consider the sum of $n$ uniform distributions on $[0,1]$, or $Z_n$. Why does the cusp in the PDF of $Z_n$ disappear for $n \geq 3$?


Conditional logistic regression: within subject matching instead of McNemar

Relationship between McNemar's test and conditional logistic regression


Can K-S goodness-of-fit be used on estimated models?

Kolmogorov-Smirnov for Pareto distribution on sample


What is the difference between the studentized and non-studentized Breusch-Pagan test?

What is the difference between these two Breusch-Pagan Tests?


2x3 ANOVA interaction no longer significant after including a covariate?

Why is ANOVA interaction no longer significant after including a covariate?


Activation value at output neuron equals 1, and the network doesn't learn anything

What should I do when my neural network doesn't learn?


What are some good exploratory analysis and diagnostic plots for count data?


trouble in prediction in neural network classifier


How to account for different degrees of familial relatedness (eg, twins) in a linear mixed model? Is heteroscedasticity a problem?

Linear mixed-effects modeling with twin study data


How to cluster/analyze effect sizes after meta-analysis? (meta-meta-analysis)


Formulate equation after fitting to log(y)~x) using lm()

How to translate the results from lm() to an equation?


How many clusters I should choose using spectral clustering?

How to decide on the correct number of clusters?


Negative values for AIC in General Mixed Model

Negative values for AICc (corrected Akaike Information Criterion)


Higher variance in sample mean or sample median?

For what (symmetric) distributions is sample mean a more efficient estimator than sample median?


Why do p-values have uniform distribution for normally distributed data

Why are p-values uniformly distributed under the null hypothesis?


When wouldn't I use LASSO for model selection?


Optimization when Cost Function Slow to Evaluate


Simulating data based on correlation coefficient?

Tool for generating correlated data sets


How to draw samples from a multivariate Gaussian distribution without having access to a function that does the job?

Generating values from a multivariate Gaussian distribution


Testing random variate generation algorithms


Regression with cyclic/modular variables

Use of circular predictors in linear regression


How can logistic regression have a factorial predictor and no intercept?


Are the terminologies of score and principal component in PCA equivalent?

What exactly is called "principal component" in PCA?


How to compare features and classifiers which achieve perfect accuracy?


Regression when each point has its own uncertainty in both $x$ and $y$


Issues with sequential feature selection


How to sample from a discrete distribution?

How to generate numbers based on an arbitrary discrete distribution?


What is the difference between principal component analysis (PCA) and principal component regression (PCR)?

Is principal component regression (PCR) using principal component scores for regression?


Why do some statistics symbols have a "squared", e.g. Variance $\sigma^2$, "R squared" $R^2$ or heritability $H^2$


What is the difference between a population and a sample?


Find multivariate pdf of a multivariate function

product of normal and lognormal variates


Confidence Intervals for Outputs of Regression?

Obtaining a formula for prediction limits in a linear model (i.e.: prediction intervals)


Is there a way to visualize what "Minimal sufficiency" and "Completeness" of a statistic means?

Basic intuition about minimal sufficient statistic


Dimensional analysis for a qdf/quantile function corresponing to the pdf/CDF (size distribution of income example)

Can a probability distribution value exceeding 1 be OK?


Interpretation of regression coefficient, which is dlog-log variable?

Interpretation of log transformed predictor and/or response


Ranking two models based on ROC-AUC and PR-AUC


Does a linear model make assumptions about distributions of depended and independent variables?

Multiple Regression, Normal distribution and Normalization


How can I group different levels of classes of a categorical variable in logistic regression?

Grouping predictor factor levels based on response variable


Contributions of variables in Log-Log models


Is correlation required condition for causation?


Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


How can I use importance sampling to estimate $p$?

Intuitive examples of importance sampling


How are AUROC scores computed with just two vectors of actual and predicted values as input?

How to calculate Area Under the Curve (AUC), or the c-statistic, by hand


Given $X,Y$ are independent Poisson random variables. Distribution of $Y-X$?

From the bivariate poisson to the Skellam (or Poisson Difference) distribution


How should I transform non-negative data including zeros?


Is there a rule for number of hidden nodes in a layer and number of hidden layers

How to choose the number of hidden layers and nodes in a feedforward neural network?


Weighted probability distribution function

What is the variance of the weighted mixture of two gaussians?


Why is Bayes theorem more popular than the normal definition of P(A|B)?

When to use Bayes' theorem to calculate conditional probability?


Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Standard deviation of quantities with errors

Determining true mean from noisy observations


What are good resources to learn about GLM?

Reference Request: Generalized Linear Models


Hierarchical clustering with categorical variables - what distance/similarity to use in R?

What is the optimal distance function for individuals when attributes are nominal?


What does the notation $\chi_{(V\ge1)}$ mean in probability / statistics?

What does capital letter I mean in this formulas?


How to Compare of Knowledge using questionnaire for paired data?

Before and after data: Which test for average comparison of Likert scale data?


When is Variance Statistically Significant?

Do descriptive statistics have p-values?


Whether to delete cases that are flagged as outliers by statistical software when performing multiple regression?


Explaining to laypeople why bootstrapping works


How to find the beta value from linear regression model?

Algorithm for minimization of sum of squares in regression packages


Identity link and log link in Poisson regression

Interpreting coefficients for Poisson regression


Probability Density Function of the sum of N random variables

PDF and CDF of sum of random variables with different distributions


Correlation non-significant and unique variance significant in the multiple regression analysis

How can adding a 2nd IV make the 1st IV significant?


Uninformative (flat) Prior density for non-linear functions

What is an "uninformative prior"? Can we ever have one with truly no information?


how to find probability cut off in logistic regression

How to determine best cutoff point and its confidence interval using ROC curve in R?


Principal Components Analysis Terminology

What exactly is called "principal component" in PCA?


How can all of these categories be insignificant in my logistic regression

High p-values for logistic regression variable that perfectly separates?


why sample variance has has n-1 in the denominator?

Intuitive explanation for dividing by $n-1$ when calculating standard deviation?


How to use a one-to-one mapping to transform the support of K-dimensional Dirichlet distribution to K-1 dimensional Euclidean space?

How to perform isometric log-ratio transformation


How Many Variables to use In Real Life Models

Should parsimony really still be the gold standard?


How to initialize EM-algorithm when trying to fit data to a separable mixture model?


A simple question about cross-validation

How does leave-one-out cross-validation work? How to select the final model out of $n$ different models?


Is there a Bayesian interpretation of linear regression with simultaneous L1 and L2 regularization (aka elastic net)?


Given correlation and linear relationship between x and y find a linear relationship with the variables switchrd

Effect of switching response and explanatory variable in simple linear regression


Likelihood Ratio Test for Exponential Distribution with a Limited Parameter Space


Regression: centered vs. uncentered predictors

Why could centering independent variables change the main effects with moderation?


Appropriate use of logarithmic notations in publications

In statistics, should I assume $\log$ to mean $\log_{10}$ or the natural logarithm $\ln$?


When using principal components as predictors in linear regression, PC1 comes out not significant

How can top principal components retain the predictive power on a dependent variable (or even lead to better predictions)?


Evaluating Classification Models with Class Probabilities

Determine accuracy of model which estimates probability of event


filling missing data with other than mean values

How to perform imputation of values in very large number of data points?


How to select a threshold for logistic regression in case of imbalance in class distribution

Does an unbalanced sample matter when doing logistic regression?


Interpretation of mean absolute scaled error (MASE)


Where can I find useful R tutorials with various implementations?


"Accept null hypothesis" or "fail to reject the null hypothesis"?

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


How to interpret $\mathbb{P}(B|A)$ when $\mathbb{P}(A) = 0$


forecast(method ='arima') ; auto.arima() function, how to avoid forecast not in line with history?

ETS() function, how to avoid forecast not in line with historical data?


Generate data from a t-distribution with specified mean and standard deviation

Generate t distributed random variable in matlab


Different random seeds lead to big classifier performance difference


what is the difference between binary cross entropy and categorical cross entropy?

Should I use a categorical cross-entropy or binary cross-entropy loss for binary predictions?


Pattern of out-of-sample reconstruction error in NMF cross-validation: why is it monotonically decreasing?

How to choose an optimal number of latent factors in non-negative matrix factorization?


Proper Sampling - can I collect a two-group sample this way without issues?

Does down-sampling change logistic regression coefficients?


What are the moments of a multivariate distribution?

Let $\mathbf{Y}$ be a random vector. Are $k$th moments of $\mathbf{Y}$ considered?


Getting p-values from a mixed-effect ANOVA

How to obtain the p-value (check significance) of an effect in a lme4 mixed model?


Suggestion for statistical analysis. Is generalized estimating equation (GEE) a good option?

Difference between generalized linear models & generalized linear mixed models


Logical reasons for choosing regression through the origin

When is it ok to remove the intercept in a linear regression model?


Confusion of significance of predictor variable in model

How can adding a 2nd IV make the 1st IV significant?


Testing the goodness of fit for a Poisson model

When someone says residual deviance/df should ~ 1 for a Poisson model, how approximate is approximate?


How to implement a uniform random walk on a simplex?


When do we calculate the population parameter instead of sample statistics?

What is the difference between a population and a sample?


What is the multivariate analog of the median?

Is there an accepted definition for the median of a sample on the plane, or higher ordered spaces?


How calculate mean from 50th and 95th percentile?

How do I determine parameters of normal & lognormal distribution given two points?


Why does the coefficient of a categorical variable (coded 0,1) change when we exclude an intercept in linear regression?

Removing intercept from GLM for multiple factorial predictors only works for first factor in model


Unpaired t-test: large samples, unequal variances, unequal sample sizes

How to choose between t-test or non-parametric test e.g. Wilcoxon in small samples


To exclude or include the intercept in GLM model


How to find conjugate prior for a given distribution?

Having a conjugate prior: Deep property or mathematical accident?


logistic regression - unbalanced classes

Does an unbalanced sample matter when doing logistic regression?


Unbalanced distribution of sample size between groups in logistic regression: should one worry?


Parameter estimation problem: maximum likelihood

Maximum Likelihood Estimation (MLE) in layman terms


how to evaluate logistic regression given binary labels

How to compare (probability) predictive ability of models developed from logistic regression?


What is the relationship between orthogonal, correlation and independence?


Is there a name for "uncentered covariance matrix"?

Is there an intuitive interpretation of $A^TA$ for a data matrix $A$?


Determining PCA scores for a new data point

How to project a new vector onto PCA space?


Apply cor() to test many correlations at once


Principal Component Analysis, computing the degree of freedom

Testing for linear dependence among the columns of a matrix


How to interpret the student t statistic in a sas proc univariate output

What is the meaning of p values and t values in statistical tests?


Finding precision of Monte Carlo simulation estimate


Categorical Variables - Factor Reduction - Can I use the dependent variable?

Principled way of collapsing categorical variables with many levels?


Explaining Mean, Median, Mode in Layman's Terms


Conflicting results of summary() and anova() for a mixed model with interactions in lmer+lmerTest

Why do lme and aov return different results for repeated measures ANOVA in R?


Why does an insignificant regressor become significant if I add some significant dummy variables?

How can adding a 2nd IV make the 1st IV significant?


How do you specify Exponential distribution in glm() in R?

Fitting exponential (regression) model by MLE?


What is the proof of $\mathbb{E}\Phi (X) = \Phi\left(\frac{\mu}{\sqrt{1+\sigma^2}}\right)$, where $X \sim \mathcal{N}(\mu,\sigma^2)$?

How can I calculate $\int^{\infty}_{-\infty}\Phi\left(\frac{w-a}{b}\right)\phi(w)\,\mathrm dw$


Negative correlation coefficient but positive regression coefficeint

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


How to compute classification accuracy of PCA?


Methods for meta-analysis: z-transform (Stouffer's approach) vs. Fisher's method vs.... infinite others?

When combining p-values, why not just averaging?


How to plot an ellipse from eigenvalues and eigenvectors in R?


Given two correlations in a 3 by 3 correlation matrix, what are allowed values for the third correlation?

If A and B are correlated with C, why are A and B not necessarily correlated?


Rationale behind iterating standard deviation after removing outliers

Iterative process for removing extreme samples


Effectiveness of using linear regression on a categorical response

What is the difference between linear regression and logistic regression?


Probability of selecting each item at least once when sampling with replacement

Mars attack (probability to destroy $n$ spaceships with $k \cdot n$ missiles)


logistic regression simulation doesn't converge

Logistic regression model does not converge


How to drop certain values for a factor variable while fitting a GLM?

Can I ignore coefficients for non-significant levels of factors in a linear model?


The meaning of representing the simplex as a triangle surface in Dirichlet distribution?


Why is "the probability that a continuous random variable equals some value always zero"?

$P[X=x]=0$ when $X$ is continuous variable


Which one to choose Type-I, Type-II, or Type-III ANOVA?

How to interpret type I, type II, and type III ANOVA and MANOVA?


Time series analysis: alternative to Brockwell & Davis

Books for self-studying time series analysis?


Adding new variables makes regression coefficients individually insignificant

Significant predictors become non-significant in multiple logistic regression


Are moments related to moments in physics?

What's so 'moment' about 'moments' of a probability distribution?


PDF and CDF of sum of two independent $\Gamma$-distributed random variables


How to interpret these results from poly() in binary logistic regression with GLM?

Why the significance of terms in orthogonal polynomial regression changes with the degree of the regression


What's the name of this "barcode-like" graph (used for visualizing spread in data)?

What is the name of this plot using vertical lines to show a distribution?


Distance between two points with covariance

What is the distribution of the Euclidean distance between two normally distributed random variables?


Use of "post-hoc" tests - do these require an ANOVA to be performed first?

Do we need a global test before post hoc tests?


How does upsampling rare events affect the interpretation of logistic regression?

Does down-sampling change logistic regression coefficients?


What are some examples of statistics problems where Bayesian and frequentist approaches give different answers?

Examples of Bayesian and frequentist approach giving different answers


What is the formula of the finite population correction factor?


Books for self-studying time series analysis?


What is the relationship between gradient boosting and gradient decent?

How is gradient boosting like gradient descent?


Difference between density and probability

Can a probability distribution value exceeding 1 be OK?


Difference between the two way of performing Kolmogorov-Smirnov normality test

Normality test for anova mixed model in SPSS: I did it in two ways but the results are contrasting


Valid way of plotting Out-of-Bag error combined randomForest model

Combining randomForests in R, why are the err.rate, mse and rsq components NULL


Fit regression model from a fan-shaped relation, in R


Why does my multivariate normal have a density greater than 1 (log-likelihood greater than 0)?


Getting exactly same forecasted values in auto arima


Why anova has different result on the same dataframe?

Coefficient changes sign when adding a variable in logistic regression


Random effect specification in lmer mixed effect model


How small a quantity should be added to x to avoid taking the log of zero?


Clustering with categorical and numeric data


Tilted rectangle in residuals vs fitted plot

Interpreting the residuals vs. fitted values plot for verifying the assumptions of a linear model


Simulate multinomial logistic regression model

Simulating Multinomial Logit Data with R


Linear Mixed-Effects Models (lmer function in R) - Statistical significance?

How to obtain the p-value (check significance) of an effect in a lme4 mixed model?


Can someone explain Metropolis Hastings algorithm with simplest possible example?

Understanding MCMC and the Metropolis-Hastings algorithm


Expected number of tries required for consecutive successes

Closed form recurrence formula for getting N consecutive heads on a coin


Do I need to include a squared and linear variable in a random forest to achieve a parabolic effect?


Why the solution of MLE based on gaussian assumption and the solution of residual-sum of squares are same?

Equivalence between least squares and MLE in Gaussian model


If k-fold cross validation is not for model selection, then how do I know which instance to use?

Model selection and cross-validation: The right way


Project Euler Problem 213 (continued...)

How should one approch Project Euler problem 213 ("Flea Circus")?


Extreme value distribution for univariate normal: Derive parameters of the Gumbel

Extreme Value Theory - Show: Normal to Gumbel


Why would parametric statistics ever be preferred over nonparametric?


Best practice when analysing pre-post treatment-control designs


What does the hidden layer in a neural network compute?


linear versus nonlinear dimensionality reduction techniques

How to understand "nonlinear" as in "nonlinear dimensionality reduction"?


Understanding linear algebra in Ordinary Least Squares derivation


Why is it sufficient to minimize expected prediction error (EPE) pointwise?


How to define critical value of ACF and PACF like R graph?

Confidence bands in case of fitting ARIMA in R?


Given the marginal distributions of $X$ and $Y$, how do I find the joint distribution?

Joint distribution of two dependent variables


Why does PCA maximize total variance of the projection?


Probability of being $\$5$ up after $25$ plays of a game of Heads and Tails (fair coin)

Probability mass function of the sample mean


How to read scientific notation output (numbers that include "e")?

What does the notation like 8.6e-28 mean? What is the 'e' for?


R squared generated from regression with randomly generated variables

What is the distribution of $R^2$ in linear regression under the null hypothesis? Why is its mode not at zero when $k>3$?


What is the name of this kind of visualization, with arrows showing count of different subsets?

What is the proper name for a "river plot" visualisation


In the Metropolis algorithm, if the ratio of probabilities $r$ is less than $1$, why not directly reject instead of accepting with probability $r$?

Questions about acceptance rule of Metropolis algorithm


What is partial least squares (PLS) regression and how is it different from OLS?

Theory behind partial least squares regression


How to generate logarithms for observations in negative value

How to transform negative values to logarithms?


Why the weighted least square $R^2$ from R summary doesn't match my manual calculation

Is a weighted $R^2$ in robust linear model meaningful for goodness of fit analysis?


Using correlation to eliminate predictors?

Is using correlation matrix to select predictors for regression correct?


Understanding Bayesian Predictive Distributions


Why would I need both a validation set & a test set if I'm not selecting a model?

What is the difference between test set and validation set?


Difference between epoch and batch size in neural network


why kernel methods are called kernel ? where is the intuition?


Interpret Wilcoxon-Mann-Whitney Result in R

How do I interpret the Mann-Whitney U when using R's formula interface


What is an accepted equivalent of non-parametric version two-way ANOVA in R package?

What is the non-parametric equivalent of a two-way ANOVA that can include interactions?


Meta analysis using the effect size based on mean and multiple outcomes


Multivariate log-normal probabiltiy density function (PDF)


How to estimate mean and variance of censored normal?

How to model this odd-shaped distribution (almost a reverse-J)


Derivation of closed form lasso solution: KKT optimality conditions


Good book on vector valued distributions?

Book recommendations for multivariate analysis


Mixed effects model with level 2 explanatory variable

Can a variable be both random and fixed effect at the same time in a mixed effect model?


Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Clustering, reducing number of levels of categorical variable

Preprocess categorical variables with many values


Confidence intervals: how do we have to interpret them?


What is the purpose of a t-distribution?

Why use Student's t distribution rather than Student's z distribution


How to forecast a very small time serie (26 observations)?


What is your favorite statistical graph?


What, precisely, is a confidence interval?


Why beta sign is different than correlation sign?

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


Simple Bayesian classification has me discouraged


Deriving the Bivariate Normal Distribution from Normal Distributions

Is it possible to have a pair of Gaussian random variables for which the joint distribution is not Gaussian?


How to recreate a particular image from PCA from a database of images?

How to reverse PCA and reconstruct original variables from several principal components?


Cluster into communities a graph with negative edge weights representing repulsion

Graph clustering algorithms which consider negative weights


How to deal with a model that can't be fit due to quasi-complete separation?

How to deal with perfect separation in logistic regression?


How to find strongly connected subgraphs in a graph?


How to report data for an entire population?

Statistical inference when the sample "is" the population


In regression, Why correlated error terms makes overconfidence?

Why autocorrelation affects OLS coefficient standard errors?


How to find distribution function of sum of 2 random variables that are uniformly distributed?

general solution sum of two uniform random variables aY+bX=Z?


Obtaining knowledge from a random forest


The mean and variance of the inverse of a normal distribution

Mean and variance of inverse of a normal RV


K means algorithm for Big Data Analytics

How to understand the drawbacks of K-means


Can I use binary variables in logistic glm in R?

Modelling a binary response variable with a binary explanatory variable


While dealing with imbalanced classes, to what extent can we upsample a minority class?

When is unbalanced data really a problem in Machine Learning?


How to calculate the distribution of the minimum of multiple exponential variables?


Classification model on a highly unbalanced dataset


Distribution of $s^*w$ if $s$ and $w$ are i.i.d. isotropic unit norm complex vectors

Distribution of scalar products of two random unit vectors in $D$ dimensions


Why is Normal Distribution required to perform an independent t-test?

Normality of dependent variable = normality of residuals?


How do you choose what variables are dependent/independent in regression?

How to determine which variables are dependent or independent?


E and M step for applying EM on zero inflated Poisson Regression

How do you use the EM algorithm to calculate MLEs for a latent variable formulation of a zero inflated Poisson model?


use of singular value decomposition for dimensionality reduction

Relationship between SVD and PCA. How to use SVD to perform PCA?


How to infer correlations from correlations


How can you model a finite mixture model where it is over a dirac point mass?

How to sample from a discrete distribution?


How can I calculate this integral? $\int_{-\infty}^{\infty} \Phi (a + bX) \phi (c + eX) dx$

How can I calculate $\int^{\infty}_{-\infty}\Phi\left(\frac{w-a}{b}\right)\phi(w)\,\mathrm dw$


Confused by extremely high autocorrelation

What is the autocorrelation for a random walk?


Using a model with domain/image constraints

Why is nls() giving me "singular gradient matrix at initial parameter estimates" errors?


Variance of a predicted $y$ when $x_0$ is given?


Scaled vs non-scaled PCA, which is more accurate?


Sparsity in Lasso and advantage over ridge (Statistical Learning)

Why does the Lasso provide Variable Selection?


Cannot understand this residuals plot in r

Interpreting the residuals vs. fitted values plot for verifying the assumptions of a linear model


Estimate ARMA coefficients through ACF and PACF inspection


Confidence interval of the mean for a beta distribution when alpha and beta are estimated

Calculate the confidence interval for the mean of a beta distribution


Conjugate prior to a Dirichlet sample distribution?

Bayesian estimation of Dirichlet distribution parameters


What are the main differences between principal component analysis PCA and factor analysis

What are the differences between Factor Analysis and Principal Component Analysis?


Correlation coefficient contradicts t-test


Best Graph for Comparing Data with a Nominal DV and Nominal IV?

Which is the best visualization for contingency tables?


Difference in sign of correlation coefficient and regression slope

Positive correlation and negative regressor coefficient sign


Is there any alternative to the EM algorithm?


Principal component analysis "backwards": how much variance of the data is explained by a given linear combination of the variables?


Continuous Markov Chains: Deriving the Transition Matrix from the Generator Matrix

Deriving Transition Matrix of the Embedded Markov Chain given the generator matrix?


Interpretation of log transformed coefficients, OLS regression

Interpretation of log transformed predictor and/or response


LSTM for time series forecasting bad performance

What should I do when my neural network doesn't learn?


Neural Network gives exact same values of previous day for 1 day ahead prediction


Should one merge training and testing sets when predicting a class of a new sample?

Training on the full dataset after cross-validation?


What is the expected amount of time it takes to first observe a triple for multiple dice rolls?

Odds of rolling doubles or triples given N 6-sided dice


How to get intuitive understanding of common fundamental distributions

Real-life examples of common distributions


Correlation between different types of variables( categorical/numerical) and a binary categorical one output

Correlations with unordered categorical variables


What does a "closed-form solution" mean?


Why square the difference instead of taking the absolute value in standard deviation?


Comparing and contrasting, p-values, significance levels and type I error


Does linear regression assume all variables (predictors and response) to be multivariate normal?

What if residuals are normally distributed, but y is not?


Logistical regression - very few 1's in response vector "Y"

problems in doing logistic regression with unbalanced sample, give me some references


Statistical modeling resources for a beginner

Tips and tricks to get started with statistical modeling?


Why does the product of the bivariate regression coefficients of the $y$-on-$x$ line and $x$-on-$y$ line equal the square of the correlation?


Expected number I will be on after drawing cards until I get an ace, 2, 3, and so forth


A good step by step second graduate course textbook for a mathematical statistics textbooks

Good resources (online or book) on the mathematical foundations of statistics


What is the probability (area) of overlap of two normal distributions having EQUAL variance

Calculate probability (area) under the overlapping area of two normal distributions


When sample size is large, can I get away with 10 bootstrap resamples?

Rule of thumb for number of bootstrap samples


Evaluation measures of goodness or validity of clustering (without having truth labels)


Correlations with unordered categorical variables


difference between R square and rmse in linear regression

What is the difference between "coefficient of determination" and "mean squared error"?


Test logistic regression model using residual deviance and degrees of freedom


How to calculate likelihood of linear regression

Equivalence between least squares and MLE in Gaussian model


Weighting of the loss function for unbalanced data

Does an unbalanced sample matter when doing logistic regression?


Do estimated probabilities obtained after logistic regression sum up to the total number of observed successes?


Composite Likelihood in the multivariate gaussian distribution

Conditional Multi-variate Normal Distribution


Conceptual difference between correlation and regression

Similarities and differences between correlation and regression


Uncertainty of PDF quantile estimated from empirical PDF


Explaining quantile regression to nonstatisticians


Interpretation of positive/negative and magnitude of coefficients in Lasso

Interpretation of LASSO regression coefficients


First Difference transformation of log variable

Interpreting coefficients of first differences of logarithms


Are the terms probability density function and probability distribution (or just "distribution") interchangeable?

Probability density and distribution function


Mean for grouped data when midpoints are unknown

Lognormal distribution using binned or grouped data


What is the fundamental confidence interval fallacy?

What, precisely, is a confidence interval?


Why is ridge regression called "ridge", why is it needed, and what happens when $\lambda$ goes to infinity?


How should tiny $p$-values be reported? (and why does R put a minimum on 2.22e-16?)


Equivalence between Elastic Net formulations


Is it the same standardized coefficients and semi-partial coefficients?

Multiple regression or partial correlation coefficient? And relations between the two


How would PCA help with a k-means clustering analysis?


wilcoxon signed rank test to test paired data?


Is a time series the same as a stochastic process?


Dealing with unassigned clusters in (MiniBatch)KMeans?

What do you do when a centroid doesn't attract any points? (K-means empty cluster problem)


How to tell the difference between linear and non-linear regression models?


How much sense does a p-value of <2e-16 make?


For lm() coefficient in R, why not give slope directly? Focus "slope",not a parameter estimation method


How to choose the window size of Parzen-window density estimation with Gaussian kernel?

Choosing a bandwidth for kernel density estimators


How to build a model with a continuous response variable bounded from 0 to 1?

Regression for an outcome (ratio or fraction) between 0 and 1


How do I find the distribution of sum of Two Dependant Random Variables?

What am I doing wrong? Joint Density of sum of random variables!


What is $X$, it doesn't seem to be a set in the usual mathematical sense, even though it's often referred to as one


Updating posterior distribution in online fashion


Can you add the probabilities of a classifier to better predict an outcome?

would adding the probabilities in a dataset be more accurate than the individual results?


How do I get from the eigenvectors of the covariance matrix to the regression parameters?

How to perform orthogonal regression (total least squares) via PCA?


Sampling from conditional distribution using copula

Sampling from copula given a particular value of marginal


how to model response variable is bounded by a predictor variable

bounded predictor variable modeling constraint


Multicollinearity - doubt on regression coefficients

Mathematical Basis behind inflation of Standard errors of Regression estimates due to multicollinearity


Random forest regressor has a negative score


Statistical significance versus sample size

How to choose significance level for a large data set?


Warning message: glm.fit: fitted probabilities numerically 0 or 1 occurred ? What does it mean and how to fix it?

How to deal with perfect separation in logistic regression?


Mean of the bootstrap sample vs statistic of the sample

Is the mean of equal length subsets always equal to the mean of the set?


does the area under the curve (AUC) has some interpretation?


Generating a skewed distribution given the median and left and right "$1\sigma$" limits

Estimating a distribution based on three percentiles


The $k$th moments of normal distribution

How to calculate the expected value of a standard normal distribution?


Interpreting results of Libreoffice Calc's TTEST function

What is the meaning of p values and t values in statistical tests?


Central limit theorem (CLT), average over 80 students but sum up over 52 weeks

Does central limit theorem (CLT) hold for non-integer values of $n$?


Optimal estimation of a single parameter given data at different scales 2


How to approximate standard deviation with summarized stats

How to calculate the variance of a partition of variables


How often do you have to roll a 6-sided die to obtain every number at least once?


Interpreting t-test results : Need a sanity check regarding t-statistic sign

Claim the superiority of a treatment in the context of a significant difference with a two-sided test


Must Random Variables' Probabilities Sum to One?


What is the best way to test normality for a very large sample size 15000?

Testing large dataset for normality - how and is it reliable?


What are good basic statistics to use for ordinal data?


What is the standard measure of fit quality for least absolute deviation regression (the analog of $R^2$)

$R^2$ for least absolute deviation regression


Deliberately fitting a model without intercept

When is it ok to remove the intercept in a linear regression model?


Non-linear modelling with several variables including a categorical variable

How to test the effect of a grouping variable with a non-linear model?


How does a Support Vector Machine (SVM) work?


10 class problems with 324 features - am I recognition class based on multiple features, class based on the pattern of one feature?


Algorithms for automatic model selection


We should verify first if the variances are equal with F-test before verify if the means are equal with t-test?

How do I interpret the results from the F-test in excel


Difference between the Law of Large Numbers and the Central Limit Theorem in layman's term?

Central limit theorem and the law of large numbers


Why reject, not accept $H_0$ when $p$ value less than $\alpha$?

What is the meaning of p values and t values in statistical tests?


What exactly are some fundamental differences between probit model and logistic regression

Difference between logit and probit models


Is it possible to use linear model $Y=aX_1+b(X_1\times X_2)+c$?

Including the interaction but not the main effects in a model


Why is SVM sensitive to scaling of features?


When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Residual diagnostics after a logistic regression model

Interpreting residual diagnostic plots for glm models?


Why is Poisson regression used for count data?


Do we always assume cross entropy cost function for logistic regression solution unless stated otherwise?

Which loss function is correct for logistic regression?


Cumulative distribution functions (cdfs) range uniformly

Inverse function for a non-decreasing CDF


when some of your coefficients in multivariate logistic regression model is negative

Coefficient changes sign when adding a variable in logistic regression


When is it ok to remove the intercept in a linear regression model?


What is a complete list of the usual assumptions for linear regression?


If $X$ takes on a Gamma Distribution, how can I find $X^2$, $X^3$, etc?


F-test of joint significance vs multiple t-test for regression parameters?

Difference between F-test and separate t tests on each variable?


Recommended Books on Advanced Statistical Inference

Advanced statistics books recommendation


What is the intuition regarding the different viewpoints of the Kullback-Leibler Divergence and the Kolmogorov-Smirnov Statistic?


Uniform PDF of the difference of two r.v

Uniform random variable as sum of two random variables


Natural logarithm transfomation and zeroes

How should I transform non-negative data including zeros?


Text mining of machine logs to find correlation between errors in R


In three-way ANOVA, how to interpret the three-way interaction?


What should I do when my neural network doesn't learn?


Neural Network for Rain Prediction - Only Learning Averages


How to tell which variable is perfectly separated in R

How to deal with perfect separation in logistic regression?


R - multiple linear regression plot analyzing

Multiple regression - Interpreting the plots


Why is my DBN predict only 2 out of 5 classes?


How to measure the degree of nonlinearity in regression model


Wanted: Statistical test to compare array with single value

Statistical significance (p-value) for comparing two classifiers with respect to (mean) ROC AUC, sensitivity and specificity


Terrible logistic model gives perfect results?

High p-values for logistic regression variable that perfectly separates?


How does regularization reduce overfitting?

(Why) do overfitted models tend to have large coefficients?


PCA in Matlab: why is the number of PCs always equal to the number of rows/observations minus 1?

Why are there only $n-1$ principal components for $n$ data if the number of dimensions is $\ge n$?


Different Confidence vs. Credible Interval (Continuous case, noninformative prior)

What's the difference between a confidence interval and a credible interval?


How to choose between sign test and Wilcoxon signed-rank test?

How to choose between t-test or non-parametric test e.g. Wilcoxon in small samples


Relationship between Gamma and chi squared distributions

Relationship between gamma and chi-squared distribution


Rapid calculation for rolling two fair dice with different numbers of faces to get a sum over X

Dungeons & Dragons Attack hit probability success percentage


Why is the term "Monte Carlo simulation" used instead of "Random simulation"?

Are all simulation methods some form of Monte Carlo?


how do i do the derivative of frobenius norm

How To quickly do derivatives with respect to matrices


Determining if data is normally distributed

How to check for normal distribution using Excel for performing a t-test?


Book that explains more than just applying the formulas for stats beginner

Any suggestions for a good undergraduate introductory textbook to statistics?


How does the variance-covariance matrix change when I create a linear combination of two variables?

Covariance of a variable and a linear combination of other variables


explaining LARS algorithm in a simple way


How do I interpret a loss of significance when adding another term to a model?

Why is ANOVA interaction no longer significant after including a covariate?


Generating a simulated dataset from a correlation matrix with means and standard deviations

How to generate correlated random numbers (given means, variances and degree of correlation)?


Does ARIMA require normally distributed data?

Does ARIMA require normally distributed errors or normally distributed input data?


When removing outlier is right? Removing techniques for outliers in R

Whether to delete cases that are flagged as outliers by statistical software when performing multiple regression?


How to plot ROC curves in multiclass classification?


Online linear regression. Possible or not?

Are there algorithms for computing "running" linear or logistic regression parameters?


Probability enemy territory captured in X turns


Coefficient in linear regression changes drastically if additional variables are added. Why?

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


Why sigmoid function instead of anything else?

Comprehensive list of activation functions in neural networks with pros/cons


Logistic regression with multicategory categorical explanatory variables

Explanatory variables may bias predictions


Help Identifying Time Series Model From ACF and PACF graphs

Estimate ARMA coefficients through ACF and PACF inspection


Two-predictor regression vs partial correlation

Multiple regression or partial correlation coefficient? And relations between the two


Effect of a lin-log model on the R^2 value as compared to a lin-lin model?

Interpretation of log transformed predictor and/or response


Which regression model to use for a probability as dependent variable?

Regression for an outcome (ratio or fraction) between 0 and 1


Test of Equal Proportions with exact p-values

H to check if proportions in two small samples are the same


Variance of a distribution's product with itself


Why transform distribution could help model accuracy?

Mboxcox, interpreting difficult regressions


Can the variance of a continuous random variable with known distribution be impossible to find?

How can a distribution have infinite mean and variance?


Correlation between binary and categorical variables

Correlations with unordered categorical variables


How does a decision tree split on a categorical variable?

Difference in implementation of binary splits in decision trees


How many stickers do I need to complete my FIFA Panini album?


Pearson correlation of data sets with possibly zero standard deviation?


Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


Kernel PCA for feature selection for various machine learning algorithms

Is it possible to use kernel PCA for feature selection?


Relationship between Pearson correlation values

If A and B are correlated with C, why are A and B not necessarily correlated?


Bound for the correlation of three random variables


Multinomial regression interpretation SPSS

Interpreting exp(B) in multinomial logistic regression


Specifying a difference in differences model with multiple time periods


Variance as a function of the mean. Why does this affect linear regression?

Heteroskedasticity - residual plot interpretation


Sequential Least Squares for Tikhonov Regularization

Recursive (online) regularised least squares algorithm


Anomaly detection within periodic time series

Simple algorithm for online outlier detection of a generic time series


How to create a Kaplan-Meier plot using ggplot2 with the number at risk table beneath


What is an unbiased estimate of population R-square?


Mixed logistic model with complete separation

How to deal with quasi-complete separation in a logistic GLMM?


Formula to calculate beta matrix in multivariate analysis

Casting a multivariate linear model as a multiple regression


PCA: When using eigendecompostion instead of single value decompostion

Why PCA of data by means of SVD of the data?


Fit a probability distribution to a time series in R

Fit mixture of distributions to your time-series data in R


HMCM vs Viterbi algorithm for calculating most likely path of an HMM

What is the difference between the forward-backward and Viterbi algorithms?


Difference between F-test and T-test on OLS

Significance contradiction in linear regression: significant t-test for a coefficient vs non-significant overall F-statistic


Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


Bayesian and frequentist reasoning in plain English


Systematic way to determine if a model is linear or nonlinear?

How to tell the difference between linear and non-linear regression models?


Z-test or t-test: Which is more appropriate for this situation?


Markov Chains: regularity and detailed balance

Does a MCMC fulfilling detailed balance yields a stationary distribution?


Could the intraclass correlation coefficient be negative?


How would you explain Markov Chain Monte Carlo (MCMC) to a layperson?


how to estimate confidence interval when p is close to 0 for binomial distribution?

Confidence interval around binomial estimate of 0 or 1


Theil–Sen estimator in R with more than one variable?

Theil-Sen estimation, more than one independent variable


Why are lower p-values not more evidence against the null? Arguments from Johansson 2011


The "Birthday Problem" generalized to continuous time rather than days

Continuous Version of Coupon-Collector Problem


What is Bayesian and Monte Carlo Simulation?


Shape of confidence interval for predicted values in linear regression


Why can variance be estimated from a sample taken from an alternative hypothesis?

Why can we use sample variance of the treatment group to estimate population variance of the controls?


Is a T-test appropriate for comparing two monthly data sets of mean values where one set is a subset of the other?

How to statistically compare two time series?


Understanding dummy (manual or automated) variable creation in GLM


Coefficient of Determination (R-Squared) definition in Matlab

Removal of statistically significant intercept term increases $R^2$ in linear model


How do I know when to normalize my data or not for prediction purposes?

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Why is it wrong to use non-nested cross-validation?


What happens in a regression setting if you code n dummy variables for a categorical variable with n categories?

Qualitative variable coding in regression leads to "singularities"


Does this analysis make sense and can references to similar work be provided?

Does this analysis make sense and can anyone provide relevent references?


When is OLS unbiased and what is the relation with weak orthogonality?

Proving OLS unbiasedness without conditional zero error expectation?


Why after including lags do seasonal dummies become significant?

Coefficient changes sign when adding a variable in logistic regression


help with lme() for nested random effects factors


How to validate k-fold cross validation results for classifiers?


Seasonal ARIMA model mathematical equation

How do I write a mathematical equation for ARIMA (0,2,1) x (0,0,1) period 12


Probability mass function of rolling two dice

How to easily determine the results distribution for multiple dice?


How to categorize a predictor measured on the continuous scale?

Optimal Binning with respect to a given response variable


Deriving the maximum likelihood for the parameters in linear regression


Why is the assumption of a normally distributed residual relevant to a linear regression model?

How does linear regression use the normal distribution?


Regression coefficients with longitudinal data yields different results in R and SAS

Why does SAS PROC GLIMMIX give me VERY different random slopes than glmer (lme4) for a binomial glmm


What is the "$R^2$" value given in the summary of a coxph model in R


Interpreting what this means in a paper - significantly different at the .05 level?

What is the meaning of p values and t values in statistical tests?


Is there a way to make some features more important than others in a SVM classifier?


Trained Logistic Regression returns 'NAN' for some out of sample data

Logistic regression in R resulted in perfect separation (Hauck-Donner phenomenon). Now what?


Changed signs from correlation to unique effect

Is the model wrong if a coefficient changes from minus in correlation table to plus in OLS?


Techniques to deal with unobserved values in test

How to deal with factors with rare levels in cross-validation?


Outlier Detection on skewed Distributions


Approximate distribution of product of N normal i.i.d.? Special case μ>10σ, σ>0

Approximate distribution of product of N normal i.i.d.? Special case μ≈0


Is there any difference between lm and glm for the gaussian family of glm?


Does biplot() function in R use rotations or loadings to plot arrows?


Negative $R^2$ at random regression forest

Manually calculated $R^2$ doesn't match up with randomForest() $R^2$ for testing new data


Independent and mutually exclusive probability

Understand the difference between independent and mutually exclusive events


Why the principal components correspond to the eigenvalues?

Making sense of principal component analysis, eigenvectors & eigenvalues


Is accuracy a reliable evaluation metric for training a classification model?

Why is accuracy not the best measure for assessing classification models?


Interpretation of simple predictions to odds ratios in logistic regression


How to interpret this PCA biplot to determine which attributes to pick?


Importance of semi-positive definiteness of covariance matrix

Why does correlation matrix need to be positive semi-definite and what does it mean to be or not to be positive semi-definite?


Including additional variable, the variable of interest becomes insignificant

How can adding a 2nd IV make the 1st IV significant?


What if residuals are normally distributed, but y is not?


For three variables $X,$ $Y,$ and $Z,$ prove that the sum of all the pairwise correlations is atleast $-3/2$

Bound for the correlation of three random variables


Probability of randomly drawing all numbers from a set

How many stickers do I need to complete my FIFA Panini album?


What is the point in regression through the origin?

Why would one suppress the intercept in linear regression?


On transformations of random variables, discrete vs continuous

Intuitive explanation for density of transformed variable?


Help with cluster analysis. Is this possible?

Cluster analysis as a preliminary analysis


What is the difference between taking a transformation of a response variable to then apply linear regression and a GLM?

Linear model with log-transformed response vs. generalized linear model with log link


Bisecting K-means using Dynamic Time Warping


Why does the Conv Neural Net using Tensorflow returns same predictions for all the data points

What should I do when my neural network doesn't learn?


interpreting Interaction 3 way interaction


How do I read this linear model output from R?


R: Fit a trendline to these points in ggplot


Relationship between Binomial and Beta distributions


Why is the squared difference so commonly used?

Why square the difference instead of taking the absolute value in standard deviation?


How does gradient boosting calculate probability estimates?


Negative Constant Positive Beta in Binary logistics


test on fold change of the mean vs. mean of fold changes

t test on original result, log2(result), fold change and log2(fold change)


Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


lme4: Why is AIC no longer displayed when using REML

REML or ML to compare two mixed effects models with differing fixed effects, but with the same random effect?


Interpreting t-SNE dimensions in terms of the original features

What is the meaning of the axes in t-SNE?


Better software for business forecasting?


Creating an index of quality from multiple variables to enable rank ordering


Linear Regression - Number of Predictors - Negative Weight

Regression coefficients that flip sign after including other predictors


What does the "machine" in "support vector machine" and "restricted Boltzmann machine" mean?


When to use linear discriminant function and when logistic regression?

Logistic regression vs. LDA as two-class classifiers


Choosing lambda.1se and lambda.min in Lasso

Why is lambda "within one standard error from the minimum" is a recommended value for lambda in an elastic net regression?


Doing regression only with correlation matrix, means, and SDs

Is there a way to use the covariance matrix to find coefficients for multiple regression?


Is there a distribution such that a sum of its samples creates the uniform distribution?

Uniform random variable as sum of two random variables


Plots to illustrate results of linear mixed effect model


How to Interpret Parameter Estimate Output from SPSS

Interpretation of simple predictions to odds ratios in logistic regression


Power of FDR vs. FWER approaches in multiple comparisons

Why is controlling FDR less stringent than controlling FWER?


Difference between effect size (partial $R^2$) and coefficients

Importance of predictors in multiple regression: Partial $R^2$ vs. standardized coefficients


Regression coefficients have a different sign for highly correlated predictors


Why are the singular values of a standardized data matrix not equal to the eigenvalues of its correlation matrix?

Relationship between SVD and PCA. How to use SVD to perform PCA?


If the sample standard deviation and standard error are biased estimators, why are they still so useful?

Why does this excerpt say that unbiased estimation of standard deviation usually isn't relevant?


Relation between the number of support vectors and the value of parameter C

SVM: Why does the number of support vectors decrease when C is increased?


How can I estimate a principal component from incomplete data?


Is there a difference between degrees of freedom and independent variables?


Find the probability of an event determined by an inequality on exponential random variables


Perform linear regression, but force solution to go through some particular data points


Keras accuracy not affected by any change in model

What should I do when my neural network doesn't learn?


What is the intuition behind Dirichlet distribution?

What exactly is the alpha in the Dirichlet distribution?


Machine Learning books for CS (non-statistician) grad student

Machine learning cookbook / reference card / cheatsheet?


testing interaction terms in regression model

What are best practices in identifying interaction effects?


Diagnostics and residual analysis for Poisson regression


The population size does not affect the sample size?


How to add predictors to LSTM time series model?

Deep learning model (LSTM) with temporal and non temporal attributes


ARIMA, p and q identification. Please help


Reduce Classification Probability Threshold


Data standardization or normalization in GBDT

What are the implications of scaling the features to xgboost?


Transforming variables for multiple regression in R


Simple combination/probability question based on string-length and possible-characters


A question regarding symmetry properties of a uniform distribution

What is the definition of a symmetric distribution?


Predict rare happen event using logistic model?

Strategy to deal with rare events logistic regression


Finding Bias$(s^2)$ in incorrect linear model


Multivariate Time Series with Long Horizon Prediction


How do I combine the standard deviations of these distributions?

What is the variance of the weighted mixture of two gaussians?


How to deal with categorical features with thousands of levels?

Preprocess categorical variables with many values


When can likelihood be interpreted as probability function?

What is the difference between "likelihood" and "probability"?


Grouping predictor factor levels based on response variable


How to interpret the output of the anova command in R?


Meaning of MATLAB logistic regression coeficients

Interpreting exp(B) in multinomial logistic regression


How to find unknown correlation coefficients in a correlation matrix from known correlation coefficients?

How to infer correlations from correlations


Why does my loading matrix following PCA with a varimax rotation contain only ones and zeros?

Strange results of varimax rotation of principal component analysis in Stata: rotated components are all zeros and ones


How to determine distribution from Sleep data min/max/mean values in R?

Calculating distribution from min, mean, and max


How embeddings relates to weights in skip-gram model (word2vec)?

Backpropagation algorithm and error in hidden layer


Calculate correlation on categorical data

Correlations with unordered categorical variables


handling categorical data with a large amount of categories

Principled way of collapsing categorical variables with many levels?


Assign p-values to all data point in the population in order to demonstrate some of them are not normal


Predictive Accuracy formula in Excel or R


Positive correlation coefficient, but negative Beta weights in multiple regression

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


Three correlated uniformly-distributed random variables

Generate three correlated uniformly-distributed random variables


Is the Wilcoxon rank-sum test the right test to see if total donations differ?


ARIMA time trend analysis using R and SPSS and poor datasets: opposite signs for the Moving Average part

Moving average process notation: negative or positive $\theta$s?


Values distribution issue in logistic regression

How to deal with perfect separation in logistic regression?


Linear regression coefficients from covariance matrix

Standard error of regression coefficient without raw data


Distribution of number of Bernoulli trials before some large number of sucess

Distribution of number of Bernoulli trials to a given number of successes


One way ANOVA in R given Mean, SD, sample size only?

ANOVA analysis with only mean and standard deviation


Do we have any assumption on the distribution of Data for linear regression?

What is a complete list of the usual assumptions for linear regression?


Is it possible that the correlation for my 3 variables is significant but the regression for the 2 variables is not?


How much of your p-value do you report in a publication?

How should tiny $p$-values be reported? (and why does R put a minimum on 2.22e-16?)


Case Control Sampling in Logistic Regression

Does down-sampling change logistic regression coefficients?


Two factor ANOVA with repeated measures by mixed model (lmer)

Using lmer for repeated-measures linear mixed-effect model


Repeating rare examples in unbalanced data classification

When is unbalanced data really a problem in Machine Learning?


PCA returns the same pair of principal axes for completely different 2D datasets

Does a correlation matrix of two variables always have the same eigenvectors?


recompute mean and standard deviation adding observed data to my sample


Finding expected order statistics from a normal with known parameters

Approximate order statistics for normal random variables


Confidence Interval on the standard deviation

Why is chi square used when creating a confidence interval for the variance?


Perform t-test R two datasets and multiple variables

T test two data set 3 variables per data set, can be used?


How to specify the null hypothesis in hypothesis testing


How to divide scattered points among multiple curves?

Separate time series data into two trends


Is it advisable to drop certain levels of a categorical variable?

Can I ignore coefficients for non-significant levels of factors in a linear model?


Book reading list for Time Series data analysis

Books for self-studying time series analysis?


What is the difference between test set and validation set?


Reliability Logistic Regression - train and evaluate the model

Why is accuracy not the best measure for assessing classification models?


Can the likelihood take values outside of the range [0, 1]?

Can a probability distribution value exceeding 1 be OK?


How is a ROCAUC=1.0 possible with imperfect accuracy?

Why AUC =1 even classifier has misclassified half of the samples?


Running analyses with uneven group sizes

Are unequal groups a problem for one-way ANOVA?


How does eigenvalues measure variance along the principal components in PCA?

What is an intuitive explanation for how PCA turns from a geometric problem (with distances) to a linear algebra problem (with eigenvectors)?


How does Batch Normalization not lead to the model blowing up?


What statistical tool do i use to determine the assocation between a nominal variables with three options and a continuous variable ?)

Correlations with unordered categorical variables


GLM and categorical variable R - remove one category

Can I ignore coefficients for non-significant levels of factors in a linear model?


Reporting of Heterogeneity in Metaanalysis


When is logistic regression solved in closed form?


Which variables to keep in my analysis based on loadings from PCA?

Using principal component analysis (PCA) for feature selection


Diagnostic plots for logistic regression


What is the intuition behind defining completeness in a statistic as being impossible to form an unbiased estimator of $0$ from it?


Quantile regression explained to a beginner


standardised random variable least square regression $X$ against $Y$, $Y$ against $X$

What is the difference between linear regression on y with x and x with y?


interpreting interaction between two categorical variables in OLS

Simple effects of categorical interaction


Are there any statistical measures to determine how "clustered" a dataset is?

How does one measure the non-uniformity of a distribution?


Can you solve non-linear problems with a neural network without using backpropagation?

Is it possible to train a neural network without backpropagation?


Difference Cohen's $\kappa$ and Spearman's $\rho$

Inter-rater reliability for ordinal or interval data


High p-values for logistic regression variable that perfectly separates?


How can my regression coefficients be so far from the underlying model?

How to interpret coefficients from a polynomial model fit?


Why subtracting the means in PCA, but not dividing by standard deviations?


$k$-fold cross-validation on a logistic regression: So which is the fitted model?

With k-fold cross-validation, do you average all $k$ models to build the final model?


R: Greenhouse-Geisser in Anova from car package


performing two sided t.test for mean, median in a data set

Test whether the study population come from a normal or log-normal distribution based on mean, median, and number of subjects


Standardize or not standardize before clustering

How to standardize data for hierarchical clustering?


p-value definition and inadequacy of tail events

If the distribution of test statistic is bimodal, does p-value mean anything?


Principal component analysis (PCA) vs. method of principal components for factor analysis (FA)

Best factor extraction methods in factor analysis


Reversing PCA back to the original variables


Which independent variables are most important in predicting the response variable?

Detecting significant predictors out of many independent variables


Perform PCA. Extract PCs. Can one then tell what the most important _original_ features were, from the PCs?

Using principal component analysis (PCA) for feature selection


The equivalence of sample correlation and R statistic for simple linear regression


Experiment with two groups, pre- and post- treatment assessments

Best practice when analysing pre-post treatment-control designs


Why is the variance squared, and does it mean the same thing as the standard deviation?

Why square the difference instead of taking the absolute value in standard deviation?


How to read multiple linear regression coefficients for dummy variables in Python?

Interpretation of betas when there are multiple categorical variables


Will a pooled coefficient be bounded by the coefficients from the group regressions?

In multiple regression, a coefficient gets opposite sign in subsample than in the full sample


Reporting Cox & Snell and Nagelkerke in logistical regression

Which pseudo-$R^2$ measure is the one to report for logistic regression (Cox & Snell or Nagelkerke)?


What does it mean to compute eigenvectors of a covariance matrix if the data were not centered first?

How does centering the data get rid of the intercept in regression and PCA?


Appropriate Statistical test for Analysis


Is KNN a discriminative learning algorithm?


how can the slopes be calculated using a covariance matrix?

Is there a way to use the covariance matrix to find coefficients for multiple regression?


Estimating the area of a circle somwhere within a square

Misunderstanding of Monte Carlo Pi Estimation


How to compute $\mathbb{P}(A|B)$ of two independent RVs?

Conditional expectation of $\mathbb{E}(X - Y | (X, Y)\in\mathcal{A})$


Simple Regression: Which parameter follows the t-distribution

Why is a T distribution used for hypothesis testing a linear regression coefficient?


Can a continuous effect modifier be categorized into quartiles?

What is the benefit of breaking up a continuous predictor variable?


Proof that a density proportional to Gaussian is Gaussian

How do we pass from proportionality back to equality in a Bayesian derivation?


Test logistic regression model using residual deviance and degrees of freedom


What are some ways to graphically display non-normal distributions in Excel?


Logistic Regression Get 100% R-square but no predictors are significant?

How to deal with perfect separation in logistic regression?


square things in statistics- generalized rationale

Why square the difference instead of taking the absolute value in standard deviation?


The Monty Hall Problem - where does our intuition fail us?


What statistical analysis should I use for Likert-Scale data?

Group differences on a five point Likert item


mutual information of two identical signals

Why would perfectly similar data have 0 mutual information?


Assumptions needed for multiple linear regression

What is a complete list of the usual assumptions for linear regression?


Skipping time points in autoregressive modeling?

Skipping lags in autoregressive modeling?


For my study design: When to log-transform data vs. when to use a non-parametric approach

When (and why) should you take the log of a distribution (of numbers)?


Sigmoid equals softmax in Bernoulli distribution (binary classification problem)?

Softmax vs Sigmoid function in Logistic classifier?


How to normalize by the covariance matrix?

Bottom to top explanation of the Mahalanobis distance?


How to calculate advertising copy wearout using kalman filter in R

How to calculate advertising copy wearout using kalman filter?


Why and When Do We Need Standardization for Machine Learning

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


How to compare two independent samples using a permutation test?

Test whether variables follow the same distribution


How to fit a glm with sum to zero constraints in R (no reference level)

Use a baseline including all observations in lm()


simulate censored data (right censored) using R statistics


What is the distribution of the maximum of a set of random variables?


How to interpret odds ratios as probability or chance?

Interpretation of simple predictions to odds ratios in logistic regression


Probability prediction using logistic regression for an unbalanced dataset

Does an unbalanced sample matter when doing logistic regression?


Neural network weights explode in linear unit

What should I do when my neural network doesn't learn?


Neural networks when there are multiple correct answers

Neural Network: What if there are multiple right answers for a given set of inputs?


Expectation of truncated normal X conditional on truncated normal Y

Truncated trivariate normal - conditional expectation


How to calculate Area Under the Curve (AUC), or the c-statistic, by hand


Modeling binary outcomes - inaccurate model when using logistic regression?

How can I account for a nonlinear variable in a logistic regression?


Evaluate collisions in classification problems


Why does the p-value double when using two-tailed test compared to one-tailed one?


Why is intercept term left out of the penalty term in ridge regression?

Reason for not shrinking the bias (intercept) term in regression


Extraction of a decision boundary (LDA) after a systematic querying of the feature space and convolution with Sobel filter (examples in numpy)

Compute and graph the LDA decision boundary


Deep Belief Network configuration for dice face recognition


Perceptron trained on time series always predicting the same answer


Ranking based on binomial data (example: website conversions)


What is the relationship between a chi squared test and test of equal proportions?


Is Gradient Boosting Regression Tree able to learn linear models


What is the dimension (or units) of a CDF and PDF?

Can a probability distribution value exceeding 1 be OK?


Minimum sample size for kernel density estimation

What is the minimum number of data points required for kernel density estimation?


Distribution of quadratic forms of normal variables

Proving the given quadratic form is chi-squared $k$


How to perform orthogonal regression (total least squares) via PCA?


Online course for inferential statistics

Introduction to statistics for mathematicians


How to design a fitness function for an evolving neural network?

What should I do when my neural network doesn't learn?


Using REML in mixed models if random factor is small

When no model comparison, should I use REML vs ML?


Cluster analysis as a preliminary analysis


In R, how would you test for the joint significance of a set of parameters?

summary of lm to compare models instead of ANOVA


Why is type I error not affected by different sample size - hypothesis testing?

Why are the number of false positives independent of sample size, if we use p-values to compare two independent datasets?


Why is a predictive distribution wider than mean response distribution?

Difference between confidence intervals and prediction intervals


Use of PCA analysis to select variables for a regression analysis

Using principal component analysis (PCA) for feature selection


log transformation vs square root transformation, Can I do both?


Changing units of measurement in a simple regression model


T-test for a small sample with unknown distribution

How to choose between t-test or non-parametric test e.g. Wilcoxon in small samples


Information about parameters using priors distributions

What is an "uninformative prior"? Can we ever have one with truly no information?


How do you Interpret RMSLE (Root Mean Squared Logarithmic Error)?


Robust Standard Errors(SE) estimators vs SE estimators assuming Conditionally Homoskedasticity

In general, would you always prefer feasible GLS to OLS?


How do you set your own intercept in SPSS?

Perform linear regression, but force solution to go through some particular data points


Testing whether two Eigen decompositions are equal

Is there a test/technique/method for comparing principal components decompositions between samples?


Calculate the tendency of a set of samples


What is the difference between scores in Princomp vs. factanal?

What are the differences between Factor Analysis and Principal Component Analysis?


Distance between two independent normal random variable

What is the distribution of the Euclidean distance between two normally distributed random variables?


What is the multivariate analog of the median?

Is there an accepted definition for the median of a sample on the plane, or higher ordered spaces?


Mean centering variables NOT in a moderation/interaction term

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Factor analysis on non normal data ( Ordinal data of Likert Scale)

Factor analysis of questionnaires composed of Likert items


How to approach logistic regression on skewed dataset

Does an unbalanced sample matter when doing logistic regression?


Why does the Bayesian posterior concentrate around the minimiser of KL divergence?

Intuition on the Kullback-Leibler (KL) Divergence


Is any quantitative property of the population a "parameter"?


Recalculating Survey Weight from combining two datasets in Stata

How to combine data from 5 surveys from the same population spanning 10 years


What are the advantages of using log GDP per capita versus simple GDP per capita when analyzing economic growth?

In linear regression, when is it appropriate to use the log of an independent variable instead of the actual values?


Algorithm for minimization of sum of squares in regression packages


How can I show that $E[(\hat\theta -\theta)^2]<Var(\bar X)=\dfrac{1}{n}$?

How to show that $E[(\hat\theta -\theta)^2]<Var(\bar X)=\dfrac{1}{n}$?


What does 'Controlling for' mean in regression?

How exactly does one “control for other variables”?


Scale parameters -- How do they work, why are they sometimes dropped?


Neural net: Cost goes down but performance on train isnt!

Overfitting on the loss graph, but not the accuracy graph


The variance of linear regression estimator $\beta_1$


Is the log loss function $f(w) = y_t \log(y_p) + (1 - y_t) \log(1 - y_p)$ convex in $w$?

Proof that CRF models and logistic models are convex functions


Hierarchical panel data: Fixed effects vs. hierarchical linear models vs. mixed models

Difference between multilevel modelling and mixed effects models?


What is a fixed effect in a mixed model compared to a fixed effect model for panel data?

How exactly does a "random effects model" in econometrics relate to mixed models outside of econometrics?


Methods of initializing K-means clustering

Initializing K-means centers by the means of random subsamples of the dataset?


How to calculate this normal distribution

completing the square for Gaussian multivariate estimation


What is the difference between lm(log(y) ~ x) and glm(y ~ x, family = gaussian(link = "log"))?

Choosing between LM and GLM for a log-transformed response variable


Test if two means are significantly different in R

What is the meaning of p values and t values in statistical tests?


If I have two samples of spatial distribution (tweets), how do I test if they're from the same distribution?

How to test if these two samples are from the same distribution?


Understanding the math behind linear discriminant analysis

Algebra of LDA. Fisher discrimination power of a variable and Linear Discriminant Analysis


Is there an analytical solution for the Kullback-Leibler-Divergence with two univariate Lognormal distributions?

Quantify Difference/Distance between Lognormal distributions


When forcing intercept of 0 in linear regression is acceptable/advisable

When is it ok to remove the intercept in a linear regression model?


Estimating the true frequency of rare events

How to tell the probability of failure if there were no failures?


Probability that $n$ trials will succeed given that $k$ succeeded

Prediction interval for binomial random variable


What's the difference between Normalization and Standardization?


Confused about kurtosis and tails compared with normal distribution

How is the kurtosis of a distribution related to the geometry of the density function?


Why is the weight vector in PLS constrained to be of unit length?

Why is the eigenvector in PCA taken to be unit norm?


The absolute value of importance is not very helpful, than how to calculate the relative importance of variables in a random forests Regression

Measures of variable importance in random forests


Can a mathematically sound prediction interval have a negative lower bound?


Correlation among different industries of the stock market

Robust method to extract "pure" part of a variable


Dealing with categorical variables in regression

Recoding a variable with three levels into a dummy variable


Calculating variance from standard error of pearsons r correlations z scores

How to calculate Inverse variance weight of several pearsons r correlations


Is Tom Mitchell's Machine Learning book incorrect in its definition of Confidence Interval?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Likelihood Ratio Testing in Multinomial logistic regression using SPSS

Singular information matrix error in lrm.fit in R


How Can Poisson Regression Predict a Count of Zero?

Can a model for non-negative data with clumping at zeros (Tweedie GLM, zero-inflated GLM, etc.) predict exact zeros?


Nonlinear estimates of regression coefficients?

OLS is BLUE. But what if I don't care about unbiasedness and linearity?


NeuralNetwork does not converge given a DataSet

What should I do when my neural network doesn't learn?


How to Split Time Series Data to train/test for RNN

Cross-validation for timeseries data with regression


Training Neural Network with Highly Correlated Inputs


Interpreting the residuals vs. fitted values plot for verifying the assumptions of a linear model


One or two output neurons for a binary classification task with an artificial neural network

Neural Network: For Binary Classification use 1 or 2 output neurons?


symmetric marginal but asymmetric joint distribution contours

Is it possible to have a pair of Gaussian random variables for which the joint distribution is not Gaussian?


Under what circomstances the sample standard error is likely to equal population standard deviation?

Difference between standard error and standard deviation


Large coefficients in logistic regression

How to deal with perfect separation in logistic regression?


Finding anomalies using moving average in a time series

Simple algorithm for online outlier detection of a generic time series


Keras - LSTM loss increasing for each epoch


How to reduce the number of feature levels without losing information?

Principled way of collapsing categorical variables with many levels?


How to measure the relation between two random variables that are not linearly correlated?


What should I do when my neural network doesn't learn?


Significant ANOVA interaction but non-significant pairwise comparisons

How can I get a significant overall ANOVA but no significant pairwise differences with Tukey's procedure?


How to judge whether model is overfitting or not

How to judge if a supervised machine learning model is overfitting or not?


Quantiles of the Chi-square over degrees of freedom distribution

Why is chi square used when creating a confidence interval for the variance?


PCA Correlation or Covariance? A follow-up question


The Monty Hall Problem - where does our intuition fail us?


how can I rescale an integer array of data to an integer one?

What's the difference between Normalization and Standardization?


You observe k heads out of n tosses. Is the coin fair?


Is there a discrete version of the exponential distribution?

What is the difference between exponential and geometric distribution?


What is the estimated variance of residuals? From R


Programming Multiple Variable PCA Ratios

How to perform orthogonal regression (total least squares) via PCA?


Non-Singularity due to inclusion of non-zero lambda in ridge regression

Why does ridge estimate become better than OLS by adding a constant to the diagonal?


What is the main conceptual difference between GEE and GLM?

Difference between generalized linear models & generalized linear mixed models


What's the link (or lack thereof) between 'Moving Average' and 'Moving Average Model'?

Why are MA(q) time series models called "moving averages"?


Non-normal variable: multiple vs poisson regression

Goodness of fit and which model to choose linear regression or Poisson


Is ARCH model an extension / generalization of ARMA model?

What is the difference between GARCH and ARMA?


Assumptions behind simple linear regression model

What is a complete list of the usual assumptions for linear regression?


Which features are most important for K-means clusters (scikit-learn)?

Estimating the most important features in a k-means cluster partition


Finding maximum likelihood of a mixture normal distribution

Is there a numerical solution to a mixture model of two normal distributions?


What is the mathematical relationship between R2 and MSE?

What is the difference between "coefficient of determination" and "mean squared error"?


Question about the calculation of likelihood function

What is the difference between "likelihood" and "probability"?


What is the difference between partial likelihood and maximum likelihood?

What is the difference between a partial likelihood, profile likelihood and marginal likelihood?


How to interpret interaction with continuous and categorical variables in logistic regression

Interpreting coefficients of an interaction between categorical and continuous variable


Dimension reduction for discrete qualitative and aggregated variables

Categorical Principal Component Analysis - using Count, Continuous, Ordinal variables together


Which dimensionality reduction technique for mixed data?


Named entity recognition and class imbalance

Class imbalance in Supervised Machine Learning


How to undersample with algorithms in R to solve class imbalance?


Difference between continuous and non-continuous data .

What is the difference between discrete data and continuous data?