Assumption of normally distributed residuals in linear regression

How does linear regression use the normal distribution?


How do ARMA and ARMA-GARCH models relate?


When is unbalanced data really a problem in Machine Learning?


Using Wilcoxon Ranksum text with Equal sample medians

Why is the Mann–Whitney U test significant when the medians are equal?


How do I measure the variability in time time-series power consumption patterns?


What is the expectation of copula function?

What is the expectation of the following joint CDF?


When is accuracy a good metric (as opposed to precision, recall, F1)?

Why is accuracy not the best measure for assessing classification models?


Multiple regression with 2 correlated variables

How can adding a 2nd IV make the 1st IV significant?


How do I write a mathematical equation for ARIMA(1,0,0)(1,1,0)[12] and How to substitute values of coefficients in that formula. Please help


meaning of error term being correlated with regressor

How can the regression error term ever be correlated with the explanatory variables?


Orthogonal polynomials lme4: Interpretation of significant quadratic predictor when linear predictor is not significant

Does it make sense to add a quadratic term but not the linear term to a model?


Is the linear combination of least square estimators in linear regression normally distributed?

Distribution of linear combination of OLS regression coefficients


In Wilcoxon signed ranked test, what box range represents?

How does boxplot in R calculate quantiles?


How biased is a statistical study in which sampling was purposely made without repeats?


Regression changing of dependent variable

What is the difference between linear regression on y with x and x with y?


How should tiny $p$-values be reported? (and why does R put a minimum on 2.22e-16?)


Principal component anaylsis, what do obtained coefficients tell me?

Making sense of principal component analysis, eigenvectors & eigenvalues


Why does the natural logarithm function pop up as default link function when doing Poisson regression?

Calculation of canonical link function in GLM


Is it necessary to standardise data sets before performing PCA?

Which variables should I transform, center, and/or standardize in my data for Principal Component Analysis?


Why do we also consider the probability of more extreme events in hypothesis testing?

What is the meaning of p values and t values in statistical tests?


What is the difference between multi-class and multi-label classification?

What is the difference between a multi-label and a multi-class classification?


Fitting lognormal distribution from D10, D50, and D90

Estimating a distribution based on three percentiles


Why would we use different output and recurrent activations in an LSTM?


What should I do when my neural network doesn't learn?


how to help the tree-based model extrapolate?

Decision Trees and Regression - Can predicted values be outside range of training data?


How to deduct the coefficient of the Dirichlet distribution?

Construction of Dirichlet distribution with Gamma distribution


Equivalence test for one proportions test


Question about the answer to "Local polynomial regression: Why does the variance increase monotonically in the degree?"


SSD MobileNet v1 loss not converging bounding boxes all over the place

What should I do when my neural network doesn't generalize well?


Normalization of input parameters before model fitting

standardising non normally distributed predictors for regression


What is the best way to decide bin size for computing Entropy or Mutual Information?

Number of bins when computing mutual information


To provide dimensionality reduction, 1x1 convolutions are used, before passsing them through a 3x3, or 5x5 convolution in an Inception module.

What does 1x1 convolution mean in a neural network?


How should I go about doing regression with a series of exponents involved?

how to select the best non-linear model that represents the data?


What does it mean if I have a high F-stat but low $R^2$?


Presence of autocorrelation and estimation of coefficients

What are the assumptions for applying a quantile regression model?


Realistically, does the i.i.d. assumption hold for the vast majority of supervised learning tasks?


Example of a k-dimensional random vector X where each component of the vector is normally distributed but X is not

Is it possible to have a pair of Gaussian random variables for which the joint distribution is not Gaussian?


Truncated trivariate normal - conditional expectation


How do you interpret the instantaneous causality test?

Difference between Granger causality and Instantaneous causality?


What is conditional normal variance of $X$ given that dependent $Y$ is bigger than a real number $M$?


If X and Y ~ Uniform(0,1), what is the distribution X/Y?

Distribution of ratio between two independent uniform random variables


Heteroscedastic errors in logistic GLM - a problem?

Interpreting residual diagnostic plots for glm models?


Sampling distribution of sum of two or more sample means


How to test normality of errors in multiple linear regression?

Interpreting Regression Diagnostic Plots


Factorial Mixed ANOVA Unequal Gender Ratio

Proper order of variables in unbalanced ANOVA


Monte Carlo simulation for grouped averages

Expected value of subset of variables in Bayesian setting


Mahalanobis distance to detect multivariate outliers

Robust PCA vs. robust Mahalanobis distance for outlier detection


Distribution of error terms in linear regression

Where does the misconception that Y must be normally distributed come from?


Is there a method to update support vector machine (SVM) parameters?

Is it possible to append training data to existing SVM models?


Mutual information between multivariate random variables?

Entropy is a measure on distributions, mutual information is a measure on RVs


Training set target categories' distribution

Class imbalance in Supervised Machine Learning


Area under the ROC curve for continuous variable

How to calculate Area Under the Curve (AUC), or the c-statistic, by hand


What does "properly normalized" mean in CLT?

What intuitive explanation is there for the central limit theorem?


The Best statistical test for comparing two models with the same data

Comparison of log-likelihood of two non-nested models


How to calculate Cohen's d effect size intervals for a within-subject design?

Understanding the calculation of the independent samples Cohen's d from t & df


Descriptive statistics interpretation of log-transformed variables

Log form of variables and descriptive measures


Cannot replicate a 95% CI using: Beta ±1.96*SE

Confidence interval of linear regression variable calculation


Regularization of linear regression problem

How is the lasso orthogonal design case solution derived?


Independent Study Statistics/Probability Grad Level

Good resources (online or book) on the mathematical foundations of statistics


Why is the convolution of two box kernels a triangle kernel?

Consider the sum of $n$ uniform distributions on $[0,1]$, or $Z_n$. Why does the cusp in the PDF of $Z_n$ disappear for $n \geq 3$?


Asymptotically unbiased estimator vs consistent estimator

What's the difference between asymptotic unbiasedness and consistency?


What does it mean to "interpret the sigmoid $\sigma(\theta^Tx)$ as a probability"?

Problem understanding the logistic regression link function


Likelihood is "proportional to a probability". Which one?

Likelihood is not "proportional to" a single probability density?


Data exploration to determine if GAMs are appropriate


Is the critical t-statistic value always 1.96 for the standard normal distribution?

Wald test in regression (OLS and GLMs): t- vs. z-distribution


Using PCA to reduce dimensionality of training and testing data


Summing Bernoulli distributions with noise

Success of Bernoulli trials with different probabilities


What is Moment generating function in layman terms

How would you explain Moment Generating Function(MGF) in layman's terms?


Modelling percentage and proportion data with GLM's

Time Series of Wound Healing percentages / proportions


Can lower inner fence be a negative number?

Negative inner fence. How can you find the outlier using 1.5 x IQR?


Relationship between standard deviations of partitioned subsets and the standard deviation of the whole set?

How to calculate the variance of a partition of variables


Sufficient set of features for distinguishing items

Minimum set of features that can distinguish all objects


What should I do when my neural network doesn't learn?


Why increasing lambda parameter in L2-regularization makes the co-efficient values converge to zero

How to derive the ridge regression solution?


Can someone confirm if I am running this generalized linear model in R correctly? Multiple observations in each experimental unit


sign of loglikelihood during parameter estimation

Can a probability distribution value exceeding 1 be OK?


How would you explain generalized linear models to people with no statistical background?


Why does level means coding only work for one (dummy) variable?

Removing intercept from GLM for multiple factorial predictors only works for first factor in model


Linear Regression and correlation - Avgerages VS Raw Data

Linear Regression With Groups vs. Points - Issue with Influence of Zeros


Can I ignore the warning: "tests made without re-estimating 'theta'" from an analysis of deviance test of a negative binomial model?


Is there any standard / criteria of good forecast measured by SMAPE and MASE?


What should be transfer learning model accuracy?


Standardization (or normalization?) before PCA (vegetation soil cover and environmental variables)


Prove that ML estimate of a function of a parameter, $g(\theta)$ is the function of its ML estimate $g(\hat{\theta})$

Question about Casella and Berger's proof of MLE invariance


Does Mahalanabis Distance have something to do with Min-Max normalisation?

Bottom to top explanation of the Mahalanobis distance?


Central limit theorem on distributions with support other than $\mathbb{R}$

How can the central limit theorem hold for distributions which have limits on the random variable?


cross entropy equivalence to to maximising log likelihood

the relationship between maximizing the likelihood and minimizing the cross-entropy


How can I get this Poisson Confidence Interval in R?

How to calculate a confidence level for a Poisson distribution?


How does the hyperparameter lambda affect L2 norm

The proof of shrinking coefficients using ridge regression through "spectral decomposition"


conditional probability how to deal with another similar

Conditional probability and venn diagram


Calculating correlation among different scales

How to measure correlation between multi-item likert scales?


Can I make conclusions with two independent samples?


Covariance and correlation between OLS estimators for slope and intercept

How to derive variance-covariance matrix of coefficients in linear regression


how to remove an outlier from demand data in the process of forecasting

How can you account for COVID-19 in your models?


What do i do with the error "there are aliased coefficients in the model"


The neural network returns a straight line

The neural network is not learning properly


Why are/aren't these functions members of the exponential family?

Is Poisson–Lindley an exponential family? If not, why?


What is intuition behind the product rule of probability and independent events?

Need intuition about independence of events


Compare models from different data subsets

Is it preferable to subset data to test specific hypotheses or specify a full model and run contrasts?


Conditional Expectation of a normal distribution

Deriving the conditional distributions of a multivariate normal distribution


What should I do when my neural network doesn't learn?


Is using the mean and the variance independent of probability distributions?

What is the difference between using a probability distribution and using the mean of observations only as a measure to describe the data?


Is it safe to use one sample-t test with a dataset of size 5000 while the population distribution is not normal?


Can someone tell me whether my data meets the assumption of linearity, normality and homoscedasticity (multiple linear regression assumptions)?

Interpreting Regression Diagnostic Plots


Example where $Cov(x_i, \epsilon_i) = 0$ and $E[\epsilon] =0$ yet $E[\epsilon | X] \neq 0$?

Can zero covariance and zero expectation imply zero conditional expectation?


Is loss or accuracy a more appropriate measure of performance for a classifier?

Why is accuracy not the best measure for assessing classification models?


How to model changing services demand during COVID recovery phase?

How can you account for COVID-19 in your models?


what is the recommended smallest value of AIC or BIC?


Monte Carlo Approximation of a Normalizing Constant

Computation of the marginal likelihood from MCMC samples


What does holding other variables fixed in a regression mean?

Is there a difference between 'controlling for' and 'ignoring' other variables in multiple regression?


which one to choose in supervised learning?

How to choose between learning algorithms


How to prove that in a linear model with an interaction term, centering the covariates doesn't impact the estimate of interaction coefficient?


What's the connection between Kendall tau and AUC ROC?


what is `offset` in the R function irls()?

When to use an offset in a Poisson regression?


What to choose for null hypothesis and alternate hypothesis?

What is the meaning of p values and t values in statistical tests?


How to De-seasonalize a time series based on trading days?


Oscillation in number of deaths by coronavirus

What could be the reason covid19 death data shows strong periodic trends?


Testing the sum of coefficients in regression analysis in R

Is it possible to to test for significance functions of regression coefficients in multiple regression


Where does the expected value definition come from?

General solution of expected value of E(f(X))?


Why is bias term not included in Regularization (Regression/Classification)?

No regularisation term for bias unit in neural network


How much can I get from only one datapoint?

What can we say about population mean from a sample size of 1?


How does colinearity among the features impact classification problem in a) Logistic Regression b) Tree models like Decision Tree or Random Forest?

Won't highly-correlated variables in random forest distort accuracy and feature-selection?


Cross Validation in an Imbalanced data set

When is unbalanced data really a problem in Machine Learning?


If overfitting occurs, what should i focus more?

What should I do when my neural network doesn't generalize well?


Dataset transformation for clustering after PCA


Warining "system is computationally singular: reciprocal condition number = 1.49911e-34FALSE" when running zeroinfl()

Matrices: system that is "computationally singular" versus "exactly singular"


How to understand the drawbacks of K-means


What does "A realization of independent copies"?

Sample space for mixture of two Normal distributions


Interpreting the residuals vs. fitted values plot for verifying the assumptions of a linear model


How to test that the regression coefficient = 1

Test model coefficient (regression slope) against some value


Is Logistic Regression more robust than Random Forest for data across time?


Is one supposed to centre binary variables before performing a LASSO regression analysis?

Ridge\Lasso -- Standardization of dummy indicators


Do I need to always normalize before to feed it to the trained neural network?

Should I normalize all data prior feeding the neural network models?


Difference between one-hot-encoding vs. building separate model for each category

Separate Models vs Flags in the same model


Facing difficulties in Cauchy PDF problem from harvard stats 110 book

Distribution of the ratio of two i.i.d standard normals


Calculating Variance of the LogOR for within subjects studies for a meta-analysis

How can I compute a log odds ratio for a within-subject design that could be meta-analyzed with log odds ratios from between-subject designs?


State of the art: Non-parametric density estimation with a boundary and data clumped near zero

Good methods for density plots of non-negative variables in R?


Proof that a slope coefficient can be given as the covariance of y and residuals divided by the variance of residuals

Converting the beta coefficient from matrix to scalar notation in OLS regression


Expected value of conditional choice probability

Expected value of the conditional choice probability


interview question use uniformly distribution {1,2,3,4,5} to generate {1,2,3,4,5,6,7}

Draw integers independently & uniformly at random from 1 to $N$ using fair d6?


When can we reasonably assume a sequence of r.v.'s is IID in real life scenarios?

Realistically, does the i.i.d. assumption hold for the vast majority of supervised learning tasks?


what is the need of dummy variable and what are alternative to it

One-hot vs dummy encoding in Scikit-learn


Probabilistic predictions from a frequentist point of view


Simple poisson regression for a death rate

In a Poisson model, what is the difference between using time as a covariate or an offset?


Best way to model a reponse when a covariate only applies to one group

How do you deal with "nested" variables in a regression model?


Do I have to apply the same kind of transformation and scaling to all data?

Can I mix different data transformations in the same model?


Effect of interchanging response and predictor in linear regression

What is the difference between linear regression on y with x and x with y?


Binomial or Poisson? Binomial makes most sense but similar p values and Poisson has no overdispersion

If my data is overdispersed when binomial but not when Poisson does that alone mean I should use Poisson GLM?


Family of GLM represents the distribution of the response variable or residuals?


Study on Human Behavior: what is a good value of RMSE when a linear regression is performed on a dataset that represents human behavior?

Is there any standard / criteria of good forecast measured by SMAPE and MASE?


Why does the value of the penalized ridge is divided by 2 in GLMNET?


Calculate power of the Kruskal-walis test

Power analysis for Kruskal-Wallis or Mann-Whitney U test using R?


Performing test for homogeneity of variance without samples


How to model a continuous variable lying between [0,1]

Regression for an outcome (ratio or fraction) between 0 and 1


Is it a good idea to use a linear model (like logistic regression) to generate new features for a non linear model (like random forest)?

Non-perpendicular hyperplane decision trees


Unpooling standard deviation from a combined set and a subset

How to calculate pooled variance of two or more groups given known group variances, means, and sample sizes?


Does random search incur less computational cost than the grid search?

What is the computational cost of random search algorithm?


Grid search vs. random search for hyperparameter tuning


How does grid search suffers from the curse of dimensionality while the random search doesn't?


What does this mean? ($\boldsymbol{I}_{\theta, \infty}(x_i)$)


How do you determine if a given method for checking normality assumptions is appropriate?

Is normality testing 'essentially useless'?


How best to present paired Wilcoxon test

Graph for relationship between two ordinal variables


About the derivation of EM for mixture of Gaussians

EM algorithm gaussian mixtures- derivation


I do PCA manually with numpy in the same method as Scikit Learn and getting same values but different signs

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Significance is poor after lasso regression

Testing for coefficients significance in Lasso logistic regression


Normalizing a truncated normal distribution

Standard normal distribution is truncated to the left by 2


Generate random data based on correlation matrix for multiple timesteps in R


Are unbalanced datasets problematic, and (how) does oversampling (purport to) help?


Comparing binomial outcomes from prediction algorithms in R

What is a reliable measure of accuracy for logistic regression?


how to make Kalman filter results equivalent to linear regression?

How to make Kalman filter results equivalent to linear regression?


How to interpret the precision matrix in Generalised Least Square regression

What is the geometric relationship between the covariance matrix and the inverse of the covariance matrix?


What to do if my LSTM model doesn't learn

What should I do when my neural network doesn't learn?


Why does removing the constant term prevent the dummy variable trap?

Removing intercept from GLM for multiple factorial predictors only works for first factor in model


Is significance of the p-value reliable with extremely small sample sizes?

Is there a minimum sample size required for the t-test to be valid?


Probability distribution for varying probabilities in R

Risk of extinction of Schrödinger's cats


How to test if two coins have different biases?

How to test for equality of means for proportions? And two-sided or one-sided?


Sum of squares of residuals instead of sum of residuals

Why squared residuals instead of absolute residuals in OLS estimation?


Solving PCA with correlation matrix of a dataset and its singular value decomposition

Relationship between SVD and PCA. How to use SVD to perform PCA?


Statistical inference when the sample "is" the population


What are the differences between (varimax and promax) rotations in PCA?

Factor rotation methods (varimax, oblimin, etc.) - what do the names mean and what do the methods do?


For some RV's $X$ with continuous density on $[0,1]$, is $\mathbb{E}|1/X|=\infty$?

I've heard that ratios or inverses of random variables often are problematic, in not having expectations. Why is that?


Logistic Regression Model Selection Criteria

Algorithms for automatic model selection


Why is only Euclidean distance allowed to be used for Ward's method?

Is it ok to use Manhattan distance with Ward's inter-cluster linkage in hierarchical clustering?


Assessing correlation with a variable in degrees

Use of circular predictors in linear regression


Are credible intervals confidence regions?

What's the difference between a confidence interval and a credible interval?


Fitting simple linear regression with no intercept


What should I do when my neural network doesn't generalize well?


Using running time distributions to determine ordering probabilities in horse racing

$P(X_1 < \min(X_i,\ldots, X_n))$ across different normal random variables


linear models vs. correlations (Pearson, Spearman, Kendall)


Optimizing a "black box" function: Linear Regression or Bayesian Optimization... what's the difference?


Is Data Normalization absolutely required for training a neural network?

Neural Networks input data normalization and centering


Why doesn't Stdev take absolute value of x- xbar?

Why square the difference instead of taking the absolute value in standard deviation?


How to estimate prevalence with a zero incidence (rare disease)?

When to use (and not use) the rule of three


What are the basic statistics to describe tensor data distribution

Let $\mathbf{Y}$ be a random vector. Are $k$th moments of $\mathbf{Y}$ considered?


Full logistic regression model significant but insignificant predictors

Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


How to calculate the effect size for the interaction term (time*Group) in a linear regression?

Calculating and interpreting effect sizes for interaction terms


Constraining regression coefficient to non-negative

Linear regression polynomial slope constraint in R


How to calculate quartiles and other percentiles?


In the case of the same SD, the difference between One sample t-test and Two sample t-test


Full model significant but insignificant predictors (NO COLLINEARITY)


Why is median age a better statistic than mean age?


Lost in the introduction discussing probability/likelihood

What is the difference between "likelihood" and "probability"?


How to generate a series correlated to a given one, with given mean and standard deviation

Generate a random variable with a defined correlation to an existing variable(s)


Does increasing the value of C in svm.LinearSVC leads to overfitting?

What is the influence of C in SVMs with linear kernel?


LASSO: selection of penalty term: "one-standard-error" rule


How to determine beta parameters in r given 2 percentiles without knowing the upper and lower bounds

Do two quantiles of a beta distribution determine its parameters?


What is an explicit formula for the seventh moment?

What's so 'moment' about 'moments' of a probability distribution?


If $X$ is independent of $Y$ and $Y$ is independent of $Z$, is $X$ independent of $Z$?

Is the sum of two variables independent of a third variable, if they are so on their own?


Can I use a correlation matrix and variances to find the covariance matrix?

Obtaining covariance matrix from correlation matrix


How would you explain the difference between correlation and covariance?


Autocovariance function at lag k for the process $x_t=A\cos(wt)+B\sin(wt)$

Calculate mean and autocovariance function to check stationarity


Do we have to tune the number of trees in a random forest?


Defining bin sizes for plotting histograms

Calculating optimal number of bins in a histogram


Convert Pearson correlation matrix into dissimilarity matrix

Converting similarity matrix to (euclidean) distance matrix


Categorical Principal Component Analysis

Can principal component analysis be applied to datasets containing a mix of continuous and categorical variables?


Reporting Results of Mann-Whitney U Test - Means vs Medians


Proof for "The sum of the observed values $Y_i$ equals the sum of the estimated / fitted values $\hat Y_i$"

Why do residuals in linear regression always sum to zero when an intercept is included?


Keras - text classification, overfitting, and how to improve my model?

What should I do when my neural network doesn't generalize well?


What's the added value of SD line over regression line when examining association between 2 variables?


Interpreting incidence rate ratios in poisson without exposure variable


Interpretation of Importance score in Random Forest


How to conclude experiment is statistically significant?

What do we really mean by "Statistically Significant" results?


What is the difference between linear regression on y with x and x with y?


Should I use log transformation for my multiple regression?


What is the best way to generate fake noncircular data?

Cholesky versus eigendecomposition for drawing samples from a multivariate normal distribution


Intuitive explanation for spline convolution

The definition of natural cubic splines for regression


Why applying Linear Regression to a classification problem often isn't a great idea?


Propensity score estimation with a variable that has more than 2 levels


Back transformed exp(log amount) showing different amount than the untransformed one


Does normalizing the design matrix change predictions?

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Generating random points uniformly on a disk

Simulate a uniform distribution on a disc


When to admit that your target cannot be predicted?

How to know that your machine learning problem is hopeless?


Can we directly use the likelihood function for Bayesian inference?

Likelihood vs conditional distribution for Bayesian analysis


Neural network from scratch: only predicts training inputs correctly

What should I do when my neural network doesn't generalize well?


Variance inflation factor vs condition number

Is there a reason to prefer a specific measure of multicollinearity?


Relationship between Binomial distribution and the Beta distribution

Relationship between Binomial and Beta distributions


Why does Ridge Regression work better than LASSO in the presence of multicollinearity?

Why Lasso or ElasticNet perform better than Ridge when the features are correlated


Power Transformations of a Single Variable for Multivariate Data Sets

Is it feasible to transform each variable differently while doing multiple regression


What is the math behind predict() in e1071 for SVM?

How does a Support Vector Machine (SVM) work?


Is it incorrect to say that a Poisson distribution has a PDF?

Does Wolfram Mathworld make a mistake describing a discrete probability distribution with a probability density function?


Why does R take so much time to run auto.arima(). How can I shorten the calculation time?

Time series modeling with high-frequency data


Does having negative correlation must also have negative coefficients in linear regression?

Example where a simple correlation coefficient has a sign opposite to that of the corresponding partial correlation coefficient


K-means - comparing solutions with SSwithin elbow-method: minimum "too early", or non-monotonic curve


Evaluating covariance terms for variance of residual in simple linear regression

In simple linear regression, where does the formula for the variance of the residuals come from?


Bagging classifier vs RandomForestClassifier

Difference between Random forest vs Bagging in sklearn


Ratios in Regression, aka Questions on Kronmal


Why, intuitively, does redundancy in a multiple linear regression increase the standard error of the partial regression coefficients?

What is the effect of having correlated predictors in a multiple regression model?


P value got 2.6293E-109 is this statistically significant after doing t-test

What is the meaning of p values and t values in statistical tests?


what is the distribution of the log of a normal distribution?


Bimodal distribution from uniform distribution


Checking Normality of Numerical and Categorical Data

Checking Normality of Numerical, and Categorical Data


Assigning Weights to An Averaged Forecast


Why does p-value have to be defined as 'at least as extreme' as the test statistic rather than just the probability that T= t?


Why are beta distributions commonly chosen for priors?

Choosing between uninformative beta priors


Bayes Theorem: How to get an intuition for it?


Could somebody please explain covariance to me

What is the difference between covariance and correlation?


Can AIC/BIC be used to compare models that differ by transformation of response variable?


Hypothesis not rejected, what does that mean for expected value?

When is it ok to remove the intercept in a linear regression model?


Can regression coefficients be higher than correlation coefficients?

How does the correlation coefficient differ from regression slope?


testing the accuracy of a probability logistic regression

Determine accuracy of model which estimates probability of event


$E(X|X)=X$ Conditional expectation of a variable with itself


Why can't we say that the probability of the true parameter being within a 90% confidence interval is 90%?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


MLPRegressor with 'lbfgs' algorithm incredibly bad performance

What should I do when my neural network doesn't learn?


Anova when dependent variable is continuous


Bootstrapped bias corrected and accelerated 95% confidence intervals

Comparison between bootstrap percentiles confidence interval and BCa confidence interval?


Variational Autoencoder: why Gaussian distribution

Why do we use Gaussian distributions in Variational Autoencoder?


Will the p value become useless in such case: logistic regression with perfect separation?

How to deal with perfect separation in logistic regression?


The OR and 95% CI for logistic regression were very high!


Recursive neural networks for Part-of-speech tagging?

Recurrent vs Recursive Neural Networks: Which is better for NLP?


What happens when many neurons have same weights?


Interpreting markedly large Logodds in logistic regression?


How to determine significant principal components using bootstrapping or Monte Carlo approach?


Univariate Regression, expectation of x given y

What is the difference between linear regression on y with x and x with y?


glm.fit: fitted probabilities numerically 0 or 1 occurred

Is it possible to get fitted values 0 or 1 in logistic regression when the fitting algorithm converges?


What norm of the reconstruction error is minimized by the low-rank approximation matrix obtained with PCA?


Can I reverse the sign on some of my PCA factor scores and how can I justify this?

Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


What is the difference between test set and validation set?


How can I get principal components by hand from covariance matrix?

How to compute PCA scores from eigendecomposition of the covariance matrix?


Interpretation of glm function output in R

Interpretation of R's output for binomial regression


What is $E(e^{rX^2})$ when $X~N(0,\sigma^2)$?

Pdf of the square of a standard normal random variable


Clustering algorithm which is guaranteed to converge to global minimum

Optimality in Clustering algorithms and an Optimality guaranteed clustering algorithm


Proof that more predictor variables will lead to less SSR

Why is sum of squared residuals non-increasing when adding explanatory variable?


MLE of mean of normal distribution using the number of observations above zero

Can I find MLE of probability of X greater than x


In linear regression, when is it appropriate to use the log of an independent variable instead of the actual values?


Driving full conditional distribution of parameters

Conditional posterior distribution of coefficient in logistic regression


Checking for reverse causality with lead regression, should the lead model be in its original state i.e. no transformation?


Percentile calculation for the combined group

Should 99 percentile of a union of two sets be the average of 99 percentile of each set?


Is training loss guaranteed to decrease for stochastic gradient descent?

How can change in cost function be positive?


What is this kind of chart is this (shows flow of components from one group to another)?

What is the proper name for a "river plot" visualisation


Mann-Whitney U Statistic seems very large - is something wrong?


Area under a guassian with two known points using error function

How are the Error Function and Standard Normal distribution function related?


How can I specify nested and crossed random effects with lme4

Crossed vs nested random effects: how do they differ and how are they specified correctly in lme4?


Why is the confidence interval defined in this way?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Is the least squares estimator of the intercept term in any linear regresssion model always the sample mean of the responses?

Regression Proof that the point of averages (x,y) lies on the estimated regression line


Calculate confidence interval for the population variance

What is a rigorous, mathematical way to obtain the shortest confidence interval given a confidence level?


Bootstrapping the sample range - When the bootstrap fails

What are examples where a "naive bootstrap" fails?


The covariance of a gaussian random variable and another one in its variance linear combination


Valid alternative to Box Tidwell method for Linear Regression

Violation of linearity assumption in Logistic Regression


Regression: What is the difference between assuming the covariates are random or not random?

What are the differences between stochastic and fixed regressors in linear regression model?


about negative coefficients of logistic regression

Coefficient changes sign when adding a variable in logistic regression


How to do liklihood ratio test comparing two models


What is the relationship between $\text{Cov}[\mathbf{X},\mathbf{X}]$ and $(\mathbf{X}^T \mathbf{X})^{-1}$ in multiple regression?

Is there a way to use the covariance matrix to find coefficients for multiple regression?


How does the covariance matrix of the predictors in multiple regression relate to the matrix $(\mathbf{X}^T \mathbf{X})^{-1}$?


How to do liklihood ratio test comparing two models using pchisq


What's the term for a r.v. X "upper bounding" Y probabilistically?


Distribution of Y/X if X and Y and i.i.d. standard Normal

What is the distribution of the ratio of two normals?


Work around restrictions of Scikit-Learns PCA implementation

Why are there only $n-1$ principal components for $n$ data if the number of dimensions is $\ge n$?


Explaining to laypeople why bootstrapping works


Correlation between two ordinal categorical variables


t.test error: data are essentially constant

one sample t-tests applied to each row - 'data are essentially constant' error


Distribution of $\frac{1}{1+Y}$ if $Y$ is Normally Distributed

I've heard that ratios or inverses of random variables often are problematic, in not having expectations. Why is that?


Bivariate normal and truncated expectation

Multivariate Normal : expectation of X given Y is doubly-truncated


t.test returns an error "data are essentially constant"


Is the number of decimal places one should provide depended on the sample size?

Number of significant figures to put in a table?


Relationship between SVD and PCA. How to use SVD to perform PCA?


Does $\sqrt{n} \left( \hat{\theta}_n - \theta \right) \overset{d}{\rightarrow} F_\infty$ imply $\hat{\theta}_n \overset{p}{\rightarrow} \theta$?

How can I formally show that a root n consistent estimator is weakly consistent?


what is training score vs validation score vs testing score

What is the difference between test set and validation set?


Logistic vs linear regression difference

What is the difference between linear regression and logistic regression?


What does -1 mean in glm model specification mean?

How can logistic regression have a factorial predictor and no intercept?


What are the Advantages of R over Python in Statistics?

How do R and Python complement each other in data science?


ANOVA vs t-test: What is the advantage of running ANOVA?

What would be the advantage of a 2x2 ANOVA compared to 2 separate pairwise comparisons?


What is the distribution of order statistic of Uniform distribution?

Spacings between discrete uniform random variables


how to determine the certain number of clusters your data contain?

How to decide on the correct number of clusters?


With k-fold cross-validation, do you average all $k$ models to build the final model?


Uniform distribution on $\mathbb{Q} \cap [0, 1]$ (sort of)

Discrete uniform random variable(?) taking all rational values in a closed interval


Understanding the bivariate Poisson distribution

Deriving the bivariate Poisson distribution


What is the meaning of p values and t values in statistical tests?


Best book to learn probability - Poisson, binomial, regression, etc

Book recommendations for beginners about probability distributions


Interpreting OLS regression coefficients of set of dummies when dependent var is in ln form

Interpretation of log transformed predictor and/or response


RSS and $R^2$ are not suitable for selecting the best model, why?

Are RSS and R^2 related to training error only?


Cross tabulation of two categorical variables: recommended techniques


How do we derive that $S^2$ is chi-squared distributed (with $n-1$ df)?

Degrees of freedom for standard deviation of sample


Does having your first child not be color-blind change the odds that the next ones will be?

What is the name of the statistical fallacy whereby outcomes of previous coin flips influence beliefs about subsequent coin flips?


Does expectation of a r.v. always converge?

Why does the Cauchy distribution have no mean?


Expected value and variance of trace function


Is it valid to include additional predictors into principal component regression?

Can I add several additional variables to my principal component regression?


How can we interpret bias-variance graphs with testing and training error curves (graph attached)?

How to do a bias-variance analysis on a machine learning modelling process


How to quantify the significance of the difference between two z-scores?

Testing equality of coefficients from two different regressions


Necessary to report p-values with population-wide patient data?

Do we need hypothesis testing when we have all the population?


R - In a 2 class problem how do I compute the normalization constant for finding the posterior distributions?


Type of correlation between binary and ordinal variable

How do you estimate correlations between ordinal and binary data in SPSS?


Does Central Limit Theorem have anything to do with Bayesian Inference?

When does asymptotic normality of the Bayesian posterior (Bernstein-von Mises) fail?


Covariance between estimates of slope and intercept

How to derive variance-covariance matrix of coefficients in linear regression


Expected value of random variables that are generated by substraction from the mean

Sum of indepedent random variables and a constant


How to convert SSR to Sigma Sqared of the Error Term-Matrix OLS


Analytically solving the conditional normal distribution

Conditional distribution of multivariate normal distribution


Using Offset in Binomial/Logit GLM for Exposure Years?

analyzing binary mortality data collected at different remeasurement intervals. Bonus for R implementation


Variance of standard normal transformation of normal variable

Variance of a Cumulative Distribution Function of Normal Distribution


Book recommendation reqd - A book that teaches both, fundamentals of statistics and the related mathematical concepts, in a comprehensively

Good resources (online or book) on the mathematical foundations of statistics


What do the steps in ROC curve represent?


Data has two trends; how to extract independent trendlines?


Why does R-Squared change with a no-intercept model?

Removal of statistically significant intercept term increases $R^2$ in linear model


Why can we suppose $\epsilon \sim \mathcal{N}(0,\sigma^2)$?

Why Normality assumption in linear regression


AB testing - normalizing for a group's historic performance? Bayes Factors?


Understanding Standard Deviation for non-normally distributed data

What does standard deviation tell us in non-normal distribution


When to correct for multiple kruskal tests?

Correcting for multiple kruskal wallis tests


Prove that sample covariance matrix is positive definite

Is a sample covariance matrix always symmetric and positive definite?


Feasibility of a neural network fitting a specific multivariate quadratic function?

What should I do when my neural network doesn't learn?


How would you interpret this Binomial Logit GLM?

How to interpret coefficients from a logistic regression?


What do eigenvectors of a data matrix consisting of house features/prices tell us?

Making sense of principal component analysis, eigenvectors & eigenvalues


Generate Uniform Random Variates with Constant Norm

How to generate uniformly distributed points on the surface of the 3-d unit sphere?


Why are two likelihood functions equivalent if one is a positive multiple of another?

What does "likelihood is only defined up to a multiplicative constant of proportionality" mean in practice?


Linear combination of two kernel functions


Proof of theorem on Poisson distribution

Intuitively understand why the Poisson distribution is the limiting case of the binomial distribution


What is the difference between time series analysis and panel data analysis?

What are differences between the terms "time series analysis" and "longitudinal data analysis"


Proof of NOT initialization of weights to zero

Actual impact of W=0 in a neural network


If V=X+Y how to prove that there is no independent random variables X,Y make V a uniform distribution

Uniform random variable as sum of two random variables


Based on the record X1 ,…, Xn what is the unbiased estimation of 1/p

For the binomial distribution, why does no unbiased estimator exist for $1/p$?


Can we do residual analysis for random forest classification model that gives out probability instead of class label?

Determine accuracy of model which estimates probability of event


Does the accepted sample based on the acceptance-rejection algorithm has the same distribution as X~$f(x)$?

Acceptance-Rejection Method Acceptance Probability Proof


Correlation of beta coefficients from linear regression

How to derive variance-covariance matrix of coefficients in linear regression


Question about correlation between Y=A*B Vs B

Does correlation between variables in an interaction matter?


Difference between marginal effects at the mean and average marginal effects in a logistic regression model?

Logistic regression model: interpretation of average marginal effect


What, precisely, is a confidence interval?


Question on a statistics symbol used in describing uniform distribution / likelihood function

What does 1 with an inequality in the subscript mean?


How to Interpret Confidence Interval ILSR Ch 3 Q10g


Can a variable become significant when adding new variables to a regression?

How can adding a 2nd IV make the 1st IV significant?


Is there an intuitive interpretation of $A^TA$ for a data matrix $A$?


What is the intuition behind exchangeable samples under the null hypothesis?


Metric to measure distance between two percentage values

Transforming proportion data: when arcsin square root is not enough


How to get multiple solutions for a given input using neural network?

Find Neural Network Inputs Given Outputs


Why are the ends of the prediction interval wider in the regression?

Shape of confidence interval for predicted values in linear regression


Why is my Tensorflow training and validation accuracy and loss exactly the same and unchanging?

What should I do when my neural network doesn't learn?


How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


How to calculate the standard error of a proportion using weighted data?


Can this statistic be shown not to be sufficient for $\theta$?


Is a covariance matrix defined through a Gaussian covariance function always positive-definite?

How to prove that the radial basis function is a kernel?


Why can $R^2$ be negative in linear regression -- interview question

How can the MSE of predictions be greater than the variance of the response variable?


How to randomly shuffle tiny spheres inside a big sphere?

Generating uniform points inside an $m$-dimensional ball


Does cross-validation work for this type of modelling time-series

How is Hyndman's explanation of proper Time Series Cross Validation different from Leave-One-Out?


Is Linear Discriminate Analysis (LDA) and Fisher Discriminant Analysis (FDA) same meaning?

Three versions of discriminant analysis: differences and how to use them


Relevance of Mixed Model Estimates vs. Observed Means


How to reconcile z-scores into a number from -1 to 1?


Addressing multi-collinearity issues with subset selection methods


How to calculate variance and expected value in R given some function f(x)

How to calculate the variance and expected value of a random variable with density function f(x) in R


Why is the marginal pdf of $x$ constant? $x$ is the coordinate of the points uniformly distributed on the surface of a sphere

Distribution of scalar products of two random unit vectors in $D$ dimensions


Statsmodel logit producing param nans, large std err, warnings, but model performance is fine

Enormous coefficients in logistic regression - what does it mean and what to do?


Given that $X\mid Z=j \sim \mathrm N(\mu_j, \sigma_j) \ j=1,2$ derive the likelihood function of $X$

Obtaining posteriors for multivariate Normal mixture models


Simple function of two random variables, $Z = \frac{Y}{X}$ where Y, X~U(0,1) and independent

Distribution of ratio between two independent uniform random variables


Definition of closed-form analytical solution

What does a "closed-form solution" mean?


What can go wrong if we don't scale and center data in a predictive model?

Is it a good practice to always scale/normalize data for machine learning?


Why does the linear regression of "x on y" intersect with the linear regression of "y on x" at (x̄, ȳ)?


what are the drawbacks of implementing `dropout` in neural network training?


Artificial Neural Network for time series analysis - $R^2$ scores

Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


If Z|Y ~ Bin(p, y) and Y ~ Poisson(L) then Z ~ Poisson(p*L)?

Distribution of successes of poisson process followed by a binomial distribution


Why the OLS parameters of a linear regression are correlated?

Correlation between OLS estimators for intercept and slope


If entropy has log probabilities, why is exponential entropy used?


Why square the difference instead of taking the absolute value in standard deviation?


How to tune the number of epochs of a neural network in a cross-validation setup?

Is epoch optimization in CV with constant mini-batch size even possible?


Use t-distribution for sample mean of uniform RV's

Confidence interval for mean of a uniform distribution


Covariance of a nxm matrix with n<m is not positive semidefinite?

Why is a sample covariance matrix singular when sample size is less than number of variables?


Is it possible for an expected value not to exist?

What makes the mean of some distributions undefined?


Name for spurious linear Regression Plots


Test of equality of means if the data is from poisson distribution

Checking if two Poisson samples have the same mean


Using Leibniz integral rule when minimizing Expected Absolute Loss


Determining true mean from noisy observations


How can I group numerical data into naturally forming "brackets"? (e.g. income)


Categorical variables sklearn random forest

Will decision trees perform splitting of nodes by converting categorical values to numerical in practice?


Why can $R^2$ be negative in a multiple regression that doesn't have an intercept ($\hat{\beta}_0 = 0$)?


Feature selection Stability of Elastic net vs Lasso

What causes lasso to be unstable for feature selection?


Violation of the IID assumption in Gradient Boosting

Realistically, does the i.i.d. assumption hold for the vast majority of supervised learning tasks?


Can someone explain the concept of 'exchangeability'?


conditional probability poisson and exponential

Conditional Distribution of Poisson Variables, given $\sum X_i$


Is there a "canonical" probabilistic version of the step function?

Why sigmoid function instead of anything else?


2 boxes of money, unknown money inside, one is twice the amount of the other


Is there a need to standardise training and test sets separately for binary classification problems?

Perform feature normalization before or within model validation?


Should Likelihood add to 1 in frequentist case?

Likelihood function of probability distributions which integrate to unity


If some respondents are skipping certain questions because they do not apply to them, how would I address these missing values?

Can I still use logistic regression if some variables are not applied to all the observational units?


How can I cure non-normality of residuals in logistic regression?

Binomial response and logit link function in GLM (r)


can anyone help with interpreting these multiple linear model assumptions? (r)


What are we plotting the residuals of a simple linear regression against if we want a normal probability plot?

Interpreting Regression Diagnostic Plots


What are the current state-of-the-art convolutional neural networks?


Newton's methods vs. Newton's method in optimization

What is the correct equation for Newton's Method?


How do you deal with "nested" variables in a regression model?


Does increasing epochs really cause overfitting?

How to use early stopping properly for training deep neural network?


Does PCA's reconstruction error get reduced with more PCs being used?


Confidence Interval for a sampling P95 in unknown distribution

How to obtain a confidence interval for a percentile?


Can weight decay be higher than learning rate


Change in standard deviation when a value is removed

Online estimation of variance with limited memory


How does classical statistical methods fit into the machine learning paradigm

What is the difference between data mining, statistics, machine learning and AI?


What is the variance of the mean estimator of simple linear regression?

How to derive variance-covariance matrix of coefficients in linear regression


Statistical data analysis - data comparison


The tail distribution of a binomial distribution can be expressed in terms of an appropriate beta distribution function - Explanation

Relationship between Binomial and Beta distributions


Can a probability distribution value exceeding 1 be OK?


Finding bound for type 1 and type 2 error


Relation between Rand index and accuracy

difference between accuracy and Rand index (R)


Is it possible to use variational autoencoders with Non-Gaussian data?

Reparametrization trick with non-Gaussian distributions?


Why the prediction of neural network doesn't change?

What should I do when my neural network doesn't learn?


Correlation analysis with dichotomous variables

Correlations between continuous and categorical (nominal) variables


Intuition behind medium true positive rate, low false positive rate and "acceptable" AUC

AUC and class imbalance in training/test dataset


How to find the point where two normal distributions intersect?

Calculate probability (area) under the overlapping area of two normal distributions


Is it possible to prove a null hypothesis?


Use squared correlation in regression without intercept

Removal of statistically significant intercept term increases $R^2$ in linear model


Scoring predictions of an ordinal variable


Historical average with exponential smoothing model

Why do I get constant forecast with the simple moving average model?


How do I determine the likelihood of a single measurement coming from a known distribution?

Is there a statistical test to compare two samples of size 1 and 3?


Confidence interval for reciprocal proportion ($\frac{1}{p}$)

Does invertible monotone transformation of a confidence interval give you a confidence interval (at the same level) in the transformed space?


Determining the Direction of Eigenvectors in PCA

I'm getting "jumpy" loadings in rollapply PCA in R. Can I fix it?


Should the predictor variables be normally distributed for Poisson glm?


Evaluating binary classifier model. What can say precision, recall etc.?

Why is accuracy not the best measure for assessing classification models?


Number of all possible splits in each node of trees in a Random Forest


Why do we take `(Bias) ^2` in total error in a model?


Fitting model on whole dataset, more or less epochs ? (w.r.t validation accuracy)

Is epoch optimization in CV with constant mini-batch size even possible?


flipping card with increasing probability


What is the difference between LightGBM and XGBoost?

Mathematical differences between GBM, XGBoost, LightGBM, CatBoost?


Is there a systematic method to do transformations on independent variables in logistic regression?

Choosing between transformations in logistic regression


One hot encoding alternatives for large categorical values?

Principled way of collapsing categorical variables with many levels?


Power calculations, logistic regression with continuous exposure--cohort

Multiple logistic regression power analysis


estimation of standard errors after logistic regression

Standard error of the estimate in logistic regression


What is the difference between Gaussian discriminant analysis and logistic regression?

Discriminant analysis vs logistic regression


PCA: violation of the normal distribution assumption


How to calculate the correlation between categorical ordered and categorical binary variables

Correlations with unordered categorical variables


Question about Validation Set for hyperparameter tuning

How to obtain optimal hyperparameters after nested cross validation?


What is a good introductory text on resampling methods?


Probability Density Function (PDF) Intuition

Can a probability distribution value exceeding 1 be OK?


Do I need to check for Autocorrelation, Heteroskedasticity and Normality when building a model with data that are not time series?

What is a complete list of the usual assumptions for linear regression?


Does the sampling distribution for the median of a bimodal distribution depend on sample size?

Central limit theorem for sample medians


"95% of confidence intervals calculated from these random samples will contain the true population mean"

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Multi-level repeated-measures logistic regression in python/R


Generalised Chi-square distribution for variables with differing means and variances

Generalized Chi-Squared Distribution PDF


One hot encode nominal categorical variables for random forest?

Label encoding vs Dummy variable/one hot encoding - correctness?


Conflicting p-values of regressors in simple regression vs multiple regression?

What is the effect of having correlated predictors in a multiple regression model?


Create dataset of multicollinear variables in R

How to generate correlated random numbers (given means, variances and degree of correlation)?


How to deal with meaningless values in machine learning?

How do you deal with "nested" variables in a regression model?


Define $Var(XY)$ in terms of $E(X)$, $E(Y)$, $Var(X)$, $Var(Y)$ for Independent Random Variables $X$ and $Y$

Variance of product of multiple independent random variables


Relation between logistic regression and logistic distribution

How is Logistic Regression related to Logistic Distribution?


Is autocorrelation and stationarity in the residuals related?


How does AdamW weight_decay works for L2 regularization?


Assessing the performance of a neural network in classification task that involves more than two class types

Why is accuracy not the best measure for assessing classification models?


How to normalize a value from a range to another


Distribution of the combination of two Chi-squared distributions

Independence of ratios of independent variates


Can I combine several ordinal questions to create an independent variable?


Why does elimination method for random variables work?

How does the proof of Rejection Sampling make sense?


Risks of disproportionate numbers of training examples for different classes?

When is unbalanced data really a problem in Machine Learning?


multivariate linear regression without b_0

When is it ok to remove the intercept in a linear regression model?


Law of large numbers applied to $\overline{X}$

Why convergence in probability is defined as convergence to R.V.?


Two Gamma functions with common terms produces new Gamma and Beta functions

Construction of Dirichlet distribution with Gamma distribution


How to interpret a negative adjusted R-squared

Is it a problem to get a negative adjusted r-squared?


Differences between Bhattacharyya distance and KL divergence


Generating uniform points inside an $m$-dimensional ball

Simulate a uniform distribution on a disc


Skewed variables in PCA or factor analysis


Building separate logistic regression models for each categorical variable?

Separate Models vs Flags in the same model


Logistic Regression : 10 events per predictor rule


Does the estimation process in a regression effect multicollinearity tests

Should one be concerned about multi-collinearity when using non-linear models?


Why are IID normal random variables spherically symmetrical?

How to generate uniformly distributed points on the surface of the 3-d unit sphere?


Confidence intervals of positive parameters reaching into negatives

Does an impossible value on a Confidence Interval for a probability distribution contain information?


Easy Stats Question: Sampling a bag of 457 marbles,

How to calculate a confidence interval for estimating a proportion when the population is very small?


Example of two Random variables which are independent but from different distributions

Showing a Normal and a Chi square are independent


Best practice when analysing pre-post treatment-control designs


Is a p-value of < 2.2e-16 in r the same as a p-value that is asymptotically 0?

How should tiny $p$-values be reported? (and why does R put a minimum on 2.22e-16?)


Moment Generating Function for values $t \neq 0$

Real life uses of Moment generating functions


Book on structural equation modelling/ confirmatory factor analysis


Measuring the overlap between two probability distribution

How to calculate overlap between empirical probability densities?


Logistic regression in R with numeric fixed effect that has some 0-variance values

How to deal with perfect separation in logistic regression?


How do I calculate the probability density function for a joint beta + uniform distribution?


Finding the copula that obeys a sum constraint

Sampling uniformly from the standard n simplex with further constraints


Regression coefficient greater than 1: is it possible?


how to generate data from a distribution whose cdf is not in closed form?

how to generate data from cdf which is not in closed form?


What are the best books to study Neural Networks from a purely mathematical perspective?


shapiro wilk for testing normality in ANOVA

What have to be normally distributed: groups or whole sample?


If A and C are independent random variables, calculating the pdf of AC using two different methods

pdf of a product of two independent Uniform random variables


A Binomial distribution of which the number of trials is a Poisson distribuion

Distribution of successes of poisson process followed by a binomial distribution


Why do I not get a p-value and F value from ANOVA in R?


When using regularization wouldnt it make all parameters very small?


Explain L1 vs. L2 regularization difference using the scientific mindset

When will L1 regularization work better than L2 and vice versa?


Gaussian Distribution: How to calculate the Cumulative Distribution Formula (CDF) from the Probability Density Function (PDF)? + Error Function?

How are the Error Function and Standard Normal distribution function related?


scipy norm.pdf return probability of a particular outcome

Can a probability distribution value exceeding 1 be OK?


prove the difference between mean and median is less than the variance

Empirical relationship between mean, median and mode


What is the recommend function for Ridge regression

Ridge regression results different in using lm.ridge and glmnet


Are the important factors given by gradient boost more arbitrary compared to random forest

Why do Random forest and XGBoost gives different importance weight on the same set of features?


In natural language parsing, what is the feature function?


Link between Maximum Likelihood and Maximum Probability

Confusion about Maximum likelihood estimation


Deep learning : How do I know which variables are important?


How would you transform a percentage dependent variable to fit a logistic regression?

Percentage as dependent variable in multiple linear regression


Error bars, linear regression and "standard deviation" for point


How to address severe class imbalance with lots of zeros in the columns?

Are unbalanced datasets problematic, and (how) does oversampling (purport to) help?


Calculating the sample cumulative distribution function for a Kolmogrov-Simulation test to examine the goodness of fit with given data

How to understand the definition of empirical distribution function


Batch Normalization or just z-normalization as a Nonlinearity


When is it ok to remove the intercept in a linear regression model?


How to optimize performance of cluster model without any ground truth?

How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?


KNN - Distance measure and interpretation

Why is Euclidean distance not a good metric in high dimensions?


why Alexnet fails even on slight modification to layers

Why are neural networks becoming deeper, but not wider?


spatstat::plot.envelope observed line longer than significance band

spatstat::plot.envelope observed line longer than shading


How does RStudio 'lm' know my data is a polynomial equation?

Understanding the shape of confidence interval for polynomial regression (MLR)


Interpreting logistic regression results?


Confidence intervals for the probabilities of each outcome in a multinomial

How to interpret margin of error in a non-binary poll?


Baseline hazard and survival curves in Cox regression


Cluster analysis in R with a mix of variable types


Symmetry of distribution function is defined as $f(x-a)=f(-(x-a))$, then expectation is $'a'$. i.e $E(X)=a$

Central Moments of Symmetric Distributions


Is a time series the same as a stochastic process?


Statistical method for finding minimum numbers of selections for popularity of an item

statistical method for finding significant numbers in a set


significant statistical/practical differences for a set of items for two populations


coxph function: When to use the Likelihood ratio test?

Why do my p-values differ between logistic regression output, chi-squared test, and the confidence interval for the OR?


Can you give a simple intuitive explanation of IRLS method to find the MLE of a GLM?


Minimizing The Expected Loss Of a Classification Problem

How to obtain the functional derivative in variational inference?


Least square estimation with quadratic fit. Any simple solution?

Explicit solution for linear regression with two predictors


Range of values of $R^2$ for a two-feature linear model based on the $R^2$s of one-feature linear models?

relation between $R^2$ of simple regression and multiple regression


The expected value of log Gamma function

What is the expected value of the logarithm of Gamma distribution?


Optimization when Cost Function Slow to Evaluate


Effect of scaling data on ARMA coefficients


Variance of linear combination of random variables

Variance of a linear combination of vectors


Predicting in Neural Network with Softmax or Logistic activation output

Reduce Classification Probability Threshold


How to combine continuous and discrete variables for bayesian network?

Specifying conditional probabilities in hybrid Bayesian networks


What are the assumptions for quantile regression?

What are the assumptions for applying a quantile regression model?


What is the intuition behind the Independent Spacings Theorem?

How to show this curious combination of Exponential order statistics has a Chi-squared distribution?


What should i use lme or glm? (Biostatistics, diversity)

which analysis fit the best for the data?


Difference between logit and probit models


How to interpret this Residuals vs. Fitted Plot

Measures of residuals heteroscedasticity


how to use RFE(Recursive feature elimination) on categorical (one-hot encoded variables)

Can I ignore coefficients for non-significant levels of factors in a linear model?


Bayesian GLM/ANOVA in brms -- what is the "equivalent" to frequentist post-hoc? Does it matter?

Why don't Bayesian methods require multiple testing corrections?


statistical regression vs machine learning regression

Difference Between Linear Regression in Machine Learning and Statistical Model


Trying to understand the logic behind the p-value in hypothesis testing

What is the meaning of p values and t values in statistical tests?


Understanding the 95% confidence interval

Confidence interval for Bernoulli sampling


Why is OLS estimator of AR(1) coefficient biased?


R glm() does not converge / huge standard errors: collinearity?

Logistic regression in R resulted in perfect separation (Hauck-Donner phenomenon). Now what?


Confused about the concept of confidence interval

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Proof that ratio of normal distributions is Cauchy

How can I obtain a Cauchy distribution from two standard normal distributions?


Is it possible to define what the last hidden layer represents in a neural net?

Can't deep learning models now be said to be interpretable? Are nodes features?


How is the likelihood different from the posterior?

What is the reason that a likelihood function is not a pdf?


How to prove that sample mean is the expectation of e.d.f.(empirical distribution function)

Obtaining an expression for empirical mean from empirical CDF definition


Box Cox transformation in multiple regression using car package in R

Interpreting multiple regression with transformed response variable


Expected Value of the Ratio of Independent Variables, E(X/(X+Y))

Expected value of product of dependent random variables


Coefficient estimates from $(X'X)^{-1}, X'y$ and $\widehat{u'}\widehat{u}$

How are the standard errors of coefficients calculated in a regression?


Are the training samples shuffled in minibatch gradient descent?

Should training data in each batch size be resample only one time or at each epoch when using mini-batch


Variance of two gaussians with the same mean

What is the variance of the weighted mixture of two gaussians?


Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


What I have this rare output value of variance and standart deviation functions in numpy?


Assumptions behind multinomial logistic regression

Multinomial logistic regression assumptions


On the S.E of the the categorical levels

How to deal with perfect separation in logistic regression?


Understanding Lasso Regression's sparsity geometrically


Why feature selection using `L1` and not using `L2` norm?


Can a linear regression model's r-squared value exceed the sum of the r-squared values of its input variables?

relation between $R^2$ of simple regression and multiple regression


Why does the bootstrap method work to estimate a statistic?

Explaining to laypeople why bootstrapping works


Anscombe transform and normal approximation


How to approximate the student-t CDF at a point without the hypergeometric function?


What is the meaning of p values and t values in statistical tests?


Why can't ARIMA model large lags and/or long range dependence?


How to find whether root means square error (RMSE) value obtained is good or bad?

Is there any standard / criteria of good forecast measured by SMAPE and MASE?


Predict an angle between 0-360, how do I deal with the discontinuity at 0/360?


What are the assumptions of cross-validation if any?


chi square test for 6X4 contingency table

Chi-squared vs Fisher's Exact Test w/ 5x6 contingency table & some cells <5?


Random matrix theory impact on covariance matrix analysis


Why should you use propensity score matching?

Propensity score matching vs non-parametric regression


Why is the train loss decreasing while the test loss increases?

What should I do when my neural network doesn't generalize well?


What is the extension(or generalisation) of the sigmoid function to non-binary classification?

Using Softmax activation function for multi-class classification


Why is the cross-entropy loss function used in logistic regression?

How to construct a cross-entropy loss for general regression targets?


DNN output: why not use sigmoid instead of linear, for linear [0-1] outputs?

Is it okay to use cross entropy loss function with soft labels?


PCA, correlation of the features of projected data

Why are PCA eigenvectors orthogonal and what is the relation to the PCA scores being uncorrelated?


Is it ok if I log/square root transform my variables and then scale them to perform a PCA?

Why log-transforming the data before performing principal component analysis?


Selecting Binary Classification Probability Threshold

Changing threshold in logistic regression


Source for how to Interprete Results with Extremely Low p-values and Coefficient of Determinations

What does it mean if I have a high F-stat but low $R^2$?


Why is the cutoff for AUC (area under ROC curve) to be considered an acceptable classfier at .7 and what is it acceptable for?

Determine how good an AUC is (Area under the Curve of ROC)


Why do we assign probability to theta even though we consider it constant in frequentist statistics?

Bayesian vs frequentist Interpretations of Probability


What is the meaning of p values and t values in statistical tests?


Intuitively understanding $F_X(X)$ (r.v. as argument)

Questions regarding proof of probability integral transform


Is it a bad idea to always standardize all features by default?

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Linear regression with non-normal residuals


Proof that $\sum_{i=1}^{n}e_i X_i = 0$ in simple linear regression

Why do residuals in linear regression always sum to zero when an intercept is included?


When is unbalanced data really a problem in Machine Learning?


Type of Data resulting from Aggression Tests


Why are the Degrees of Freedom for multiple regression n - k - 1? For linear regression, why is it n - 2?

How do I use the standard regression assumptions to prove that $\hat{\sigma}^2$ is an unbiased estimator of $\sigma^2$?


Should I go back to do conventional logistic regression after LASSO logistic regression?

Coefficients and significance of lasso/ridge


What is the maximum likelihood for this distribution(received signal)?

Linear regression: any non-normal distribution giving identity of OLS and MLE?


likelihood of machine learning model with continuous data must be zero?

Why does Maximum Likelihood estimation maximize probability density instead of probability


Why can't we interpret likelihood as probability?

What is the reason that a likelihood function is not a pdf?


Prove that In A simple linear regression, $SSR/\sigma^2$ follows chi square with one degree of freedom

How to get the degree of freedom when doing multiple linear regression?


Sampling data from a Cox proportional hazard model

How to simulate survival times using true base line hazard function


Distribution of $(X_1-\overline{X})/S$ where $X_i$ are i.i.d. normal


Covariance of Poisson and Conditional Binomial RV's


Random variable with finite logarithmic first moment, infinite logarithmic variance

How can a distribution have infinite mean and variance?


Random variable with finite exponential first moment, infinite exponential variance


Number of units in fully connected layers

How to choose the number of hidden layers and nodes in a feedforward neural network?


Is there a variance/ uncertainty tradeoff when we use log likelihood instead of likelihood?

Theoretical motivation for using log-likelihood vs likelihood


What statistical analysis? Three continuous independent variables w/ one categorical dependent

Ordinal dependent variable with continuous independent variables


Are there really many continous distributions without the PDF

"Absolutely continuous random variable" vs. "Continuous random variable"?


The Monty Hall Problem - where does our intuition fail us?


How to derive Poisson distribution from gamma distribution?


Where plus 1 came from in variance estimation

Basic question regarding variance and stdev of a sample


Hypothesis testing of a slope in simple linear regression

If and how to use one-tailed testing in multiple regression


The variance matrix of the unique solution to linear regression

Standard error of regression coefficient without raw data


Mean number of throws to exceed a threshold

Calculating the expected number of unbalanced dice needed to reach a sum


Solving the Kolmogorov forward equation for transition probabilities


Is it valid to conduct t-tests with just 20 students?

Why is the t-test designed for small samples?


Question based on the @whuber detailed answer on fat tailed term

Example of heavy-tailed distribution that is not long-tailed


Significant Difference in prediction when using library and coding from scratch in Multiple Linear Regression

Why use gradient descent for linear regression, when a closed-form math solution is available?


Calculating MEAN and STANDARD DEVIATION confussed


Is the model with the lowest AIC value always the preferred one?

AIC versus Likelihood Ratio Test in Model Variable Selection


Minimal Sufficient Statistic for the distribution $U(-\theta, \theta)$

Sufficient statistics for Uniform $(-\theta,\theta)$


Can this statistic be shown not to be sufficient for $\theta$?


will WLS estimator be smaller or larger than the robust standard errors?

How to prove positive (semi-)definitness in matrix notation without numbers


What is a good P value for statistical significance when conducting a Wilcoxon Rank Sum test?

Regarding p-values, why 1% and 5%? Why not 6% or 10%?


Approximate probability of minimum n such that the sum of n Bernoulli random variables is greater or equal to 1000

How can I model flips until N successes?


How is it that each probability in a normal distribution occurs with the same frequency?

Proving the probability integral transform without assuming that the CDF is strictly increasing


Which has the heavier tail, lognormal or gamma?


Prior and posterior distributions involving a prior Beta distribution

Help me understand Bayesian prior and posterior distributions


How to calculate a var of the sum of two coefficients in linear regression

Closed form for the variance of a sum of two estimates in logistic regression?


Notation: What does the tilde below of the expectation mean?


why did this model make loss higher than before?

What should I do when my neural network doesn't learn?


t-test or z-test: assume normality or s≈σ?


Can one uniformly generate complex numbers of absolute value less than a given constant $R \neq 1$?

Generating random points uniformly on a disk


Distinguishing the meaning and uses of effect size vs relative feature importance

Is there a general definition of the effect size?


How to calculate correlation coefficient for the 3 scenarios?


Does the sign of scores or of loadings in PCA or FA have a meaning? May I reverse the sign?


Why is scaling usually done within the range of -1 and +1 in machine learning?

Neural Networks input data normalization and centering


positive and negative correlation after controlling variables

Positive correlation and negative regressor coefficient sign


Normal random vector with some known values

Deriving the conditional distributions of a multivariate normal distribution


Using a variable both as fixed and random effect?

Using the same variable as a fixed and random effect in Mixed Effect Models


Logistic regression vs. LDA as two-class classifiers


Propensity score matching vs non-parametric regression


Is there any benefit to Monte Carlo simulation when probability can be directly calculated?

What are the advantages of a simulation over an exact binomial calculation?


My second data science project: Classifying the price at fine art auctions

What should I do when my neural network doesn't generalize well?


i.i.d assumption: formal definition vs. intuition

On the importance of the i.i.d. assumption in statistical learning


Confusion regarding obtaining a Dirichlet distribution from Beta marginals

Construction of Dirichlet distribution with Gamma distribution


Expectation of a function of a random variable from CDF


Best Statistical Test for Median Comparison

Hypothesis test for difference in medians among more than two samples


Excel NORM.DIST() calculation for a specific value of x (CUMULATIVE = FALSE)?

Can a probability distribution value exceeding 1 be OK?


Basic question about PDFs: multi-parameter PDF, not multi-variate

Is it possible to have a pair of Gaussian random variables for which the joint distribution is not Gaussian?


Is it a good practice to always scale/normalize data for machine learning?


Is my logic straight? Logistic regressions in R


Association Between Two Categorical Variables in R

Correlation coefficient between a (non-dichotomous) nominal variable and a numeric (interval) or an ordinal variable


Does failing to reject the null hypothesis mean rejecting the alternative?

If we fail to reject the null hypothesis in a large study, isn't it evidence for the null?


Do any of zero coefficients become non-zero by increasing $\lambda$ in lasso regression?

Variable coefficient rises, then falls as lambda decreases (LASSO)


Bayesian inference for both mean and variance

Help with Bayesian derivation of normal model with conjugate prior


Conditions for gaussianity of sum of Gaussians

Is joint normality a necessary condition for the sum of normal random variables to be normal?


How the time lag is non-integer in ACF plot?


¿What is the difference between scores and Principal Components in PCA?


Is it allowed to log a already (logged)transformed continuous variable for low skewness?

In linear regression, when is it appropriate to use the log of an independent variable instead of the actual values?


What is the distribution of $(X−Y)^2+(Z−Y)^2$, where $X$,$Y$ and $Z$ are independent normal distributions with their own means and variance?

sum of noncentral Chi-square random variables


Conditional distribution of a normal distribution given it is smaller/bigger than another normal distribution


Does 'mean' / 'median' divides area under Probability Density Function (PDF) into half in case of normal distribution which is left/right skewed?

Why are mean and median not equal for asymmetric distributions?


What are the benefits of K-fold cross validation compared with grid search with repetitions


Does zero correlation implies independence for linear models?

Why zero correlation does not necessarily imply independence


How is $E_q[\log p(x,z)] - E_q[\log q(z|x)]$ equal to$ E_{q(z|x)}[\log p(x|z)] - KL(q(z|x) || p(z))$?


Automatic detection of seasonality on a time-series


Applying Bayes rule in the context of reinforcement learning

Model evidence and Bayesian model selection


What does the notation like 8.6e-28 mean? What is the 'e' for?


Violated non-proportional hazards - Cox regression model of time-dependent covariable


What is the point of redundant samples in bootstrapping?

Explaining to laypeople why bootstrapping works


Why do we need more than 1 epoch to train data?

Why do we use multiple epochs and why does it not lead to over fitting


Conceptually understand z-score obtained from standard normal table

Why does the p-value double when using two-tailed test compared to one-tailed one?


Does multivariate multiple regression take into account correlated outcomes?

Why do we need multivariate regression (as opposed to a bunch of univariate regressions)?


How to know whether the data is linearly separable?


"Unbiased" hypothesis test --- what does it mean actually?

Why is the unbiasedness condition in hypothesis testing called "unbiasedness"?


Regression - What to do with insignificant variables?

Should covariates that are not statistically significant be 'kept in' when creating a model?


Measure the correlation between categorical variable and continuous variable

How do I study the "correlation" between a continuous variable and a categorical variable?


How to explain RMSE to business folks and in a simple and easy way

Explain Root Mean Square Error to non-technical audience


How to show $X_n$ converges in distribution to U(0,1)


Inverse CDF (Quantile) of Piecewise Function

Constructing inversion method from a given pdf by finding inverse of cdf


In what order should you do linear regression diagnostics?


Autocorrelation in residuals, what to do next?

How can I handle autocorrelated residuals?


UMVUE of the probability of a conditional poisson probability $P_{\lambda} (X=r )$

UMVUE of $e^{-\lambda}$ from poisson distribution


why are squares of gradient used in adaptive learning rates techniques like rmsprop?


Non Linear regression to obtain diminishing marginal effect / elasticity


What is the best introductory Bayesian statistics textbook?


Lots of training data in cross validation -> overfitting?

Bias and variance in leave-one-out vs K-fold cross validation


Applying cross-validation to find the best length of n-gram


Logistic regression and balanced treatment groups

Do I need a balanced sample (50% yes, 50% no) to run logistic regression?


How to Compute the Brier Score for more than Two Classes


What should be the minimum observation size per group in a random effect

Minimum sample size per cluster in a random effect model


Principal components with and without centering

How does centering make a difference in PCA (for SVD and eigen decomposition)?


Expected number of trials to get 5 heads

How can I model flips until N successes?


UMVUE of $\exp(t \mu)$ for $N(\mu, \sigma^2)$ where $\mu$ is not known but $\sigma^2$ is known

UMVU estimator for non-linear transformation of a parameter


If correlation does not imply causation, then what will it take to infer a causal relationship?


Normalize parameter in sklearn Ridge, Lasso, ElasticNet

Standardization vs. Normalization for Lasso/Ridge Regression


How to get coordinates when only pairwise distances are known?

Constructing N-dimensional vectors out of point distances


Metrics to optimize imbalanced multiclass classification

Evaluating multiclass imbalanced problem per class


What is the distribution of the k-th event in the Poisson process?

Conditional expection of gamma distribution on sum


Two sample tests for stratified randomization


Why is independence of observations an assumption in logistic regression

Is there i.i.d. assumption on logistic regression?


Leverage Statistic (h) for Multiple Predictors

Leverage formula/derivation and Hat matrix


ANOVA - Adding interaction term changes a main effect to being insignificant. How can that be?

What if interaction wipes out my direct effects in regression?


Probability of substring inside string of coin-tosses


Dropping one of the columns when using one-hot encoding


If $P(A \mid E) > P(B \mid E)$ and $P(A \mid \neg E) > P(B \mid \neg E)$, then is $P(A) > P(B)$ true?


Is entropy the same for a shifted-mean distribution?

How does entropy depend on location and scale?


Confidence intervals for a joint probability distribution


Confidence regions on bivariate normal distributions using $\hat{\Sigma}_{MLE}$ or $\mathbf{S}$


What are the differences between the likelihood functions in Maximum Likelihood Estimation and in the Bayes' Theorem?

Is there any difference between Frequentist and Bayesian on the definition of Likelihood?


Calculate statistical significance between binary and continuous data groups

Logarithmic loss vs Brier score vs AUC score


Online estimation of variance with limited memory


How do I show this equation involving the Gaussian pdf?

completing the square for Gaussian multivariate estimation


How cost function of Logistic Regression is derived?

the relationship between maximizing the likelihood and minimizing the cross-entropy


machine learning and neural network - hidden layers

Number of hidden units - function approximation


What's the relationship between standard deviation and bandwidth in a Gaussian kernel smoother? (ksmooth in R vs gaussian_filter in Python)

Kernel density estimation -Effect of bandwidth


Derivation of t-distribution for small sample from Normal population

A normal divided by $\sqrt{\chi^2(s)/s}$


Proving Least-Squares Estimator is Unbiased

Intuition behind unbiasedness of ordinary least squares estimator


Is a sum of two binomial distributions with different $p$ also binomial?

How can I calculate the probability for multiple trials with different probabilities?


When will lasso and regression tree perform differently?

Can a random forest be used for feature selection in multiple linear regression?


When do machine learning algorithms beat deep neural networks?

Is there any supervised-learning problem that (deep) neural networks obviously couldn't outperform any other methods?


Least-squares fit of explicit parabolic sheet to scattered data points

Least squares fit of a bivariate quadratic-linear product to an oriented point set


How to remove the effect of age on the ROC curve?

Adjusting for covariates in ROC curve analysis


Why is using squared error the standard when absolute error is more relevant to most problems?

Mean absolute error OR root mean squared error?


An example of continuous random variable X > 0 with finite second moment but Infinite third moment

Can you bound the third moment from the second moment?


Best Feature Selection Algorithm for Multiple Linear Regression

Multiple regression with more than 20 predictors


What can I validly conclude about a variable that becomes significant and switches sign when other variables are included in the model?

Significant predictors become non-significant in multiple logistic regression


Why do we only look at the sample from MCMC? (And ignore the sample points' posterior probabilities?)

When approximating a posterior using MCMC, why don't we save the posterior probabilities but use the parameter value frequencies afterwards?


Reasoning about random variables with bounded range


Accounting for a covariate that only exists in one of two groups

How do you deal with "nested" variables in a regression model?


Why is Newton's method not widely used in machine learning?


how to decide on how to model something that doesn't satisfy all assumptions of linear regression

In what order should you do linear regression diagnostics?


Determining the number of trees in a random forest

Do we have to tune the number of trees in a random forest?


How to prove this decomposition of sum of squares?


What is the covariance of the product of two independent random vectors with known covariances?

Variance of product of 2 independent random vector


What's the difference between Normalization and Standardization?


Inaccurate coefficient output when using binomial glm in R

Difference in output between SAS's proc genmod and R's glm


How do I perform a minimax ($L^\infty$) regression?

Software package to solve L-infinity norm linear regression


How to deal with 100+ levels in categorical variable in multiple linear regression?

Principled way of collapsing categorical variables with many levels?


If k-folds cross-validation gives k models, how can we decide which to use?

How to choose a predictive model after k-fold cross-validation?


Probability - Find $P(X_n \ge max(X_1, X_2, \dots, X_{n-1}))$

Proof that the probability of one RV being larger than $n-1$ others is $\frac{1}{n}$


Difference between loss functions in neural networks

What is happening here, when I use squared loss in logistic regression setting?


Scientifi notation in CI vaue - how to present it

What does the notation like 8.6e-28 mean? What is the 'e' for?


How to know the specific ARIMA model through its yt equation?


How can logistic regression maximize AUC?

Does a logistic regression maximizing likelihood necessarily also maximize AUC over linear models?


How to read this LASSO Coefficient Path Plot?

What is "step size" in LASSO regression?


creating multiple categorical variable with specified degree of association (correlation) matrix

How to generate Bernoulli random variables with common correlation $\rho$?


Test model coefficient (regression slope) against some value


Does SPSS Homoscedasticity Residual scatterplot have meaning for Likert Data?

Parallel straight Lines on Residuals vs. Predicted Values Plot


How to compute error terms in moving average time series model?


How to deal with hierarchical / nested data in machine learning


Keras: validation loss decreases but accuracy does not increase

What should I do when my neural network doesn't generalize well?


Modelling the heat exchange between a steel cylinder and the surrounding medium

How to minimize residual sum of squares of an exponential fit?


How to detect the anomaly in a time series data with trend and seasonality present?

Algorithms for Time Series Anomaly Detection


having trouble interpreting confint function using R (logistic regression)

What, precisely, is a confidence interval?


How to De-standardize coefficients from multiple linear regression?

Convert standardized coefficients to unstandardized (metric) coefficients for linear regression of a standardized independent variable


State Space model identification with Kalman Filter

Identifiability of a state space model (Dynamic Linear Model)


Clear pattern in the residual vs fitted values plot

Apparent correlation between standardized residuals and predicted in regression


Why do we use ANOVA and linear regression together?

Why is ANOVA taught / used as if it is a different research methodology compared to linear regression?


Piece Wise Linear Interpretation in R and plotting with ggplot


How to set the priors for Bayesian estimation of Multivariate Normal Distribution when the correlation matrix has small values?

bayesian updating for multivariate normal priors


Standard formula for quick calculation of scores


Can ReLU replace a Sigmoid Activation Function in Neural Network without needing to change other parameters/functions of Network?

Why do we use ReLU in neural networks and how do we use it?


Why is correlation formula the way it is? Or Say how it formed?

How to understand the correlation coefficient formula?


Chi-squared Test and Data Representation


I am confused between selection of limits for joint distribution


non-parametric tests for repeated observations


What is the cause of the sudden drop in error rate that one often sees when training a CNN?

What causes sudden drops in training/test errors when training a neural network?


How the probability threshold of a classifier can be adjusted in case of multiple classes?

How to threshold multiclass probability prediction to get confusion matrix?


Backing up Windows 7 clean installation for restore purposes

Software to backup data and files on a Windows computer


Excel freezes when copying a few cells multiple times

Excel freezes when copying / cutting to paste elsewhere


USB flash drive not working or is appearing as an empty disk drive, Disk Management reports "No Media" with 0 bytes size


Rebind Microsoft Sculpt Mobile Mouse (Windows Key)


Swap Fn and Ctrl keys on a Lenovo ThinkPad X200

Swapping Function (Fn) and Control (Ctrl) Keys on Lenovo ThinkPad W500


What can I do if I forgot my Windows password?


Can't remove read only attribute from folder windows 8.1

Folder keeps changing back to read-only. What permissions setup causes this in Windows?


How can I see which wifi channel is used by my laptop with Windows 8?

How to find what channel the SSID is on?


OpenOffice Writer: preserve hyphen in text


How to type the tilde character that is not in my keyboard layout?

Italian keyboard: entering tilde (~) and backtick (`) characters without changing keyboard layout


EXCEL - How to use two cells for input and output at the same time

Excel VBA code Private Sub Worksheet Change Power function not working


In excel 2010 how to colour a cell based on values from another cell


Can a 20V 4.51A power supply be used with a computer that requires a 19V 3.42A power supply?

Can I safely charge my laptop with a non-standard, third-party charger?


My keyboard has no volume control keys; how do I assign shortcuts to control the global sound volume?

How can I control the master volume in Windows?


Injection of banners in my webbrowsers possible malware

How can I remove malicious spyware, malware, adware, viruses, trojans or rootkits from my PC?


Adware issue on Microsoft Windows 8.1 Pro


Is there a shortcut in excel that will expand the column width to show the entire column header

How do I expand all columns in Excel spreadsheet?


Why do I get many Removable Disk icons that don't really exist?

How do I delete "Removable Disk" listings?


Keyboard shortcut helper app for windows?

Is there any way to get a list of the system-wide keyboard shortcuts currently in use?


Chrome: remove URL from autocomplete which doesn't show up in history?


How To Separate One Channel Audio To 2 Channels?

How do I force single (only) channel audio in youtube/flash videos to play in both (left/right) channels?


How to make Excel's "Auto Fit Row Height" feature actually auto fit the row height?


How to check if my eSATAp port provides 12V power?


Why is notepad++ writing to my new document?


Is liquid cooling necessary for high CPU performance over extended periods?


Migrating windows 8 license from one machine to another

Transferring a Windows 8 license and proper un- and reinstallation


How to search the content of visited pages in Google Chrome?

Search text of webpages using browser history in chrome?


Task Manager shows 100% CPU utilization, but nothing in process list does


How can I rate or tag files that aren't images in Windows 7?

How to add tags to files in Windows 7 so that they appear in search results


What software has a bug that space in Adobe password fails to open in Chrome?

Stop PDFs from displaying inside Google Chrome


How do I fix the sound of my game when I start a Skype call?

Windows 7 lowers applications' volume automatically


Windows 7 Delete heavily nested folder structure

How to delete directories with path/names too long for normal delete


Burn movies to CD's that will play on a standard DVD?

Ensure a burned DVD will work any dvd player?


Why Excel sometimes changes cell formats after reopening file?

How to preserve custom number formatting after closing a workbook?


My 4TB Seagate Backup plus works externally, not internally

Why is my USB drive showing corrupted data when plugged as an internal SATA drive?


How do I make a USB flash drive writable on Linux?

What can I do if my USB flash drive is write-protected or read-only?


How to stop "Do you want to scan and fix drive" message in Windows 7?

Is it possible to disable the "scan and fix" message when inserting an SD Card?


Event Viewer: Event ID 2 'Session "Circular Kernel Context Logger" failed to start with the following error: 0xC0000035'

Cause of "Session Circular Kernel Context Logger failed to start error in Event Log?


How do I disable microphone volume auto-adjusting?


How can I remove malicious spyware, malware, adware, viruses, trojans or rootkits from my PC?