How to calculate the area under the precision-recall curve for the random classifier?

What is "baseline" in precision recall curve


What are the limitations of ANOVA vis a vis multiple regression analysis

Why is ANOVA equivalent to linear regression?


Is it possible to test for a Gaussian distribution?

Is normality testing 'essentially useless'?


What does the MGF do when its parameter is other than 0?

Real life uses of Moment generating functions


Possibilities of accelerating EM algortihm


Why my Convolutional Neural Network always produces the same outputs?

What should I do when my neural network doesn't learn?


Deep Q Network: Cannot reduce training error


How does logistic regression work with p>n?

Regularization methods for logistic regression


Is PCA effectively just a rotation of the data, if you were to keep all principal components?

What are "rotated" and "unrotated" principal components, given that PCA always rotates the coordinates axes?


Is GLM appropriate for an extreme unbalanced dataset?

How should one interpret the comparison of means from different sample sizes?


What is the meaning of p values and t values in statistical tests?


Mean and variance of bernoulli of two normally distributed random variables

What is the variance of the weighted mixture of two gaussians?


How do I calculate two linear regressions in one dataset

Data has two trends; how to extract independent trendlines?


Simple examples of uncorrelated but not independent $X$ and $Y$


What to conclude from this lasso plot (glmnet)


Is there a measure of association for a nominal DV and an interval IV?

Correlations between continuous and categorical (nominal) variables


Statistical test to assess the strength of the assertion "time series' values stayed the same"

What is the best way to proof your time series has a deterministic linear trend


How does rectilinear activation function solve the vanishing gradient problem in neural networks?


confusion related to maximum a posteriori estimation

Under the 0-1 loss function, the Bayesian estimator is the mode of the posterior distribution


Why does logistic regression become unstable when classes are well-separated?


Correlation between two binary variables

Is it meaningful to calculate Pearson or Spearman correlation between two Boolean vectors?


Interpreting results output from Firth logistic regression in R

Predict probabilities from Firth logistic regression in R


Neural Nets: Benefits of Mixing Activation Functions?

Varied Activation Functions in Neural Networks


Flexible and inflexible models in machine learning


do you need to remove mean and divide by std for testing normality?

Simulation of KS-test with estimated parameters


Random process not so random after all (deterministic)

Generate identically distributed dependent normal random numbers with prespecified sum


Association between categorical and continous variables

Correlations between continuous and categorical (nominal) variables


Difference of nearest-neighbour clustering and K-nearest neighbor clustering

What are the main differences between K-means and K-nearest neighbours?


How to derive mathematically that derivative of |Ax-y|^2 with respect to A is 2|Ax-y| x^T

Derivative of $(y-XB)' h(y-XB)$ with respect to $B$


Sampling Distribution of Exponential Sample Variance (Formal, not Empirical)

Sampling distribution of exponential sample variance (formal not empirical)


In Bayesian inference, why is p(D) sometimes called "the evidence"?

In Bayesian terminology, what does evidence refer to?


Can the difference of random variables be uniform distributed?

Uniform PDF of the difference of two r.v


Sampling from marginal distribution using conditional distribution?


What is the purpose of dimension reduction in classification?

Is dimensionality reduction almost always useful for classification?


How to develop a model in R to illustrate that sum of two variables normally distributed if these two variables each follow a Normal distribution?

Sum of 2 Normally Distributed Random Variables With a Correlation


Visualizing clustering on 2D binary data

How to plot clusters in more than 3 dimensions?


Confusion when going from index notation to matrix notation


What should I do when my neural network doesn't learn?


Understanding whether to use two-way effects

Logistic Regression - Adding interactions makes Independent variable statistically insignificant


Lack of accuracy for my open market price forecasting

How to know that your machine learning problem is hopeless?


It is possible to run Principal Component Analysis (PCA) on proportions?

How to analyze a small matrix to discover associations between cases and variables and the main factors underlyining the variables?


How the first tree in gradient boosting classifier is constructed and the split criteria

First Iteration in Gradient Boosting Algorithm


When it is necessary to assume distribution to calculate probability?

Why would parametric statistics ever be preferred over nonparametric?


Am I statistically allowed to use a binomial family here -> is my data truly independent?


Is there just one exponential family? Or are there many exponential families?

Why doesn't the exponential family include all distributions?


Variance of the product of correlated normal variables

Variance of product of dependent variables


Negative correlation between y and X, yet positive coef. in Logit model?

Positive correlation and negative regressor coefficient sign


Why and when would one begin with PCA on $X$ when predicting $y$?

How can top principal components retain the predictive power on a dependent variable (or even lead to better predictions)?


How can I apply a Logistic Regression model in real life?

Interpretation of R's output for binomial regression


Regression: Why does using quadratic expressions work with linear estimators?

Why is polynomial regression considered a special case of multiple linear regression?


"Regression" versus "regression to the mean"

What is the relationship between the function $\mathbb{E}(Y \mid X = x)$ and linear regression?


Beginner: Simulating Gaussian Process on $\mathbb{R}$

Simulating the posterior of a Gaussian process


Getting critical values - clarify solution

p-value approach - clarify teacher's solution?


Sample size and confidence level to verify existing data

How to calculate a sample size for validating correct/incorrectness of records in a data table?


Distribution function terminology (PDF, CDF, PMF, etc.)

What does "probability distribution" mean?


Does simple linear regression imply causation?


Princomp() outputs seemingly wrong PCA scores with cor=TRUE input argument

Why do the R functions 'princomp' and 'prcomp' give different eigenvalues?


Why shouldn't the denominator of the covariance estimator be n-2 rather than n-1?


Area under curve of ROC vs. overall accuracy


How is the mahalanobis distance like the euclidean distance?

Bottom to top explanation of the Mahalanobis distance?


What is the meaning of p values and t values in statistical tests?


Understanding complete separation for logistic regression


Fail normality test but the qqplot is a straight line

Interpreting QQplot - Is there any rule of thumb to decide for non-normality?


Generate sample data from Gaussian mixture model

Generating random variables from a mixture of Normal distributions


Motivation for Gamma, exponential, & chi-squared distributions

Motivation for statistical distributions


Statistical evidence that the AUC was not overfitted to the model. With N=119, C-stat = 0.81 seems optimistic. Optimism-adjusted?


Metropolis-Hastings algorithm for a possibly negative probability distribution


Why is Fisher's information the *negative* of expected second derivative?

What kind of information is Fisher information?


Are there any models that can handle out of sample features?

Dealing with new Factor Levels in a Regression in R


univariable significance lost when combining variables together

Significant predictors become non-significant in multiple logistic regression


What is a good oob score for random forests with sklearn, three-class classification?

Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


Is Baron and Kenny method for mediation now outdated?

Alternatives to the Baron-Kenny approach to modeling mediation


Should I use q-values or p-values when presenting results?

Multiple hypothesis testing with FDR in R - FDRtool and p.adjust


linear mixed effect model splits variabel into two

Interpreting Intercept when doing logistic regression with categorical data in R


Loss is stuck at 67% and wont converge even with large epoch and early stopping criterion

What should I do when my neural network doesn't learn?


Does one need to standardize data before PCA even if all the variables are measured in the same units?


Can a probability distribution value exceeding 1 be OK?


Intuitive explanation of the bias-variance tradeoff?


How interpret RMSE figure (Cross Validation)


For what types of research designs should (Days|Subject) vs. (1|Days:Subject) random effect specification be used?

Difference between (factor|group) and (1|factor:group) specifications in lme4


*Why* are eigenvectors the principal components in Principal Component Analysis?

Making sense of principal component analysis, eigenvectors & eigenvalues


What is the story of "$n-1$" in the denominator of an estimated variance?

Intuitive explanation for dividing by $n-1$ when calculating standard deviation?


What is the conditional probability of normal given that another normal is less than a constant

If $X, Y$ are jointly standard normal with correlation $r$, and $a, b$ are constants, what is $p(Y < b | X < a)$?


Metropolis-Hastings Algorithm for Numerical Integration

What is the deeper intuition behind the symmetric proposal distribution in the Metropolis-Hastings Algorithm?


Bivariate normal distribution , link $\Bbb E(Y\mid X=x)$ and $\Bbb E(X\mid Y=y)$

Effect of switching response and explanatory variable in simple linear regression


What follows if we fail to reject the null hypothesis?

If we fail to reject the null hypothesis in a large study, isn't it evidence for the null?


Finding the MLE of the Pareto distribution and distributions

Distribution of $\sum_{j=1}^n\ln\left(\frac{X_{(j)}}{X_{(1)}}\right)$ when $X_i$'s are i.i.d Pareto variables


What does "more extreme" mean when talking about p-values?


How is Hyndman's explanation of proper Time Series Cross Validation different from Leave-One-Out?


What is the meaning of p values and t values in statistical tests?


Bonferroni Correction When Using Dates as Data Points

Paired Samples T-Test by Day or By Group?


The relation between copula and survival copula


Which statistical test to use for Likert scale questionaire


Estimating the number of bottles in a set


Why do we not write the residuals in a logistic regression equation?


Transformed data due to non-normal residuals - how to see if it actually improved the model?


Do I need to refit the whole training set after cross-validation?

Training on the full dataset after cross-validation?


Closed-form likelihood. Why to use Bayesian parameter estimation instead of maximum likelihood?

Why would someone use a Bayesian approach with a 'noninformative' improper prior instead of the classical approach?


Monte carlo upsamling for imbalanced data to balance the class before Machine learning algorithm

Is up- or down-sampling imbalanced data actually that effective? Why?


What is the probability of n people from a list of m people being in a random selection of x people from a list of y people?


Probability of dummy variable of randomly chosen observation is equal to 1 in R

Confidence interval for Bernoulli sampling


Mixed effects models, why isn't the stdev of the intercepts equal to the estimate for the stdev for the random effects?

Understanding the variance of random effects in lmer() models


How to know that your machine learning problem is hopeless?


Is there a central limit theorem for random variables with a bounded interval?

How can the central limit theorem hold for distributions which have limits on the random variable?


How to deal with categorical variables in a clustering problem?

How to use both binary and continuous variables together in clustering?


MLE for logistic regression, formal derivation

What makes the formula for fitting logistic regression models in Hastie et al "maximum likelihood"?


R, RandomForest, the meaning of nodesize parameter

What does "node size" refer to in the Random Forest?


Time Series: Confused about identification of (possibly?) an ARMA(p,q) model


Does zero-one loss correspond to any maximum likelihood procedure?

Under the 0-1 loss function, the Bayesian estimator is the mode of the posterior distribution


How to define a skewed distribution using mode and two inflection points?

How to define a skewed normal distribution using mode and two points?


How to define a skewed Gaussian distribution using mode and two points?


inequality involving mean, median and variance

Empirical relationship between mean, median and mode


R: Can I make a regression model (or something similar) with likert scale data?


Equivalent of R-squared in Generalized Linear Model Regression Results?

How to calculate goodness of fit in glm (R)


How do I analyze the correlation between Likert Scales?

What are good basic statistics to use for ordinal data?


How to fit a Beta-Binomial Distribution to a dataset


Calculate the derivative of the CDF with respect to the mean value

How to get the derivative of a normal distribution w.r.t its parameters?


Why maximum likelihood estimation is different in a logistic regression classifier?

What is happening here, when I use squared loss in logistic regression setting?


What is meant by Principal Component Analysis. including in the explanation the terms given below

Making sense of principal component analysis, eigenvectors & eigenvalues


How can I explain the intuition behind ANOVA?


How to choose the K-fold for a small data set


density() function not working as expected

Can a probability distribution value exceeding 1 be OK?


How does the Adam method of stochastic gradient descent work?


Determining minimum probability for a standardised variable using the Chebyshev inequality

How to compute Chebyshev bounds on probabilities: one- or two-sided inequality?


Is it a good idea to train a Neural Network on continiously randomly generated training data?

Does it makes sense to perturb images on-the-run while training CNNs?


What is the difference between "likelihood" and "probability"?


Making a simple Keras classification with a low sample size

What should I do when my neural network doesn't learn?


Why do we assume Gaussian margins in Gaussian mixture models

Does assumption of normality of each mixture components implies that each margins is normal


Will the small proportion ruin the ability of chi-square test?

What to do when I have expected count <5 warning for a chi squared test?


Where to start with statistics for an experienced developer


Fitting a distribution to data given only the tails? Fitting normal distribution from only the 90th-99th percentile of data

Finding gaussian distribution given 15th and 50th percentile.


Finding good estimators for a function of bernoulli parameter

Finding UMVUE for a function of a Bernoulli parameter


Formulation for multiple regression, but with the bias term taken out and treated separately

When is it ok to remove the intercept in a linear regression model?


Is normality testing 'essentially useless'?


Why is sample variance squared? (Basic Question)

Why square the difference instead of taking the absolute value in standard deviation?


Equivalence of sufficient statistics definitions

Why a sufficient statistic contains all the information needed to compute any estimate of the parameter?


In a logistic regression model focused on prediction, what are the problems associated with a big difference in the sample sizes of a binary variable?

When is unbalanced data really a problem in Machine Learning?


Why is it possible to get insignificant F statistic (p>0.1) but significant regressor t-tests (p<0.1)?

Significance contradiction in linear regression: significant t-test for a coefficient vs non-significant overall F-statistic


What is $\lambda_{min}$ that makes all regression coefficients zero in LASSO regression

LASSO: Deriving the smallest lambda at which all coefficient are zero


Integral of the inverse of a CDF is the mean of the PDF?

Expected value as a function of quantiles?


How is MCMC relevant for Bayesian inference?

Why is it necessary to sample from the posterior distribution if we already KNOW the posterior distribution?


Understanding covariance matrix used in gaussian mixture model

Different covariance types for Gaussian Mixture Models


Normalization and Standardization of variables before clustering

Are mean normalization and feature scaling needed for k-means clustering?


Why not to initialize a neural network's weights to zero?

Danger of setting all initial weights to zero in Backpropagation


Intra-individual covariance matrix in lme4


GLM for proportion data in r - with many zeros (or ones)

How to deal with perfect separation in logistic regression?


How to run linear regression with constraints in R?

Constrained Regression in R: coefficients positive, sum to 1 and non-zero intercept


Proof/Derivation of Residual Sum of Squares (Based on Introduction to Statistical Learning)


What is the name for bins derived from Quantiles?

"-iles" terminology for the top half a percent


help with formula for prediciting electrical consumption

How to represent kWh usage by year against average temperature?


What is the validation data for the neural network?

What is the difference between test set and validation set?


How to show that the mean is (weakly) consistent

How to show that an estimator is consistent?


Can anyone help me with step by step procedure in MATLAB for missing data imputation using Singular Value Decomposition (SVD

How to perform SVD to impute missing values, a concrete example


Determine expected value for continuous random variable


Learning algorithm vs Model in Machine Learning


Logistic regression for classification: are there any analytical solutions for the out-of-sample accuracy?

Validation: Data splitting into training vs. test datasets


Books for self-studying time series analysis?


ezANOVA produces "missing cells" error when no cellls are missing

Error in `ezANOVA` with balanced dataset with no missing data


Could you derive the mean and variance in this theorem?


Why do we use squared deviations to compute the SD, given that it amplifies the effect of outliers?

Why square the difference instead of taking the absolute value in standard deviation?


Help with normalising data that has A LOT of 0s

How to log transform data with a large number of zeros


How to relate beta CDF to student-t CDF?

How to approximate the student-t CDF at a point without the hypergeometric function?


If I have less than 5 elements in a cell is there a way to use Chi Squared?

What to do when I have expected count <5 warning for a chi squared test?


Can the variables for a regression be replaced?

Effect of switching response and explanatory variable in simple linear regression


How to calculate median and mode from continuous data?

How to find the mode of a probability density function?


Sum of N random variables from the same distributions

Why is the sum of two random variables a convolution?


testing normality for a two way anova, residuals as well as each sample?

Is normality testing 'essentially useless'?


change a categorical variable to a numeric variable in Stata


Definition of symmetric probability mass function

What is the definition of a symmetric distribution?


What does this mean? Can you explain it to me in laymans term?

How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


How do you tell if you should use a one-tailed test or a two-tailed test in a t-test?


What is equivalent of pairwise t-test for categorical variables?

McNemar’s test or T-test for measuring statistical significance of matched-pre-post-test result


Probability of getting any matching pair of 2 cards when x cards are drawn from a deck

What is the probability of drawing a four of a kind when 20 cards are drawn from a deck of 52?


How to choose predictor variables for GLM / GLMM from rather large data set?

Algorithms for automatic model selection


How to assess correlation in non-ordinal (non-ranked) and non-normally distributed data?

How do the Goodman-Kruskal gamma and the Kendall tau or Spearman rho correlations compare?


The difference between with or without intercept model in logistic regression


Choosing the right linkage method for hierarchical clustering


Can you give a simple intuitive explanation of IRLS method to find the MLE of a GLM?


Convert Benjamini-Hochberg FDR Threshold to Adjusted Pvalues

What's the formula for the Benjamini-Hochberg adjusted p-value?


When should I apply feature scaling for my data

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


How to test if regression coefficient = 1

Test model coefficient (regression slope) against some value


Which kind of diagnostic plots for count data?


Covariance of two uncorrelated variables multiplied with the same random variable

Covariance of products of dependent random variables


Intuition about a coupon problem were we ask for the distribution of the unique coupons when the number of draws is fixed

How often do you have to roll a 6-sided die to obtain every number at least once?


Why volume preservation is important for Metropolis update?

For Hamiltonian Monte Carlo, why does negating the momentum variables result in a symmetric proposal?


If a study indicates no correlation between two variables, does it also indicate a lack of casual relationship?


R linear regression - how to handle when some factors significant while others aren't

Can I ignore coefficients for non-significant levels of factors in a linear model?


XGBoost Loss function Approximation With Taylor Expansion


Neural Network for input values optimization


Introduction to statistics for mathematicians


Adding very small probabilities - How to compute?


Testing correlation between a Boolean and integer variable

Correlations between continuous and categorical (nominal) variables


What should I do when my neural network doesn't learn?


How to test the mean difference of two Gamma distributions

Test if two gamma distributed populations are different


ReLU for small artificial neural networks?

Does ReLU layer work well for a shallow network?


How to interpret caret's variable importance and feature selection plots?

Measures of variable importance in random forests


What exactly is "stepwise model selection"?


Why do we need to dummy code categorical variables


Why is the estimated variance of a random effect not equal to the variance of its BLUP estimates?

Understanding the variance of random effects in lmer() models


Given the normal distribution X=N(1,2), what is E[X^3]?

calculating mean of a random variable raised to a power


Simulation of logistic regression power analysis - designed experiments


advice on a solution attempt: interrater reliability of time-point data

Testing two raters' time-point data for interrater reliability


Can bootstrap re-sampling be a re-sample of a smaller size

Can we use bootstrap samples that are smaller than original sample?


Evaluation measures of goodness or validity of clustering (without having truth labels)

How to select a clustering method? How to validate a cluster solution (to warrant the method choice)?


What is the most intuitive proof that Gaussian kernel is positive definite?

How to prove that the radial basis function is a kernel?


How to understand "factor loadings" in PCA?

Making sense of principal component analysis, eigenvectors & eigenvalues


Method for proving no difference in a set of paired samples

How to test hypothesis of no group differences?


Interpretation of interaction and main effect in a mixed model when one is significant and the other is not

How to interpret the significant interaction of two non-significant main predictors?


PCA when # of features larger than # of samples?

Is PCA still done via the eigendecomposition of the covariance matrix when dimensionality is larger than the number of observations?


Introduction to frequentist statistics for Bayesians


are there different meanings of the word "sample"?

How to Understand the Relationships Among Random Variables, Samples, and Populations?


How to explain differences in formulas of ridge regression, lasso, and elastic net


PCA, need help visually estimate the directions


Understanding MCMC and the Metropolis-Hastings algorithm


Can a model for non-negative data with clumping at zeros (Tweedie GLM, zero-inflated GLM, etc.) predict exact zeros?


How to use the hazard function in survival analysis? And how to make prediction in survival analysis?

Understanding Hazard Function Values Exceeding 1


Expected value of the following expression

Finding MLE for $\frac{\theta}{1-\theta}$


Why there are two different logistic loss formulation / notations?


The relationship between UMVUE and complete sufficient statistic

Find best unbiased estimator for $\theta$ when $X_i\sim U(-\theta,\theta)$


$R^2$ for mixed models with multiple fixed and random effects


Fixed-effects or mixed-effects models to population based data

What is the difference between fixed effect, random effect and mixed effect models?


What should I do when my neural network doesn't learn?


Is there a Welch-like correction for the standard deviation of Mann-Whitney U or Wilcoxon W?

Mann Whitney test with unequal variances


Binary Logit Regression: Binary independent variable's coefficient sign reversal with addition of more Regressors.s

Coefficient changes sign when adding a variable in logistic regression


Viterbi training vs Baum-Welch algorithm

What are the differences between the Baum-Welch algorithm and Viterbi training?


What is the difference between Deep Neural Network(DNN) and Artificial Neural Network (ANN)?

What is the difference between a neural network and a deep neural network, and why do the deep ones work better?


Proof of the distribution of the residual standard error

Why is RSS distributed chi square times n-p?


The difference between the Frequentist, Bayesian and Fisherian appraoches to statistical inference

Bayesian vs frequentist Interpretations of Probability


Variance of expectation conditional on marginal distribution


SVM: intuition behind maximizing the margin

How does a Support Vector Machine (SVM) work?


Adding Interaction Terms to Multiple Linear Regression, how to standardize?


Intuitive examples of importance sampling


Order of hyperparameter optimisation and feature selection in a nested CV structure

How should Feature Selection and Hyperparameter optimization be ordered in the machine learning pipeline?


What does "probability distribution" mean?

Are the terms probability density function and probability distribution (or just "distribution") interchangeable?


Why a smaller covariance matrix is valid when calculating Eigenfaces?

Is PCA still done via the eigendecomposition of the covariance matrix when dimensionality is larger than the number of observations?


How normal should variables be to run PCA?

Applying PCA to data that fail a normality test


How do Variational Auto Encoders backprop past the sampling step

How does the reparameterization trick for VAEs work and why is it important?


Is cross-validation enough to prevent overfitting?

How does cross-validation overcome the overfitting problem?


Textbooks on linear regression with least squares


Book to understand time series, then use it for forecasting

Books for self-studying time series analysis?


Relation Between Partial Correlation and Beta Coefficient in Multiple Regression

Multiple regression or partial correlation coefficient? And relations between the two


Why is the P value from a binomial test sometimes not consistent with the confidence interval of the proportion?

Disagreement between the p-value and the confidence interval in a binomial test


Finding predictors of upper level of a variable


Interpreting hypothesis testing result (assuming that the null hypothesis is true)

What follows if we fail to reject the null hypothesis?


How to work with inside(V) and outside(U) vectors of wordtovec model?

Input vector representation vs output vector representation in word2vec


How are values in a two tailed t-table calculated?

Formula to generate Critical t-values for t-test (instead of using a look-up array)


How to decide on the correct number of clusters?


Where does the 12 come from in the denominator of the variance formula in the Wilcoxon (Mann-Whitney U) test?

Where does the number 12 come from and why is it the same 12 in Wilcoxon and Kruskal Wallis?


Back-transformation of regression coefficients


How to interpret coefficients of $x$ and $x^2$ in same regression


Which criterion should be used for transformations of dependent variables?


Exact formula for coefficients of linear discriminants in R

Difference in scaling of Linear Discriminant Analysis coefficients between manual calculation and R


What are the possible tests for gauging the correlation between two categorical variables?

How to measure correlation between categorical variable?


What does it mean for "A is confounded with B"


IID in real life /Machine Learning - When is data truly IID?

Realistically, does the i.i.d. assumption hold for the vast majority of supervised learning tasks?


How likely is a hyperparameter search on a subset dataset going to be accurate on the full dataset?

Is hyperparameter tuning on sample of dataset a bad idea?


In a linear regression, can I both normalize the dependent variable by X and include X as an explanatory variable?

Ratios in Regression, aka Questions on Kronmal


Keras - Predictive ANN model converging on a single value. Overfitting?

What should I do when my neural network doesn't learn?


Unsure about the distribution of the canonical statistic


Adaptive Moment Estimate - What is meant by parameters of Adam optimizer are biased towards zero initially?

Why is it important to include a bias correction term for the Adam optimizer for Deep Learning?


Why does the log transformation bring data closer to normal distribution?

Does a log transform always bring a distribution closer to normal?


What does the term saturating nonlinearities mean?


How to test if the difference between the means of two groups is more than a given value?

Can a paired (or two group) t-test test if the difference between two means is less than a specific value?


Sampling without replacement - Normal sampling distribution


Force a polynomial fit to pass through zero intercept

Perform linear regression, but force solution to go through some particular data points


Is forward selection using AIC as selection critiria valid?

Algorithms for automatic model selection


variance of theoretical mean of y at given value of x in regression


Squaring floats between -1 and 1 reduces sum of squares, so why do it?

Why square the difference instead of taking the absolute value in standard deviation?


Find an expectation of normal random variable

How to calculate the expected value of a standard normal distribution?


Which property of stationarity is violated by a time series with regular cycles?

Can stationary time series contain regulary cycles and periods with different fluctuations


Is it "safe" to ignore perfect random effect correlations in glmer?

What to do with random effects correlation that equals 1 or -1?


multiple regression model - interpreting graphs for the fit


Issues with tree based learners for Boosting Machines or RFs

Random forest regression not predicting higher than training data


Does collinearity of one-hot encoded features matter for SVM and LogReg?

Dropping one of the columns when using one-hot encoding


Will very uneven sample sizes within a factor variable cause problems when running a binomial glm?

Consequences of unbalanced subgroups of categorical variables in logistic regression?


Likelihood formulation in linear regression with right censored data

ML estimate of exponential distribution (with censored data)


Fisher Information as measurement of curvature and hence information

What kind of information is Fisher information?


Similarities and differences between correlation and regression

What's the difference between correlation and simple linear regression?


Real-life example in which Markov chain Monte Carlo is desirable?

Why is it necessary to sample from the posterior distribution if we already KNOW the posterior distribution?


hard voting versus soft voting in ensemble based methods

hard voting, soft voting in ensemble based methods


Should PCA be fit on test set or only on training set


Correlation Coefficient and Regression Line

How does the correlation coefficient differ from regression slope?


Confidence Interval for predicted value in a simple regression model


Varying lengths of eigenvectors on a PCA biplot

What is the proper association measure of a variable with a PCA component (on a biplot / loading plot)?


Why MSE of this MATLAB neural network is so high?

What should I do when my neural network doesn't learn?


How to calculate standard error of prediction

Can we calculate the standard error of prediction just based on simple linear regression output?


What is the difference between using the multiplication rule or using Venn diagram subtraction for probability?


Testing to see if a population is normal?


Practically speaking, how do people handle ANOVA when the data doesn't quite meet assumptions?


Can the null hypothesis be **more** true than the alternative hypothesis or vice versa?

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


Clustering time-shifted sales time-series


Cross-validation: Which classifier to use in the end?

How to choose a predictive model after k-fold cross-validation?


Aside from the exponential family, where else can conjugate priors come from?


Parametric vs non-parametric machine learning methods

What exactly is the difference between a parametric and non-parametric model?


Proving the given quadratic form is chi-squared $k$

Distribution of a quadratic form, non-central chi-squared distribution


Looking for good references on Neural Networks (math for learning algorithms)

What are the best books to study Neural Networks from a purely mathematical perspective?


References to learn how to efficiently use neural networks for time series prediction (textbooks, online courses, etc.)

Getting started with neural networks for forecasting


How to Interpret coefficients of a beta regression model with logit link

How to interpret the coefficients from a beta regression?


Why do I get the same output with Poisson GLM vs quasi-Poisson GLM?

Identical coefficients estimated in Poisson vs Quasi-Poisson model


Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


The question of Taylor expansion of loss function in XGBoost


Var(XY), if X and Y are independent random variables

Variance of product of multiple independent random variables


Middle entries of a random vector - Conditional expectation and covariance matrix of normal distribution P(X2|X1, X3)

Find conditional expectation from a 3-dimensional random vector?


Why do we use "Sum of Squared Errors" as loss function in linear regression?

What is a loss function in decision theory?


How to reverse PCA and reconstruct original variables from several principal components?


At what scale to plot variables in different units?

Scaling data that are on different orders of magnitude for plotting


Combined Variance of two groups with different sample sizes


What's the difference between correlation and simple linear regression?


How to properly solve for the inverse problem of OLS?

I have a line of best fit. I need data points that will not change my line of best fit


Why is there a need to find a variance and take the square root to get a standard deviation?

Why square the difference instead of taking the absolute value in standard deviation?


Alternatives to one-way ANOVA for heteroskedastic data


Regression $y = \beta_1x_1 + \beta_2x_2$ with constraints $\beta_1 + \beta_2 = 1, \beta_1, \beta_2 > 0$

How do I fit a constrained regression in R so that coefficients total = 1?


Is it a good practice to always scale/normalize data for machine learning?

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


Probability rule involving conditional and marginal distributions


How do I know if my Ordered Logistic Regression is a good model?

Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


When building a model with all categorical features, when do we use dummy variables and when do we use label encoding?

Principled way of collapsing categorical variables with many levels?


How to overcome Coefficients: (4 not defined because of singularities)

Qualitative variable coding in regression leads to "singularities"


Why a lot of people use random.seed() at the beginning of their python code

Am I creating bias by using the same random seed over and over?


KL divergence between two univariate Gaussians


How to make sure if the residuals are normally distributed?

Regression - How do I know if my residuals are normally distributed?


Combining categorical and continuous features for neural networks


How to deal with a mix of binary and continuous inputs in neural networks?

How to recode categorical variable into numerical variable when using SVM or Neural Network


Multiplicity Correction for Coefficient Estimates in Linear Regression

multiple regression and multiple comparisons


Can binary cross entropy loss be used for non-binary data?

Why binary crossentropy can be used as the loss function in autoencoders?


What is a complete list of the usual assumptions for linear regression?


Regression with highly negative correlated variable

How to deal with high correlation among predictors in multiple regression?


Is the MSE of a vector a scalar or a matrix?

What's the MSE of $\hat{Y}$ in ordinary least squares using bias-variance decomposition?


probability density of a random vector greater than some value?

Multi-dimensional CDF on a discrete support


Experimental design for optimizing a machine producing candles


Why do PCA and PCoA give the same components but different explained variances?

What's the difference between principal component analysis and multidimensional scaling?


I understand over-fitting in RandomForest algorithm is taken care by bootstrapping & bagging but what happens if we prune the trees and apply bagging?

Why is pruning not needed for random forest trees?


If sample standard deviation is biased, why do we use it in typical mean tests?

Why does this excerpt say that unbiased estimation of standard deviation usually isn't relevant?


Keras model fit: validation_data vs validation_split

How to correctly use validation and test sets for Neural Network training?


Including the interaction but not the main effects in a model


What should I do when my neural network doesn't learn?


Why is the display of summary statistics changed after normalizing data?

What does the notation like 8.6e-28 mean? What is the 'e' for?


Asymptotic distribution of sample variance of non-normal sample


why is standard deviation a biased estimator

Why is sample standard deviation a biased estimator of $\sigma$?


Why is the probability of having a *rare* disease super low even if the test is very accurate?

Calculating whether a disease is probable using Bayes rule?


calculate a variance for a given R-squared

I have a line of best fit. I need data points that will not change my line of best fit


Using lasso for feature selection, followed by a non-regularized regression


Multiple class prediction with unbalanced data

When is unbalanced data really a problem in Machine Learning?


Regression regularization penalty center at w0 instead of 0

How to implement L2 regularization towards an arbitrary point in space?


How to find out if a model is overfitted?

How to judge if a supervised machine learning model is overfitting or not?


Is it possible to detect outliers in two related columns

What is the best way to identify outliers in multivariate data?


Why my machine learning's prediction appears to be random guesses?

How to know that your machine learning problem is hopeless?


k-fold crossvalidation: how does MSE go with k?

Bias and variance in leave-one-out vs K-fold cross validation


What if both null hypothesis and alternative hypothesis are wrong?

Do null and alternative hypotheses have to be exhaustive or not?


Can z-score transformation ever be undesirable?

Is it a good practice to always scale/normalize data for machine learning?


Why maximum likelihood estimation is same with minimizing cross-entropy?

the relationship between maximizing the likelihood and minimizing the cross-entropy


Question about pca proof in deeplearning by ian goodfellow

What is an intuitive explanation for how PCA turns from a geometric problem (with distances) to a linear algebra problem (with eigenvectors)?


Build a (normal?) distribution from $n$, quartiles and mean?

Estimating a normal distribution from three order statistics


What is the stastical perspective of regression?

What is the difference between variable and random variable?


What logistic function 's mean have to do with vanishing gradient?


How does the expected value relate to mean, median, etc. in a non-normal distribution?


What range of values to initialize neuron weight matrix with for a CNN?

How to initialize the elements of the filter matrix?


I like to generate correlated variables with a existing variable in R

Generate a random variable with a defined correlation to an existing variable(s)


How to measure the Success of Logistic Regression


How to show that the variance estimator of a gaussian is biased?

Bias in estimators of population variance


Why is my validation loss always larger than my epoch loss

What should I do when my neural network doesn't generalize well?


Variance of an AR and ARMA process derived from lag notation


Probability of independent events given the history

Confused about independent probabilities. If a fair coin is flipped 5 times, P(HHHHH) = 0.03125, but P(H | HHHH) = 0.5


Confidence interval for simple sample, uniform distribution


What's the formula for the Benjamini-Hochberg adjusted p-value?


What is the motivation for the formula for the Gamma distribution?


Interpretation of regression coefficients after power transform (possibily with polynomial transform and PCA)

How to interpret regression coefficients when response was transformed by the 4th root?


Using a beta-binomial model to estimate the average for a uniform prior

Help me understand how to apply a beta-binomial model in order to estimate a parameter when there are several Bernoulli trials?


How do outliers affect the k-means algorithm?

How to understand the drawbacks of K-means


Using stepAIC to help select final model

Algorithms for automatic model selection


Proof that the sample mean is normally distributed

Linear Combination of Random Normal Variables


How to estimate an ellipse's parameters from the points scattered around it?


How can Welch's t-test be expressed in lme4

Equivalent to Welch's t-test in GLS framework


Is the likelihood term in Baye's rule a conditional probability?

Wikipedia entry on likelihood seems ambiguous


Best introduction to longitudinal data analysis

Request for reference for longitudinal data analysis which is mathematically well-written


Different sample covariance formulae (conventions)

Intuitive explanation for dividing by $n-1$ when calculating standard deviation?


What are the different types of codings available for categorical variables (in R) and when would you use them?


How do I adjust for covariates using Kruskal Wallis in SPSS?

What is the non-parametric equivalent of a two-way ANOVA that can include interactions?


Odds ratio MLE calculation: unconditional vs conditional?

Why do odds ratios from formula and R's fisher.test differ? Which one should one choose?


Calculating area under normal curve to the right of an extremely high z-score

Evaluate definite interval of normal distribution


Whats the motivation to demean variables when estimating an interaction effect?


How to normalize my data between -1 and 1?


Is curse of dimensionality more harmful for distance based models?

Why is Euclidean distance not a good metric in high dimensions?


How many trials of n samples where each value was sampled at least once

How many stickers do I need to complete my FIFA Panini album?


What should the relationship between significance and correlation be?

How do you interpret a significant but weak correlation?


What's the usage difference between G test and Chi-square test?


Why can you not find the probability of a specific value for the normal distribution?

$P[X=x]=0$ when $X$ is continuous variable


Intuition Behind the Elastic Net Penalty


Transforming the independent variable for better prediction results with decision tree and random forest

When to Log/Exp your Variables when using Random Forest Models?


Feeding Word Embeddings into Recurrent Neural Networks


ANOVA vs regression output: what is the difference in interpretation of main effects and interaction terms

How does the interpretation of main effects in a Two-Way ANOVA change depending on whether the interaction effect is significant?


Power Analysis for Logistic Regression with one nominal variable

Multiple logistic regression power analysis


What effect does 1x1 convolution has on quality of feature being learnt?

What does 1x1 convolution mean in a neural network?


Test statistics in IR (t-test vs Wilcoxon vs signed test)

How to choose between t-test or non-parametric test e.g. Wilcoxon in small samples


References on tensor algebra for machine learning?

Why the sudden fascination with tensors?


Sum and Multiplication of Two Normal Distributions


Why can a set of random variables be called a sample?

Question about definition of random sample


Reconciling the differences in tail probability between t-test and normal distribution

The standard normal distribution vs the t-distribution


Does centering really help interpret the intercept?

When conducting multiple regression, when should you center your predictor variables & when should you standardize them?


What is most important in building a regression model?

In what order should you do linear regression diagnostics?


Central limit theorem for sample medians


What is the equaton for ARIMAX(1,1,1) and how can I undifference the 1st differenced data to fit the equation?

Formula for an ARIMA(1,1,1) solving for y


Standard deviation of binned observations


What is the drawback of using a non-parametric test when parametric alternative could have been used?

Why would parametric statistics ever be preferred over nonparametric?


Why we always get different accuracy for a different number of training our model?

ANN produces different result every time it's run


Regressing the "fixed effect" on time invariant characteristics. Is it possible?

panel data - within-group estimate - individual fixed effects retrieved


Confidence Level and Interval probability

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Is the zero truncated Poisson Distribution part of the Exponential Family?


Why does my cross_val_score give different values when I run it again?

Different seed gives different LASSO output


What is a symmetric distribution symmetric about if it has zero skewness?

What is the definition of a symmetric distribution?


What is the meaning of an autoregressive parameter greater than one?

Explosive AR(MA) processes are stationary?


Distribution of the product of $n$ i.i.d log-normal random variables

The product of two lognormal random variables


How to compare predicted accuracy and actual accuracy?

How can I determine accuracy of past probability calculations?


What is the benefit of Linear mixed effects models over GEE models?

When to use generalized estimating equations vs. mixed effects models?


Sum of two kernel is also a kernel, how can we prove that?

Proof of sum of kernels of concatenated vector


Is an AR(p) process with roots inside the unit circle non-stationary?


Terminology: "L1 regularization" even if I'm using mean instead of sum?

Error Measures, why is the sum halved? why not use the absolute value?


Why Cauchy distribution has no Moment-generating Function?

Existence of the moment generating function and variance


Will the change of mean/variance of data impact the svm classifier?

Why scaling is important for the linear SVM classification?


Is it statistically valid to enter predictors that are not significantly related to DV in a linear mixed effects model?

Should control variables be included in model if statistically insignificant?


Metropolis-Adjusted Langevin Monte Carlo on a Bounded Domain


Converting continuous predictor to category e.g. Age

What is the benefit of breaking up a continuous predictor variable?


Calculate posterior from normal prior and some observations


Poisson or Gamma distribution for density or encounter rate data?

Should I use an offset for my Poisson GLM?


Difference between Pearson residuals and Deviance

What do the residuals in a logistic regression mean?


Why is dimensionality reduction always done before clustering?

When do we combine dimensionality reduction with clustering?


interpreting coefficients with binary dependent and independent variables


Basic Linear Regression in R: Dependent and Independent Variables

What is the difference between linear regression on y with x and x with y?


Difference between deep neural network and convolutional neural network

What is the difference between convolutional neural networks and deep learning?


Power transformation using Box-Cox transformation


How do you interpret an arithmetic mean without knowing the underlying distribution?

Should the mean be used when data are skewed?


Computing probability of sum of I.I.D uniform random variables

Consider the sum of $n$ uniform distributions on $[0,1]$, or $Z_n$. Why does the cusp in the PDF of $Z_n$ disappear for $n \geq 3$?


How to compute the correlation between a qualitative and a quantitative variable?

Correlations with unordered categorical variables


Approximation error of confidence interval for the mean when $n \geq 30$

What references should be cited to support using 30 as a large enough sample size?


What is actually being maximized in the fitting of a logistic regression?

Maximize log-likelihood of logistic regression


How do I interpret a simple linear regression model when both dependent and independent variables are square root transformed?

How to interpret regression coefficients when outcome variable was transformed to $1 / \sqrt{Y}$?


Unbiased estimator of variance of binomial variable


Machine Learning: What are the types of data set?

What characterizes a function that is easy to learn?


Why eigen vector of a covariance matrix is the largest principle components?

Making sense of principal component analysis, eigenvectors & eigenvalues


Calculating a weighted mean and weighted SD from multiple mean/SD/different sample sizes?


Given $p=0.05$ in one study, what is the likelihood of $p \ge 0.05$ in a repeated study?

Cumming (2008) claims that distribution of p-values obtained in replications depends only on the original p-value. How can it be true?


Explain Cohen's kappa in a simplest way?


On effect of mastitis on milk yield, regression coefficient of mastitis found is 1.1, how do we interpret this regression coefficient


The Number of Exponential Summands in a Fixed Interval is Poisson


Why penalized logistic regression doesn't provide Z value like in glm?

Testing for coefficients significance in Lasso logistic regression


Can I do a factorial ANOVA on non-normal data?

Normality of dependent variable = normality of residuals?


Test if the probability of two events occurring are equal

Given the power of computers these days, is there ever a reason to do a chi-squared test rather than Fisher's exact test?


Why k-means algorithm tends to fail on elongated dataset?

How to understand the drawbacks of K-means


Kernel ridge regression with matrix-vector data set $S := \{ X_i, y_i \}_{i=1}^{N}$?


Converting Continuous variable to Categorical

When should we discretize/bin continuous independent variables/features and when should not?


Mixed models in ecology: when to use a random effect

What is the difference between fixed effect, random effect and mixed effect models?


Number of bootstrap samples to construct confidence interval in mixed models

Rule of thumb for number of bootstrap samples


Difference between tensor product and main effects plus interaction in mgcv

R/mgcv: Why do te() and ti() tensor products produce different surfaces?


Anova() / anova() on a single lme not consistent results - Can you ignore ANOVA?

R Tukey HSD Anova: Anova significant, Tukey not?


MLE of a parameter that lies in a certain range


Aren't these statements about confidence intervals equivalent?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


How to show that $\mathrm{mgf}$ $M(s)$ and $\mathrm{pgf}$ $P(s)$ are related?

What is the difference between moment generating function and probability generating function?


How to identify which variables are collinear in a singular regression matrix?

Testing for linear dependence among the columns of a matrix


Should I use confidence or prediction interval to calculate cost uncertainty (Simple Linear Regression)?

Difference between confidence intervals and prediction intervals


Proportion hazards assumption violated for Cox regression, is AFT an acceptable alternative?

Recommendations for Non-Proportional Hazards


What should I do when my neural network doesn't learn?


Can ANOVA be significant when none of the pairwise t-tests is?


looking at the evidence against the null hypothesis in a slightly different way

Why do statisticians say a non-significant result means "you can't reject the null" as opposed to accepting the null hypothesis?


How to check the correlation between categorical and numeric independent variable in R?

Correlation between a nominal (IV) and a continuous (DV) variable


correlation between a continuous and a binary variable

How do I study the "correlation" between a continuous variable and a categorical variable?


If $Y|X \sim N(0,1)$, does that mean $Y$ itself is also $N(0,1)$?

If $Y|X \sim \mathcal{N}(0,1)$ then is $Y^2|X \sim \chi^2(1)$?


Pre and Post intervention with no pairing

Analysing pre-and-post intervention study with anonymous responses


Setting up a MLP for binary classification with tensorflow


Why imbalance in the data set is an issue in data mining and machine learning?

When is unbalanced data really a problem in Machine Learning?


Cross-Level-Interaction without varying slope in Multilevel

Can I probe cross-level interactions without random slope in a hierarchical linear model?


How do you deal with "nested" variables in a regression model?


AIC/BIC for model selection between GLM and LM?

Goodness of fit and which model to choose linear regression or Poisson


How to deal with very small probabilities in likelihood?

What to do when your likelihood function has a double product with small values near zero - log transform doesn't work?


Is there a way to use the covariance matrix to find coefficients for multiple regression?


Conditional Mean E[X|X>Y] when X,Y are Uniform

Finding $E(X\mid X>Y)$ when $X,Y$ are i.i.d $U(0,1)$


Rule of thumb for choosing NN parameters in a regression analysis

How to choose the number of hidden layers and nodes in a feedforward neural network?


Expected value and variance of trace function


Probability of X greater than Y with different types of random variable

probability of gamma greater than exponential


Why does the variance of the Random walk increase?


What is the expectation of $\left\langle (n \bar{y})^4 \right\rangle$, if $y_i \sim \mathcal{N}(\mu,\sigma^2)$?

How to calculate the expected value of a standard normal distribution?


Total sum of squares(TSS) is not equal ESS +RSS, when the model doesn't include intercept of ones


Why is my keras resnet50 model overfitting?

What should I do when my neural network doesn't generalize well?


How do I interpret all these parameters?


Is it possible to learn a neural network to predict always zero?

Is it possible to learn a neural networks for a constant target?


Is there something like a Root Mean Square Percentage Error (RMSPE)? Or: What is the name of this error?

Is there something like a Root Mean Square Relative Error (RMSRE)? Or: What is the name of this error?


Mauchly's test not giving significant value

Repeated measures ANOVA: Mauchly's test undefined


Relationship between strict stationarity and 2nd order stationarity

A Strict Sense Stationary (SSS) process implies it is a Wide Sense Stationary (WSS) process - proof


Finding a sufficient statistic for a rectangular distribution

Jointly Complete Sufficient Statistics: Uniform(a, b)


Estimation of variance of mean of Bernoulli distribution, if sample is degenerated

Using Rule of Three to obtain confidence interval for a binomial population


Why is $\frac{\sum^n_{i=1}(X_i-\bar{X})^2}{\sigma^2}$chi-square distributed with $n-1$ degrees of freedom?

Intuitive explanation for dividing by $n-1$ when calculating standard deviation?


In a CNN is not it better to apply the activation function after the pooling layer rather than after the convolutional layer?

Can we do activations before convolution and maxpooling


Is the density of the unnormalised posterior distribution the same as the density for normalised posterior?

Why Normalizing Factor is Required in Bayes Theorem?


AIC and transformation of the independent variable


What book would you recommend for non-statistician scientists?


Correlation between a categorical and a numerical variable

Correlations with unordered categorical variables


What does this Statistic mean? And how to find a density of a statistic?


Testing for normality with small sample sizes in order to use t-test

Is there a minimum sample size required for the t-test to be valid?


Is there one universally agreed-upon definition of a quantile? If not what definitions exist?


What tests to use for zero-inflated count data that does not fit a poisson distribution? (N=2500)

count data that does not follow poisson distribution


T-distribution as Gamma(\nu/2;\nu/2) and Normal

Relationship between gamma and chi-squared distribution


The first principal component line minimizes the sum of the squared perpendicular distances between each point and the line

Making sense of principal component analysis, eigenvectors & eigenvalues


How use the ROC curve to choose correct threshold in logistic regression

How is the optimal probability cut-off in a ROC defined by the R package Epi?


PCA on predictor variables before supervised learning is appplied

How can top principal components retain the predictive power on a dependent variable (or even lead to better predictions)?


Various Methods to Calculate Linear Regression

Why use gradient descent for linear regression, when a closed-form math solution is available?


What algorithm can I use to forecast the time series?

Modelling auto-correlated binary time series


R : Calculate a P-value of a random distribution


Shapiro-Wilk and Kolmogrov-Smirnoff contradict each other


Shapiro-Wilk-Test with p < .05 but data looks normal


Possible to use draws from two distributions to get draw from distribution with density their product?


how can I convert a negative log likelihood to likelihood?

What is the difference between "likelihood" and "probability"?


Real life examples of AR and MA PROCESSES

Real-life examples of moving average processes


What is a healthy acceptance rate for Metropolis-Hastings algorithm?

Acceptance rates for Metropolis-Hastings with uniform candidate distribution


Derivation of $p(\omega|X,Y) = \frac{p(Y|X, \omega) p(\omega)}{p(Y|X)}$ in bayesian modelling

Formulas for probabilities in Bayes theorem


In Random Forest, cross-validation can be avoided using the out-of-bag sample?

Out of Bag Error makes CV unnecessary in Random Forests?


How do we combine probability distributions component-wise to make a more accurate probability distribution?

Combining probabilities/information from different sources


Follow up question to: Why does logistic regression generate well-calibrated models?

Why does logistic regression produce well-calibrated models?


Correlation between occupational status and knowledge

Correlation between a nominal (IV) and a continuous (DV) variable


Null hypothesis test for proportions without minimum requirements?

Exact two sample proportions binomial test in R (and some strange p-values)


Who is more complex computationally knn or SVM?


Small sample size with very skewed right response

How to know that your machine learning problem is hopeless?


Is it possible to get non-significant post hoc test in a significant ANOVA test while the unpair t-tests are significant?

Can ANOVA be significant when none of the pairwise t-tests is?


Why does linear regression use "vertical" distance to the best-fit-line, instead of actual distance?

Why does linear regression use a cost function based on the vertical distance between the hypothesis and the input data point?


Does Fisher Information quantify precision?

What kind of information is Fisher information?


Why is it okay to take the log (or any other transformation) of the dependent variable?

When (and why) should you take the log of a distribution (of numbers)?


What statistical distribution test to use for comparing Dataset and its subset?


Two variables are correlated but regression is not significant?

X and Y are not correlated, but X is significant predictor of Y in multiple regression. What does it mean?


Matrix inversion in the smoothing splines

Why is $B^TB+\lambda\Omega$ positive definite?


Maximum Likelyhood Estimator (MLE) vs. Bias

How bias arises in using maximum likelihood to determine the variance of a Gaussian?


Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


Why does removing the intercept in my categorical GLM result in the same model?

Removing intercept from GLM for multiple factorial predictors only works for first factor in model


Interpreting categorical x categorical interaction in a poisson regression


Should I remove non-significant variables from my regression model


Transform right skewed distribution to normal


What is the difference between Generalized Linear Models(GLM), Fixed-effect models (FE), and Random-effect models (RE)?

What is the difference between fixed effect, random effect and mixed effect models?


Linear mixed effect model - Single Trials vs Aggregation

How to correctly treat multiple data points per each subject


When is it ok to remove the intercept in a linear regression model?


What are appropriate methods for preparing categorical features for recurrent networks to ensure efficient backpropagation?

Can Convolution Neural Network be useful with encoded categorical features?


How to encode categorical variables for neural networks

How to recode categorical variable into numerical variable when using SVM or Neural Network


Why is glmnet ridge regression giving me a different answer than manual calculation?


Why reject Null Hypothesis when p value< alpha?

What is the meaning of p values and t values in statistical tests?


Forecasting algorithms for incomplete time series data


Distribution of maximum of normally distributed random variables

Approximate order statistics for normal random variables


What is the correct formula for Bayesian update for normal distribution with known variance


Why does my forest plot say a study's result is statistically significant when it's not?

Opinions on a statistical error in p values (re: standard deviations, t-test/Kruskal-Wallis) in a published study?


polynomial regression in R: how to add hard constraints (go through specified points)?

Perform linear regression, but force solution to go through some particular data points


Artificial Neural Network with continuous and binary variables

Neural Network: MLP for regression with 3 continuous features, 1 categorical


Why my residual-fitted plot looks like this?

Interpreting plot of residuals vs. fitted values from Poisson regression


Econometrics Problem. Proving Regressions have both R squared

R-squared: X "explains" the percentage of variation of the Y values. Does axis order matter?


What's the good way to find outliers in the continuous physical process measurements time-series? (picture attached)

What's the best way to find outliers in the time-series, encountering that it is a real-world mechanical process (process continuity)?


Possible to use a root data transformation below a square root (< 2) for data normalization

How is the Box-Cox transformation valid?


Is this a correct use of Bayesian statistics when choosing a box A-E?


The best way to plot high amount of discrete data with 2 variables in R

Graph for relationship between two ordinal variables


Interpreting t-values in a categorical regression model: R

What is the meaning of p values and t values in statistical tests?


ACF and PACF Plots for Predictive Modeling

How to interpret these acf and pacf plots


Coefficient of $Y$ on $X$ and Coefficient of $X$ on $Y$

What is the difference between linear regression on y with x and x with y?


How to measure the mass of a probability distribution?

Does Wasserstein distance require the source and target distributions to have the same mass?


Data normalization and standardization in neural networks


Pearson correlation for comparing models

Does the concordance correlation coefficient make linearity or monotone assumptions?


KL-Divergence to evaluate regression model performance

Does the cross-entropy cost make sense in the context of regression?


OLS regression problem in R, where intercept is function of the other parameters

Linear Regression with individual constraints in R


Maximum Likelihood Estimator : special case of uniform which exclude the upper limit

MLE of $f(x\vert\theta)=1/\theta$, $x_1 , \cdots , x_n \sim U(0,\theta) \;\;, \theta>0$,


Linear regression - Can I log transform dependent variable and one of the independent ones and keep the rest not transformed?


Unbiasedness of Bayesian Posterior Mean Under Bayesian and Frequentist Models

Is the mean (Bayesian) posterior estimate of $\theta$ a (Frequentist) unbiased estimator of $\theta$?


How do I statistically compare the readings from two different sensors?

What ways are there to show two analytical methods are equivalent?


Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


What is the reasoning behind standardization (dividing by standard deviation)?


When are biased estimators with lower MSE preferred?

When is a biased estimator preferable to unbiased one?


Recommended textbooks for student majoring in applied statistics

Do you have recommendations for books to self-teach Applied Statistics at the graduate level?


How to intuitively understand the shapes of confidence and prediction intervals in simple linear regression

Shape of confidence interval for predicted values in linear regression


When are is Bayes estimator the same as the maximum likelihood estimator?

What is the difference in Bayesian estimate and maximum likelihood estimate?


Reference books on uniform spherical distributions in multiple dimensions

Claims and questions regarding $n$-ball distribution?


What is Deviance? (specifically in CART/rpart)


How does ReLU deal with negative inputs?

How can a network with only ReLU nodes output negative values?


MLE estimator linear regression: Why inverse?


Measures of Uncertainty in Higher Order Moments

Range of values of skewness and kurtosis for normal distribution


What are the units of entropy of a normal distribution?


How to calculate variance or standard deviation for product of two normal distributions?

Variance of product of dependent variables


Is least squares the standard method to fit a 3 parameters Gaussian function to some x and y data?


Negative confidence intervals in linear regression

Why does a positively correlated variable have a negative coefficient in a multiple regression?


Given time series forecast and associated confidence interval, how to calculate the total return's confidence interval

Forecast total for a year given monthly time series


Understanding P-Value with respect to the Level of Significance

What is the meaning of p values and t values in statistical tests?


Why are the directions of eigenvectors in SVD and Eigen-Decomposition for PCA opposite?

I'm getting "jumpy" loadings in rollapply PCA in R. Can I fix it?


Why is homogeneity of variance so important?


What's the interpretation of the coefficient of a categorical variable?

Beta coefficient interpretion with categorical and continuous predictors in a linear regression


Condition Random Variable on Range of Another Random Variable


Variance of the distribution of difference scores


Acceptance-Rejection Method Acceptance Probability Proof


How to plot binary vs. categorical (nominal) data?

Graph for relationship between two ordinal variables


How to prove that the expected value minimizes mean square error

How can I prove mathematically that the mean of a distribution is the measure that minimizes the variance?


Why is it bad idea to initialize all weight to same value?

Why doesn't backpropagation work when you initialize the weights the same value?


Why using RMSE as loss function in logistic regression takes non convex form but doesn't in linear regression?

Logistic regression cost surface not convex


Cross Validation Vs Train Validation Test


Looking for a name for theory of a "balance of fair probability" (example provided)

What is the name of the statistical fallacy whereby outcomes of previous coin flips influence beliefs about subsequent coin flips?


Wiener process definition as Gaussian summation

Matlab Regenerating figures: Simulating Brownian Motion via Random Walks


Beginner : Interpreting Regression Model Summary


Force sum of random varables to equal to 1

Random process not so random after all (deterministic)


which regression to use when response variable is in percentage

Percentage as dependent variable in multiple linear regression


How do I get an asymmetrical confidence interval for population rate?

Different ways to produce a confidence interval for odds ratio from logistic regression


Gradient descent derivation in Eigenspace

Gradient descent of $f(w)=\frac12w^TAw-b^Tw$ viewed in the space of Eigenvectors of $A$


How to test if 2 binomial samples are equivalent?


Is it correct to do a one tailed test based on observed direction?

What is the problem with post-hoc testing?


Why is the dot product of x and e equal to zero with least squares regression?

How can the regression error term ever be correlated with the explanatory variables?


How to approximate the student-t CDF at a point without the hypergeometric function?


What is the difference between zero-inflated and hurdle models?


Logistic regression demonstration with one preditor

What is the difference between linear regression and logistic regression?


Have $(U,V)$ be a pair of Bivariate Gaussian variables with mean $0$, variance $1$ and $Cov(U,V) = p$ where 0 < ρ < 1

Distribution of sums and differences of n correlated normal random variables


Probability that all cards have been drawn

How many stickers do I need to complete my FIFA Panini album?


In R (nlme/lme4), how do I compare two linear models with different sample sizes and different groups?

Compare the statistical significance of the difference between two polynomial regressions in R


How does the nth sample impact Mean and Variance?

Online estimation of variance with limited memory


Logistic regression - how good is my model?

Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


What is the significance of the log base being 2 in entropy?

What is the role of the logarithm in Shannon's entropy?


How to write a seasonal SRIMA model (0,1,1)*(1,1,1) [12] mathematically?

How To Write Seasonal ARIMA model mathematically


Am I interpreting this scatter plot correctly? ggplot in R

Interpreting two linear regression outputs - one generic, one "faceted" (R, ggplot)


lm.ridge in R must have standarize inputs?

Question about standardizing in ridge regression


How to make a simmilarity matrix with relative abundance data?

What similarity index should I use with relative abundance data for a PERMANOVA?


Explaining to laypeople why bootstrapping works


Can we use multiple regression for a binary classification problem?


Interpretation of the confidence interval

What, precisely, is a confidence interval?


Assessing potential multicollinearity for various model types meant for causal inference

In plain language, why is there no VIF for binary outcome regression models?


Sampling from a multivariate Gaussian mixture model

Generating random variables from a mixture of Normal distributions


Exponential Family distribution with non-open natural parameter space?

Can the parameter space of a single parameter exponential family in canonical form be a closed interval?


How to model and generate forecasts for time series with missing observations?

Is there any gold standard for modeling irregularly spaced time series?


Testing for linear dependence among the columns of a matrix


Correlation between two constant variables using the different approaches

What is the correlation if the standard deviation of one variable is 0?


Can someone explain Importance Sampling to me?

Intuitive examples of importance sampling


Exploring long-term associations in STATA

Choosing the appropriate statistical test


Auto.arima application in R with sub-daily data - No seasonality given

Auto.arima with daily data: how to capture seasonality/periodicity?


Generalization of ARMA to fit many brief series instead of one long series

Estimating same model over multiple time series


What mean should I use when few big values?

Why is median age a better statistic than mean age?


What do r (Pearson correlation coefficient) and R^2 stand for?

Relationship between $R^2$ and correlation coefficient


What is the meaning of p values and t values in statistical tests?


Read auto_arima summary from pmdarima package correctly

How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


Simple point processes and the expected value

Rewriting the probability density function as a probability function


A job interview question on flipping a coin


Does logistic regression take into account prior probabilities of classes?

Why P>0.5 cutoff is not "optimal" for logistic regression?


Pros and cons of logistic regression with binary dependent and binary independent variables

Logistic regression with binary dependent and independent variables


What is the benefit of breaking up a continuous predictor variable?


In a Poisson model, what is the difference between using time as a covariate or an offset?


Why does leave one out cross validation have less bias compared to k fold cross validation but higher variance?

Why does k-fold cross validation generate an MSE estimator that has higher bias, but lower variance then leave-one-out cross-validation?


R fit a logistic regression of the form $y=\frac{c}{1+ae^{-bx}}$

How to fit a piecewise assembly of nonlinear functions?


How should tiny $p$-values be reported? (and why does R put a minimum on 2.22e-16?)


How can I obtain hourly readings from 24 hour moving average data?

Extract data points from moving average?


Understanding the decomposed matrices in Singular Value Decomposition


correlation coefficient bivariate normally distributed

Bound for the correlation of three random variables


Do non-invertible MA models imply that the effect of past observations increases with the distance?

Why do we care if an MA process is invertible?


Simple homework question about normally distributed variables


How to simplify the understanding behind Hypothesis Testing?

What is the meaning of p values and t values in statistical tests?


Optimization when Cost Function Slow to Evaluate


Variables non-significant in univariate analysis but significant in multivariate analysis?

How can adding a 2nd IV make the 1st IV significant?


When my training loss goes down, my evaluation loss goes up. What is this a symptom of?

What should I do when my neural network doesn't generalize well?


The correlation coefficient captures only strength linear dependence, due to the normalised covariance, what does that mean?

Difference between correlation and covariance: is covariance only useful if the relation is linear?


Conditional probability formula for continuous random variables

Formula for expected value of continuous random variable without using density


Test statistic for follow up procedure (stepwise step down) of Kruskal Wallis


Does the order of columns matter in PCA for the results? Jumpy factor loadings?

I'm getting "jumpy" loadings in rollapply PCA in R. Can I fix it?


How do I fix the problem of collinearity, i think i am in the dummy variable trap

How to deal with high correlation among predictors in multiple regression?


Distribution of hat sigma in simple linear regression model

Prove that $\frac{(n-2)s^2}{\sigma^2}\sim \chi^{2}_{n-2}$


Can someone explain why would glm() and multinom() in R give different results?

Using multinom() and glm() functions in R to determine at what extent multiple factorial variables influence the outcome. Get different results


Why shouldn't the denominator of the covariance estimator be n-2 rather than n-1?


Interpreting a binomial regression model in R with cloglog link function

Interpretation of R's output for binomial regression


Interpreting a binomial regression model in R


Batch learning in digits recognition (MNIST database)

What should I do when my neural network doesn't learn?


Non parametric test to compare variances

Nonparametric test for equality of variances


Multivariate normal distribution property

Is it possible to have a pair of Gaussian random variables for which the joint distribution is not Gaussian?


Mathematical equation for ARIMA(1,1,0) with drift


How does $\vec{\beta}=(H^TH)^{-1}H^T\vec{y}$ equivalent to least squares criteria for evaluating splines?

What algorithm is used in linear regression?


When should we split the data into train, valid and test datasets?

Should exploratory data analysis include validation set?


asymptotic p values of standard normal distributed ? how to calculate them?


Log Sum Exponential Trick On Weibull Mixture

Computation of likelihood when $n$ is very large, so likelihood gets very small?


Unusual (to me) Phrasing of Power Analysis Objective; Interpretation Requested


Assessing approximate distribution of data based on a histogram


Does it make sense to use a date variable in a regression?


How to get the mean and standard deviation from several individuals each with their own mean and standard deviation?

How to calculate pooled variance of two or more groups given known group variances, means, and sample sizes?


Question about prediction bands for non-linear regression computation?

How to compute prediction bands for non-linear regression?


Is pairwise distance matrix useful to k-means?

Why does k-means clustering algorithm use only Euclidean distance metric?


is k-means generalizable at any distance?


Circular variable in spatial GLM / SVM modeling using R

Regression using circular variable (hour from 0~23) as predictor


Murphy: A probabilistic perspective - Completing the in Variational Inference

How do I complete the square with normal likelihood and normal prior?


Why are interaction terms multiplicative in linear regression?

In multiple regression, why are interactions modelled as products, and not something else, of the predictors?


Is the population parameter more likely to occur closer to the sample statistic?

Why does a 95% Confidence Interval (CI) not imply a 95% chance of containing the mean?


Scaling separately in train and test set?

Perform feature normalization before or within model validation?


How do I write a mathematical equation for seasonal ARIMA (0,0,1) x (2,1,2) period 12

How do I write a mathematical equation for ARIMA (2,1,0) x (0,2,2) period 12


What is the mean and variance for this Normal distrbution?

Sum of normal independent random variables with coefficients


10-faces dice "emulation" from N 6-faces dices

Converting random 6-faced dice results to decimal base


(Basic question) normal distribution of error in predictive model

How does linear regression use the normal distribution?


Non - convergence of loss function in Neural Networks with a step activation function

Why is step function not used in activation functions in machine learning?


When is logistic regression solved in closed form?


Why would you want to fit/use a Poisson regression instead of Negative Binomial?


Monotonically increasing transformation function

How small a quantity should be added to x to avoid taking the log of zero?


Which method (enter, Forward LR or Backward LR) of logistic regression to use?

Algorithms for automatic model selection


Is Statistics really better at making Relationship Inferences compared to Machine Learning?

The Two Cultures: statistics vs. machine learning?


How to tell if a sample comes from a distribution with infinite mean?


Why is it hard for a neural network to learn the identity function?

What should I do when my neural network doesn't learn?


Why is the likelihood a product of pdf terms $f(\theta; x_1, x_2, ...)$

Maximum likelihood function for mixed type distribution


Accuracy in neural network for regression


Why does the linear regression algorithm assume the input residuals (errors) to be normal distributed?

How does linear regression use the normal distribution?


Why aren't the outputs of the softmax and logistic function the same in this example?

Is binary logistic regression a special case of multinomial logistic regression when the outcome has 2 levels?


Capturing effects / Controlling for variables

How exactly does one “control for other variables”?


r - Understand goodness of a fitted curve

Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


Multilevel model method in non-Bayes algo?

How to deal with hierarchical / nested data in machine learning


Weird sample variance when creating a lognromal sample with pre-defined mean and variance

How to find normal and lognormal moments, given partial information?


How is MAP 'not invariant to reparametrization'?

What is an example of a transformation on a posterior distribution such that the MAP estimate will be non-invariant?


VECM and Impulse Response Functions in R: Trend and Stationarity

Levels or First Differences, VECM or VAR for Ultimate Impulse Response Functions?


Why is sample standard deviation a biased estimator of $\sigma$?


Interpretation of four plots returned by lm in R


Multivariate Gaussian distribution explanation needed

Covariance of a random vector after a linear transformation


Issue with proof in Statistical Theory related to Beta and Binomial distributions


What do I do when my deep learning model in CNN does not learn?

What should I do when my neural network doesn't generalize well?


When is unbalanced data really a problem in Machine Learning?


Wilcoxon Rank Sum test unequal sample sizes

Mann-Whitney U test with unequal sample sizes


What exactly is a seed in a random number generator?


Binary classification with imbalanced classes


Derivation of odds ratios from logit equation parameters?

Help me understand adjusted odds ratio in logistic regression


Why is deep neural net with linear activation diverges?

What should I do when my neural network doesn't learn?


Raw data outperforms Z-score transformed data in SVM classification


Data set with high imbalance and extremely low frequency of the minority class

Binary classification with strongly unbalanced classes


Why are activation functions needed in neural networks?

How does the Rectified Linear Unit (ReLU) activation function produce non-linear interaction of its inputs?


Validation set used for early-stopping. Do I retrain the model using the validation data as training data?

Interplay between early stopping and cross validation


How should new variables to be added in logistic regression model in production?

Dealing with new Factor Levels in a Regression in R


Introducing new values for a categorical feature


Are lower-order interactions a prequisite for three-way interactions in regression analysis?

Do all interactions terms need their individual terms in regression model?


Calculate variance and standard deviation for Log Normal Distribution


Is there any paper about vanishing-gradients of LSTM?

How does LSTM prevent the vanishing gradient problem?


How can I calculate AUC using Gini coefficient?

How to calculate Area Under the Curve (AUC), or the c-statistic, by hand


How to handle data imbalance in classification?

When is unbalanced data really a problem in Machine Learning?


Modeling a dependent variable as a ratio in regression with an interaction

Ratios in Regression, aka Questions on Kronmal


Conditionally heteroskedastic linear regression: How can I model variance from given predictors?


Does the following "theorem" have a name?

Why is the sum of two random variables a convolution?


How do I interpret RMSE in layman words?

Explain Root Mean Square Error to non-technical audience


What would a suitable justification be to use 'log(exports)' as a dependent variable instead of solely 'exports'?

What is the reason the log transformation is used with right-skewed distributions?


Simulating random variables from a discrete distribution II

How to generate numbers based on an arbitrary discrete distribution?


Metropolis-Hastings acceptance ratio for truncated proposal


Why is the outer loop of nested cross validation needed?

Nested cross validation for model selection


What is meant by multicollinearity does not influence the predictive power of the model?

Why doesn't collinearity affect the predictions?


What is a good PR-AUC and should I undersample time series for rare event detection?

Is my model any good, based on the diagnostic metric ($R^2$/ AUC/ accuracy/ RMSE etc.) value?


Let A and B be two random variables, both independent from another random variable C. Is A*B also independent from C?

Functions of Independent Random Variables


Should I use OLS of fixed effects for this model?

Should I use OLS of fixed effects for this model for estimating level of immigrants?


Regression Model with aggregated target data

Fit individual-level model on aggregate-level target-data


Relationship between the probability and likelihood functions


Difference between standard beta and unstandard beta distributions?


Survival Analysis with Time-Varying data & AFT Models

Weibull Survival Model with Time Varying Covariates in R


If a random sample all came out positive, what can be inferred about the population?

How to tell the probability of failure if there were no failures?


A roadmap to learn statistics if one has background in mathematics

Mathematician wants the equivalent knowledge to a quality stats degree


Approximate distribution of product of N normal i.i.d.? General case

Approximate distribution of product of N normal i.i.d.? Special case μ≈0


Good explanation of the QQ-plot algorithm?

Benefits of using QQ-plots over histograms


How to prove that special data is useless for given problem?

How to know that your machine learning problem is hopeless?


Centering variables in regression leads to the same model of original variables, why still doing that?


How do I test for a symmetric distribution?

Testing symmetry of a distribution around its mean


How do I prove that $ E[X] = \int _{0}^\infty (1-F_x(t))dt $

Expectation of a function of a random variable from CDF


Where do the values for t tables come from?

How to approximate the student-t CDF at a point without the hypergeometric function?


if 2 random variables have exactly same mean and variance


Non-Normal Distribution to Normal Distribution (including 0s and -ve numbers)

Which constant to add when applying 'Box-Cox transformation' to negative values?


Working with systems with Perfect Multicollinearity


Selection of an ARIMA model looking at the ACF and PACF

How does ACF & PACF identify the order of MA and AR terms?


VAR or VECM for a system of I(0) and I(1) variables?

VAR or VECM for a mix of stationary and nonstationary variables


Does the OLS regression line pass through the mean of ALL covariates?

Regression Proof that the point of averages (x,y) lies on the estimated regression line


The formula for covariance in terms of joint cdf

Prove that $ \mathbb{E}[XY] - \mathbb{E}[X] \mathbb{E}[Y] = \int_{- \infty}^\infty \int_{- \infty}^\infty (F(x,y)-F_X(x) F_Y(y)) \,dx\,dy,$


An example where the output of the k-medoid algorithm is different than the output of the k-means algorithm


Normal approximation for binomial distribution: probabilities don't match up between 2 models

Normal approximation to the binomial distribution


clear example of sigma algebra generated by r.v

A random variable that induces a $\sigma$-algebra the same as the one in the sample space


is log1p the "correct" way of doing log scale transformation of charts?

How small a quantity should be added to x to avoid taking the log of zero?


Mean absolute error OR root mean squared error?


How random search converges to find optimum of a function?

Practical hyperparameter optimization: Random vs. grid search


What is the meaning of p values and t values in statistical tests?


Why use a certain measure of forecast error (e.g. MAD) as opposed to another (e.g. MSE)?


Computing correlation coefficient in linear regression


Linear Regression on Boston Housing Price?

Linear regression with strongly non-normal response variable


Understand conditional expectation w.r.t. sigma -algebra

Intuition for Conditional Expectation of $\sigma$-algebra


Mean and variance of the median estimator


How to prove the following linear regression properties?


How do we use linear regression in which response variable is related to the regressors in a nonlinear fashion?

What is the difference between linear equation and linear regression?


Removal of statistically significant intercept term increases $R^2$ in linear model


Adam optimizer's escape from local minima

What causes sudden drops in training/test errors when training a neural network?


How to handle large number of categories in a regression model?

Principled way of collapsing categorical variables with many levels?


Dealing with non-linear variable in multiple linear regression model

What happens when I include a squared variable in my regression?


Why is it possible to get significant F statistic (p<.001) but non-significant regressor t-tests?


Calculate a confidence interval of 88% for the difference in proportions

Understanding the formula for the Confidence Interval of the difference between two sample proportions


Is it possible for a binary classifier to have lower accuracy, macrof1 and binaryf1 but higher ROC AUC?

Why is AUC higher for a classifier that is less accurate than for one that is more accurate?


Multiple regression vs propensity score matching for covariates in observational study

Survival Analysis, Cox Regression in randomized trial vs. observational study and propensity score matching


Subtracting very small probabilities - How to compute?

Computation of likelihood when $n$ is very large, so likelihood gets very small?


Is heights of humans actually a discrete random variable?

Is my random variable discrete or continuous?


Self Study - How does $\alpha$ and $\beta$ correspond to mean and variance of a beta distribution?

Mean and variance of a Beta distribution with $\alpha \ge 1$ or $\beta \ge 1$?


Solution to a single feature logistic regression problem

Clarification on the Math of Logistic Regression


When performing Confidence Interval estimation, can I assume that the data comes from different distributions other than the normal distribution?

Recommended visualization libraries for standalone applications


When using GLM to fit data, how do we select which family the data belongs to


mean centering leads to perfect correlation?

Does standardising independent variables reduce collinearity?


Can a probability distribution value exceeding 1 be OK?


What approaches or problems do I need to consider when building a classification model from 2 different populations?


Are there parameters where a biased estimator is considered "better" than the unbiased estimator?

When is a biased estimator preferable to unbiased one?


To what extent can we call a Geometric Distribution a Geometric Density

Does Wolfram Mathworld make a mistake describing a discrete probability distribution with a probability density function?


Data augmentation techniques for numeric datasets?

Data augmentation techniques for general datasets?


What do we mean by saying "Explained Variance"


Predicting Uncertainty in Random Forest Regression

Do the predictions of a Random Forest model have a prediction interval?


How do I model count data (Poisson regression) that has a seasonal pattern?

Is this an appropriate method to test for seasonal effects in suicide count data?


Linear separability for a sum of kernel functions


Help, my neural network is only recognising one particular category?

What should I do when my neural network doesn't learn?


what is the conditional density of $X$ given $Y$?

How to find density function from this joint probability density function


Paired t-test or Wilcoxon signed sum rank test for a slightly skewed data with a small sample size of 21?

How to deal with ties when conducting Wilcoxon signed rank test?


Is it possible to calculate an average correlation of r from several correlations of r?


Why do we find eigen vectors of the co-variance matrix in PCA?

What is an intuitive explanation for how PCA turns from a geometric problem (with distances) to a linear algebra problem (with eigenvectors)?


Normalizing the covariance matrices of a series of random vectors

Is the covariance of standardized variables the correlation?


Given the normal distribution X=N(1,2), what is E[X^3]?


Correlation Matrix or Covariance Matrix in PCA


Why anova table disappear when we use robust regression

Why anova disappear in robust regression


sum of independent normally distributed random variables in regression model

Meaning of $\hat{\beta}$ of the linear regression model


asymptotic distribution of $\sqrt{n}(\hat\theta_n-\theta)$ to determine the efficiency of $\hat\theta_n$?


batch size of stochastic gradient descent

Stochastic gradient descent Vs Mini-batch size 1


How to obtain p-values when using glmer - mixed model logistic regression GLMER?

How to obtain the p-value (check significance) of an effect in a lme4 mixed model?


Regression when each observation of the dependent variable is a vector

Multivariate linear regression vs. several univariate regression models


Can't Recreate Values for U, S, V from SVD in numpy

Why cannot I obtain a valid SVD of X via eigenvalue decomposition of XX' and X'X?


Maximum likelihood estimator when $\sum_{j} \theta_j = 1$. How to impose this condition?

maximum of a function from proportions using optim() in R


How should I intuitively understand the KL divergence loss in variational autoencoders?

Deriving the KL divergence loss for VAEs


Why do neural networks need so many training examples to perform?


When and when not to use activation function between input layer and hidden layer?

is there any diffrence to use nonlinear or liner activation function in single hidden layer network


AIC versus Likelihood Ratio Test in Model Variable Selection


normalization coefficient in the central limit theorem

What intuitive explanation is there for the central limit theorem?


If the data is not normally distributed and the skewness is = 0.208 SE of skewness is 0.144 , is it acceptable to use t-test?

Is normality testing 'essentially useless'?


What is embedding? (in the context of dimensionality reduction)

What is the difference between embedding in pure math and embedding in ML?


R: linear regression: very small coefficient and R-squared but significant P values


explain the cost function of scalar vector machine (SVM)


Specifying the conditional distribution for the response in practice?


standard error of sums of estimates of a linear model

How do I calculate standard errors for sums of OLS coefficients?


Log-Log in panel data for multiple regression

Interpretation of log transformed predictor and/or response


Mahalanobis distance between 2 points doesn't work when covariance matrix has values close to 0

Singular covariance matrix in Mahalanobis distance in Matlab


What is the main reason why a hypothesis test usually has the equality hold under the null hypothesis?

Why must a null hypothesis contain equality?


Properties of the diff of a sorted uniformly generated set

Spacings between continuous uniform random variables


Best practice when analysing pre-post treatment-control designs


Bootstrapping with bootstrap sample greater than original sample

Why should boostrap sample size equal the original sample size?


How to Construct a Maximum Likelihood Estimator for Parameter from a Beta Distribution?

Maximum Likelihood Estimator - Beta Distribution


Comparing mean of subgroup with national mean

How  to test  whether subgroup mean differs from overall group that includes the subgroup?