Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [linear-models]

27 questions
4
votes
1 answer

Help on data transformation

I have reaction time as a dependent variable and age as an independent variable. I want to do a linear mixed model analysis. My data is not normally distributed. Should I have to transform data? I tried multiple lambda values but my data is not…
Monika Thakur
  • 41
  • 2
3
votes
1 answer

what is difference between Logistic regression and SGDClassifier with log loss OR SVM and SGDClassifer with hinge loss?

Can we just use SGDClassifier with log loss instead of Logistic regression, would they have similar results ?
inder singh
  • 39
  • 1
3
votes
2 answers

How to visualize optimization problems' feasible region?

Is there any tool to visualize the feasible region when given a set of Linear equations (equalities and inequalities). If not, can anyone suggest a way to visualize it? If I am going to do it myself using Python, which libraries should I use. I have…
Mina Ashraf
  • 141
  • 1
  • 4
2
votes
0 answers

Does linear kernel make SVM a linear model?

I have deleloped several SVR models for my case study using the linear kernel, and those models were optimized using the RMSE as criterion. Now Im searching for additional evaluation metrics and it turns the most publications use R squared to…
tabumis
  • 43
  • 4
1
vote
0 answers

How can I compare a NN model and a linear regression?

I have a small dataset (1500 rows) and to predict the imbalanced target, I am running two linear models (linear regression and lasso) and one nonlinear model (Neural Network) on it. I am using Area Under Precision Recall Curve (AUPRC) to compare the…
Shahab Kazemi
  • 103
  • 1
  • 4
1
vote
3 answers

What is the impact of low correlation on regression and classification problems, and how does it affect model performance?

I’m building two models (one for a regression problem and the other for a classification task) but I am facing low correlation in the data (lower in the classification problem than in the regression problem). Are there any resources or key…
bebel
  • 123
  • 5
1
vote
1 answer

Minimize $\sum_i||Y_i-AX_i||^2$

I have N data vectors $X_i$ and N target vectors $Y_i$ where $i$ indexes the sample. I would like to learn a linear map $A$ between the data and the target i.e find the matrix $A$ that minimize $$\sum_i^N||Y_i-AX_i||^2.$$ Is that a well know machine…
Nichola
  • 113
  • 4
1
vote
1 answer

Linear Regression and Logistic Regression

I'm a beginner, and I'm wondering whether a logistic regression in a nut-shell is just normalizing a linear regression? Correct me if I'm wrong, but I came to this conclusion because the predicted value of logistic regression is simply just the…
Justin Jonany
  • 51
  • 4
1
vote
1 answer

What are the advantages of model drift vs concept drift in online learning?

I have asked this question here but I'm also posting it here to get a better insight: https://stats.stackexchange.com/questions/602282/what-are-the-advantages-of-model-drift-vs-concept-drift-in-online-learning Let's say I have a simple linear…
Ash
  • 127
  • 5
1
vote
1 answer

Temperature lag forecasting

I am working on a data science project on an industrial machine. This machine has two heating infrastructures. (fuel and electricity). It uses these two heatings at the same time, and I am trying to estimate the temperature value that occurs in the…
Clankk
  • 23
  • 3
1
vote
1 answer

Is it possible to explain why Lasso models eliminated certain coefficient?

Is it possible to understand why Lasso models eliminated specific coefficients?. During the modelling, many of the highly correlated features in data is being eliminated by Lasso regression. Is it possible why precisely these features are being…
NAS_2339
  • 263
  • 2
  • 13
1
vote
0 answers

Does the appliance of R-squared to non-linear models depends on how we calculate it?

Does the appliance of R-squared to non-linear models depends on how we calculate it? $R^2 = \frac{SS_{exp}}{SS_{tot}}$ is going to be an inadequate measure for non-linear models since an increase of $SS_{exp}$ doesn't necessarily mean that the…
mathgeek
  • 121
  • 3
1
vote
1 answer

The effect of the λ in the Ridge regression

Why by increasing value of λ in Ridge estimator the slope of the line is decreasing? How exactly λ affects to the y = kx + b?
Dablup
  • 11
  • 1
0
votes
1 answer

How to make a linear model with a constant value in R?

I'm working on an unassessed homework problem from unpublished course notes of a statistics module from a second year university mathematics course. I'm trying to plot a 2-parameter full linear model and a 1-parameter reduced linear model for the…
mjc
  • 103
  • 1
  • 4
0
votes
0 answers

What is the Intuition behind weight vector W which is normal to the plane? Is the weight vector W same as the W which is normal to the plane π?

In an interview, I was asked the intuition behind the weight vector. I told the weight vector is a vector which we try to minimize to a local minima with the help of regulariser so we don't overfit. Weights tells us the influence of a feature on the…
Vinit Sutar
  • 35
  • 1
  • 5
1
2