Data Science Stack Exchange
Data Science Stack Exchange

Questions tagged [prediction]

prediction is the use of data, statistical algorithms and machine learning techniques to identify the likelihood of future outcomes based on historical data. The goal is to go beyond knowing what has happened to providing a best assessment of what will happen in the future.

443 questions
87
votes
8 answers

Time series prediction using ARIMA vs LSTM

The problem that I am dealing with is predicting time series values. I am looking at one time series at a time and based on for example 15% of the input data, I would like to predict its future values. So far I have come across two models: LSTM…
ahajib
  • 1,085
  • 1
  • 9
  • 15
21
votes
1 answer

What do "compile", "fit", and "predict" do in Keras sequential models?

I am a little confused between these two parts of Keras sequential models functions. May someone explains what is exactly the job of each one? I mean compile doing forward pass and calculating cost function then pass it through fit to do backward…
user3486308
  • 1,310
  • 5
  • 19
  • 29
17
votes
5 answers

Prediction interval around LSTM time series forecast

Is there a method to calculate the prediction interval (probability distribution) around a time series forecast from an LSTM (or other recurrent) neural network? Say, for example, I am predicting 10 samples into the future (t+1 to t+10), based on…
4Oh4
  • 308
  • 1
  • 2
  • 7
14
votes
1 answer

How to Predict the future values of time horizon with Keras?

I just built this LSTM neural network with Keras import numpy as np import pandas as pd from sklearn import preprocessing from keras.layers.core import Dense, Dropout, Activation from keras.activations import linear from…
Nbenz
  • 283
  • 2
  • 3
  • 7
12
votes
2 answers

Is a 100% model accuracy on out-of-sample data overfitting?

I have just completed the machine learning for R course on cognitiveclass.ai and have begun experimenting with randomforests. I have made a model by using the "randomForest" library in R. The model classifies by two classes, good, and bad. I know…
Milan van Dijck
  • 123
  • 1
  • 6
9
votes
3 answers

Is There a Way to Re-Calibrate Predicted Probabilities After Using Class Weights?

I have classification data with far more negative instances than positive instances. I have used class weights in my models and have achieved the discrimination I want but the predicted probabilities from the models do not match the actual…
from keras import michael
  • 370
  • 3
  • 13
8
votes
1 answer

How to predict advantage value in deep reinforcement learning

I'm currently working on a collection of reinforcement algorithms: https://github.com/lhk/rl_gym For deep q-learning, you need to calculate the q-values that should be predicted by your network. There are many strategies: monte-carlo,…
lhk
  • 181
  • 3
7
votes
3 answers

Why can't my neural network learn how to predict the squares of natural numbers?

I want my neural network to learn to predict the square $n+1$ number having $n$ number. I am considering a regression problem. That's what I'm doing: from keras.preprocessing import sequence from keras.models import Sequential from keras.layers…
SoH
  • 119
  • 5
7
votes
1 answer

how to interpret predictions from model?

I'm working on a multi-classification problem - Recognizing flowers. I trained the mode and I achieved accuracy of 0.99. To predict, I did: a = model.predict(train[:6]) output: array([[5.12799371e-18, 2.08305119e-05, 1.14476855e-07,…
Jagadeesh Kotra
  • 73
  • 1
  • 4
7
votes
3 answers

Prediction Intervals Using XGBoost

I want to obtain the prediction intervals of my xgboost model which I am using to solve a regression problem. I am using the python code shared on this blog, and not really understanding how the quantile parameters affect the model (I am using the…
mari
  • 141
  • 1
  • 2
  • 8
7
votes
1 answer

Wind Power Data Analysis - Python

I am seeking some help and or perspectives in solving a problem. I have a dataset (accessible here) with the following columns: DATE: this is the date in dd/mm/yyyy format HH: this is the "half-hour" window of the day. In a day there are 48 HH…
ExcellentGas3142
  • 71
  • 1
7
votes
1 answer

When the regression models outperforms naive method?

I followed from this question. Case1: I have the following task to do: Training by the consecutive 3 days to predict the each 4th day. Each day data represents one CSV file which has dimension 24x25. Every datapoints of each CSV file are…
S. M.
  • 125
  • 17
7
votes
1 answer

Are Machine Learning Weather Prediction models better than classic weather forecast?

We all know that, there are weather prediction models and case studies. But I don't understand the reason, why people trust them rather than weather forecast on TV. I mean, what is advantages of Machine Learning weather prediction over classic…
Anar
  • 73
  • 5
6
votes
2 answers

Why is input preprocessing in VGG16 in Keras not 1/255.0

I am just trying to use pre-trained vgg16 to make prediction in Keras like this. from scipy import ndimage from keras.preprocessing import image from keras.applications.vgg16 import preprocess_input im =…
kawingkelvin
  • 221
  • 1
  • 2
  • 7
6
votes
3 answers

tsne for prediction

I have a traditional prediction setting, with a training data set train and a test data set test. I do not know the outcome y of the test set. I found that tsne separates my binary classification setting quite well. However, tsne cannot really be…
spore234
  • 613
  • 8
  • 14
1
2 3
…
29 30