hi i have historical data of some crypto currencies as csv files for each row i…
- User
hi i have historical data of some crypto currencies as csv files for each row i calculated a column named high_2d(which is the price change in next 2 days) and prior_2d(which is a 0 or 1 binary label)
i want to train a LSTM model to predict high_2d and prior_2d based on last 30 days data i want to train the model on them without merging them give me proper python code
- Assistant
To build a Long Short-Term Memory (LSTM) model that predicts "high_2d" as a continuous value (for regression) and "prior_2d" as a binary label (for classification) based on the last 30 days of data from your CSV files, you'll follow these steps:
- Preprocess your data: Load your CSV files, normalize your features, prepare your sequences (30-day windows), and split your dataset into training and testing sets.
- Build two separate LSTMs: One for predicting "high_2d" and another for "prior_2d".
- Train your models separately.
- Evaluate and make predictions.
This guide assumes you have a basic understanding of Python, pandas, and TensorFlow/Keras.
Prerequisites:
Ensure you have TensorFlow, pandas, numpy, and scikit-learn installed:
pip install tensorflow pandas numpy scikit-learnStep 1: Preprocess Your Data
import pandas as pd from sklearn.model_selection import train_test_split from sklearn.preprocessing import MinMaxScaler import numpy as np # Load your dataset file_path = 'your_crypto_data.csv' # Change this to your actual file path df = pd.read_csv(file_path) # Assuming you have timestamp or similar to sort your data chronologically df.sort_values(by='date_column', inplace=True) # Normalize features (example: selecting 'close' feature. You may choose others as needed) scaler = MinMaxScaler(feature_range=(0, 1)) df['normalized_close'] = scaler.fit_transform(df['close'].values.reshape(-1,1)) # Function to create 30-day sequences def create_sequences(data, seq_length): xs = [] ys_high = [] ys_prior = [] for i in range(len(data)-seq_length-1): x = data.iloc[i:(i+seq_length)].values y_high = data.iloc[i+seq_length]['high_2d'] y_prior = data.iloc[i+seq_length]['prior_2d'] xs.append(x) ys_high.append(y_high) ys_prior.append(y_prior) return np.array(xs), np.array(ys_high), np.array(ys_prior) seq_length = 30 # Number of days to look back X, y_high, y_prior = create_sequences(df[['normalized_close']], seq_length) # Split the data into training and testing sets X_train, X_test, y_high_train, y_high_test, y_prior_train, y_prior_test = \ train_test_split(X, y_high, y_prior, test_size=0.2, random_state=42) # Reshaping for LSTM X_train = np.reshape(X_train, (X_train.shape[0], X_train.shape[1], 1)) X_test = np.reshape(X_test, (X_test.shape[0], X_test.shape[1], 1))Step 2: Build Your LSTMs
We'll create two LSTM models, one for regression (predicting "high_2d") and one for classification (predicting "prior_2d").
from keras.models import Sequential from keras.layers import LSTM, Dense, Dropout # Regression Model for 'high_2d' regression_model = Sequential() regression_model.add(LSTM(units=50, return_sequences=True, input_shape=(X_train.shape[1], 1))) regression_model.add(Dropout(0.2)) regression_model.add(LSTM(units=50)) regression_model.add(Dropout(0.2)) regression_model.add(Dense(units=1)) # For regression output regression_model.compile(optimizer='adam', loss='mean_squared_error') # Classification Model for 'prior_2d' classification_model = Sequential() classification_model.add(LSTM(units=50, return_sequences=True, input_shape=(X_train.shape[1], 1))) classification_model.add(Dropout(0.2)) classification_model.add(LSTM(units=50)) classification_model.add(Dropout(0.2)) classification_model.add(Dense(units=1, activation='sigmoid')) # For binary classification classification_model.compile(optimizer='adam', loss='binary_crossentropy', metrics=['accuracy'])Step 3: Train Your Models
# Train the regression model regression_model.fit(X_train, y_high_train, epochs=50, batch_size=32) # Train the classification model classification_model.fit(X_train, y_prior_train, epochs=50, batch_size=32, class_weight={0:1, 1:2}) # Assuming class_weight is needed, adjust as necessaryStep 4: Evaluate and Make Predictions
# Evaluate the regression model regression_predictions = regression_model.predict(X_test) # You might want to inverse transform predictions and actuals if you want to interpret them in their original scale # Evaluate the classification model classification_predictions = (classification_model.predict(X_test) > 0.5).astype("int32") # Here, you could print out your predictions, or compare them with the actual values to evaluate your model's performanceNote: The performance of these models heavily depends on the nature of your dataset, the features you decide to include, and hyperparameter tuning.