Which of the following are true of a Long Short-Term Memory network? 1. It determines…
- User
Which of the following are true of a Long Short-Term Memory network?
- It determines which words should be remembered forever.
- It learns whether the current concept should be admitted into the hidden state.
- Assistant
Both statements capture what the gating mechanisms inside an LSTM do, so they are TRUE.
• Statement 1
The forget gate (in combination with the cell state) learns to keep or erase information.
If the forget gate keeps its value near 1, that piece of information can be carried along for the whole sequence—“remembered forever” (or at least until the gate later decides to forget it).• Statement 2
The input gate decides how much of the current input (the “current concept/word”) should be written into the cell’s memory.
If it lets that information in, it becomes part of the internal state that will influence future hidden states.So:
1 ✅ 2 ✅
- User
- It increases the amount of information passed from time slice to time slice.
- It learns when certain concepts should be forgotten.
- Assistant
Here’s how the last two statements stack up:
# Statement True / False Why 3 “It increases the amount of information passed from time slice to time slice.” ❌ False An LSTM doesn’t try to maximize (or “increase”) how much information flows forward; it tries to control it. The gates can keep, attenuate, or erase parts of the cell state. Sometimes they even pass less information than a vanilla RNN would. What the architecture guarantees is an unimpeded gradient path (via the cell state’s linear connection), not a larger information payload. 4 “It learns when certain concepts should be forgotten.” ✅ True The forget gate receives the previous hidden state and the current input, producing a value between 0 and 1 for every dimension of the cell state. That learned signal decides whether each “concept” (feature) should be decayed or wiped, i.e., forgotten. Quick recap of all four:
- Remember forever? ✔️
- Admit current concept? ✔️
- Increase information? ❌
- Learn to forget? ✔️
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.