The limits of the context window become much less important (but can still be a problem I agree) when crucial context can be dynamically inserted only when relevant.
Gpt-3.5 doesn't need the algorithm prompt for every single query. It just needs it for every query that requires arithmetic. Much more feasible.
Gpt-3.5 doesn't need the algorithm prompt for every single query. It just needs it for every query that requires arithmetic. Much more feasible.