Did It Decline Logo
Did It Decline?

That is the question that has been on a lot of ChatGPTs Users minds these past few months. There have been discussions in forms, wild claims on social media and more. However what has been missing is concrete evidence. Thus Did It Decline was created, to follow a more systematic approach.

A Methodical Approach

To objectively monitor ChatGPT's accuracy and response time, I designed five distinct prompts covering Grammar, Math, Data Analysis, Coding, and Translation. These prompts are periodically presented to both ChatGPT 3.5 and 4 models via the OpenAI API every two hours. Their responses undergo validation for correctness, enabling us to track and analyze performance trends over time.

Discover Insights and Trends in Real-Time

Join us as we delve into the performance of ChatGPT. Explore the detailed analysis and observe how these AI models have evolved. This interactive platform offers you a comprehensive view of the data, empowering you to draw your own conclusions.

See for yourself

Now I invite you to take a look at the prompts and then jump into the analyis of the Data. Whether you're a skeptic, a supporter, or simply curious, Did It Decline offers a transparent and data-driven perspective on the evolution of ChatGPT's capabilities.

The Prompts

English Grammar

Count the Grammar Mistakes in the Text:

She don't like going to the gym. There is many reasons why I don’t want to go. Me and my friend are going to the park. Each of the students have completed their project. He eats a apple every day.

Initial Accuracy

  • GPT-4: 12/12 Correct Answers (100.00%)
  • GPT-3.5: 5/12 Correct Answers (41.67%)
Mathematics

Calculate this expression:

√(3000 + 30000 + 35121)

Initial Accuracy

  • GPT-4: 0/12 Correct Answers (0.00%)
  • GPT-3.5: 0/12 Correct Answers (0.00%)
Translation

Translate this text from English to French.

The quick brown fox jumps over the lazy dog.

Initial Accuracy

  • GPT-4: 12/12 Correct Answers (100.00%)
  • GPT-3.5: 10/12 Correct Answers (83.33%)
Data Analysis

Make out the store with the single highest selling day:

Day Store A Store B Store C Store D Store E
Monday 120 90 140 110 80
Tuesday 115 95 130 120 85
Wednesday 130 100 120 115 90
Thursday 140 110 150 105 95
Friday 160 120 170 130 100
Saturday 189 130 190 140 110
Sunday 150 120 160 150 105

Initial Accuracy

  • GPT-4: 12/12 Correct Answers (100.00%)
  • GPT-3.5: 12/12 Correct Answers (100.00%)
Coding

Count the Amount of Syntax Errors in this JS Snippet: 

function calculateArea(width, height)
	var area = width * height;
	console.log('The area is: ' + area);
	if width > 0 && height > 0 {
			return area;
	else {
			return 'Invalid dimensions';
	}
}

calculateArea(10, 5);

Initial Accuracy

  • GPT-4: 0/12 Correct Answers (0.00%)
  • GPT-3.5: 5/12 Correct Answers (41.67%)