5 Comments
May 8, 2023Liked by Abhinav Upadhyay

Context can be compressed. Much like how humans can only remember 7 random things at any given time.

I think GPT-100 will have fewer parameters than GPT-5

The moore's law is for parameters not transistors.

Expand full comment
May 8, 2023Liked by Abhinav Upadhyay

Such a brilliant compilation of ideas. AI is not expected to kill the programming industry but rather transform it.

Expand full comment

Well written. I agree with this completely. I have a theory that AI will start to build packages for us to use. Almost like an "AI Package Manager". It will generate it's own documentation and make it easy for us to use. The token limit seems to be the biggest complication. Unless we're all going to start running $30,000 PCs to handle hundreds of thousands of tokens, I don't see them taking the occupation over anytime soon.

Expand full comment