[Research] [Tech] Yannis' Law and Proebsting's law

Now here's some food for thought for all developers out there:

Yannis' Law: Programmer Productivity Doubles Every 6 Years

I keep hearing aphorisms about the "software crisis" and the lack of progress in software development. I have been programming for over 15 years, and I find such claims to be completely false: I am convinced that I could reproduce with today's tools the work of a competent programmer of 15 years ago in a small fraction of the time.

By analogy to Moore's law and (more appropriately, because of its intention to provoke, rather than predict) Proebsting's law, I propose that programmer productivity doubles every 6 years.

...

The year is 2003 and I would not consider a programmer to be good (this includes familiarity with tools) if they cannot produce the KWIC system within an hour or two, instead of a week or two in 1972. This constitutes an increase in productivity by a factor of 40 over the course of 31 years, or over 12.5% per year, which results in a doubling of productivity every 6 years.

...

This impressive progress is arguably the cumulative result of reusable software entities, better system tools, better programming languages, better CS education, but also good use of faster machines that allow us to ignore low-level overheads and favor slightly less efficient but convenient solutions.


This reminds me a little of what Chuck Darrah discovered about Silicon Valley dual career families, that it wasn't that technology eased our lives so much as made it possible to take on more responsibilities. Perhaps the software crisis isn't a crisis per se, but more of changing expectations as we gain the capabilities to produce more sophisticated features, as we compete more (thanks to the web and the Internet), and as systems are used in more situations (especially where they were not expected to be used, just see comp.risks for examples).



Proebsting's Law: Compiler Advances Double Computing Power Every 18 Years

I claim the following simple experiment supports this depressing claim. Run your favorite set of benchmarks with your favorite state-of-the-art optimizing compiler. Run the benchmarks both with and without optimizations enabled. The ratio of of those numbers represents the entirety of the contribution of compiler optimizations to speeding up those benchmarks. Let's assume that this ratio is about 4X for typical real-world applications, and let's further assume that compiler optimization work has been going on for about 36 years. These assumptions lead to the conclusion that compiler optimization advances double computing power every 18 years. QED.

This means that while hardware computing horsepower increases at roughly 60%/year, compiler optimizations contribute only 4%. Basically, compiler optimization work makes only marginal contributions.

Perhaps this means Programming Language Research should be concentrating on something other than optimizations. Perhaps programmer productivity is a more fruitful arena.

Comments

Medis said…
I would like to say that without definitive practice each and every learner will fail to uncover a wide variety of sources on a suggested theme at university. Only those who will use our custom writing services will get at that site free essays done in accordance to all theoretical methods of secondary education. It has a great practical value as it gathers consistent materials and precise data for any analysis or overview.
11:45 AM
Post a Comment

Popular posts from this blog

How to Fix a Jammed Toyota Camry Trunk

This problem needs a higher pagerank, so I figured I would post the solution here. If your Toyota Camry trunk won't open, one possible reason is that it is set to valet mode. Valet mode means that you cannot open the trunk using the release lever inside the car. To set valet mode, you put the key into the trunk lock and turn it counterclockwise. You will know that your trunk is in valet mode if the lock is horizontal rather than vertical, and if you cannot open the trunk using the lever near the driver's seat. Of course, a problem is that sometimes the Camry can get stuck in valet mode, such that you can't use your key to get out of it. (You can see how I spent part of my Sunday morning ...) The solution turns out to be WD-40 . Spray some WD-40 on your key and on the lock. Put the key in, and jiggle it around, and happiness ensues. From an interaction design perspective, it sort of makes sense to have a valet mode. After all, the point of having a valet key is to limit the
Read more

Web 2.0 and Research

I've been chatting with many of my friends and colleagues about an issue that's been bugging me for a while, namely whether academic research has any role to play in the emerging Web 2.0 . I've been slowly coming to the conclusion that the answer is not much. I had a similar discussion with other researchers at HotMobile a few weeks ago. When the web first came out, pretty much every systems researcher ignored it because it was so ugly. The web was not very sophisticated in terms of distributed systems, HTTP lacked elegance, HTML conflated many different ideas, and so on. There were also not any really new ideas with the web, as evidenced by the fact that Tim Berners-Lee 's first paper on the Web was (probably rightfully) rejected from an ACM conference on hypertext. I'm sure one thing that really irked researchers about the nascent web was that it completely ignored the large body of work in hypertext and distributed systems that had preceded it. Even in 1997, as
Read more

[Research] Famous Rejected Papers

I've always thought it would be fun to compile a list of famous rejected research papers, ones that later turned out to be highly influential. For example, in My Life as a Quant , the author tells the story of how the famous Black-Scholes paper (which describes how options should be priced) was rejected several times. The work eventually led to a Nobel Prize in economics. (Yes, I know, there technically is no Nobel Prize in economics). Then there's George Akerlof 's work on asymmetric information . I don't recall exactly, but I think the reviewers thought it was too simplistic. It also led to a Nobel Prize in econ. And then there's Tim Berners-Lee 's original paper on the World Wide Web. He describes his experiences in his book Weaving the Web . I think it was submitted to a hypertext conference, but was accepted only as a demo. I'm guessing reviewers didn't see much novelty in the work, which probably was correct from a research perspective.
Read more