MIT researchers build ultrahigh-definition Quad HD (4K) TV chip
February 21, 2013

A new video-coding standard — known variously as ultrahigh-def (UHD), Quad HD or 4K — promises four times the resolution of today’s high-definition video (credit: MIT)
At the International Solid-State Circuits Conference this week, MIT researchers unveiled their own Quad HD video chip design.
Quad HD is also known as 4K and ultrahigh-definition (UHD). The new Quad HD video standard enables a fourfold increase in the resolution of TV screens.
At the Consumer Electronics Show (CES) in January, several manufacturers debuted new UHD models.
There is no UHD content yet, but the Japanese government plans to launch the world’s first 4K TV broadcast in July 2014, from communications satellites, followed by satellite broadcasting and ground digital broadcasting, NBC News Gadget Box has reported.
Nonetheless, 4K TVs are now on sale by Japanese makers including Sony, Panasonic and Sharp. Other manufacturers include South Korea’s LG Electronics.
HEVC

A key to efficient video compression is predicting future video frames on the basis of past ones. This diagram concerns “intra angular prediction.”
(Credit: ISO)
UHD also requires a new video-coding standard, known as high-efficiency video coding, or HEVC (aka or H.265).
Although the MIT chip isn’t intended for commercial release, its developers believe that the challenge of implementing HEVC algorithms in silicon helps illustrate design principles that could be broadly useful.
Moreover, “because now we have the chip with us, it is now possible for us to figure out ways in which different types of video data actually interact with hardware,” says Mehul Tikekar, an MIT graduate student in electrical engineering and computer science and one of the paper’s co-authors.
How HEVC works
Like older coding standards, the HEVC standard exploits the fact that in successive frames of video, most of the pixels stay the same. Rather than transmitting entire frames, it’s usually enough for broadcasters to transmit just the moving pixels, saving a great deal of bandwidth. The first step in the encoding process is thus to calculate “motion vectors” — mathematical descriptions of the motion of objects in the frame.
On the receiving, end, however, that description will not yield a perfectly faithful image, as the orientation of a moving object and the way it’s illuminated can change as it moves. So the next step is to add a little extra information to correct motion estimates that are based solely on the vectors. Finally, to save even more bandwidth, the motion vectors and the corrective information are run through a standard data-compression algorithm, and the results are sent to the receiver.
The new chip performs this process in reverse. It was designed by researchers in the lab of Anantha Chandrakasan, the Joseph F. and Nancy P. Keithley Professor of Electrical Engineering and head of the MIT Department of Electrical Engineering and Computer Science.
The chip’s first trick for increasing efficiency is to “pipeline” the decoding process: a chunk of data is decompressed and passed to a motion-compensation circuit, but as soon as the motion compensation begins, the decompression circuit takes in the next chunk of data. After motion compensation is complete, the data passes to a circuit that applies the corrective data and, finally, to a filtering circuit that smooths out whatever rough edges remain.
Fine-tuning
Pipelining is fairly standard in most video chips, but the MIT researchers developed a couple of other tricks to further improve efficiency. The application of the corrective data, for instance, is a single calculation known as matrix multiplication. A matrix is just a big grid of numbers; in matrix multiplication, numbers in the rows of one matrix are multiplied by numbers in the columns of another, and the results are added together to produce entries in a new matrix.
“We observed that the matrix has some patterns in it,” Tikekar explains. In the new standard, a 32-by-32 matrix, representing a 32-by-32 block of pixels, is multiplied by another 32-by-32 matrix, containing corrective information. In principle, the corrective matrix could contain 1,024 different values. But the MIT researchers observed that, in practice, “there are only 32 unique numbers,” Tikekar says. “So we can efficiently implement one of these [multiplications] and then use the same hardware to do the rest.”
Similarly, Chiraag Juvekar, another graduate student in Chandrakasan’s group, developed a more efficient way to store video data in memory. The “naive way,” he explains, would be to store the values of each row of pixels at successive memory addresses. In that scheme, the values of pixels that are next to each other in a row would also be adjacent in memory, but the value of the pixels below them would be far away.
In video decoding, however, “it is highly likely that if you need the pixel on top, you also need the pixel right below it,” Juvekar says. “So we optimize the data into small square blocks that are stored together. When you access something from memory, you not only get the pixels on the right and left, but you also get the pixels on the top and bottom in the same request.”
Chandrakasan’s group specializes in low-power devices, and in ongoing work, the researchers are trying to reduce the power consumption of the chip even further, to prolong the battery life of quad-HD cell phones or tablet computers.
One design modification they plan to investigate, Tikekar says, is the use of several smaller decoding pipelines that work in parallel. Reducing the computational demands on each group of circuits would also reduce the chip’s operating voltage.
Comments (13)
by Scott
Great 4K of crappy content.
by MSOMM2000
As to better than retinal quality displays, I think you are omitting screen size and distance from the viewing screen as issues. 4K will allow for very large screens with intense clarity, even at closer viewing distances.
Similar to HDTV today, a 19′ viewing screen does not seem much different from standard TV with a quaility input. At 50″, the differences are dramatic.
by marco
this is great news. most of us are already watching television for 3000 dollars a year that we used to watch for free with rabbit ears…. god only knows what this will cost us
by Dinoguy1000
“Similarly, Chiraag Juvekar, another graduate student in Chandrakasan’s group, developed a more efficient way to store video data in memory.”
The description of this technique makes it sound like swizzling, which is hardly a new development. He may have developed a new swizzling algorithm, though.
by SmartAndSober
After the Singularity, if you are unaugmented, you will not be able to understand the least bit of technological innovation done by superintelligences, not to mention whether they will be “swizzling”.
by snake0
I contest that at least one of the adjectives in your username is false.
by SmartAndSober
A display that exceeds the visual resolution (allowed by the density of cone cells and disc cells in human eyes) will appear, apparently, in the next few years. To match such high definition, human cyborgization (in this case, of the eyes, the optic nerves and the optic lobes of the cerebrum) must be performed.
I understand that, in initial stages, cyborgs will be seen as alienating outcasts and are not accepted by humans who are not (yet) augmented.
But, I also believe that the stage should take a very short amount of time.
Cyborgs with sufficiently augmented nervous system will doubtlessly and irreversibly control the world.
The unaugmented will live under the mercy of the augmented.
by SmartAndSober
On how our machineries are providing more data than our sensory organs and brain can percieve, I wish to, again, quote Dr Vernor Vinge:
“For me, the superhumanity is the essence of the Singularity. Without that we would get a glut of technical riches, never properly absorbed.”
The inability to “properly absorb” our technologies, in my opinion, is regretably wasteful. For now, I can only fantasize about a world where the potentials of all technologies are used to the fullest.
The most important of all technologies, AGI, with its ability to self-improve and achieve superhumanity, should help actualize what I can only fantasize.
by Gorden Russell
Just imagine what they will do when those sharp Wall Street stock traders get augmented. When the first guy gets a DNA computer in his brain, he will link with the supercomputers at the brokerage houses and perform flash trades all day long using the knowledge he gains from all the big data he can mine all over the world. He will be like Christopher Lambert at the end of “The Highlander” when he knew what was going on everywhere.
The first trader who can do this will end up owning the entire market by the end of trading on his first day.
But what if this guy works for Goldman Sachs or CitiGroup? Who would want to live in a world where they are the Masters of the Universe?
It would be Orwell’s vision of the future of humanity at the end of his book, “1984.” A hobnail boot stamping on a human face.
by SmartAndSober
” Who would want to live in a world where they are the Masters of the Universe? ”
Isn’t this what all sentient beings strive to become? The ideal end of all progress is the domestication of all things.
by Bri
“I know all things, I am all things” the Highlander movie was an interesting premise. They ruined it in subsequent sequels. No I don’t think he woukd be a stock trader.
by gaoptimize
I think what you mean is there is no over-the-network or air UHD content. The good folks at Red.com have been providing cameras for acquisition, software for editing and image processing, and storage and display equipment at 4K for a few years now. Most movies produced today (and the majority shot on Red) can be viewed in 4K at fine cinemas across the country now. Their most recent enabling hardware is a 4K player “Redray” for only $1,500 (comparable in price to BluRay in its first year of availability). Consumer editing software such as Sony Vegas already supports 4K. It is all coming, and coming down in price.
by John N
Correct. 4K video has been around for some time now with cameras from Red Camera and 4K displays have available since last year at least. Sony’s new 4K camera is being released a week from now and will be widely available. And to top it off Gopro released a tiny wearable camera that shoots in 3K for under $500. Not sure what this new 4K sensor introduces anything new other than more efficient video encoding.
The article states that there is no 4K content currently available. This is not true, Youtube already allows for the upload for 4K content and you can find 4K resolution video on Youtube. Also the UHD video spec refers to both 4K video and 8K video.