Sony's Fabs Camera Sensor that Captures 1000fps Super Slow-Mo
Sony announced a new camera sensor for smartphones that will make it possible top capture incredible slow-motion video. The dual-layer CMOS sensor includes 1 GB of DRAM, which Sony says allows the sensor to capture and read images much faster.
Sony claims the sensor can read 19.3-megapixel images in 1/120 of a second, which is four times faster than most of today's sensors. This has two effects. First, the sensor can snag fast-moving subjects without introducing focal plane distortion, and second, the sensor can boost video capture speeds by a factor of eight. Many of today's smartphones capture slow-motion video at 120 frames per second. Sony's new sensor can capture distortion-free, full HD slow-motion at 1000 frames per second, which will greatly expand what filmmakers can do creatively. The sensor itself captures images up to 21.2 megapixels and 4K video.
The sensor takes the conventional two-layered image sensor concept and stacks a third layer of dynamic random access memory, giving the sensor faster readout speeds that can prevent distortion during high-speed photography and record videos at a significantly higher frame rate.
According to Sony, the sensor can read a single image of 19.3 million pixels in just 1/120 of a second – a figure the electronics giant claims is four times faster than the IMX318 sensor it announced almost exactly a year ago.
With the stacked high-speed, low power consumption, high-capacity DRAM, the new sensor can read one still image of 19.3 million pixels in only 1/120 second (approximately 4x faster than conventional products*3), reducing the time lapse for reading each pixel line. This technology minimizes the focal plane distortion*2 in still images that tends to occur when shooting fast-moving subjects on smartphones, which lack a mechanical shutter for controlling exposure time.
Supports shooting of super slow motion movies with a maximum frame rate of 1,000 fps in full HD (1920x1080 pixels)
The high-speed readout capability makes it possible to record up to 1,000 fps (approximately 8x faster than conventional products*3) super slow motion movies in full HD (1920x1080 pixels). Normal speed shooting data and maximum 1,000 fps high-speed shooting data stored on the DRAM are exported from the image sensor for signal processing on an external image signal processor (hereafter referred to as ISP), making it possible to record vibrant movies on a smartphone that seamlessly combine normal speed movies and super slow motion movies. To ensure that users don't miss split-second moments in super slow motion movies, it is possible to adjust settings so that sudden subject movement is automatically detected and high-speed shooting begins. Because high-speed shooting data is stored on the DRAM and output at a normal speed, a conventional ISP can be used.
Sony didn't say when the sensor might be ready for production.
Effective pixel count | 5520 (H) x 3840 (V) 21.2 megapixels | |
---|---|---|
Image size | Diagonal 7.73mm (Type 1/2.3) | |
Unit cell size | 1.22μm (H) x 1.22μm (V) | |
Frame rate | Still images |
|
Movies |
|
|
Reading speed | 8.478 ms (4:3 19.3 megapixels) / 6.962 ms (16:9 17.1 megapixels) | |
Power supply | 2.5V / 1.8V / 1.1V | |
Image format | Bayer RAW | |
Output | MIPI (CSI2) D-PHY 2.2Gbps/lane / C-PHY 2.0Gsps/lane | |
DRAM capacity | 1G bit |
Some quick math show the recording time at full 1000 fps super-slomo is restricted though, roughly four seconds of it. Still, that is seriously imrpessive if this technology end up in a smart-phone.
Senior Member
Posts: 2898
Joined: 2013-03-10
I haven't been following the camera technology developments for a number of years now. Are smartphones actually better than real cameras these days in everything but optics? Obviously optics will continue to suck considering how thin phones are. Sensors need to be tiny for the same reason, restricting the amount of light they can receive. But I'd suppose compact cameras have no bigger sensors even if they had vastly superior optics.
Senior Member
Posts: 4861
Joined: 2008-12-09
So what is the hardware compression capable of? There's no way that thing would dump 45Gb/s to the processor because there's no way a phone processor could handle that. Are they saying that 1Gb/s is the datarate at 1080p@960fps?
A quick google shows that 1080p@60fps = 2.78Gb/s. So if it scales linearly it's about 45Gb/s which is about 5.6GB/s. So if you magically had 64GB of storage free on your phone, that's 11 seconds worth of video. Plus there's no way you could feed your storage at that rate, so what's their magic?
Senior Member
Posts: 1454
Joined: 2008-07-16
You're probably talking about those cheapo flea market pocket cameras... otherwise this statement is grossly false.
For example, my Panasonic DMC-G7 (mirrorless, micro 4/3) for example can run circles at lightspeed around any high-end phone when it comes to picture quality.
Senior Member
Posts: 746
Joined: 2008-03-03
So what is the hardware compression capable of? There's no way that thing would dump 45Gb/s to the processor because there's no way a phone processor could handle that. Are they saying that 1Gb/s is the datarate at 1080p@960fps?
A quick google shows that 1080p@60fps = 2.78Gb/s. So if it scales linearly it's about 45Gb/s which is about 5.6GB/s. So if you magically had 64GB of storage free on your phone, that's 11 seconds worth of video. Plus there's no way you could feed your storage at that rate, so what's their magic?
Probly an ASIC.
Junior Member
Posts: 17
Joined: 2013-12-26
1Gbit = 128MB