AMD released information on their Exascale Heterogenous Processor (EHP) for Supercomputers, quite a few words eh ? Basically you 'could' read EHP as APU on a more advanced scale. EHP actually shares similarities with the recently launched Fiji chip with it's interposer and on-die memory.
EHP a die with several components mounted into it in the form of a number of processor cores, then a GPGPU unit all combined with the interposer which bridges the die towards a maximum of 32 GB of HBM2 memory, that would be on-package this on the EHP/APU.
if you combined the CPU/GPU with GPGPU functionality and the heaps of memory bandwidth, you can imagine that would be a pretty powerful solution for super-computing.
It is rumored that the processor side of things will get 32 cores, we think Zen micro-architecture here with eight "Zen" quad-core units. AMD is aiming to release the first engineering sample of this what will be a massive chip by 2016-17.