Thanks for the hint! I never heard about the cone step mapping. Sounds interesting! But i think the future lies in tesselation. So you get things right (shadow, silhouette, deformation) without any artifacts. But i really like to know what else is possible. Thanks for your comment!
cone step meapping is very ineffective pipeline-wise because of its enormous pre-calculation time and the increased memory footprint is not the best solution either.
what the unreal docs describe seems to be a simple Steep Parallax Mapping (only a primary linear stepping pass) and not a real Parallax Occlusion Mapping (which would use a secant-method as the second pass to smooth out stepping artifacts)
the problem all of these fake-displacement techniques have in common is the lack of real silhouette, the surface is flat nonetheless and you will get artifacts at grazing view angles.
the future might be tesselation, but not necessarily in the form of a heightfield displacement. instead use the "classic" method and make the pins round by tesselation or stuff like that
It's so interesting to see, how important a silhouette is. :) At the end of the UDK docs is a small experiment with parallax+silhouette but you're right, faking isn't the future...i guess :D
Voxels are 3D grid. You can make overhang with them, unlike heightmap. And make hole easily, without retessellating the mesh.
The sprite method is nice; remind me of Warcraft 3. What if we had a 3D texture, the third dimension being the orientation from the camera? And what if we had a normal map to shadow the stud, like this: http://www.youtube.com/watch?v=-Q6ISVaM5Ww
Interesting. When i was getting the first knowledge about voxels it was about Outcast and there you could not have overhangs or anything like this. Maybe the voxel tech developed more than i thought :)
Warcraft 3? They did imposters? Or do you just mean sprites?
Oh interesting video! Remembers me of the engine for the kickstarter project "Project Eternity". A classic 2D game but with enhanced tech like normalmaps and stuff like this :)
Voxel literally means "volumetric pixel". Saying voxels can't do overhangs is like saying pixels are a line that curves.
An example of a popular game that uses voxels is Minecraft, it uses very large voxels that are not smoothed. Another example is Atomontage engine https://www.youtube.com/watch?v=VYfBrNOi9VM
Outcast only used height-map information for the voxel terrain, so this technique is not able to render caves and the like. It's a reduction of a hell of a lot of information you would need to keep in memory if you really use the third dimension in your voxel grid.
so each voxel in outcast has a location on the 2d grid and a height. you never have two or more voxels on top of each other
First, thanks for your curiosity and sharing all this with us :)
On the Imposters method :
From my understanding, one of the limitations lies in the view angle. As long as the view angle of the imposter billboard is about the same as the view angle that was used to bake the texture, it's fine. But when the difference between these view angles is too extreme, the trick is revealed.
How would you takle that issue ? Does a billboard angle controlled shader could fade in-between 3 texture "states" (top, mid, side) ? or would that just feel super weird ?
Lighting, as it is baked and always faces the camera, is another issue as well, though you could still cheaply "light" these billboards in real time with some tricks, but "stylistically" there should be constraints when rendering the texture so it adapts visually :) The lighting issue doesn't show in your example as the light is frontal and not moving, only the object is.
I believe LOD could also be an option : - Closer studs are geometry - Further are billboards/imposters (you still have silouhettes) - Even further are flat texture
This means that all level geometry should be cut into pieces to allow proper LOD swapping. What do you think about that ?
When talking about these options, I have in mind mobile as well. For next gen, tessellation feels like the future, it's powerful, optimized and flexible.
Hi Ben, thank you very much for your long post! :)
To be honest, my presentation isn't 100% correct: you would render one imposter for every of these sprites. This means: when you're near to them, it doesn't make sense at all! But: you don't update them in real time a soon as they are a bit more far away. So for far away objects you could see you update them when the camera angle changed 5° and maybe for further objets only when it changed 10° or something like this.
In my GIF i used the same stud-rendering for all sprites because it's just a tiny fake and not a real imposter :D i just tried to present the way of using renderd textures on sprites.
If you want to know more about this, feel free to read the linked article (i linked the "Imposters" word to it) where this tech is explained very well. They bake even the shadow in the texture! Awesome :)
Yeah, tesselation is maybe the best way of doing it. And on mobile maybe doing it without geometry and only flat textures since the displays are pretty small :D LoD would surely be possible, but then for the whole LEGO plate and not for every single stud i guess.
Thanks for all your thinking and questioning :) Really cool to "meet" people asking a lot like me :)
rendering the impostors for such small things which always look the same would be a waste of rendering time.
you know beforehand all the variations that this thingy can look. it looks the same from all left-right variations of view, so you only need to capture the variation of looking more from top or below. which would be 360 degree
you don't need the below part, because you never will see it, halfing it to a hemisphere, 180 degree. again, each half of it might look the same, you might only need to flip the texture on the height axis, reducing the required coverage to 90 degree.
setting a variation of 5 degree as the angle that requires a new texture, you would end up with 90/5=18 textures.
so you could pre render a flipbook texture with the about 18 texture to cover (nearly) every possible view you will ever have of such a pin.
lighting could be done using some fancy converting-the-normal-into-wordl-space stuff, if you don't use deferred shading anyway.
definitely an interesting idea, using impostors for this ;)
Thank's for the comment! Yeah...pre-rendering the stuff would also be an idea, that's right! I just mentioned imposters because i wanted to drop some "next-gen-stud"-ideas :D pre-rendered stuff is totally usefull but i thought in my case felt a bit last-gen. hehe.
of course that's not true, especially on the effect side (e.g. explosions) there's pre-rendered stuff used all the time :)
For the pixel displacement you could also use cone step mapping, which doesn't have stairstepping effects.
ReplyDeleteThanks for the hint! I never heard about the cone step mapping. Sounds interesting! But i think the future lies in tesselation. So you get things right (shadow, silhouette, deformation) without any artifacts. But i really like to know what else is possible. Thanks for your comment!
Deletecone step meapping is very ineffective pipeline-wise because of its enormous pre-calculation time and the increased memory footprint is not the best solution either.
Deletewhat the unreal docs describe seems to be a simple Steep Parallax Mapping (only a primary linear stepping pass) and not a real Parallax Occlusion Mapping (which would use a secant-method as the second pass to smooth out stepping artifacts)
the problem all of these fake-displacement techniques have in common is the lack of real silhouette, the surface is flat nonetheless and you will get artifacts at grazing view angles.
the future might be tesselation, but not necessarily in the form of a heightfield displacement. instead use the "classic" method and make the pins round by tesselation or stuff like that
It's so interesting to see, how important a silhouette is. :) At the end of the UDK docs is a small experiment with parallax+silhouette but you're right, faking isn't the future...i guess :D
DeleteVoxels are 3D grid. You can make overhang with them, unlike heightmap. And make hole easily, without retessellating the mesh.
ReplyDeleteThe sprite method is nice; remind me of Warcraft 3.
What if we had a 3D texture, the third dimension being the orientation from the camera? And what if we had a normal map to shadow the stud, like this: http://www.youtube.com/watch?v=-Q6ISVaM5Ww
Interesting. When i was getting the first knowledge about voxels it was about Outcast and there you could not have overhangs or anything like this.
DeleteMaybe the voxel tech developed more than i thought :)
Warcraft 3? They did imposters? Or do you just mean sprites?
Oh interesting video! Remembers me of the engine for the kickstarter project "Project Eternity". A classic 2D game but with enhanced tech like normalmaps and stuff like this :)
Voxel literally means "volumetric pixel". Saying voxels can't do overhangs is like saying pixels are a line that curves.
DeleteAn example of a popular game that uses voxels is Minecraft, it uses very large voxels that are not smoothed. Another example is Atomontage engine https://www.youtube.com/watch?v=VYfBrNOi9VM
You're right...thanks man! :)
DeleteOutcast only used height-map information for the voxel terrain, so this technique is not able to render caves and the like. It's a reduction of a hell of a lot of information you would need to keep in memory if you really use the third dimension in your voxel grid.
Deleteso each voxel in outcast has a location on the 2d grid and a height. you never have two or more voxels on top of each other
Thanks for clearing out. Now it's clear to me. Voxel CAN be "3D" but for optimization purposes they did it only "2D".
DeleteHi Simon !
ReplyDeleteFirst, thanks for your curiosity and sharing all this with us :)
On the Imposters method :
From my understanding, one of the limitations lies in the view angle. As long as the view angle of the imposter billboard is about the same as the view angle that was used to bake the texture, it's fine. But when the difference between these view angles is too extreme, the trick is revealed.
How would you takle that issue ?
Does a billboard angle controlled shader could fade in-between 3 texture "states" (top, mid, side) ? or would that just feel super weird ?
Lighting, as it is baked and always faces the camera, is another issue as well, though you could still cheaply "light" these billboards in real time with some tricks, but "stylistically" there should be constraints when rendering the texture so it adapts visually :)
The lighting issue doesn't show in your example as the light is frontal and not moving, only the object is.
I believe LOD could also be an option :
- Closer studs are geometry
- Further are billboards/imposters (you still have silouhettes)
- Even further are flat texture
This means that all level geometry should be cut into pieces to allow proper LOD swapping. What do you think about that ?
When talking about these options, I have in mind mobile as well. For next gen, tessellation feels like the future, it's powerful, optimized and flexible.
Thanks again for your work !
ben
Hi Ben, thank you very much for your long post! :)
DeleteTo be honest, my presentation isn't 100% correct: you would render one imposter for every of these sprites. This means: when you're near to them, it doesn't make sense at all!
But: you don't update them in real time a soon as they are a bit more far away. So for far away objects you could see you update them when the camera angle changed 5° and maybe for further objets only when it changed 10° or something like this.
In my GIF i used the same stud-rendering for all sprites because it's just a tiny fake and not a real imposter :D i just tried to present the way of using renderd textures on sprites.
If you want to know more about this, feel free to read the linked article (i linked the "Imposters" word to it) where this tech is explained very well. They bake even the shadow in the texture! Awesome :)
Yeah, tesselation is maybe the best way of doing it. And on mobile maybe doing it without geometry and only flat textures since the displays are pretty small :D
LoD would surely be possible, but then for the whole LEGO plate and not for every single stud i guess.
Thanks for all your thinking and questioning :) Really cool to "meet" people asking a lot like me :)
rendering the impostors for such small things which always look the same would be a waste of rendering time.
Deleteyou know beforehand all the variations that this thingy can look. it looks the same from all left-right variations of view, so you only need to capture the variation of looking more from top or below. which would be 360 degree
you don't need the below part, because you never will see it, halfing it to a hemisphere, 180 degree.
again, each half of it might look the same, you might only need to flip the texture on the height axis, reducing the required coverage to 90 degree.
setting a variation of 5 degree as the angle that requires a new texture, you would end up with 90/5=18 textures.
so you could pre render a flipbook texture with the about 18 texture to cover (nearly) every possible view you will ever have of such a pin.
lighting could be done using some fancy converting-the-normal-into-wordl-space stuff, if you don't use deferred shading anyway.
definitely an interesting idea, using impostors for this ;)
-alfalfasprossen
Thank's for the comment! Yeah...pre-rendering the stuff would also be an idea, that's right! I just mentioned imposters because i wanted to drop some "next-gen-stud"-ideas :D pre-rendered stuff is totally usefull but i thought in my case felt a bit last-gen. hehe.
Deleteof course that's not true, especially on the effect side (e.g. explosions) there's pre-rendered stuff used all the time :)