There should probably be a scene.pickWithRayToRef so that we can use Ray.TransformToRef.