MasterSplinter Posted January 3, 2018 Share Posted January 3, 2018 Haven't been around in a bit but still actively use babylon for a lot of demos... Has anyone messed around with this yet? https://github.com/AssemblyScript/assemblyscript Over the past few months I've found myself breaking web vs native rules left and right switching over to web assembly. Just curious if anyone else here has been experimenting with transpiling babylon. -Patrick JackFalcon 1 Quote Link to comment Share on other sites More sharing options...
JackFalcon Posted January 3, 2018 Share Posted January 3, 2018 Hey Patrick... While, didn't transpile, did figure out how to re-animate ar.js into babylon for AR. Works fine. The jsartoolkit underneath was a super big wasm blob. Always dreamed of starting from that side. Like +1, for "breaking web vs native rules"... I know some radiated turtles...looking for a start. Care to share steps? Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 3, 2018 Author Share Posted January 3, 2018 Jsartoolkit really is only opencv 2.4 and aruco. It’s quite old I got opencv 3.4 to transpile using Ubuntu system headers ninja build system and newest version of emscripten. Really Ubuntu is the secret sauce will break on Mac or windows. Was hoping assembly script had legs cause c++ is painful. Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 3, 2018 Author Share Posted January 3, 2018 9 hours ago, aFalcon said: Hey Patrick... While, didn't transpile, did figure out how to re-animate ar.js into babylon for AR. Works fine. The jsartoolkit underneath was a super big wasm blob. Always dreamed of starting from that side. Like +1, for "breaking web vs native rules"... I know some radiated turtles...looking for a start. Care to share steps? Piggybacking off that here's what disney did with their markers: https://next.reality.news/news/disney-has-figured-out-make-ar-content-react-real-world-obstacles-0181601/ Attach collider to marker and ragdoll your AR critter. brianzinn and JackFalcon 2 Quote Link to comment Share on other sites More sharing options...
brianzinn Posted January 3, 2018 Share Posted January 3, 2018 Patrick, Sorry to go off-topic as I haven't tried AssemblyScript compiler. I did briefly browse the assemblyscript compiler tests, but too hard to tell from that how far along the support is. Did you get babylonJS working with openCV 3.4 or with non-ArUco markers? Looks like AR.js is using ThreeJS webglrenderer even for BabylonJS demo. I am interested in more recent WebAssembly starting points for BabylonJS AR with no THREE dependencies... thanks. Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 3, 2018 Author Share Posted January 3, 2018 i did in fact. my translation matrix data was slightly off but i was able to use any image as a marker and get the correct rotation matrix data. i moth balled the project because of performance issues but found a solution to that by processing the images in a compute shader. ahem gpu.js i firmly believe arkit/arcore can run in a web browser at native speed. brianzinn 1 Quote Link to comment Share on other sites More sharing options...
JackFalcon Posted January 3, 2018 Share Posted January 3, 2018 This is great stuff. You guys rawk. Hold on catching up. <out of likes again/> ... Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 4, 2018 Author Share Posted January 4, 2018 at some point this year ill try and get something released you can play with. after seeing the disney demo id like merge slam tracking and marker tracking. but quite a few bugs to fix till i have something for release. Quote Link to comment Share on other sites More sharing options...
JackFalcon Posted January 4, 2018 Share Posted January 4, 2018 @MasterSplinter afalcon is an old c++ guy... emscripten, Ubuntu... +1 for the tip. "Hoping Assembly script has legs"... <--Mental-Note-->. ... "AssemblyScript Compiler" thx +1 Mr. @brianzinn 3 hours ago, brianzinn said: AR.js is using ThreeJS webglrenderer even for BabylonJS demo. "It's all true... all of it!" - Han Solo THREE Dependencies was removed, a couple quick examples exist... happy to post...please ask. ... [dual-rendering][then shut off the camera][Mr. Jerome did make the change, and a solo babylon ar.js is ....beyond the outer rim]... ...[but the more recent suggestion is also good - no time, need to do both].... ... "Collider to marker"... ah jeez. Nice! Yep that's all it is ... lol. Good call. -> gpu.js ah,k. (my translation matrix... was also slightly off, Jerome froze... it. That seemed to work. Dunno why.) brianzinn 1 Quote Link to comment Share on other sites More sharing options...
JackFalcon Posted January 4, 2018 Share Posted January 4, 2018 1 hour ago, MasterSplinter said: i firmly believe arkit/arcore can run in a web browser at native speed. Very cool. With you guyz... Ready to move on that, in ~like~ a month... Have a little node server needs crankin out and taxes (stuf like that). Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 4, 2018 Author Share Posted January 4, 2018 thats good to know. i figured the translation related to opencv scale vs webgl scale Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 4, 2018 Author Share Posted January 4, 2018 1 minute ago, aFalcon said: Very cool. With you guyz... Ready to move on that, in ~like~ a month... Have a little node server needs crankin out and taxes (stuf like that). Well theres a paper published by somw georgia tech students that combines slam and gyroscope to return the camera pose estimation. just need to turn it into cpp code. Quote Link to comment Share on other sites More sharing options...
JackFalcon Posted January 4, 2018 Share Posted January 4, 2018 Cool like it. Pose estimations... neat thing. Interesting, @Mostafa Kaouri shared a thesis: 136880_oberhofer_christoph_2012.pdf and a solution, took a dive, it looks good to me... in this thread: mkaouri 1 Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 4, 2018 Author Share Posted January 4, 2018 just to show you this is not a pipe dream brianzinn, focomoso and JackFalcon 3 Quote Link to comment Share on other sites More sharing options...
brianzinn Posted January 4, 2018 Share Posted January 4, 2018 @MasterSplinter check out the comments on this recent issue "Port to asm.js/webassembly, is it worth?": https://github.com/BabylonJS/Babylon.js/issues/3248 JackFalcon 1 Quote Link to comment Share on other sites More sharing options...
JackFalcon Posted January 4, 2018 Share Posted January 4, 2018 MS: +1 for Plant growth out of eyeballs, and scurry Vader really cool... BZ: great read on that issue. Pretty much ANSWER... :). Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 4, 2018 Author Share Posted January 4, 2018 1 hour ago, brianzinn said: @MasterSplinter check out the comments on this recent issue "Port to asm.js/webassembly, is it worth?": https://github.com/BabylonJS/Babylon.js/issues/3248 omg this is the dirty dirt.... ty for showing me this. Quote Link to comment Share on other sites More sharing options...
brianzinn Posted January 4, 2018 Share Posted January 4, 2018 yes, that's the dirt! if you want a hand make sure to reach out. i can definitely make time for this. JackFalcon 1 Quote Link to comment Share on other sites More sharing options...
MasterSplinter Posted January 5, 2018 Author Share Posted January 5, 2018 going off topic on my own thread i got optical flow on the original ptam working using version of opencv 3.4. i havent ported to wasm cuz i dont have the camera pose... but the math works! arkit is for the peasants! brianzinn and GameMonetize 2 Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.