Jump to content

BABYLON.Augmented Reality ...


JackFalcon
 Share

Recommended Posts

  • 4 weeks later...

YouAugment, a free augmented reality app creator that was developed with BabylonJs 3D Engine and jsartoolkit.

 



- What’s YouAugment AR app creator?
AR app creator is a web enabled application that can help anyone to create their AR app for free and without coding skills. It can work on your iphone/ipad or android enabled devices. It's highly depends on BabylonJs.

- Why I made it?
I’m looking for everyone to get the absolute benefit from Augmented Reality without pain on coding or paying for high cost licenses.

- Why it’s free?
I made it free for you to be part of AR community and let you engage your customers, family or friends to experience the AR technology for any purpose you are looking for such as increasing sales, education, or entertainment.

- How do I support it?
It’s my passion to continue improving and supporting the youaugment AR app creator from my income and interested investors.

- Contact us
If you’ve any question, please feel free to contact me on [email protected]

Link to comment
Share on other sites

  • 3 months later...
  • 4 weeks later...

Has anyone got this working on iPhone?

I'm running iOS 11.3.1 and I can't get this working, but I have tested other webRTC demos and they work fine.

I tried using artoolkit.debug.js so I can get the actual line of the error but if I use that file I get:

Invalid asm.js: Invalid member of stdlib artoolkit.debug.js:6963

 

I've created a copy of the Babylonjs NFT example here https://preview.punkoffice.com/ar/

When I run on my iPhone 6+ I get this error

[Error] Failed to load resource: the server responded with a status of 404 (Not Found) (babylon.standardRenderingPipeline.js.map, line 0)

then when I touch the screen I get this error

[Error] Unhandled Promise Rejection: TypeError: Type error
createObjectURL (artoolkit.min.js:1:14551)
success (artoolkit.min.js:1:14551)
promiseReactionJob

Does anyone know what I'm doing wrong? Maybe @mkaouri knows?

Link to comment
Share on other sites

First, I do not think this ARToolkit uses webRTC at all.  iOS has has implemented webRTC in very recent versions, as you confirm.  AR has nothing to with "video chat", or the otherwise deal with bi-directional video transfer.  Not that it might not be able to handle all local camera streams, but your testing against other webRTC applications is flawed, if this artoolkit does not use it.

I can not find webRTC mentioned in the repo's readme.  If you look at the source, you see they are using navigator.getUserMedia media streaming.  Probably not directly helping, other than to say I think your assumptions might be wrong, & that is Never good.

Link to comment
Share on other sites

9 minutes ago, JCPalmer said:

First, I do not think this ARToolkit uses webRTC at all.  iOS has has implemented webRTC in very recent versions, as you confirm.  AR has nothing to with "video chat", or the otherwise deal with bi-directional video transfer.  Not that it might not be able to handle all local camera streams, but your testing against other webRTC applications is flawed, if this artoolkit does not use it.

I can not find webRTC mentioned in the repo's readme.  If you look at the source, you see they are using navigator.getUserMedia media streaming.  Probably not directly helping, other than to say I think your assumptions might be wrong, & that is Never good.

WebRTC implements three APIs:

  • MediaStream (aka getUserMedia)
  • RTCPeerConnection
  • RTCDataChannel

https://www.html5rocks.com/en/tutorials/webrtc/basics/

https://medium.com/@leemartin/hello-webrtc-on-safari-11-e8bcb5335295

https://github.com/processing/p5.js/issues/2146

 

 

Link to comment
Share on other sites

  • 2 weeks later...
On 5/23/2018 at 4:38 PM, ozRocker said:

Has anyone got this working on iPhone?

I'm running iOS 11.3.1 and I can't get this working, but I have tested other webRTC demos and they work fine.

I tried using artoolkit.debug.js so I can get the actual line of the error but if I use that file I get:


Invalid asm.js: Invalid member of stdlib artoolkit.debug.js:6963

 

I've created a copy of the Babylonjs NFT example here https://preview.punkoffice.com/ar/

When I run on my iPhone 6+ I get this error


[Error] Failed to load resource: the server responded with a status of 404 (Not Found) (babylon.standardRenderingPipeline.js.map, line 0)

then when I touch the screen I get this error


[Error] Unhandled Promise Rejection: TypeError: Type error
createObjectURL (artoolkit.min.js:1:14551)
success (artoolkit.min.js:1:14551)
promiseReactionJob

Does anyone know what I'm doing wrong? Maybe @mkaouri knows?

 

Hi @ozRocker

The iOS 11 works with Navigator.mediaDevices.getUserMedia, which is already configured in the Artoolkit.min.js. 

That sounds great... but still missing the video attribute "playsinline".

So, either you configure the attribute playsinline in the artoolkit.min.js after var video=document.createElement('video'); or replace  var video .... with var video=document.getElementById('video') and add the following video tag in the HTML:

<video  id="video" autoplay playsinline></video>

And make renderCanvas overlay on that video tag using position: fixed with z-index: -100 style. use this style on both tags: canvas and video.

If video camera still not showing, it could be from the video source configuration. In the 'var success = function(stream)' replace the video.src = window.URL.createObjectURL(stream) with video.srcObject = stream

If the iOS 11 showing the front camera, you've to make sure that faceMode constraint in artoolkit.min.js is set to 'environment' to use the back camera of your mobile.

Hope this will work.

 

Link to comment
Share on other sites

  • 3 weeks later...
  • 3 months later...
  • 2 months later...

hi @MarianG, I didn't really follow the AR.js - from my recollection it was relying on another engine renderer.  If you are not specifically after AR.js, do the jsartookit examples no longer work https://github.com/mkaouri/jsartoolkit5?

Also, BabylonJS 4.0 has AR via WebXR, if that meets your needs (it's very early market for browser support).  I haven't been following close enough, but otherwise if you want a demo of that (like magic window) check here: https://github.com/BabylonJS/Babylon.js/issues/3899

Link to comment
Share on other sites

Thanks @brianzinn.
Actualy I checked webXR support from babylonjs, and I faced some issues, or I didn't understand very well how it work,...maybe I'll open a different topic for this. And I think I'll focus on this once webXR will be by default enabled on browser.
 I tried jsartoolkit5, and I'm faceing some problems with this too ? in one device is opening front camera, in other is opening back, and sometimes I lost camera for some reasons, I have to deep learn about this.
 ... and I have remembered about this topic and I wanted to check some links from here but most of them are NotFound. I hoped it'll be faster to do a simple example?

Link to comment
Share on other sites

  • 4 weeks later...

looking into this...

babylonjs is no longer at this location on Ar.js:

https://github.com/jeromeetienne/AR.js/tree/dev/babylon.js

@jeromeetienne, friend, any info on AR.js + Babylon status?

Also @brianzinn is right - original solution cross-matrix calculations (because I don't understand matrix inversions..), but then jerome etienne figured out how to make them babylon specific (details above).

Old, but still have a backup if needed...

Link to comment
Share on other sites

On 12/28/2018 at 10:31 PM, JackFalcon said:

looking into this...

babylonjs is no longer at this location on Ar.js:

https://github.com/jeromeetienne/AR.js/tree/dev/babylon.js

@jeromeetienne, friend, any info on AR.js + Babylon status?

Also @brianzinn is right - original solution cross-matrix calculations (because I don't understand matrix inversions..), but then jerome etienne figured out how to make them babylon specific (details above).

Old, but still have a backup if needed...

Hey uh, theres a new forum, not sure if you knew that.  Maybe create a new post with this linked to it so we dont loose all this KNOWLEDGE

https://forum.babylonjs.com/

Link to comment
Share on other sites

... Wingnut to the rescue. Great to see you and happy holidays.

Thank you for the assist Dylan. I was off tracking down some leads.

And with help from friends... bird finds new forum. Thanks. : )

Yes -> there is important news around PWA - it will be big for us. 

See you on the other side.

~jf

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...
 Share

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...