VisionforGraphics3DMotionCapture圖形的三維運(yùn)動(dòng)捕捉視覺

上傳人:wux****ua 文檔編號:16137462 上傳時(shí)間:2020-09-20 格式:PPT 頁數(shù):25 大小:3.58MB
收藏 版權(quán)申訴 舉報(bào) 下載
VisionforGraphics3DMotionCapture圖形的三維運(yùn)動(dòng)捕捉視覺_第1頁
第1頁 / 共25頁
VisionforGraphics3DMotionCapture圖形的三維運(yùn)動(dòng)捕捉視覺_第2頁
第2頁 / 共25頁
VisionforGraphics3DMotionCapture圖形的三維運(yùn)動(dòng)捕捉視覺_第3頁
第3頁 / 共25頁

下載文檔到電腦,查找使用更方便

9.9 積分

下載資源

還剩頁未讀,繼續(xù)閱讀

資源描述:

《VisionforGraphics3DMotionCapture圖形的三維運(yùn)動(dòng)捕捉視覺》由會(huì)員分享,可在線閱讀,更多相關(guān)《VisionforGraphics3DMotionCapture圖形的三維運(yùn)動(dòng)捕捉視覺(25頁珍藏版)》請?jiān)谘b配圖網(wǎng)上搜索。

1、Today,Project 2 Recap 3D Motion Capture Marker-based Video Based Mocap demo on Monday (2/26) Image segmentation and matting,Match Move Recap,Difficulty and Effort Varied 6 used direct linear method 3 used Tomasi-Kanade 1 used Zhangs approach 2 used home-brewed methods Data collection very important-

2、-getting good video makes all the difference Tracking was a challenge Discrete search more reliable than Lucas-Kanade for some Need to restart the tracker periodically Took a lot of fiddling with parameters to get right Rendering RenderX bugs Some used openGL, java, but not required Calibration near

3、ly co-planar features a problem,Match Move Results,Direct Linear Method Factorization Zhangs method,Motion Capture,From “Final Fantasy” (Columbia Pictures) out Summer 2001,How is it Done?,Place ping pong balls on an actor Track the balls in 2D for each camera Triangulate to compute 3D positions Labe

4、l markers Compute body pose inverse kinematics (IK) Do it all at up to 240 Hz !!! Mocap demo at end of class today,Today: how to do this without markers,Hand Mocap,Capturing hands and fingers J. Rehg, T. Kanade, Model-based tracking of self-occluding articulated objects, In Proceedings of Internatio

5、nal Conference on Computer Vision, pages 612-617, Cambridge, MA, 1995. pdf, 300K Ying Wu and Thomas S. Huang, Capturing Articulated Hand Motion: A Divide-and-Conquer Approach, In Proc. IEEE Intl Conf. on Computer Vision (ICCV99), pp.606-611, Greece, Sept., 1999.,Heads and Faces,Capturing Faces Essa.

6、 I., and A. Pentland. Coding, Analysis, Interpretation and Recognition of Facial Expressions., Volume 19 (7), IEEE Computer Society Press, July, 1997. K. Toyama and G. Hager, Incremental Focus of Attention for Robust Vision-Based Tracking,IJCV(35), No. 1, November 1999, pp. 45-63. Douglas DeCarlo an

7、d Dimitris Metaxas, Optical Flow Constraints on Deformable Models with Applications to Face Tracking. In IJCV, July 2000, 38(2), pp. 99-127. PDF (695K),Human Body,Focus of today Search over 3D pose Gavrila & Davis 3D tracking Bregler & Malik Single view motion capture Leventon & Williams Brand,Gavri

8、la and Davis,D. M. Gavrila and L. S. Davis, 3-D Model-based Tracking of Humans in Action: a Multi-view Approach, Proc. of IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, U.S.A., 1996.,Gavrila and Davis,Step 1: Edge Detection,Step 2: Background Edge Subtraction,Step 3: Sear

9、ch over 3D Parameters,Search for 3D body pose parameters Model body as segments (superquadrics), 22 DOF Discrete search over DOFs Metric: projected model should match edges Speedup: use distance transform of edge image,Divide and Conquer,Searching all pose parameters simultaneously is too hard,Stage

10、 1:torso position,Stage 2:arm positions,Stage 3:leg positions,Bregler and Malik,Tracking approach Initialize 3D model in first frame Track over subsequent frames C. Bregler and J. Malik, Tracking People with Twists and Exponential Maps, Proc. IEEE CVPR 1998,How? Our old friend: Lukas and Kanade!!! B

11、ut now (u,v) are functions of and,3D Tracking,Lets start with tracking a single rigid object We know 3D position X, orientation R in first frame Solve for change in 3D position and orientation,How? Our old friend,Problem: equation is not linear in and Solution (Bregler and Malik): use twist repres

12、entation,Twist Representation Murray, Li, Sastry,Any rigid transformation may be expressed as a rotation about an axis and translation along that same axis w encodes the axis direction and rotation angle n the location of axis and amount of translation,Kinematic Chains As Twist Compositions,Bregler

13、and Malik,Algorithm Overview Initialize 3D pose in first frame Compute support map pixels that are on each body part being tracked use layer extraction techniques (Wang & Adelson, EM) Apply modified Lukas-Kanade to estimate change in pose Repeat for each subsequent pose Works better with two or more

14、 views Each view gives more equations in unknown twist The more views, the better conditioned the problem is Can also do better initialization,,,Motion Capture from a Single Viewpoint,Basic Idea Train the system on a database of motions Bias the system to reconstruct shapes from the training set,Sha

15、dow Puppetry Brand, ICCV 99,Machine Learning Approach Model training 3D motion capture data using an HMM fancy HMM fitting method: Entropic Estimation global rotation/scale handled by duplicating HMM for each setting Find most likely path through HMM, given input data,,,Leventon and Freeman NIPS 200

16、0,Train on motion capture data Break 3D motion into short snippets express motion as a linear combination of training snippets similar to Blanz and Vetter approach for face modeling track limbs in image sequence in 2D, break into 2D snippets Whole problem is cast as Bayesian estimation,Wren and Pent

17、land,Real-time capture using learned motion models Combines inverse-kinematics with trained HMM model that predicts next move Uses “Blob Tracking” and two cameras C. Wren and A. Pentland, Dynamic Models of Human Motion, Proceedings of the Third IEEE International Conference, on Automatic Face and Gesture Recognition, April 14-16, 1998 in Nara, Japan.,

展開閱讀全文
溫馨提示:
1: 本站所有資源如無特殊說明,都需要本地電腦安裝OFFICE2007和PDF閱讀器。圖紙軟件為CAD,CAXA,PROE,UG,SolidWorks等.壓縮文件請下載最新的WinRAR軟件解壓。
2: 本站的文檔不包含任何第三方提供的附件圖紙等,如果需要附件,請聯(lián)系上傳者。文件的所有權(quán)益歸上傳用戶所有。
3.本站RAR壓縮包中若帶圖紙,網(wǎng)頁內(nèi)容里面會(huì)有圖紙預(yù)覽,若沒有圖紙預(yù)覽就沒有圖紙。
4. 未經(jīng)權(quán)益所有人同意不得將文件中的內(nèi)容挪作商業(yè)或盈利用途。
5. 裝配圖網(wǎng)僅提供信息存儲(chǔ)空間,僅對用戶上傳內(nèi)容的表現(xiàn)方式做保護(hù)處理,對用戶上傳分享的文檔內(nèi)容本身不做任何修改或編輯,并不能對任何下載內(nèi)容負(fù)責(zé)。
6. 下載文件中如有侵權(quán)或不適當(dāng)內(nèi)容,請與我們聯(lián)系,我們立即糾正。
7. 本站不保證下載資源的準(zhǔn)確性、安全性和完整性, 同時(shí)也不承擔(dān)用戶因使用這些下載資源對自己和他人造成任何形式的傷害或損失。

相關(guān)資源

更多
正為您匹配相似的精品文檔
關(guān)于我們 - 網(wǎng)站聲明 - 網(wǎng)站地圖 - 資源地圖 - 友情鏈接 - 網(wǎng)站客服 - 聯(lián)系我們

copyright@ 2023-2025  zhuangpeitu.com 裝配圖網(wǎng)版權(quán)所有   聯(lián)系電話:18123376007

備案號:ICP2024067431-1 川公網(wǎng)安備51140202000466號


本站為文檔C2C交易模式,即用戶上傳的文檔直接被用戶下載,本站只是中間服務(wù)平臺(tái),本站所有文檔下載所得的收益歸上傳人(含作者)所有。裝配圖網(wǎng)僅提供信息存儲(chǔ)空間,僅對用戶上傳內(nèi)容的表現(xiàn)方式做保護(hù)處理,對上載內(nèi)容本身不做任何修改或編輯。若文檔所含內(nèi)容侵犯了您的版權(quán)或隱私,請立即通知裝配圖網(wǎng),我們立即給予刪除!