๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
728x90
๋ฐ˜์‘ํ˜•

Deep Learning/[D&A] 2023 Conference5

[4์ฃผ์ฐจ] <์ฃผ์ œ ๋ณ€๊ฒฝ> ์ฒดํ˜•๋ณ„ ์˜ท์ž…ํžˆ๊ธฐ ์‚ฌ์ „ ์กฐ์‚ฌ https://github.com/lijiaman/awesome-3d-human - ๋Œ€์‹  ์ฝ”๋“œ๊ฐ€ ์—†๋Š”๊ฒŒ ๋งŽ์Œ ใ… ใ…  https://github.com/lzhbrian/Clothes-3D ๊ธฐ์กด๋Œ€๋กœ ์ฒดํ˜•์— ๋”ฐ๋ผ ์˜ท์ž…ํžˆ๊ธฐ๋ฅผ ํ•  ๊ฒƒ์ธ์ง€ (SMPL + 3D clothesํ™” + ํ•ฉ์„ฑ + ๋””ํ…Œ์ผ ) ์˜ท ์ž…์€ ์‚ฌ๋žŒ์˜ ํ˜•ํƒœ๋ฅผ ๋”ฐ์„œ ์˜ท ๋””์ž์ธ์„ ๋ฐ”๊พธ๋Š” ๊ฒƒ์œผ๋กœ ๊ฐˆ์ง€ (์ด ์นœ๊ตฌ๋Š” ์กฐ๊ธˆ ๋‹ค๋ฅธ ๋ฐฉ์•ˆ)⇒ + upgrade ๋ฒ„์ „: ์šฐ๋ฆฌ๊ฐ€ ์ง์ ‘ ์˜ท์„ ๊ทธ๋ฆฐ ๋‹ค์Œ, ์˜ท์˜ ๋””์ž์ธ๊นŒ์ง€ ๋”ฐ์„œ ์ƒˆ๋กœ ์ž…ํžˆ๋Š” ๊ฒƒ(ํฌ๋ง ์‚ฌํ•ญ) 1๋ฒˆ์œผ๋กœ ์„ ํƒํ•  ๊ฒฝ์šฐ) input์œผ๋กœ ์‚ฌ์ง„ ๋ฐ›๊ณ , ๋ชจ๋ธ ๋Œ๋ ค์„œ ์›ํ•˜๋Š” ์˜ท ์ž…ํžˆ๋Š”๊ฑธ๋กœ ๋ณด์—ฌ์ฃผ๋Š”๊ฑฐ? 2๋ฒˆ์œผ๋กœ ์„ ํƒํ•  ๊ฒฝ์šฐ) ์˜ท ๊ทธ๋ฆฌ๊ฒŒ ํ•ด์„œ ๋””์ž์ธ์„ ์ž…ํ˜€์„œ ๋ณด์—ฌ์ฃผ๋Š” ์ •๋„?๊ฐ€ ๋  ๋“ฏ (์•„์ด๋””์–ด ์ œ์‹œ์ผ ๋ฟ - ์ฐพ์ง„ ์•Š์Œ) 1. ์ฒดํ˜•๋ณ„ .. 2023. 8. 10.
[3์ฃผ์ฐจ] ๊ฑด๋ฌผ 3Dํ™” ๋ชจ๋ธ ์ฐพ๊ธฐ GitHub - chrise96/3D_building_reconstruction: MSc Computer Science project. Automatically enhance CityGML LOD2 buildings with facade details, by using a panoramic image sequence and building footprint data. NOTE: Amsterdam Panorama API is currently offline. MSc Computer Science project. Automatically enhance CityGML LOD2 buildings with facade details, by using a panoramic image sequence and buil.. 2023. 7. 28.
[2์ฃผ์ฐจ] 3D Generation Model Github ํƒ์ƒ‰ ๐Ÿ’ก 2์ฃผ์ฐจ ๊ณผ์ œ: 3D ์ƒ์„ฑํ•˜๋Š” ๋ชจ๋ธ ๊นƒํ—™ → ๋งŒ์•ฝ ํ•™์Šต์ด ํ•„์š”ํ•œ ๋ชจ๋ธ์ด๋ฉด ์–ด๋–ค ๋ฐ์ดํ„ฐ๊ณ , ๋ฐ์ดํ„ฐ AIํ—ˆ๋ธŒ๊ฐ™์€ ๋ฐ ์žˆ๋Š”์ง€ 1. CIPS-3D (21๋…„๋„ 10์›”) ์ด๋ฏธ์ง€๋ฅผ 3Dํ™” ์‹œํ‚ค๋ ค๊ณ  ํ•˜๋Š”, ์ €๋ฒˆ์— ์˜๊ฒฌ ๋‚˜์™”๋˜ ์˜ํ™” ํฌ์Šคํ„ฐ ํ˜น์€, ํ•ด๋ฆฌํฌํ„ฐ ์‹ ๋ฌธ?, ๊ทธ๋ฆผ ๋ช…ํ™” ๋“ฑ์ด ๊ฐ€๋Šฅํ•  ์ˆ˜๋„ ์žˆ์ง€ ์•Š์„๊นŒ ๐Ÿ’ป https://github.com/PeterouZh/CIPS-3D ๐Ÿ“š https://arxiv.org/abs/2110.09788 ๐Ÿงช https://huggingface.co/spaces/hysts/Shap-E ํŠน์ง• : NeRF ๊ธฐ๋ฐ˜ : ํ•œ๊ณ„์ ์€ NeRF ๋งˆ๋ƒฅ ์•ž์—์„œ๋งŒ ๋น™๋น™๋Œ€๋Š” ๊ฒƒ๋งŒ ๊ฐ€๋Šฅ → ์šฐ๋ฆฌ๊ฐ€ ์–ด๋–ค ์ฃผ์ œ๋กœ ํ• ๊ฑฐ๋ƒ์— ๋”ฐ๋ผ์„œ choice ๋  ์ˆ˜๋„ ์•ˆ๋  ์ˆ˜๋„ : ๋ฐ์ดํ„ฐ์…‹: ์ด๋ฏธ์ง€…? 2. FastGANFit (21๋…„.. 2023. 7. 17.
[1์ฃผ์ฐจ] NeRF: Representing Scenes asNeural Radiance Fields for View Synthesis ๐Ÿ’ก 0. Abstract ์šฐ๋ฆฌ๋Š” ๋“œ๋ฌธ ์ž…๋ ฅ ๋ทฐ ์„ธํŠธ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์—ฐ์†์ ์ธ ๋ถ€ํ”ผ ์žฅ๋ฉด ํ•จ์ˆ˜๋ฅผ ์ตœ์ ํ™”ํ•˜์—ฌ ๋ณต์žกํ•œ ์žฅ๋ฉด์˜ ์ƒˆ๋กœ์šด ์‹œ์ ์„ ํ•ฉ์„ฑํ•˜๋Š” ์ตœ์ฒจ๋‹จ ๊ฒฐ๊ณผ๋ฅผ ๋‹ฌ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค. ์šฐ๋ฆฌ์˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ์™„์ „ํžˆ ์—ฐ๊ฒฐ๋œ (๋น„์„ ํ˜•) ์‹ฌ์ธต ๋„คํŠธ์›Œํฌ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์žฅ๋ฉด์„ ํ‘œํ˜„ํ•˜๋ฉฐ, ์ž…๋ ฅ์€ ๋‹จ์ผ ์—ฐ์†์ ์ธ 5D ์ขŒํ‘œ (๊ณต๊ฐ„ ์œ„์น˜ (x, y, z) ๋ฐ ์‹œ์ฒญ ๋ฐฉํ–ฅ (θ, φ))์ด๊ณ  ์ถœ๋ ฅ์€ ํ•ด๋‹น ๊ณต๊ฐ„ ์œ„์น˜์—์„œ์˜ ๋ถ€ํ”ผ ๋ฐ€๋„์™€ ์‹œ์ ์— ์˜์กดํ•˜๋Š” ๋ฐฉ์ถœ ๋ž˜๋””์–ธ์Šค์ž…๋‹ˆ๋‹ค. ์šฐ๋ฆฌ๋Š” ์นด๋ฉ”๋ผ ๊ด‘์„ ์„ ๋”ฐ๋ผ 5D ์ขŒํ‘œ๋ฅผ ์ฟผ๋ฆฌํ•˜์—ฌ ๋ทฐ๋ฅผ ํ•ฉ์„ฑํ•˜๊ณ , ์ „ํ†ต์ ์ธ ๋ถ€ํ”ผ ๋ Œ๋”๋ง ๊ธฐ์ˆ ์„ ์‚ฌ์šฉํ•˜์—ฌ ์ถœ๋ ฅ ์ƒ‰์ƒ๊ณผ ๋ฐ€๋„๋ฅผ ์ด๋ฏธ์ง€๋กœ ํˆฌ์˜ํ•ฉ๋‹ˆ๋‹ค. ๋ถ€ํ”ผ ๋ Œ๋”๋ง์€ ์ž์—ฐ์Šค๋Ÿฝ๊ฒŒ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•˜๊ธฐ ๋•Œ๋ฌธ์—, ์šฐ๋ฆฌ์˜ ํ‘œํ˜„์„ ์ตœ์ ํ™”ํ•˜๊ธฐ ์œ„ํ•ด ํ•„์š”ํ•œ ์œ ์ผํ•œ ์ž…๋ ฅ์€ ์•Œ๋ ค์ง„ ์นด๋ฉ”๋ผ ํฌ์ฆˆ๋ฅผ ๊ฐ€์ง„ ์ด.. 2023. 7. 13.
[1์ฃผ์ฐจ] [EECS 498-007 / 598-005] 3D Vision ๊ฐ•์˜ ์ •๋ฆฌ 1. 3D Vision Topics 2. 3D Shape Representations 2.1 3D Shape Representations: Depth Map ๐Ÿ’ก ํ”ฝ์…€์— ๋Œ€ํ•ด ์นด๋ฉ”๋ผ์™€ ํ”ฝ์…€์˜ ๊ฑฐ๋ฆฌ๋ฅผ ๊ตฌํ•˜๋Š” ๋ฐฉ์‹ + ์‹œ์•ผ์˜ ๋‹จ์ ์„ ๋ณด์™„ํ•˜๊ธฐ ์œ„ํ•œ loss ๊ตฌ๋น„ https://arxiv.org/abs/1411.4734 Depth map์€ ๊ฐ pixel์— ๋Œ€ํ•ด ์นด๋ฉ”๋ผ์™€ ํ”ฝ์…€ ์‚ฌ์ด์˜ ๊ฑฐ๋ฆฌ๋ฅผ ๊ตฌํ•จ ๊ธฐ์กด segmentation ์ฒ˜๋Ÿผ FC๋ฅผ ํ†ตํ•ด pixel ๋ณ„๋กœ ๊ณ„์‚ฐํ•  ์ˆ˜ ์žˆ๋‹ค ์ด๋ฅผ ํ†ตํ•ด Predicted Depth Image์™€ Ground-Truth image์™€์˜ Per-pixel loss๋ฅผ ๊ณ„์‚ฐํ•˜์—ฌ ํ•™์Šตํ•  ์ˆ˜ ์žˆ์Œ ํ•˜์ง€๋งŒ ์šฐ๋ฆฌ ๋ˆˆ์—์„œ๋Š” ์ž‘๊ณ  ๊ฐ€๊นŒ์ด ์žˆ๋Š” ๋ฌผ์ฒด์™€ ํฌ๊ณ  ๋ฉ€๋ฆฌ ์žˆ๋Š” ๋ฌผ์ฒด์˜ ํฌ๊ธฐ๋ฅผ ๊ตฌ๋ถ„ํ•˜์ง€ ๋ชปํ•จ ์œ„ ๋ฌธ์ œ๋ฅผ .. 2023. 7. 10.
728x90
๋ฐ˜์‘ํ˜•