๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ
728x90
๋ฐ˜์‘ํ˜•
Module 6. ๊ฐ•ํ™”ํ•™์Šต (Reinforcement Learning) (๊ณ ๋ ค๋Œ€ํ•™๊ต ์ด๋ณ‘์ค€ ๊ต์ˆ˜) ๋‚ ์งœ: 2023๋…„ 7์›” 13์ผ Part 1. MDP and Planning : Markov Decision Process์˜ ์•ฝ์ž Sequential Decision Making under Uncertainty๋ฅผ ์œ„ํ•œ ๊ธฐ๋ฒ• ๊ฐ•ํ™”ํ•™์Šต(Reinforcement Learning, RL)์„ ์œ„ํ•œ ๊ธฐ๋ณธ ๊ธฐ๋ฒ• ์•Œ๊ณ ๋ฆฌ์ฆ˜(transition probability, reward function)์„ ์•Œ๊ณ  ์žˆ์„ ๋•Œ๋Š” MDP(stocasitc control ๊ธฐ๋ฒ•)์„ ์ด์šฉ ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ๋ชจ๋ฅด๊ณ  simulation ๊ฒฐ๊ณผ(reward ๊ฐ’)๋ฅผ ํ™œ์šฉํ•  ๋•Œ๋Š” ๊ฐ•ํ™”ํ•™์Šต์„ ์ด์šฉ https://velog.io/@recoder/MDP%EC%9D%98%EA%B0%9C%EB%85%90 S : set of states(state space) state .. 2023. 7. 15.
Noisy Student: Self-training with Noisy Student improves ImageNet classification(2019) ๋ฆฌ๋ทฐ๋Š” ์•„๋ž˜์ชฝ์— ์žˆ์Šต๋‹ˆ๋‹น ! ! ๋ฒˆ์—ญ ver 0. Abstract ์šฐ๋ฆฌ๋Š” Noisy Student Training์„ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค. ์ด๋Š” ๋ ˆ์ด๋ธ”์ด ํ’๋ถ€ํ•œ ๊ฒฝ์šฐ์—๋„ ์ž˜ ์ž‘๋™ํ•˜๋Š” ์ค€์ง€๋„ ํ•™์Šต ๋ฐฉ๋ฒ•์ž…๋‹ˆ๋‹ค. Noisy Student Training์€ ImageNet์—์„œ 88.4%์˜ top-1 ์ •ํ™•๋„๋ฅผ ๋‹ฌ์„ฑํ•ฉ๋‹ˆ๋‹ค. ์ด๋Š” 35์–ต ๊ฐœ์˜ ์•ฝํ•œ ๋ ˆ์ด๋ธ”์ด ๋ถ€์ฐฉ๋œ Instagram ์ด๋ฏธ์ง€๊ฐ€ ํ•„์š”ํ•œ ์ตœ์ฒจ๋‹จ ๋ชจ๋ธ๋ณด๋‹ค 2.0% ๋” ๋†’์€ ์„ฑ๋Šฅ์ž…๋‹ˆ๋‹ค. ๊ฐ•๊ฑด์„ฑ ํ…Œ์ŠคํŠธ ์„ธํŠธ์—์„œ๋Š” ImageNet-A์˜ top-1 ์ •ํ™•๋„๋ฅผ 61.0%์—์„œ 83.7%๋กœ ํ–ฅ์ƒ์‹œํ‚ค๋ฉฐ, ImageNet-C์˜ ํ‰๊ท  ์†์ƒ ์˜ค์ฐจ๋ฅผ 45.7์—์„œ 28.3์œผ๋กœ ์ค„์ด๊ณ , ImageNet-P์˜ ํ‰๊ท  ๋’ค์ง‘๊ธฐ ๋น„์œจ์„ 27.8์—์„œ 12.2๋กœ ์ค„์ž…๋‹ˆ๋‹ค. Noisy Student Train.. 2023. 7. 14.
Module 6. ๊ฐ•ํ™”ํ•™์Šต (Reinforcement Learning) (๊ณ ๋ ค๋Œ€ํ•™๊ต ์ด๋ณ‘์ค€ ๊ต์ˆ˜) Part 1. MDP and Planning : Markov Decision Process์˜ ์•ฝ์ž - Sequential Decision Making under Uncertainty๋ฅผ ์œ„ํ•œ ๊ธฐ๋ฒ• - ๊ฐ•ํ™”ํ•™์Šต(Reinforcement Learning, RL)์„ ์œ„ํ•œ ๊ธฐ๋ณธ ๊ธฐ๋ฒ• - ์•Œ๊ณ ๋ฆฌ์ฆ˜(transition probability, reward function)์„ ์•Œ๊ณ  ์žˆ์„ ๋•Œ๋Š” MDP(stocasitc control ๊ธฐ๋ฒ•)์„ ์ด์šฉ - ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ๋ชจ๋ฅด๊ณ  simulation ๊ฒฐ๊ณผ(reward ๊ฐ’)๋ฅผ ํ™œ์šฉํ•  ๋•Œ๋Š” ๊ฐ•ํ™”ํ•™์Šต์„ ์ด์šฉ https://velog.io/@recoder/MDP%EC%9D%98%EA%B0%9C%EB%85%90 S : set of states(state space) - state s t∈S :.. 2023. 7. 13.
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis ๐Ÿ’ก 0. Abstract ์šฐ๋ฆฌ๋Š” ๋“œ๋ฌธ ์ž…๋ ฅ ๋ทฐ ์„ธํŠธ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์—ฐ์†์ ์ธ ๋ถ€ํ”ผ ์žฅ๋ฉด ํ•จ์ˆ˜๋ฅผ ์ตœ์ ํ™”ํ•˜์—ฌ ๋ณต์žกํ•œ ์žฅ๋ฉด์˜ ์ƒˆ๋กœ์šด ์‹œ์ ์„ ํ•ฉ์„ฑํ•˜๋Š” ์ตœ์ฒจ๋‹จ ๊ฒฐ๊ณผ๋ฅผ ๋‹ฌ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค. ์šฐ๋ฆฌ์˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ์™„์ „ํžˆ ์—ฐ๊ฒฐ๋œ (๋น„์„ ํ˜•) ์‹ฌ์ธต ๋„คํŠธ์›Œํฌ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์žฅ๋ฉด์„ ํ‘œํ˜„ํ•˜๋ฉฐ, ์ž…๋ ฅ์€ ๋‹จ์ผ ์—ฐ์†์ ์ธ 5D ์ขŒํ‘œ (๊ณต๊ฐ„ ์œ„์น˜ (x, y, z) ๋ฐ ์‹œ์ฒญ ๋ฐฉํ–ฅ (θ, φ))์ด๊ณ  ์ถœ๋ ฅ์€ ํ•ด๋‹น ๊ณต๊ฐ„ ์œ„์น˜์—์„œ์˜ ๋ถ€ํ”ผ ๋ฐ€๋„์™€ ์‹œ์ ์— ์˜์กดํ•˜๋Š” ๋ฐฉ์ถœ ๋ž˜๋””์–ธ์Šค์ž…๋‹ˆ๋‹ค. ์šฐ๋ฆฌ๋Š” ์นด๋ฉ”๋ผ ๊ด‘์„ ์„ ๋”ฐ๋ผ 5D ์ขŒํ‘œ๋ฅผ ์ฟผ๋ฆฌํ•˜์—ฌ ๋ทฐ๋ฅผ ํ•ฉ์„ฑํ•˜๊ณ , ์ „ํ†ต์ ์ธ ๋ถ€ํ”ผ ๋ Œ๋”๋ง ๊ธฐ์ˆ ์„ ์‚ฌ์šฉํ•˜์—ฌ ์ถœ๋ ฅ ์ƒ‰์ƒ๊ณผ ๋ฐ€๋„๋ฅผ ์ด๋ฏธ์ง€๋กœ ํˆฌ์˜ํ•ฉ๋‹ˆ๋‹ค. ๋ถ€ํ”ผ ๋ Œ๋”๋ง์€ ์ž์—ฐ์Šค๋Ÿฝ๊ฒŒ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•˜๊ธฐ ๋•Œ๋ฌธ์—, ์šฐ๋ฆฌ์˜ ํ‘œํ˜„์„ ์ตœ์ ํ™”ํ•˜๊ธฐ ์œ„ํ•ด ํ•„์š”ํ•œ ์œ ์ผํ•œ ์ž…๋ ฅ์€ ์•Œ๋ ค์ง„ ์นด๋ฉ”๋ผ ํฌ์ฆˆ๋ฅผ ๊ฐ€์ง„ ์ด.. 2023. 7. 13.
[1์ฃผ์ฐจ] NeRF: Representing Scenes asNeural Radiance Fields for View Synthesis ๐Ÿ’ก 0. Abstract ์šฐ๋ฆฌ๋Š” ๋“œ๋ฌธ ์ž…๋ ฅ ๋ทฐ ์„ธํŠธ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์—ฐ์†์ ์ธ ๋ถ€ํ”ผ ์žฅ๋ฉด ํ•จ์ˆ˜๋ฅผ ์ตœ์ ํ™”ํ•˜์—ฌ ๋ณต์žกํ•œ ์žฅ๋ฉด์˜ ์ƒˆ๋กœ์šด ์‹œ์ ์„ ํ•ฉ์„ฑํ•˜๋Š” ์ตœ์ฒจ๋‹จ ๊ฒฐ๊ณผ๋ฅผ ๋‹ฌ์„ฑํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ์ œ์‹œํ•ฉ๋‹ˆ๋‹ค. ์šฐ๋ฆฌ์˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ ์™„์ „ํžˆ ์—ฐ๊ฒฐ๋œ (๋น„์„ ํ˜•) ์‹ฌ์ธต ๋„คํŠธ์›Œํฌ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์žฅ๋ฉด์„ ํ‘œํ˜„ํ•˜๋ฉฐ, ์ž…๋ ฅ์€ ๋‹จ์ผ ์—ฐ์†์ ์ธ 5D ์ขŒํ‘œ (๊ณต๊ฐ„ ์œ„์น˜ (x, y, z) ๋ฐ ์‹œ์ฒญ ๋ฐฉํ–ฅ (θ, φ))์ด๊ณ  ์ถœ๋ ฅ์€ ํ•ด๋‹น ๊ณต๊ฐ„ ์œ„์น˜์—์„œ์˜ ๋ถ€ํ”ผ ๋ฐ€๋„์™€ ์‹œ์ ์— ์˜์กดํ•˜๋Š” ๋ฐฉ์ถœ ๋ž˜๋””์–ธ์Šค์ž…๋‹ˆ๋‹ค. ์šฐ๋ฆฌ๋Š” ์นด๋ฉ”๋ผ ๊ด‘์„ ์„ ๋”ฐ๋ผ 5D ์ขŒํ‘œ๋ฅผ ์ฟผ๋ฆฌํ•˜์—ฌ ๋ทฐ๋ฅผ ํ•ฉ์„ฑํ•˜๊ณ , ์ „ํ†ต์ ์ธ ๋ถ€ํ”ผ ๋ Œ๋”๋ง ๊ธฐ์ˆ ์„ ์‚ฌ์šฉํ•˜์—ฌ ์ถœ๋ ฅ ์ƒ‰์ƒ๊ณผ ๋ฐ€๋„๋ฅผ ์ด๋ฏธ์ง€๋กœ ํˆฌ์˜ํ•ฉ๋‹ˆ๋‹ค. ๋ถ€ํ”ผ ๋ Œ๋”๋ง์€ ์ž์—ฐ์Šค๋Ÿฝ๊ฒŒ ๋ฏธ๋ถ„ ๊ฐ€๋Šฅํ•˜๊ธฐ ๋•Œ๋ฌธ์—, ์šฐ๋ฆฌ์˜ ํ‘œํ˜„์„ ์ตœ์ ํ™”ํ•˜๊ธฐ ์œ„ํ•ด ํ•„์š”ํ•œ ์œ ์ผํ•œ ์ž…๋ ฅ์€ ์•Œ๋ ค์ง„ ์นด๋ฉ”๋ผ ํฌ์ฆˆ๋ฅผ ๊ฐ€์ง„ ์ด.. 2023. 7. 13.
[1์ฃผ์ฐจ] [EECS 498-007 / 598-005] 3D Vision ๊ฐ•์˜ ์ •๋ฆฌ 1. 3D Vision Topics 2. 3D Shape Representations 2.1 3D Shape Representations: Depth Map ๐Ÿ’ก ํ”ฝ์…€์— ๋Œ€ํ•ด ์นด๋ฉ”๋ผ์™€ ํ”ฝ์…€์˜ ๊ฑฐ๋ฆฌ๋ฅผ ๊ตฌํ•˜๋Š” ๋ฐฉ์‹ + ์‹œ์•ผ์˜ ๋‹จ์ ์„ ๋ณด์™„ํ•˜๊ธฐ ์œ„ํ•œ loss ๊ตฌ๋น„ https://arxiv.org/abs/1411.4734 Depth map์€ ๊ฐ pixel์— ๋Œ€ํ•ด ์นด๋ฉ”๋ผ์™€ ํ”ฝ์…€ ์‚ฌ์ด์˜ ๊ฑฐ๋ฆฌ๋ฅผ ๊ตฌํ•จ ๊ธฐ์กด segmentation ์ฒ˜๋Ÿผ FC๋ฅผ ํ†ตํ•ด pixel ๋ณ„๋กœ ๊ณ„์‚ฐํ•  ์ˆ˜ ์žˆ๋‹ค ์ด๋ฅผ ํ†ตํ•ด Predicted Depth Image์™€ Ground-Truth image์™€์˜ Per-pixel loss๋ฅผ ๊ณ„์‚ฐํ•˜์—ฌ ํ•™์Šตํ•  ์ˆ˜ ์žˆ์Œ ํ•˜์ง€๋งŒ ์šฐ๋ฆฌ ๋ˆˆ์—์„œ๋Š” ์ž‘๊ณ  ๊ฐ€๊นŒ์ด ์žˆ๋Š” ๋ฌผ์ฒด์™€ ํฌ๊ณ  ๋ฉ€๋ฆฌ ์žˆ๋Š” ๋ฌผ์ฒด์˜ ํฌ๊ธฐ๋ฅผ ๊ตฌ๋ถ„ํ•˜์ง€ ๋ชปํ•จ ์œ„ ๋ฌธ์ œ๋ฅผ .. 2023. 7. 10.
728x90
๋ฐ˜์‘ํ˜•