ABOUT ME

-

Today
-
Yesterday
-
Total
-
  • Stochastic differential equation(SDE)
    AI\ML\DL/Deep learning theory 2023. 12. 5. 14:52
    ๋ฐ˜์‘ํ˜•

    ํ™•๋ฅ ๋ฏธ๋ถ„๋ฐฉ์ •์‹ (Stochastic differential equation)

    SDE๋Š” ์ผ๋ฐ˜ ๋ฏธ๋ถ„ ๋ฐฉ์ •์‹๊ณผ ํŽธ๋ฏธ๋ถ„ ๋ฐฉ์ •์‹ ์‚ฌ์ด์˜ connection์„ ์ œ๊ณตํ•œ๋‹ค. ์ผ๋ฐ˜ ๋ฏธ๋ถ„ ๋ฐฉ์ •์‹(ODE)๊ณผ ์œ ์‚ฌํ•˜๋‚˜, ํ™•๋ฅ ์  ์š”์†Œ๋ฅผ ์ถ”๊ฐ€ํ•˜์—ฌ ๋” ๋ณต์žกํ•œ ์‹œ์Šคํ…œ์„ ๋ชจ๋ธ๋งํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋œ๋‹ค. 

     

    1) ODE

    ์ผ๋ฐ˜๋ฏธ๋ถ„๋ฐฉ์ •์‹์€ ๋ณ€์ˆ˜์˜ ๋ณ€ํ™”๋ฅผ ์‹œ๊ฐ„์— ๋Œ€ํ•ด ์„ค๋ช…ํ•˜๋Š” ๋ฐฉ์ •์‹์ด๋‹ค. 

    $$ \frac{dx}{dt}=f(x,t)$$

    ODE๋Š” ๋™์ผํ•œ ์ดˆ๊ธฐ๋ณ€์ˆ˜์™€ ๋งค๊ฐœ๋ณ€์ˆ˜ ํ•˜์— ํ•ด๊ฐ€ ํ•ญ์ƒ ๋™์ผํ•˜์—ฌ deterministicํ•˜๋‹ค. randomness ๋ฅผ ๊ณ ๋ คํ•˜์ง€ ์•Š๊ธฐ ๋•Œ๋ฌธ์ด๋‹ค. 

     

    2) SDE

    ๋ฐ˜๋ฉด ํ™•๋ฅ ๋ฏธ๋ถ„๋ฐฉ์ •์‹์€ ODE์— ํ™•๋ฅ ์„ฑ ๋˜๋Š” ๋…ธ์ด์ฆˆ๋ฅผ ํ†ตํ•ฉํ•˜์—ฌ ๋ถˆํ™•์‹ค์„ฑ์„ ๊ฐ€์ง„ ์‹œ์Šคํ…œ์„ ๋ชจ๋ธ๋งํ•œ๋‹ค. 

    $$ dx=f(x,t)dt+g(x,t)\cdot dB(t)$$

    ์ด๋•Œ $B(t)$๋Š” ํ™•๋ฅ ์„ฑ ์š”์†Œ๋ฅผ ์ถ”๊ฐ€ํ•˜๋Š” Brownian motion ์„ ๋‚˜ํƒ€๋‚ด๋ฉฐ ์ด๊ฒƒ ๋•Œ๋ฌธ์— ๋™์ผํ•œ ์ดˆ๊ธฐ ์กฐ๊ฑด์—์„œ ๋งค๋ฒˆ ํ•ด๊ฐ€ ๋‹ฌ๋ผ์ง„๋‹ค. 

    'AI\ML\DL > Deep learning theory' ์นดํ…Œ๊ณ ๋ฆฌ์˜ ๋‹ค๋ฅธ ๊ธ€

    Receptive field  (0) 2023.09.15
    Insights for CNN  (0) 2023.09.13
    2D convolution (Conv2d) ๊ณผ์ •์˜ ์ดํ•ด  (0) 2023.05.28
    Batch Normalization  (0) 2023.05.11
Designed by Tistory.