Cloud Storage FUSE์™€ Google Cloud ์ œํ’ˆ ํ†ตํ•ฉ

์ด ํŽ˜์ด์ง€์—์„œ๋Š” Cloud Storage FUSE์™€ ํ†ตํ•ฉ๋œ Google Cloud ์ œํ’ˆ์„ ์„ค๋ช…ํ•ฉ๋‹ˆ๋‹ค.

์ผ๋ฐ˜์ ์œผ๋กœ Cloud Storage์™€ ํ†ตํ•ฉ๋˜๋Š” Google Cloud ์ œํ’ˆ ๋ชฉ๋ก์€ Google Cloud ์„œ๋น„์Šค ๋ฐ ๋„๊ตฌ์™€ ํ†ตํ•ฉ์„ ์ฐธ์กฐํ•˜์„ธ์š”.

์ œํ’ˆ Cloud Storage FUSE ํ†ตํ•ฉ ๋ฐฉ๋ฒ•
Google Kubernetes Engine(GKE)

Cloud Storage FUSE CSI ๋“œ๋ผ์ด๋ฒ„๋Š” Cloud Storage FUSE ๋ฐ Kubernetes API์˜ ํ†ตํ•ฉ์„ ๊ด€๋ฆฌํ•˜์—ฌ Cloud Storage ๋ฒ„ํ‚ท์„ ๋ณผ๋ฅจ์œผ๋กœ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. Cloud Storage FUSE CSI ๋“œ๋ผ์ด๋ฒ„๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋ฒ„ํ‚ท์„ Google Kubernetes Engine ๋…ธ๋“œ์— ํŒŒ์ผ ์‹œ์Šคํ…œ์œผ๋กœ ๋งˆ์šดํŠธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
Vertex AI ํ•™์Šต

Vertex AI์—์„œ ์ปค์Šคํ…€ ํ•™์Šต์„ ์ˆ˜ํ–‰ํ•  ๋•Œ Cloud Storage ๋ฒ„ํ‚ท์˜ ๋ฐ์ดํ„ฐ๋ฅผ ๋งˆ์šดํŠธ๋œ ํŒŒ์ผ ์‹œ์Šคํ…œ์œผ๋กœ ์•ก์„ธ์Šคํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ž์„ธํ•œ ๋‚ด์šฉ์€ ํ•™์Šต ์ฝ”๋“œ ์ค€๋น„๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.
Vertex AI Workbench

Vertex AI Workbench ์ธ์Šคํ„ด์Šค์—๋Š” JupyterLab ์ธํ„ฐํŽ˜์ด์Šค ๋‚ด์—์„œ ๋ฒ„ํ‚ท์„ ํƒ์ƒ‰ํ•˜๊ณ  Cloud Storage์— ์žˆ๋Š” ํ˜ธํ™˜ ํŒŒ์ผ๋กœ ์ž‘์—…ํ•  ์ˆ˜ ์žˆ๋Š” Cloud Storage ํ†ตํ•ฉ์ด ํฌํ•จ๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค. Cloud Storage ํ†ตํ•ฉ์„ ์‚ฌ์šฉํ•˜๋ฉด Vertex AI Workbench ์ธ์Šคํ„ด์Šค์™€ ๋™์ผํ•œ ํ”„๋กœ์ ํŠธ ๋‚ด์—์„œ ์•ก์„ธ์Šคํ•  ์ˆ˜ ์žˆ๋Š” ๋ชจ๋“  Cloud Storage ๋ฒ„ํ‚ท ๋ฐ ํŒŒ์ผ์— ์•ก์„ธ์Šคํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ํ†ตํ•ฉ์„ ์„ค์ •ํ•˜๋ ค๋ฉด JupyterLab์—์„œ Cloud Storage ๋ฒ„ํ‚ท ๋ฐ ํŒŒ์ผ์— ์•ก์„ธ์Šคํ•˜๋Š” ๋ฐฉ๋ฒ•์— ๊ด€ํ•œ Vertex AI Workbench ์•ˆ๋‚ด๋ฅผ ์ฐธ๊ณ ํ•˜์„ธ์š”.
Deep Learning VM Image

Cloud Storage FUSE์—๋Š” Deep Learning VM Image๊ฐ€ ์‚ฌ์ „ ์„ค์น˜๋˜์–ด ์žˆ์Šต๋‹ˆ๋‹ค.
Deep Learning Containers

Deep Learning Containers์šฉ Cloud Storage ๋ฒ„ํ‚ท์„ ๋งˆ์šดํŠธํ•˜๋ ค๋ฉด Cloud Storage FUSE CSI ๋“œ๋ผ์ด๋ฒ„(๊ถŒ์žฅ)๋ฅผ ์‚ฌ์šฉํ•˜๊ฑฐ๋‚˜ Cloud Storage FUSE๋ฅผ ์„ค์น˜ํ•˜๋ฉด ๋ฉ๋‹ˆ๋‹ค.
Batch

Cloud Storage FUSE๋ฅผ ์‚ฌ์šฉํ•˜๋ฉด ์ผ๊ด„ ์ž‘์—…์„ ๋งŒ๋“ค๊ณ  ์‹คํ–‰ํ•  ๋•Œ Cloud Storage ๋ฒ„ํ‚ท์„ ์Šคํ† ๋ฆฌ์ง€ ๋ณผ๋ฅจ์œผ๋กœ ๋งˆ์šดํŠธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ž‘์—… ์ •์˜์—์„œ ๋ฒ„ํ‚ท์„ ์ง€์ •ํ•˜๋ฉด ์ž‘์—…์ด ์‹คํ–‰๋  ๋•Œ ๋ฒ„ํ‚ท์ด ์ž‘์—…์˜ VM์— ์ž๋™์œผ๋กœ ๋งˆ์šดํŠธ๋ฉ๋‹ˆ๋‹ค.
Cloud Run

Cloud Run์„ ์‚ฌ์šฉํ•˜๋ฉด Cloud Storage ๋ฒ„ํ‚ท์„ ๋ณผ๋ฅจ์œผ๋กœ ๋งˆ์šดํŠธํ•˜๊ณ  ๋ฒ„ํ‚ท ์ฝ˜ํ…์ธ ๋ฅผ ์ปจํ…Œ์ด๋„ˆ ํŒŒ์ผ ์‹œ์Šคํ…œ์— ํŒŒ์ผ๋กœ ์ œ๊ณตํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ๋ณผ๋ฅจ ๋งˆ์šดํŠธ๋ฅผ ์„ค์ •ํ•˜๋ ค๋ฉด Cloud Storage ๋ณผ๋ฅจ ๋งˆ์šดํŠธ๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.

Cloud Composer

ํ™˜๊ฒฝ์„ ๋งŒ๋“ค๋ฉด Cloud Composer๊ฐ€ ์›Œํฌํ”Œ๋กœ ๋ฐ Cloud Storage ๋ฒ„ํ‚ท์˜ ํŠน์ • ํด๋”์— ์žˆ๋Š” ํ•ด๋‹น ์ข…์† ํ•ญ๋ชฉ์˜ ์†Œ์Šค ์ฝ”๋“œ๋ฅผ ์ €์žฅํ•ฉ๋‹ˆ๋‹ค. Cloud Composer๋Š” Cloud Storage FUSE๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋ฒ„ํ‚ท์˜ ํด๋”๋ฅผ Cloud Composer ํ™˜๊ฒฝ์˜ Airflow ๊ตฌ์„ฑ์š”์†Œ์— ๋งคํ•‘ํ•ฉ๋‹ˆ๋‹ค.

๋จธ์‹ ๋Ÿฌ๋‹์šฉ Cloud Storage FUSE

Cloud Storage FUSE๋Š” ๋จธ์‹ ๋Ÿฌ๋‹(ML) ํ•™์Šต ๋ฐ ๋ชจ๋ธ ๋ฐ์ดํ„ฐ๋ฅผ Cloud Storage์˜ ๊ฐ์ฒด๋กœ ์ €์žฅํ•˜๊ณ  ์•ก์„ธ์Šคํ•˜๋ ค๋Š” ๊ฐœ๋ฐœ์ž๊ฐ€ ์ผ๋ฐ˜์ ์œผ๋กœ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. Cloud Storage FUSE๋Š” ML ํ”„๋กœ์ ํŠธ๋ฅผ ๊ฐœ๋ฐœํ•  ๋•Œ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ๋ช‡ ๊ฐ€์ง€ ์ด์ ์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.

  • Cloud Storage FUSE๋ฅผ ์‚ฌ์šฉํ•˜๋ฉด Cloud Storage ๋ฒ„ํ‚ท์„ ๋กœ์ปฌ ํŒŒ์ผ ์‹œ์Šคํ…œ์œผ๋กœ ๋งˆ์šดํŠธํ•  ์ˆ˜ ์žˆ์œผ๋ฏ€๋กœ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์ด ํ‘œ์ค€ ํŒŒ์ผ ์‹œ์Šคํ…œ ์‹œ๋งจํ‹ฑ์Šค๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ํ•™์Šต ๋ฐ ๋ชจ๋ธ ๋ฐ์ดํ„ฐ์— ์•ก์„ธ์Šคํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ฆ‰, Cloud Storage๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ML ๋ฐ์ดํ„ฐ๋ฅผ ์ €์žฅํ•  ๋•Œ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜ ์ฝ”๋“œ๋ฅผ ๋‹ค์‹œ ์ž‘์„ฑํ•˜๊ฑฐ๋‚˜ ๋ฆฌํŒฉํ„ฐ๋งํ•˜๋Š” ๋น„์šฉ์„ ๋ฐฉ์ง€ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • ํ•™์Šต๋ถ€ํ„ฐ ์ถ”๋ก ์— ์ด๋ฅด๊ธฐ๊นŒ์ง€ Cloud Storage FUSE๋ฅผ ์‚ฌ์šฉํ•˜๋ฉด Cloud Storage์˜ ๊ธฐ๋ณธ ์ œ๊ณต๋˜๋Š” ๋†’์€ ํ™•์žฅ์„ฑ, ์„ฑ๋Šฅ, ๋น„์šฉ ํšจ์œจ์„ฑ์„ ์‚ฌ์šฉํ•˜์—ฌ ML ์›Œํฌ๋กœ๋“œ๋ฅผ ๋Œ€๊ทœ๋ชจ๋กœ ์‹คํ–‰ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

  • Cloud Storage FUSE๋ฅผ ์‚ฌ์šฉํ•˜๋ฉด Cloud Storage์˜ ๋ฐ์ดํ„ฐ์— ์ง์ ‘ ์•ก์„ธ์Šคํ•  ์ˆ˜ ์žˆ๋Š” ์ปดํ“จํŒ… ๋ฆฌ์†Œ์Šค๋ฅผ ์ œ๊ณตํ•˜์—ฌ ํ•™์Šต ์ž‘์—…์„ ๋น ๋ฅด๊ฒŒ ์‹œ์ž‘ํ•  ์ˆ˜ ์žˆ์œผ๋ฏ€๋กœ ์ปดํ“จํŒ… ๋ฆฌ์†Œ์Šค์— ํ•™์Šต ๋ฐ์ดํ„ฐ๋ฅผ ๋‹ค์šด๋กœ๋“œํ•  ํ•„์š”๊ฐ€ ์—†์Šต๋‹ˆ๋‹ค.

์ž์„ธํ•œ ๋‚ด์šฉ์€ Cloud Storage FUSE์—์„œ ์ง€์›ํ•˜๋Š” ML ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.