์˜ˆ์•ฝ ์†Œ๋น„

TPU ์˜ˆ์•ฝ์ด ์žˆ๋Š” ๊ฒฝ์šฐ ์˜ˆ์•ฝ๋œ ๋ฆฌ์†Œ์Šค๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์˜ˆ์•ฝ์˜ ์†์„ฑ๊ณผ ์ผ์น˜ํ•˜๋Š” TPU๋ฅผ ๋งŒ๋“ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋Ÿฌํ•œ ์ž‘์—…์„ ์˜ˆ์•ฝ์„ ์‚ฌ์šฉํ•œ๋‹ค๊ณ  ํ•ฉ๋‹ˆ๋‹ค. GKE๋ฅผ ์‚ฌ์šฉํ•  ๋•Œ TPU ์˜ˆ์•ฝ์„ ์‚ฌ์šฉํ•˜๋Š” ๋ฐฉ๋ฒ•์— ๊ด€ํ•œ ์ž์„ธํ•œ ๋‚ด์šฉ์€ GKE ๋ฌธ์„œ์˜ TPU ์˜ˆ์•ฝ์„ ์ฐธ๊ณ ํ•˜์„ธ์š”.

ํŠน์ • ์˜ˆ์•ฝ ์†Œ๋น„

gcloud alpha compute tpus queued-resources create ๋ช…๋ น์–ด๋กœ ๋ฆฌ์†Œ์Šค๋ฅผ ๋งŒ๋“ค ๋•Œ --reservation ํ”Œ๋ž˜๊ทธ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์‚ฌ์šฉํ•  ์˜ˆ์•ฝ์˜ ์ด๋ฆ„์„ ์ง€์ •ํ•ฉ๋‹ˆ๋‹ค. ์บ˜๋ฆฐ๋” ๋ชจ๋“œ์—์„œ ์ƒ์„ฑ๋œ ๋ฏธ๋ž˜์šฉ ์˜ˆ์•ฝ์˜ ๊ฒฝ์šฐ --provisioning-model ํ”Œ๋ž˜๊ทธ๋ฅผ reservation-bound๋กœ ์„ค์ •ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

gcloud alpha compute tpus queued-resources create QUEUED_RESOURCE_ID \
    --node-id=TPU_NAME \
    --zone=ZONE \
    --accelerator-type=ACCELERATOR_TYPE \
    --runtime-version=SOFTWARE_VERSION \
    --reservation=RESERVATION_URL \
    --provisioning-model=reservation-bound # Only required for calendar mode

๋‹ค์Œ ์ž๋ฆฌ ํ‘œ์‹œ์ž ๋ณ€์ˆ˜๋ฅผ ๋ฐ”๊ฟ‰๋‹ˆ๋‹ค.

  • QUEUED_RESOURCE_ID: ํ์— ์ถ”๊ฐ€๋œ ๋ฆฌ์†Œ์Šค ์š”์ฒญ์˜ ์‚ฌ์šฉ์ž ํ• ๋‹น ID
  • TPU_NAME: ํ์— ์ถ”๊ฐ€๋œ ๋ฆฌ์†Œ์Šค ์š”์ฒญ์ด ํ• ๋‹น๋  ๋•Œ ์ƒ์„ฑ๋˜๋Š” TPU์˜ ์‚ฌ์šฉ์ž ํ• ๋‹น ID(์ด๋ฆ„)
  • ZONE: TPU VM์„ ๋งŒ๋“ค ์˜์—ญ. ์ง€์›๋˜๋Š” ์˜์—ญ์— ๋Œ€ํ•œ ์ž์„ธํ•œ ๋‚ด์šฉ์€ ๋ฆฌ์ „ ๋ฐ ์˜์—ญ์„ ์ฐธ๊ณ ํ•˜์„ธ์š”.
  • ACCELERATOR_TYPE: ์ƒ์„ฑํ•  Cloud TPU์˜ ๋ฒ„์ „๊ณผ ํฌ๊ธฐ. ๊ฐ TPU ๋ฒ„์ „์—์„œ ์ง€์›๋˜๋Š” ๊ฐ€์†๊ธฐ ์œ ํ˜•์— ๋Œ€ํ•œ ์ž์„ธํ•œ ๋‚ด์šฉ์€ TPU ๋ฒ„์ „์„ ์ฐธ๊ณ ํ•˜์„ธ์š”.
  • SOFTWARE_VERSION: Cloud TPU ์†Œํ”„ํŠธ์›จ์–ด ๋ฒ„์ „
  • RESERVATION_URL: ์˜ˆ์•ฝ์˜ URL. ๋‹ค์Œ ๊ฐ’ ์ค‘ ํ•˜๋‚˜๋ฅผ ์ง€์ •ํ•ฉ๋‹ˆ๋‹ค.
    • ์˜ˆ์•ฝ์ด ํ”„๋กœ์ ํŠธ์— ์žˆ๋Š” ๊ฒฝ์šฐ: RESERVATION_NAME
    • ์˜ˆ์•ฝ์ด ๋‹ค๋ฅธ ํ”„๋กœ์ ํŠธ์— ์žˆ๊ณ  ๋‚ด ํ”„๋กœ์ ํŠธ์—์„œ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ๊ฒฝ์šฐ: projects/OWNER_PROJECT_ID/reservations/RESERVATION_NAME

์ผ์น˜ํ•˜๋Š” ์˜ˆ์•ฝ ์†Œ๋น„

--reserved ํ”Œ๋ž˜๊ทธ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๊ฐ€์†๊ธฐ ์œ ํ˜•, ํ”„๋กœ์ ํŠธ ID, ์˜์—ญ์— ๋”ฐ๋ผ ์‚ฌ์šฉํ•  ์˜ˆ์•ฝ์„ ์ž๋™์œผ๋กœ ๊ฒฐ์ •ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

CreateNode

CreateNode API๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ผ์น˜ํ•˜๋Š” ์˜ˆ์•ฝ์„ ์‚ฌ์šฉํ•˜๋ ค๋ฉด --reserved ํ”Œ๋ž˜๊ทธ์™€ ํ•จ๊ป˜ gcloud alpha compute tpus tpu-vm create ๋ช…๋ น์–ด๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

gcloud alpha compute tpus tpu-vm create TPU_NAME \
    --zone=ZONE \
    --accelerator-type=ACCELERATOR_TYPE \
    --version=SOFTWARE_VERSION \
    --reserved

๋‹ค์Œ ์ž๋ฆฌ ํ‘œ์‹œ์ž ๋ณ€์ˆ˜๋ฅผ ๋ฐ”๊ฟ‰๋‹ˆ๋‹ค.

  • TPU_NAME: TPU์˜ ์ด๋ฆ„
  • ZONE: TPU VM์„ ๋งŒ๋“ค ์˜์—ญ. ์˜ˆ์•ฝ ์˜์—ญ๊ณผ ์ผ์น˜ํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.
  • ACCELERATOR_TYPE: ์ƒ์„ฑํ•  Cloud TPU์˜ ๋ฒ„์ „๊ณผ ํฌ๊ธฐ. ๊ฐ TPU ๋ฒ„์ „์—์„œ ์ง€์›๋˜๋Š” ๊ฐ€์†๊ธฐ ์œ ํ˜•์— ๋Œ€ํ•œ ์ž์„ธํ•œ ๋‚ด์šฉ์€ TPU ๋ฒ„์ „์„ ์ฐธ๊ณ ํ•˜์„ธ์š”.
  • SOFTWARE_VERSION: Cloud TPU ์†Œํ”„ํŠธ์›จ์–ด ๋ฒ„์ „

ํ์— ์ถ”๊ฐ€๋œ ๋ฆฌ์†Œ์Šค

๋Œ€๊ธฐ์—ด์— ์ถ”๊ฐ€๋œ ๋ฆฌ์†Œ์Šค๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์ผ์น˜ํ•˜๋Š” ์˜ˆ์•ฝ์„ ์‚ฌ์šฉํ•˜๋ ค๋ฉด --reserved ํ”Œ๋ž˜๊ทธ์™€ ํ•จ๊ป˜ gcloud alpha compute tpus queued-resources create ๋ช…๋ น์–ด๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

gcloud alpha compute tpus queued-resources create QUEUED_RESOURCE_ID \
    --node-id=TPU_NAME \
    --zone=ZONE \
    --accelerator-type=ACCELERATOR_TYPE \
    --runtime-version=SOFTWARE_VERSION \
    --reserved

๋‹ค์Œ ์ž๋ฆฌ ํ‘œ์‹œ์ž ๋ณ€์ˆ˜๋ฅผ ๋ฐ”๊ฟ‰๋‹ˆ๋‹ค.

  • QUEUED_RESOURCE_ID: ํ์— ์ถ”๊ฐ€๋œ ๋ฆฌ์†Œ์Šค ์š”์ฒญ์˜ ์‚ฌ์šฉ์ž ํ• ๋‹น ID
  • TPU_NAME: ํ์— ์ถ”๊ฐ€๋œ ๋ฆฌ์†Œ์Šค ์š”์ฒญ์ด ํ• ๋‹น๋  ๋•Œ ์ƒ์„ฑ๋˜๋Š” TPU์˜ ์‚ฌ์šฉ์ž ํ• ๋‹น ID(์ด๋ฆ„)
  • ZONE: TPU VM์„ ๋งŒ๋“ค ์˜์—ญ์ด์ž ์˜ˆ์•ฝ์ด ์กด์žฌํ•˜๋Š” ์˜์—ญ
  • ACCELERATOR_TYPE: ์ƒ์„ฑํ•  Cloud TPU์˜ ๋ฒ„์ „๊ณผ ํฌ๊ธฐ. ๊ฐ TPU ๋ฒ„์ „์—์„œ ์ง€์›๋˜๋Š” ๊ฐ€์†๊ธฐ ์œ ํ˜•์— ๋Œ€ํ•œ ์ž์„ธํ•œ ๋‚ด์šฉ์€ TPU ๋ฒ„์ „์„ ์ฐธ๊ณ ํ•˜์„ธ์š”.
  • SOFTWARE_VERSION: Cloud TPU ์†Œํ”„ํŠธ์›จ์–ด ๋ฒ„์ „

์˜ˆ์•ฝ ์‚ฌ์šฉ๋Ÿ‰ ํ™•์ธ

๊ณต์œ  ์˜ˆ์•ฝ ์‚ฌ์šฉ๋Ÿ‰์€ ์†Œ์œ ์ž ํ”„๋กœ์ ํŠธ์—์„œ๋งŒ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์†Œ๋น„์ž ํ”„๋กœ์ ํŠธ์— ์žˆ๋Š” ๊ฒฝ์šฐ ์†Œ์œ ์ž ํ”„๋กœ์ ํŠธ๋กœ ์ „ํ™˜ํ•˜์—ฌ ์˜ˆ์•ฝ ์‚ฌ์šฉ๋Ÿ‰์„ ํ™•์ธํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

์˜ˆ์•ฝ ์ค‘ ์‚ฌ์šฉ ์ค‘์ธ ๋ถ€๋ถ„์„ ํ™•์ธํ•˜๋ ค๋ฉด gcloud compute reservations describe ๋ช…๋ น์–ด๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

gcloud compute reservations describe RESERVATION_NAME \
    --project=PROJECT_ID --zone=ZONE

๋‹ค์Œ ์ž๋ฆฌ ํ‘œ์‹œ์ž ๋ณ€์ˆ˜๋ฅผ ๋ฐ”๊ฟ‰๋‹ˆ๋‹ค.

  • RESERVATION_NAME: ์˜ˆ์•ฝ ์ด๋ฆ„
  • PROJECT_ID: ์˜ˆ์•ฝ์ด ํฌํ•จ๋œ ํ”„๋กœ์ ํŠธ์˜ ID
  • ZONE: ์˜ˆ์•ฝ์ด ์žˆ๋Š” ์˜์—ญ

ํ”„๋กœ์ ํŠธ์˜ ๋ชจ๋“  ์˜ˆ์•ฝ์„ ๋‚˜์—ดํ•˜๋ ค๋ฉด gcloud compute reservations list ๋ช…๋ น์–ด๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

gcloud compute reservations list --project=PROJECT_ID

๋‹ค์Œ ์ž๋ฆฌํ‘œ์‹œ์ž ๋ณ€์ˆ˜๋ฅผ ๋ฐ”๊ฟ‰๋‹ˆ๋‹ค.

  • PROJECT_ID: ํ”„๋กœ์ ํŠธ์˜ ID

๋‹ค์Œ ๋‹จ๊ณ„