์‹คํ—˜ ๋งŒ๋“ค๊ธฐ ๋˜๋Š” ์‚ญ์ œ

Python์šฉ Vertex AI SDK ๋˜๋Š” Google Cloud ์ฝ˜์†”์„ ์‚ฌ์šฉํ•˜์—ฌ ์‹คํ—˜์„ ๋งŒ๋“ค๊ฑฐ๋‚˜ ์‚ญ์ œํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. SDK๋Š” ํ”„๋กœ๊ทธ๋ž˜๋งคํ‹ฑ ๋ฐฉ์‹์œผ๋กœ ์‹คํ—˜์„ ๋งŒ๋“ค๊ณ  ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•ด์ฃผ๋Š” Python ์ฝ”๋“œ์˜ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. ์ฝ˜์†”์€ ์‹คํ—˜์„ ์‹œ๊ฐ์ ์œผ๋กœ ๋งŒ๋“ค๊ณ  ๊ด€๋ฆฌํ•  ์ˆ˜ ์žˆ๊ฒŒ ํ•ด์ฃผ๋Š” ์›น ๊ธฐ๋ฐ˜ ์‚ฌ์šฉ์ž ์ธํ„ฐํŽ˜์ด์Šค์ž…๋‹ˆ๋‹ค.

ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค๋กœ ์‹คํ—˜ ๋งŒ๋“ค๊ธฐ

Python์šฉ Vertex AI SDK

Python์šฉ Vertex AI SDK๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ์‹คํ—˜์„ ๋งŒ๋“ค๊ณ  ์„ ํƒ์ ์œผ๋กœ Vertex AI ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค๋ฅผ ์—ฐ๊ฒฐํ•ฉ๋‹ˆ๋‹ค. ์‹คํ—˜์— ๋Œ€ํ•œ ์„ค๋ช…์„ ์ถ”๊ฐ€ํ•˜์—ฌ ๋ชฉ์ ์„ ๊ธฐ์ˆ ํ•ฉ๋‹ˆ๋‹ค. Vertex AI SDK ์ฐธ์กฐ ๋ฌธ์„œ์˜ init๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.

Python

from typing import Optional, Union

from google.cloud import aiplatform


def create_experiment_sample(
    experiment_name: str,
    experiment_description: str,
    experiment_tensorboard: Optional[Union[str, aiplatform.Tensorboard]],
    project: str,
    location: str,
):
    aiplatform.init(
        experiment=experiment_name,
        experiment_description=experiment_description,
        experiment_tensorboard=experiment_tensorboard,
        project=project,
        location=location,
    )

  • experiment_name: ์‹คํ—˜ ์ด๋ฆ„์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.
  • experiment_description: ์‹คํ—˜์— ๋Œ€ํ•œ ์„ค๋ช…์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.
  • experiment_tensorboard: (์„ ํƒ์‚ฌํ•ญ) ์ œ๊ณต๋œ ์‹คํ—˜์˜ ๋ฐฑ์—… ํ…์„œ๋ณด๋“œ๋กœ ์‚ฌ์šฉํ•  Vertex TensorBoard ์ธ์Šคํ„ด์Šค์ž…๋‹ˆ๋‹ค. experiment_tensorboard๋ฅผ ์ œ๊ณตํ•˜์ง€ ์•Š์œผ๋ฉด ์ด ์‹คํ—˜์—์„œ ๊ธฐ๋ณธ TB ์ธ์Šคํ„ด์Šค๊ฐ€ ์ƒ์„ฑ๋˜์–ด ์‚ฌ์šฉ๋ฉ๋‹ˆ๋‹ค. ์ฐธ๊ณ : CMEK(์•”ํ˜ธํ™” ํ‚ค)๋ฅผ ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค์™€ ์—ฐ๊ฒฐํ•ด์•ผ ํ•˜๋Š” ๊ฒฝ์šฐ experiment_tensorboard๋Š” ์„ ํƒ์‚ฌํ•ญ์ด ์•„๋‹™๋‹ˆ๋‹ค.
  • project: ํ”„๋กœ์ ํŠธ ID ์ด๋Ÿฌํ•œ ID๋Š” Google Cloud ์ฝ˜์†” ์‹œ์ž‘ ํŽ˜์ด์ง€์—์„œ ์ฐพ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
  • location: ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•œ ์œ„์น˜ ๋ชฉ๋ก์„ ์ฐธ์กฐํ•˜์„ธ์š”. ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค๋ฅผ ๋งŒ๋“œ๋Š” ๊ฒฝ์šฐ ํ…์„œ๋ณด๋“œ๋ฅผ ์ง€์›ํ•˜๋Š” ๋ฆฌ์ „์„ ์‚ฌ์šฉํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

Google Cloud ์ฝ˜์†”

๋‹ค์Œ ์•ˆ๋‚ด์— ๋”ฐ๋ผ ์‹คํ—˜์„ ๋งŒ๋“ญ๋‹ˆ๋‹ค.

  1. Google Cloud ์ฝ˜์†”์—์„œ ์‹คํ—˜ ํŽ˜์ด์ง€๋กœ ์ด๋™ํ•ฉ๋‹ˆ๋‹ค.
    ์‹คํ—˜์œผ๋กœ ์ด๋™
  2. ์‹คํ—˜์„ ๋งŒ๋“ค๋ ค๋Š” ํ”„๋กœ์ ํŠธ์— ์žˆ๋Š”์ง€ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.
    Vertex AI ์„ ํƒ ํ”„๋กœ์ ํŠธ
  3. ๋งŒ๋“ค๊ธฐ๋ฅผ ํด๋ฆญํ•˜์—ฌ ์‹คํ—˜ ์ฐฝ์„ ์—ฝ๋‹ˆ๋‹ค. ์‹คํ—˜ ๋งŒ๋“ค๊ธฐ ์ฐฝ์ด ๋‚˜ํƒ€๋‚ฉ๋‹ˆ๋‹ค.
  4. ์‹คํ—˜ ์ด๋ฆ„ ํ•„๋“œ์— ์‹คํ—˜์„ ๊ณ ์œ ํ•˜๊ฒŒ ์‹๋ณ„ํ•˜๋Š” ์ด๋ฆ„์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.
  5. ์„ ํƒ์‚ฌํ•ญ์ž…๋‹ˆ๋‹ค. ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค ํ•„๋“œ์˜ ๋“œ๋กญ๋‹ค์šด์—์„œ ์ธ์Šคํ„ด์Šค๋ฅผ ์„ ํƒํ•˜๊ฑฐ๋‚˜ ์ƒˆ ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค์˜ ์ด๋ฆ„์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
  6. ๋งŒ๋“ค๊ธฐ๋ฅผ ํด๋ฆญํ•˜์—ฌ ์‹คํ—˜์„ ๋งŒ๋“ญ๋‹ˆ๋‹ค.

๊ธฐ๋ณธ ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค ์—†์ด ์‹คํ—˜ ๋งŒ๋“ค๊ธฐ

Python์šฉ Vertex AI SDK

์‹คํ—˜ ๋งŒ๋“ค๊ธฐ ์‹คํ—˜์— ๋Œ€ํ•œ ์„ค๋ช…์„ ์ถ”๊ฐ€ํ•˜์—ฌ ๋ชฉ์ ์„ ๊ธฐ์ˆ ํ•ฉ๋‹ˆ๋‹ค. Vertex AI SDK ์ฐธ์กฐ ๋ฌธ์„œ์˜ init๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.

Python

from google.cloud import aiplatform


def create_experiment_without_default_tensorboard_sample(
    experiment_name: str,
    experiment_description: str,
    project: str,
    location: str,
):
    aiplatform.init(
        experiment=experiment_name,
        experiment_description=experiment_description,
        experiment_tensorboard=False,
        project=project,
        location=location,
    )

  • experiment_name: ์‹คํ—˜ ์ด๋ฆ„์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.
  • experiment_description: ์‹คํ—˜์— ๋Œ€ํ•œ ์„ค๋ช…์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.
  • project: ํ”„๋กœ์ ํŠธ ID ์ด๋Ÿฌํ•œ ID๋Š” Google Cloud ์ฝ˜์†” ์‹œ์ž‘ ํŽ˜์ด์ง€์—์„œ ์ฐพ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
  • location: ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•œ ์œ„์น˜ ๋ชฉ๋ก์„ ์ฐธ์กฐํ•˜์„ธ์š”. ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค๋ฅผ ๋งŒ๋“œ๋Š” ๊ฒฝ์šฐ ํ…์„œ๋ณด๋“œ๋ฅผ ์ง€์›ํ•˜๋Š” ๋ฆฌ์ „์„ ์‚ฌ์šฉํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

์‹คํ—˜ ์‚ญ์ œ

์‹คํ—˜์„ ์‚ญ์ œํ•˜๋ฉด ์‹คํ—˜ ๋ฐ ํ•ด๋‹น ์‹คํ—˜๊ณผ ๊ด€๋ จ๋œ ๋ชจ๋“  ์‹คํ—˜ ์‹คํ–‰์ด ์‚ญ์ œ๋ฉ๋‹ˆ๋‹ค. ์‹คํ—˜๊ณผ ์—ฐ๊ฒฐ๋œ Vertex AI ํ…์„œ๋ณด๋“œ ์‹คํ—˜์€ ์‚ญ์ œ๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ํ…์„œ๋ณด๋“œ ์‹คํ—˜์„ ์‚ญ์ œํ•˜๋ ค๋ฉด ์˜ค๋ž˜๋œ Vertex AI ํ…์„œ๋ณด๋“œ ์‹คํ—˜ ์‚ญ์ œ๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”.

๋˜ํ•œ, ์‚ญ์ œ๋œ ์‹คํ—˜๊ณผ ์—ฐ๊ฒฐ๋œ ๋ชจ๋“  ํŒŒ์ดํ”„๋ผ์ธ ์‹คํ–‰, ์•„ํ‹ฐํŒฉํŠธ, ์‹คํ–‰์€ ์‚ญ์ œ๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ์ด ๋‚ด์šฉ์€ Google Cloud ์ฝ˜์†”์—์„œ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์•„ํ‹ฐํŒฉํŠธ ๋ฐ ์‹คํ–‰์˜ ๊ฒฝ์šฐ ์›” $10/GB์˜ ์š”๊ธˆ์ด Vertex ML Metadata ์„œ๋น„์Šค์—์„œ ์ฒ˜๋ฆฌ๋ฉ๋‹ˆ๋‹ค.

Python์šฉ Vertex AI SDK

๋‹ค์Œ ์ƒ˜ํ”Œ์—์„œ๋Š” ExperimentClass์˜ delete ๋ฉ”์„œ๋“œ๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค.

Python

from google.cloud import aiplatform


def delete_experiment_sample(
    experiment_name: str,
    project: str,
    location: str,
    delete_backing_tensorboard_runs: bool = False,
):
    experiment = aiplatform.Experiment(
        experiment_name=experiment_name, project=project, location=location
    )

    experiment.delete(delete_backing_tensorboard_runs=delete_backing_tensorboard_runs)

  • experiment_name: ์‹คํ—˜ ์ด๋ฆ„์„ ์ž…๋ ฅํ•ฉ๋‹ˆ๋‹ค.
  • project: ํ”„๋กœ์ ํŠธ ID ์ด๋Ÿฌํ•œ ID๋Š” Google Cloud ์ฝ˜์†” ์‹œ์ž‘ ํŽ˜์ด์ง€์—์„œ ์ฐพ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
  • location: ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•œ ์œ„์น˜ ๋ชฉ๋ก์„ ์ฐธ์กฐํ•˜์„ธ์š”.
  • delete_backing_tensorboard_runs: True์ธ ๊ฒฝ์šฐ ์ด ์‹คํ—˜์—์„œ ์‹œ๊ณ„์—ด ์ธก์ •ํ•ญ๋ชฉ์„ ์ €์žฅํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ๋œ ์‹คํ—˜ ์‹คํ–‰๊ณผ ์—ฐ๊ฒฐ๋œ Vertex AI ํ…์„œ๋ณด๋“œ ์‹คํ–‰๋„ ์‚ญ์ œ๋ฉ๋‹ˆ๋‹ค.

์ฝ˜์†”

๋‹ค์Œ ์•ˆ๋‚ด์— ๋”ฐ๋ผ ์‹คํ—˜์„ ์‚ญ์ œํ•ฉ๋‹ˆ๋‹ค.

  1. Google Cloud ์ฝ˜์†”์—์„œ ์‹คํ—˜ ํŽ˜์ด์ง€๋กœ ์ด๋™ํ•ฉ๋‹ˆ๋‹ค.
    ์‹คํ—˜์œผ๋กœ ์ด๋™
  2. ์‚ญ์ œํ•  ์‹คํ—˜๊ณผ ์—ฐ๊ด€๋œ ์ฒดํฌ๋ฐ•์Šค๋ฅผ ์„ ํƒํ•ฉ๋‹ˆ๋‹ค. ์‚ญ์ œ ์˜ต์…˜์ด ๋‚˜ํƒ€๋‚ฉ๋‹ˆ๋‹ค.
  3. ์‚ญ์ œ๋ฅผ ํด๋ฆญํ•ฉ๋‹ˆ๋‹ค.
    • ๋˜๋Š” ์‹คํ—˜๊ณผ ๋™์ผํ•œ ํ–‰์— ์žˆ๋Š” ์˜ต์…˜ ๋ฉ”๋‰ด๋กœ ์ด๋™ํ•˜์—ฌ ์‚ญ์ œ๋ฅผ ์„ ํƒํ•  ์ˆ˜๋„ ์žˆ์Šต๋‹ˆ๋‹ค.

Google Cloud ์ฝ˜์†”์—์„œ ์‹คํ—˜ ๋ชฉ๋ก ๋ณด๊ธฐ

  1. Google Cloud ์ฝ˜์†”์˜ Vertex AI ์„น์…˜์—์„œ ์‹คํ—˜ ํŽ˜์ด์ง€๋กœ ์ด๋™ํ•ฉ๋‹ˆ๋‹ค.

    ์‹คํ—˜ ํŽ˜์ด์ง€๋กœ ์ด๋™

  2. ํ”„๋กœ์ ํŠธ๊ฐ€ ์˜ฌ๋ฐ”๋ฅธ์ง€ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.

  3. ํ”„๋กœ์ ํŠธ์˜ ์‹คํ—˜ ๋ชฉ๋ก์ด ์‹คํ—˜ ์ถ”์  ๋ทฐ์— ํ‘œ์‹œ๋ฉ๋‹ˆ๋‹ค.
    Vertex AI ํ…์„œ๋ณด๋“œ ์ธ์Šคํ„ด์Šค๋ฅผ ์‹คํ—˜๊ณผ ์—ฐ๊ฒฐํ•˜๋ฉด ๋ชฉ๋ก์— '๊ฐœ๋ฐœ์ž ์‹คํ—˜ ์ง€์› ํ…์„œ๋ณด๋“œ ์‹คํ—˜'์œผ๋กœ ํ‘œ์‹œ๋ฉ๋‹ˆ๋‹ค.

์‹คํ—˜ Vertex AIList

๋‹ค์Œ ๋‹จ๊ณ„

๊ด€๋ จ ๋…ธํŠธ๋ถ ์ƒ˜ํ”Œ