GKE ๊ธฐ๋ฐ˜ Dataproc ๊ฐœ์š”

GKE ๊ธฐ๋ฐ˜ Dataproc์„ ์‚ฌ์šฉํ•˜๋ฉด GKE ํด๋Ÿฌ์Šคํ„ฐ์—์„œ Dataproc jobs API๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋น…๋ฐ์ดํ„ฐ ์• ํ”Œ๋ฆฌ์ผ€์ด์…˜์„ ์‹คํ–‰ํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. Google Cloud ์ฝ˜์†”, Google Cloud CLI ๋˜๋Š” Dataproc API(HTTP ์š”์ฒญ ๋˜๋Š” Cloud ํด๋ผ์ด์–ธํŠธ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ)๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ GKE ๊ธฐ๋ฐ˜ Dataproc ๊ฐ€์ƒ ํด๋Ÿฌ์Šคํ„ฐ๋ฅผ ๋งŒ๋“  ํ›„ Spark, PySpark, SparkR, Spark-SQL ์ž‘์—…์„ Dataproc ์„œ๋น„์Šค์— ์ œ์ถœํ•ฉ๋‹ˆ๋‹ค.

GKE ๊ธฐ๋ฐ˜ Dataproc์€ Spark 3.5 ๋ฒ„์ „์„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.

GKE ๊ธฐ๋ฐ˜ Dataproc ์ž‘๋™ ๋ฐฉ์‹

GKE ๊ธฐ๋ฐ˜ Dataproc์€ GKE ํด๋Ÿฌ์Šคํ„ฐ์— Dataproc ๊ฐ€์ƒ ํด๋Ÿฌ์Šคํ„ฐ๋ฅผ ๋ฐฐํฌํ•ฉ๋‹ˆ๋‹ค. Compute Engine ๊ธฐ๋ฐ˜ Dataproc ํด๋Ÿฌ์Šคํ„ฐ์™€ ๋‹ฌ๋ฆฌ GKE ๊ธฐ๋ฐ˜ Dataproc ๊ฐ€์ƒ ํด๋Ÿฌ์Šคํ„ฐ์—๋Š” ๋ณ„๋„์˜ ๋งˆ์Šคํ„ฐ ๋ฐ ์ž‘์—…์ž VM์ด ํฌํ•จ๋˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ๋Œ€์‹  GKE ๊ธฐ๋ฐ˜ Dataproc ๊ฐ€์ƒ ํด๋Ÿฌ์Šคํ„ฐ๋ฅผ ๋งŒ๋“ค๋ฉด GKE ๊ธฐ๋ฐ˜ Dataproc์ด GKE ํด๋Ÿฌ์Šคํ„ฐ ๋‚ด์— ๋…ธ๋“œ ํ’€์„ ๋งŒ๋“ญ๋‹ˆ๋‹ค. GKE ๊ธฐ๋ฐ˜ Dataproc ์ž‘์—…์€ ์ด ๋…ธ๋“œ ํ’€์—์„œ ํฌ๋“œ๋กœ ์‹คํ–‰๋ฉ๋‹ˆ๋‹ค. ๋…ธ๋“œ ํ’€ ๋ฐ ๋…ธ๋“œ ํ’€์˜ ํฌ๋“œ ์˜ˆ์•ฝ์€ GKE์—์„œ ๊ด€๋ฆฌ๋ฉ๋‹ˆ๋‹ค.