Skip to content
View masondev1024's full-sized avatar
๐ŸŽฏ
Focusing
๐ŸŽฏ
Focusing
0 followers · 1 following

Achievements

Achievement: Pair ExtraordinaireAchievement: YOLOAchievement: Pull Sharkx3Achievement: Quickdraw

Achievements

Achievement: Pair ExtraordinaireAchievement: YOLOAchievement: Pull Sharkx3Achievement: Quickdraw

Block or report masondev1024

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please donโ€™t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this userโ€™s behavior. Learn more about reporting abuse.

Report abuse
masondev1024/README.md

์•ˆ๋…•ํ•˜์„ธ์š”, Mason์ž…๋‹ˆ๋‹ค

BI ์šด์˜ ๊ฒฝํ—˜์„ ๋ฐ”ํƒ•์œผ๋กœ, ์ˆ˜์ง‘๋ถ€ํ„ฐ ๊ฒ€์ฆยท์ œ๊ณต๊นŒ์ง€ ์—ฐ๊ฒฐํ•˜๋Š” ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด.

์žฌ์‹คํ–‰ํ•ด๋„ ์ค‘๋ณต์ด ์Œ“์ด์ง€ ์•Š๊ณ , ์ž˜๋ชป๋œ ๋ฐ์ดํ„ฐ๊ฐ€ ์‚ฌ์šฉ์ž์—๊ฒŒ ๋‹ฟ๊ธฐ ์ „์— ๋ฉˆ์ถ”๋Š” ํŒŒ์ดํ”„๋ผ์ธ ์ง€ํ–ฅ.

์ง€๊ธˆ ์ง‘์ค‘ํ•˜๋Š” ๊ฒƒ

  • ๋ณต๊ตฌ ๊ฐ€๋Šฅํ•œ ์ˆ˜์ง‘: Cloudflare R2์— ์›๋ณธ๊ณผ ์ˆ˜์ง‘ ์ด๋ ฅ์„ ๋ณด์กดํ•ด ์žฌ์ฒ˜๋ฆฌ ๊ธฐ์ค€์  ํ™•๋ณด. Airflow๋กœ ์ž‘์—… ์˜์กด์„ฑยท์žฌ์‹œ๋„ยท๊ณผ๊ฑฐ ๊ตฌ๊ฐ„ ์žฌ์ฒ˜๋ฆฌ ๊ด€๋ฆฌ.
  • ์ค‘๋ณต ์—†๋Š” ์žฌ์‹คํ–‰: 8๋งŒ ํ–‰ ์ด์ƒ ์ ์žฌ ์‹œ SQL ํฌ๊ธฐ ์ œํ•œ์— ๋Œ€์‘ํ•ด Iceberg์˜ ์‚ญ์ œยท์ถ”๊ฐ€๋ฅผ ๋‹จ์ผ ํŠธ๋žœ์žญ์…˜์œผ๋กœ ๊ตฌ์„ฑ. ๊ฐ™์€ ์‹คํ–‰ ๊ตฌ๊ฐ„์„ ์•ˆ์ „ํ•˜๊ฒŒ ๊ต์ฒด.
  • ์ž์› ํ•œ๊ณ„์— ๋งž์ถ˜ ์ฒ˜๋ฆฌ: Trino ๋ฉ”๋ชจ๋ฆฌ ํ•œ๊ณ„์— ๋งž์ถฐ ์ „์ฒด ์ด๋ ฅ ์ค‘๋ณต ์ œ๊ฑฐ๋ฅผ ๋ณ€๊ฒฝ ํ‚ค ์ค‘์‹ฌ์˜ ์ฆ๋ถ„ MERGE๋กœ ์ „ํ™˜. ๋‹ค์‹œ ์ฝ๊ณ  ๊ณ„์‚ฐํ•  ๋ฒ”์œ„ ์ถ•์†Œ.
  • ๊ฒ€์ฆ ํ›„ ์ œ๊ณต: dbt/Trino์—์„œ ํ‚คยทํ–‰ ์ˆ˜ยท์ตœ์‹ ์„ฑ์„ ๊ฒ€์ฆํ•œ ๊ฒฐ๊ณผ๋งŒ D1/Workers๋กœ ๊ฒŒ์‹œ. ์ด๋ ฅ ๋ถ„์„๊ณผ ์‚ฌ์šฉ์ž ์กฐํšŒ ๊ฒฝ๋กœ๋ฅผ ๋ถ„๋ฆฌํ•ด ๋ถˆํ•„์š”ํ•œ ์ „์ฒด ์ด๋ ฅ ์กฐํšŒ ๋ฐฉ์ง€.

ํ•ต์‹ฌ ๊ธฐ์ˆ 

Python SQL Apache Airflow dbt Trino Apache Iceberg Apache Kafka AWS Amazon Kinesis Cloudflare R2 Docker Kubernetes Terraform GitHub Actions LangChain RAG MicroStrategy Linux

GitHub ํ™œ๋™

GitHub ํ™œ๋™ ํ†ต๊ณ„

masondev1024์˜ GitHub ์—ฐ์† ๊ธฐ์—ฌ ๊ธฐ๋ก

์—ฐ๋ฝ์ฒ˜

๋ธ”๋กœ๊ทธ ยท ์ด๋ฉ”์ผ

Pinned Loading

  1. robot-data-pipeline robot-data-pipeline Public

    Python

  2. aws-data-platform-gitops aws-data-platform-gitops Public

    develop my team project

    Python