Skip to content

4EVR0/Iceberg_UI

Repository files navigation

Olive Young Ops UI

Standalone Streamlit UI for checking Glue/Iceberg table status.

The app also supports Grafana-style drilldown links that open a dedicated Athena-backed query view.

Run

pip install -r requirements.txt
streamlit run app.py --server.address 0.0.0.0 --server.port 8501

The app uses the default boto3/PyIceberg AWS credential chain. No pipeline package imports are required.

Optional Environment Variables

OPS_UI_AWS_REGION=ap-northeast-2
OPS_UI_S3_BUCKET=oliveyoung-crawl-data
OPS_UI_OLIVEYOUNG_WAREHOUSE=s3://oliveyoung-crawl-data/olive_young_iceberg_metadata/
OPS_UI_INCI_WAREHOUSE=s3://oliveyoung-crawl-data/inci_iceberg_metadata/
OPS_UI_ICEBERG_CATALOG_NAME=glue
OPS_UI_ICEBERG_CATALOG_TYPE=glue
OPS_UI_ATHENA_DATABASE=oliveyoung_db
OPS_UI_ATHENA_WORKGROUP=primary
OPS_UI_ATHENA_OUTPUT=s3://your-athena-query-results-prefix/

Defaults match the current production paths.

Drilldown URL Examples

/?view=drilldown&metric=category_failure&catalog=oliveyoung_db&table=oliveyoung_silver_error&main_category=스킨케어&sub_category=토너&snapshot_mode=latest

/?view=drilldown&metric=error_type_spike&catalog=oliveyoung_db&table=oliveyoung_silver_error&error_type=category_parse_failed&snapshot_mode=latest

/?view=drilldown&metric=category_success_count&catalog=oliveyoung_db&table=oliveyoung_silver_current&snapshot_mode=latest&batch_date=2026-07-11&main_category=메이크업

If batch_date is provided without any previous_* parameters, the drilldown automatically compares the latest snapshot with the last DELETE snapshot committed on that UTC date.

About

Iceberg MetaData Table 조회용 UI

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

No releases published

Packages

 
 
 

Contributors