Merge pull request #47 from ClojureCivitas/initial-workshop-draft

adding workshop article

Author: timothypratley

site/conferences/conj2025/workshop/scicloj/buzz.qmd

@@ -0,0 +1,282 @@
+---
+author: [ezmiller]
+description: Getting to know our host city for Clojure/conj 2025. We dive into 311 service data to see what's on the minds of Charlotte's citizens and get a taste of our hands-on data analysis workshop.
+type: post
+date: '2025-08-15'
+category: conj
+tags: [clay, workflow, conj]
+draft: true
+format:
+  html: {title: 'What''s the Buzz in Charlotte? A Pre-Conj Data Dive'}
+
+---
+<style></style><style>.printedClojure .sourceCode {
+  background-color: transparent;
+  border-style: none;
+}
+</style><style>.clay-limit-image-width .clay-image {max-width: 100%}
+.clay-side-by-side .sourceCode {margin: 0}
+.clay-side-by-side {margin: 1em 0}
+</style>
+<script src="buzz_files/md-default0.js" type="text/javascript"></script><script src="buzz_files/md-default1.js" type="text/javascript"></script><script src="buzz_files/plotly2.js" type="text/javascript"></script>
+This November 12th, Clojure enthusiasts will gather in **Charlotte, North Carolina**
+for Clojure/conj 2025.
+For many of us, it's a cherished yearly tradition of code,
+conversations, and that special *"this is my people"* feeling.
+
+::: {.callout-note}
+Fun fact: during the Revolutionary War, a British general called Charlotte a "hornet's nest of rebellion"
+for its fierce resistance.
+That same spirit of passionate engagement seems to live on in the city's civic life today,
+on display using the hornet as their city emblem.
+:::
+
+In the spirit of exploration that defines our community, let's get to know our host city
+before we even arrive.
+What can 3 million service requests tell us about the heart of Charlotte?
+
+
+## A Glimpse into Charlotte's Data
+
+Let's find out by diving into the city's 311 system, which captures the pulse
+of city life through non-emergency service requests.
+Every pothole report, noise complaint, and fallen tree notification tells a story.
+
+Downloaded from [Charlotte Service Requests](https://data.charlottenc.gov/datasets/charlotte::service-requests-311/explore?location=35.265099%2C-80.810750%2C9.72).
+
+
+::: {.sourceClojure}
+```clojure
+(defonce Charlotte-311
+  (tc/dataset (fs/file (fs/home) "Downloads" "Service_Requests_311.csv")
+              {:key-fn csk/->kebab-case-keyword}))
+```
+:::
+
+
+Let's see what columns we have
+
+
+::: {.sourceClojure}
+```clojure
+(tc/column-names Charlotte-311)
+```
+:::
+
+
+
+::: {.printedClojure}
+```clojure
+(:x
+ :y
+ :objectid
+ :department
+ :division
+ :request-no
+ :fiscal-year
+ :fiscal-month
+ :request-type
+ :received-date
+ :internal-field-observation
+ :title
+ :cmpd-division
+ :neighborhood-profile-area
+ :block-no
+ :street-direction
+ :street-name
+ :street-type
+ :city
+ :state
+ :zip-code
+ :full-address
+ :x-coord
+ :y-coord
+ :latitude
+ :longitude
+ :council-district
+ :global-id
+ :pid)
+
+```
+:::
+
+
+I wonder what the request types are
+
+
+::: {.sourceClojure}
+```clojure
+(tc/group-by Charlotte-311 :request-type)
+```
+:::
+
+
+::: {.clay-dataset}
+_unnamed [175 3]:
+
+|                     :name | :group-id |                                         :data |
+|---------------------------|----------:|-----------------------------------------------|
+|          MISSED RECYCLING |         0 |           Group: MISSED RECYCLING [56694 29]: |
+| CDOT STREET SIGN REP/REPL |         1 |  Group: CDOT STREET SIGN REP/REPL [14259 29]: |
+|  STREET SWEEPING/FLUSHING |         2 |   Group: STREET SWEEPING/FLUSHING [10876 29]: |
+|      NON_RECYCLABLE ITEMS |         3 |     Group: NON_RECYCLABLE ITEMS [1542623 29]: |
+| HNS HEALTH AND SANITATION |         4 | Group: HNS HEALTH AND SANITATION [147023 29]: |
+|       CART REPAIR-GARBAGE |         5 |        Group: CART REPAIR-GARBAGE [69893 29]: |
+|          RECYCLABLE ITEMS |         6 |          Group: RECYCLABLE ITEMS [366433 29]: |
+|     SW DOCUMENT RECYCLING |         7 |      Group: SW DOCUMENT RECYCLING [32594 29]: |
+|  PARKING ON LAWN OFFHOURS |         8 |    Group: PARKING ON LAWN OFFHOURS [6019 29]: |
+|    CDOT SIGHT OBSTRUCTION |         9 |      Group: CDOT SIGHT OBSTRUCTION [4055 29]: |
+|                       ... |       ... |                                           ... |
+|  NEW SVC BUSINESS GARBAGE |       164 |     Group: NEW SVC BUSINESS GARBAGE [225 29]: |
+| CURBIT PICKUP DAY INQUIRY |       165 |     Group: CURBIT PICKUP DAY INQUIRY [39 29]: |
+|        ROW OBSTRUCT OTHER |       166 |          Group: ROW OBSTRUCT OTHER [1630 29]: |
+|  SWS MLTFMLY SITE INVSTGT |       167 |       Group: SWS MLTFMLY SITE INVSTGT [5 29]: |
+|           ILLEGAL PARKING |       168 |             Group: ILLEGAL PARKING [1211 29]: |
+|       ZON DUPLEX/DUPLEXES |       169 |           Group: ZON DUPLEX/DUPLEXES [68 29]: |
+|              SUBDIVISIONS |       170 |                  Group: SUBDIVISIONS [29 29]: |
+|  UT/WATER QUALITY TESTING |       171 |       Group: UT/WATER QUALITY TESTING [1 29]: |
+|             CART PURCHASE |       172 |                  Group: CART PURCHASE [8 29]: |
+| HOMELESS SUPPORT OUTREACH |       173 |    Group: HOMELESS SUPPORT OUTREACH [929 29]: |
+|    HNS ESCALATED REQUESTS |       174 |        Group: HNS ESCALATED REQUESTS [82 29]: |
+
+
+:::
+
+
+Let's see what are the most common requests
+
+
+::: {.sourceClojure}
+```clojure
+(def frequent-requests
+  (-> Charlotte-311
+      (tc/group-by :request-type)
+      (tc/aggregate {:frequency tc/row-count})
+      (tc/order-by :frequency :desc)))
+```
+:::
+
+
+
+::: {.sourceClojure}
+```clojure
+frequent-requests
+```
+:::
+
+
+::: {.clay-dataset}
+_unnamed [175 2]:
+
+|              :$group-name | :frequency |
+|---------------------------|-----------:|
+|      NON_RECYCLABLE ITEMS |    1542623 |
+|          RECYCLABLE ITEMS |     366433 |
+| HNS HEALTH AND SANITATION |     147023 |
+|       CART REPAIR-GARBAGE |      69893 |
+|          MISSED RECYCLING |      56694 |
+|              311 DOCUMENT |      52972 |
+|       SW DOCUMENT GARBAGE |      46761 |
+|     SW DOCUMENT RECYCLING |      32594 |
+|    DEAD ANIMAL COLLECTION |      30048 |
+|    SW DOCUMENT YARD WASTE |      26465 |
+|                       ... |        ... |
+|    COVID 19-PRICE GOUGING |          4 |
+| SW EXCESSIVE STORM-SW USE |          2 |
+|  SW REMINDER BULKY-SW USE |          2 |
+| SWS MLTFMLY FIELD OBSERVE |          2 |
+|   ON CALL - SWS SPEC SERV |          1 |
+|           COMPLEX PROBLEM |          1 |
+|              UT/LANDSCAPE |          1 |
+|            DISABILITY ACT |          1 |
+|              UT/MANDATORY |          1 |
+| BUS STOP-REMOVE TRASH CAN |          1 |
+|  UT/WATER QUALITY TESTING |          1 |
+
+
+:::
+
+
+The most frequent request type is about non-recyclable items.
+It suggests Charlotte residents care about recycling
+but might need clearer guidelines about what can be recycled.
+The high volume of requests also shows that people feel comfortable
+asking the city for guidance.
+Data like this helps cities improve their communication and services.
+
+
+::: {.sourceClojure}
+```clojure
+(-> frequent-requests
+    (plotly/base {:=title "Charlotte 311 Service Requests"})
+    (plotly/layer-bar {:=x-title "Request Type"
+                       :=y :frequency
+                       :=y-title "Count"}))
+```
+:::
+
+
+
+```{=html}
+<div style="height:auto;width:100%;"><script>Plotly.newPlot(document.currentScript.parentElement,
+               [{"y":[1542623,366433,147023,69893,56694,52972,46761,32594,30048,26465,25145,24900,24268,23914,20396,20359,20121,18946,17301,16702,16495,16012,15404,14337,14259,13106,12496,10876,10659,10616,10461,9922,9117,8710,8601,8286,8255,8243,8128,8057,7749,7528,7266,7264,6936,6355,6249,6019,5467,5301,5124,4967,4879,4431,4355,4055,3939,3836,3723,3559,3480,3248,3200,3003,2957,2823,2700,2663,2592,2592,2518,2392,2321,2187,2175,1874,1643,1630,1598,1440,1431,1365,1335,1325,1248,1211,1136,1045,1043,1001,983,977,971,969,929,870,836,835,816,794,790,785,785,677,564,509,478,476,441,406,368,364,351,331,278,264,250,228,225,219,214,210,208,185,180,151,128,125,113,105,100,89,82,74,68,63,61,60,53,51,43,41,39,37,33,29,28,28,27,22,18,15,15,15,12,11,10,9,9,8,8,6,5,4,4,2,2,2,1,1,1,1,1,1,1],"r":null,"name":"","fill":null,"mode":null,"width":null,"type":"bar","theta":null,"z":null,"lon":null,"lat":null,"text":null}], {"width":500,"height":400,"margin":{"t":25},"automargin":false,"plot_bgcolor":"rgb(235,235,235)","xaxis":{"gridcolor":"rgb(255,255,255)","title":"Request Type","showgrid":true},"yaxis":{"gridcolor":"rgb(255,255,255)","title":"Count","showgrid":true},"title":"Charlotte 311 Service Requests"}, {});</script></div>
+```
+
+
+That's a long tail you have there.
+Let's focus on the top 5.
+
+
+::: {.sourceClojure}
+```clojure
+(-> frequent-requests
+    (tc/select-rows (range 5))
+    (plotly/base {:=title "Charlotte 311 Service Requests"})
+    (plotly/layer-bar {:=x :$group-name
+                       :=x-title "Request Type"
+                       :=y :frequency
+                       :=y-title "Count"}))
+```
+:::
+
+
+
+```{=html}
+<div style="height:auto;width:100%;"><script>Plotly.newPlot(document.currentScript.parentElement,
+               [{"y":[1542623,366433,147023,69893,56694],"r":null,"name":"","fill":null,"mode":null,"width":null,"type":"bar","theta":null,"z":null,"lon":null,"lat":null,"x":["NON_RECYCLABLE ITEMS","RECYCLABLE ITEMS","HNS HEALTH AND SANITATION","CART REPAIR-GARBAGE","MISSED RECYCLING"],"text":null}], {"width":500,"height":400,"margin":{"t":25},"automargin":false,"plot_bgcolor":"rgb(235,235,235)","xaxis":{"gridcolor":"rgb(255,255,255)","title":"Request Type","showgrid":true},"yaxis":{"gridcolor":"rgb(255,255,255)","title":"Count","showgrid":true},"title":"Charlotte 311 Service Requests"}, {});</script></div>
+```
+
+
+This brief analysis gives us a snapshot of daily life in Charlotte, revealing a community
+that's actively engaged in civic life and recycling. It's a perfect backdrop for the
+kind of thoughtful problem-solving we cherish in the Clojure community.
+
+![Clean data, clean streets. A city after our own hearts.](buzz.webp)
+
+
+## Join Us at the Workshop
+
+This journey from a raw CSV file to a clear visualization is exactly what our
+**Empowering Data Analysis through SciCloj** [workshop](https://www.2025.clojure-conj.org/workshops) is all about.
+Led by me, Ethan Miller, you'll start your Conj experience by diving into practical,
+hands-on data analysis and come away with new ideas to carry back home.
+
+**You will learn how to:**
+
+- Load and explore real-world datasets
+- Create clear, reproducible analyses
+- Share your insights through interactive notebooks
+- Leverage Clojure's immutable data structures for data science
+
+We can't wait to explore data with you. See you in Charlotte!
+
+
+```{=html}
+<div style="background-color:grey;height:2px;width:100%;"></div>
+```
+
+
+
+```{=html}
+<div><pre><small><small>source: <a href="https://github.com/ClojureCivitas/clojurecivitas.github.io/blob/main/src/conferences/conj2025/workshop/scicloj/buzz.clj">src/conferences/conj2025/workshop/scicloj/buzz.clj</a></small></small></pre></div>
+```

site/db.edn

@@ -4,6 +4,11 @@
    :image "https://avatars.githubusercontent.com/u/36110?v=4"
    :url   "https://chouser.us/"
    :links [{:icon "github" :href "https://github.com/chouser"}]}
+  {:id :ezmiller
+   :name "Ethan Miller"
+   :image "https://avatars.githubusercontent.com/u/772738?v=4"
+   :url "https://github.com/ezmiller"
+   :affiliation [:scicloj]}
   {:id          :daslu
    :name        "Daniel Slutsky"
    :image       "https://avatars.githubusercontent.com/u/5673102?v=4"