Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: update Observed PM2.5 sensor data #152

Open
wants to merge 6 commits into
base: main
Choose a base branch
from

Conversation

bodom0015
Copy link
Collaborator

@bodom0015 bodom0015 commented Apr 17, 2024

Problem

Observed Particulate Matter (PM2.5) data needs to be updated

Fixes #148

Approach

  • feat: use new data + metadata links from @jluiuc to display this data in the ChiVes frontend

Screenshot 2024-04-17 at 3 45 44 PM

How to Test

  1. Navigate to https://deploy-preview-152--chicago-env-explorer.netlify.app/map
  2. From the Variables dropdown, select "Observed Particulate Matter (PM2.5)" from the Air Quality category
    • You should see the data is displayed in the map to the right
    • You should see some overlayed sensor readings appear in the map (do these values need to be updated as well?)
    • You should see some additional controls in the panel, such as "2D or 3D" and "Aggregated by Tract or Source Data"
  3. Toggle from "Aggregated by Tract" to "Source Data"
    • You should see that different values now appear in the map
  4. Toggle from 2D to 3D
    • You should see the perspective shift slightly to show a 3D rendering of this data on the map

Copy link

netlify bot commented Apr 17, 2024

Deploy Preview for chicago-env-explorer ready!

Name Link
🔨 Latest commit d16535f
🔍 Latest deploy log https://app.netlify.com/sites/chicago-env-explorer/deploys/664e209ec55aa300087f3d4b
😎 Deploy Preview https://deploy-preview-152--chicago-env-explorer.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@jluiuc
Copy link
Collaborator

jluiuc commented Apr 17, 2024

It looks like the overlaid sensor readings are from the old data, as they contain values higher than the new data's highest value. Also, I noticed the legend properly shows the true min and max at each end, but in between the value do not match this.

Copy link
Collaborator

@jluiuc jluiuc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like the overlaid sensor readings are from the old data, as they contain values higher than the new data's highest value. Also, while the Aggregated by Tract/Source Data button works, I'm not sure what the differences are from, as I only submitted values aggregated to each tract. Perhaps this is also from the old data? I also noticed the legend properly shows the true min and max at each end, but in between the values do not match this (but the min and max are definitely correct).

@bodom0015
Copy link
Collaborator Author

bodom0015 commented Apr 22, 2024

Hey, @jluiuc! Thank you for bringing these issues up, and sorry for overlooking them in my first attempt 🙏

I removed the old/hardcoded bins - this should fix the Legend at the bottom to display quantile bins 👍

@mradamcox and I are looking into the toggle for "Aggregated vs Source Data" as well as the "Weekly PM2.5" overlay, since they both appear to be using old sensor data as you mentioned. We've tracked down the PM2.5 overlay values to an archived process here. I don't have direct access to the S3 bucket here, so we're trying to figure out the best way to update this data going forward 🤔

@jluiuc
Copy link
Collaborator

jluiuc commented Apr 22, 2024

Great, the legend looks good now! Also, I have the raster from the initial interpolation before aggregating to tracts. Maybe that is what the Aggregated vs Source Data button did? I'm also thinking the number overlays might correlate to each sensor from the previous data. I also have the reading averages and lat/long for each sensor if that is desired.

@bodom0015
Copy link
Collaborator Author

Per @Makosak I've updated the bins + color scale so that they mostly match the other Air Quality variables, despite the differing number of bins:
Screenshot 2024-04-23 at 11 50 45 AM

@jluiuc let me know if there's any other information I can provide that might help with updating the "Source Data" toggle and/or the overlayed sensor values 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Microsoft Sensor reading aggregate to map
2 participants