Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
91f4836
Updated makefile
LRDOC Mar 28, 2024
94b33ec
shape files updated
darbyatNE Mar 28, 2024
e3848e5
Update makefile (2)
LRDOC Mar 28, 2024
2ad016a
shape files modified
darbyatNE Mar 28, 2024
9e45802
deleted tabblock data
LRDOC Mar 28, 2024
fae1a8c
Merge pull request #2 from ds5010/liam
charVANder Mar 28, 2024
811f5db
src dir purged
darbyatNE Mar 28, 2024
15c3730
THIS BETTER WORK
ErinP123 Mar 28, 2024
8613d3f
plots population density
pbnu Mar 28, 2024
0a0b846
updating map -- work in progress
pbnu Mar 29, 2024
d8d26fa
added prototype of new github-pages site
pbogden Mar 30, 2024
5730263
restoring Makefile from main branch
pbogden Mar 30, 2024
e07ca3f
Merge pull request #7 from ds5010/pbstuff2
pbogden Mar 30, 2024
a526d47
Made Updates from First bullet point in class
ErinP123 Apr 2, 2024
ebfa455
Merge pull request #9 from ds5010/ErinCLass0402
darbyatNE Apr 3, 2024
86de4ac
modifies readme instructions, rewrites makefile; adds create_json.py …
darbyatNE Apr 3, 2024
9518c65
v2 modified readme, modified makefile, added create_json.py
darbyatNE Apr 4, 2024
9fa9c8c
Updated README and deleted unnecessary files
charVANder Apr 4, 2024
9a6e0de
Merge pull request #11 from ds5010/van
LRDOC Apr 4, 2024
809e278
Added dictionary.json (created by make_dictionary.py)
charVANder Apr 4, 2024
a3c12c2
Merge pull request #12 from ds5010/van
LRDOC Apr 4, 2024
2f33e6c
Update Makefile
charVANder Apr 4, 2024
3169ce3
Merge pull request #13 from ds5010/van
LRDOC Apr 4, 2024
2d39981
Merge branch 'main' into bd
LRDOC Apr 4, 2024
19640ec
Merge pull request #10 from ds5010/bd
LRDOC Apr 4, 2024
555b72c
Added data.json and script
charVANder Apr 5, 2024
e62a38b
Merge pull request #14 from ds5010/van
darbyatNE Apr 5, 2024
06b398c
make_plots only
darbyatNE Apr 6, 2024
e8be9f0
Merge pull request #15 from ds5010/bd3
charVANder Apr 6, 2024
e8b7469
Added PNGs, updated Makefile, gitignore, and README
charVANder Apr 6, 2024
6c18f9e
Fixed illegible figure issue
charVANder Apr 6, 2024
16144f8
Normalized colorbar for percentage figures
charVANder Apr 6, 2024
20c1dfb
Fixed figures
charVANder Apr 6, 2024
4795e83
Merge pull request #16 from ds5010/ek_branch
darbyatNE Apr 6, 2024
215221b
Added code to make bar graphs
ErinP123 Apr 9, 2024
fba75ee
Added county level geojson/json/dictionary stuff
charVANder Apr 10, 2024
62a3cfb
adding counties.json and tracts.json
pbnu Apr 10, 2024
c08e6a7
adding framework site
pbnu Apr 11, 2024
4088da9
updating docs/dist
pbnu Apr 11, 2024
0237b66
Merge pull request #18 from ds5010/ek_branch
LRDOC Apr 11, 2024
05ba7f7
Merge pull request #17 from ds5010/ErinCLass0402
charVANder Apr 11, 2024
4f6de63
Erin Json Attempt
ErinP123 Apr 11, 2024
7063466
Stripped Maine
ErinP123 Apr 11, 2024
be7c959
Merge pull request #19 from ds5010/ErinInformationJson
LRDOC Apr 11, 2024
9d1fcb4
tracts.json issue fixed
charVANder Apr 11, 2024
dc59044
Merge pull request #20 from ds5010/ek_json
LRDOC Apr 11, 2024
adc28d0
added code to convert json to html
ErinP123 Apr 11, 2024
f73af32
popup_info.json
LRDOC Apr 11, 2024
0b486cd
Merge pull request #21 from ds5010/ErinInformationJson
LRDOC Apr 11, 2024
f0c4eed
Merge pull request #22 from ds5010/popup_info
LRDOC Apr 11, 2024
3c6f261
update
pbnu Apr 11, 2024
065879d
Merge branch 'main' of github.com:ds5010/broadband-4
pbnu Apr 11, 2024
4824f88
updating site
pbnu Apr 11, 2024
6e17c11
popup html and json
LRDOC Apr 11, 2024
c613b07
Merge pull request #23 from ds5010/popup_html_and_json
LRDOC Apr 11, 2024
2bf09ca
fixed docs/.nojekyll
pbogden Apr 12, 2024
32daa3a
new shape file and restricted data to Maine only
Apr 14, 2024
d932416
updated shapefile and merge
Apr 15, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 1 addition & 3 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -2,13 +2,11 @@
*.gz
*.swp

#files to ignore


#Folders to ignore
data/
test/

#Mac clean-up
__pycache__
*.ds_store

55 changes: 19 additions & 36 deletions Makefile
Original file line number Diff line number Diff line change
@@ -1,41 +1,24 @@
# Allows use of make data while having a data folder
.PHONY: data img
.PHONY: data

all: clean-data data img speed avg json state block DDI
# Creates the data folder
# Creates the data folder and populates it with the necessary files
data:
mkdir -p data
cd data; curl -LO https://www2.census.gov/geo/tiger/TIGER2022/TABBLOCK20/tl_2022_23_tabblock20.zip
cd data; curl -LO https://www2.census.gov/geo/maps/DC2020/DC20BLK/st23_me/cousub/cs2301945810_millinocket/DC20BLK_CS2301945810_BLK2MS.txt
cd data; curl -LO https://github.com/dobnu/fcc-data/raw/main/bdc_23_Cable_fixed_broadband_063022.zip
cd data; curl -LO https://github.com/dobnu/fcc-data/raw/main/bdc_23_Copper_fixed_broadband_063022.zip
cd data; curl -LO https://github.com/dobnu/fcc-data/raw//main/bdc_23_Fiber-to-the-Premises_fixed_broadband_063022.zip
cd data; curl -LO https://github.com/dobnu/fcc-data/raw/main/bdc_23_Licensed-Fixed-Wireless_fixed_broadband_063022.zip

img:
mkdir -p img

speed:
python3 -B src/speeds.py

avg:
python3 -B src/compute_avg.py

json:
python3 -B src/create_json.py

state: img
python3 -B src/plot_state.py

block: img
python3 -B src/plot_block.py

DDI: data/
python3 -B src/DDI.py

maps: data/
python3 -B src/maps.py

clean-data:
cd data; curl -LO https://www2.census.gov/geo/tiger/TIGER2019/TRACT/tl_2019_23_tract.zip
cd data; curl -LO https://www2.census.gov/geo/tiger/TIGER2019/COUNTY/tl_2019_us_county.zip
cd data; curl -LO https://www2.census.gov/programs-surveys/demo/datasets/community-resilience/county_tract_total_covered_populations.xlsx
python -B src/make_dictionary.py
python -B src/make_county_dictionary.py
python -B src/create_json.py
python -B src/create_county_json.py

plots:
mkdir -p figs
mkdir -p figs/tract
mkdir -p figs/county
python -B src/make_plots.py
python -B src/make_county_plots.py

# Removes the data folder and all of its contents
clean:
rm -rf data

133 changes: 82 additions & 51 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,77 +1,108 @@
# broadband-3
# Broadband-4
This repository takes data about Maine populations and plots them based on census tracts and counties.

## Step 0
Run following command to download all of the data:
## Instructions for Use
### *Step 1: Generating the Data*
After cloning the repository, the following command will download and clean necessary data, placing them within the required directories
```
make data
```
The data comes from the following sources:

The FCC National Broadband Map [here](https://broadbandmap.fcc.gov/data-download/nationwide-data).
Download the data for Cable, Copper, and Fiber to the Premises, then save those to your data folder.
### *Step 2: Reproducing the Map Figures*
The following command will plot the figures of covered populations of Maine tracts/counties based on numerous factors and save the PNGs in the `figs` directory. The covered population factors include *Total Covered Households, Low Income/Poverty, Ages 60+, Incarcerated, Disability, Veterans, Language Barrier, Those w/o Broadband or Computers, Minorities, Rural Living, ESL, Low Literacy (county only), and Those w/o Fixed Broadband (county only)*.
```
make plots
```
### Tract Plots
<p align="center">
<img src="figs/tract/covered_population.png" width="700">
</p><br>

The US Census Bureau shapefiles [here](https://www.census.gov/geographies/mapping-files/time-series/geo/tiger-line-file.html).
The specific file is found [here](https://www2.census.gov/geo/tiger/TIGER2022/TABBLOCK20/tl_2022_23_tabblock20.zip).
<p align="center">
<img src="figs/tract/near_poverty.png" width="700">
</p><br>

US Census Bureau county subdivision information [here](https://www2.census.gov/geo/maps/DC2020/DC20BLK/st23_me/cousub/cs2301945810_millinocket/DC20BLK_CS2301945810_BLK2MS.txt).
<p align="center">
<img src="figs/tract/Age 60+.png" width="700">
</p><br>

<p align="center">
<img src="figs/tract/Incarcerated.png" width="700">
</p><br>

## Step 1
Run the following command to a csv file with the maximum download speeds for Cable, Copper, and Fiber for each census block in Maine:
<p align="center">
<img src="figs/tract/Disabled.png" width="700">
</p><br>

```
make speed
```
<p align="center">
<img src="figs/tract/Veterans.png" width="700">
</p><br>

## Step 2
Calculate the average download speeed for Millinocket, which will be printed to the terminal.
<p align="center">
<img src="figs/tract/Language Barrier.png" width="700">
</p><br>

```
make avg
```
<p align="center">
<img src="figs/tract/Lack Broadband or Computers.png" width="700">
</p><br>

The output you recieve should be "Millinocket average download speed: 516.423"
<p align="center">
<img src="figs/tract/Minorities.png" width="700">
</p><br>

## Step 3
Merge the maximum download speeds information with the Census block data for Maine.
<p align="center">
<img src="figs/tract/People in Rural Areas.png" width="700">
</p><br>

```
make json
```
<p align="center">
<img src="figs/tract/Non-native English Speakers.png" width="700">
</p><br>

## Step 4
Create a plot for maximum broadband speeds available throughout Maine
### County Plots
<p align="center">
<img src="figs/county/covered_population.png" width="700">
</p><br>

```
make state
```
![](img/Maine_speeds.png)
## Step 5
Create a plot for maximum broadband speeds available in the individual Census blocks of Millinocket, Maine
<p align="center">
<img src="figs/county/near_poverty.png" width="700">
</p><br>

```
make block
```
![](img/Millinocket_speeds.png)
<p align="center">
<img src="figs/county/Age 60+.png" width="700">
</p><br>

<p align="center">
<img src="figs/county/Incarcerated.png" width="700">
</p><br>

## Step 6
<p align="center">
<img src="figs/county/Disabled.png" width="700">
</p><br>

```
make DDI
```
DDI Data of different speeds will be saved as a CSV in data folder
<p align="center">
<img src="figs/county/Veterans.png" width="700">
</p><br>

<p align="center">
<img src="figs/county/Language Barrier.png" width="700">
</p><br>

## Step 7
Create plots and GeoJSON files for DDI, SE, and INFA scores by running the following command:
```
make maps
```
<p align="center">
<img src="figs/county/Lack Broadband or Computers.png" width="700">
</p><br>

<p align="center">
<img src="figs/county/Minorities.png" width="700">
</p><br>

The plots should look like this:
![](img/DDI_tract.png)
<p align="center">
<img src="figs/county/People in Rural Areas.png" width="700">
</p><br>

![](img/SE_tract.png)
<p align="center">
<img src="figs/county/Non-native English Speakers.png" width="700">
</p><br>

![](img/INFA_tract.png)
<p align="center">
<img src="figs/county/County-level Only Columns.png" width="700">
</p><br>
Empty file added docs/.nojekyll
Empty file.
405 changes: 0 additions & 405 deletions docs/DDI.json

This file was deleted.

405 changes: 0 additions & 405 deletions docs/INFA.json

This file was deleted.

7 changes: 7 additions & 0 deletions docs/_npm/@observablehq/plot@0.6.14/_esm.js

Large diffs are not rendered by default.

7 changes: 7 additions & 0 deletions docs/_npm/binary-search-bounds@2.0.5/_esm.js

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

7 changes: 7 additions & 0 deletions docs/_npm/d3-array@3.2.4/_esm.js

Large diffs are not rendered by default.

7 changes: 7 additions & 0 deletions docs/_npm/d3-axis@3.0.0/_esm.js

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

Loading