Skip to content

Commit 87e33d0

Browse files
committed
remove old parts
1 parent 11baebd commit 87e33d0

File tree

1 file changed

+0
-80
lines changed

1 file changed

+0
-80
lines changed

readme.md

Lines changed: 0 additions & 80 deletions
Original file line numberDiff line numberDiff line change
@@ -205,83 +205,3 @@ The application provides a foundation for understanding enterprise data analytic
205205
- [LocalStack Resource Browser](https://docs.localstack.cloud/user-guide/web-application/resource-browser/)
206206
- [AWS Data Lake Architecture](https://aws.amazon.com/big-data/datalakes-and-analytics/)
207207
- [COVID-19 Data Lake Blog Post](https://aws.amazon.com/blogs/big-data/a-public-data-lake-for-analysis-of-covid-19-data/)
208-
209-
210-
211-
212-
## Instructions
213-
214-
You can build and deploy the sample application on LocalStack by running our `Makefile` commands. Run `make setup` to create the infrastructure on LocalStack. Run `make stop` to delete the infrastructure by stopping LocalStack.
215-
216-
Alternatively, here are instructions to deploy it manually step-by-step.
217-
218-
### Creating the S3 bucket
219-
220-
We will create an S3 bucket to store the datasets. We will use the `awslocal` CLI to create the bucket.
221-
222-
```sh
223-
awslocal s3 mb s3://covid19-lake
224-
awslocal s3 cp CovidLakeStack.template.json s3://covid19-lake/cfn/CovidLakeStack.template.json
225-
awslocal s3 sync ./covid19-lake-data/ s3://covid19-lake/
226-
```
227-
228-
### Creating the Glue Data Catalog
229-
230-
We will create a Glue Data Catalog to set up the definitions for that data and create the database & tables. We will use the `awslocal` CLI to create the database and tables.
231-
232-
```sh
233-
awslocal cloudformation create-stack --stack-name covid-lake-stack --template-url https://covid19-lake.s3.us-east-2.amazonaws.com/cfn/CovidLakeStack.template.json
234-
```
235-
236-
Wait for a few seconds for the infrastructure to be created. You can check the status of the stack using the following command:
237-
238-
```sh
239-
awslocal cloudformation describe-stacks --stack-name covid-lake-stack | grep StackStatus
240-
```
241-
242-
If the StackStatus is `CREATE_COMPLETE`, you can proceed to the next step.
243-
244-
### Running Athena SQL queries
245-
246-
After the CloudFormation stack has been deployed in LocalStack, you can run queries against the data. To make testing more accessible, we have an [Athena SQL viewer](https://app.localstack.cloud/inst/default/resources/athena/sql) in the LocalStack Web Application. You can run queries against the `covid-19` database in the Glue Data Catalog.
247-
248-
Run the query to fetch the hospital beds per US state:
249-
250-
```sql
251-
SELECT * FROM covid_19.hospital_beds LIMIT 10
252-
```
253-
254-
You will see the results of the query in the Athena SQL viewer:
255-
256-
![Results of the query in the Athena SQL viewer for hospital beds per US state](./images/hospital-beds-per-us-state-athena-query.png)
257-
258-
Run the query to get agreggated COVID test data and cases:
259-
260-
```sql
261-
SELECT * FROM covid_19.enigma_aggregation_us_states
262-
```
263-
264-
You will see the results of the query in the Athena SQL viewer:
265-
266-
![Results of the query in the Athena SQL viewer for aggregated COVID test data and cases](./images/agreggated-covid-test-data-cases-athena-query.png)
267-
268-
Run the query to get the list of Moderna vaccine allocations:
269-
270-
```sql
271-
SELECT * FROM covid_19.cdc_moderna_vaccine_distribution
272-
```
273-
274-
You will see the results of the query in the Athena SQL viewer:
275-
276-
![Results of the query in the Athena SQL viewer for the list of Moderna vaccine allocations](./images/moderna-vaccine-allocations-athena-query.png)
277-
278-
You can write your own queries to explore the data in the COVID-19 data lake through LocalStack's Athena Resource Browser.
279-
280-
## Learn more
281-
282-
The sample application is based on a [public AWS sample app](https://github.com/aws-samples/query-data-in-s3-with-amazon-athena-and-aws-sdk-for-dotnet) that leverages Amazon Athena from .NET Core Application using AWS SDK for .NET to run standard SQL to analyze a large amount of data in Amazon S3. See this AWS blog post for more details: [A public data lake for analysis of COVID-19 data](https://aws.amazon.com/blogs/big-data/a-public-data-lake-for-analysis-of-covid-19-data/).
283-
284-
## Contributing
285-
286-
We appreciate your interest in contributing to our project and are always looking for new ways to improve the developer experience. We welcome feedback, bug reports, and even feature ideas from the community.
287-
Please refer to the [contributing file](CONTRIBUTING.md) for more details on how to get started.

0 commit comments

Comments
 (0)