{"contributors":[],"created":"2024-03-28T19:29","description":"Eine gemeinsame digitale Werkzeugkiste","homepage":"","keywords":["dribdat","hackathon","co-creation"],"licenses":[{"name":"ODC-PDDL-1.0","path":"http://opendatacommons.org/licenses/pddl/","title":"Open Data Commons Public Domain Dedication & License 1.0"}],"name":"event-3","resources":[{"data":[{"aftersubmit":"","boilerplate":"### 🚀 Let's launch your idea!\r\n\r\nWrite a **Title** and short **Summary**, select a **Template** if one is available, or use the **Readme** link to fetch an open source repository on [GitHub](https://github.com), [GitLab](https://gitlab.com) or [Bitbucket](https://bitbucket.org); an online document at [Etherpad](http://etherpad.org), [Instructables](http://instructables.com), [HackMD or CodiMD](https://hackmd.io), [Google Docs](http://docs.google.com) (Published to Web) or [DokuWiki](http://make.opendata.ch/wiki/project:home).\r\n\r\n_Need more help?_ Get in touch with the organising team, or raise [an issue](https://github.com/dribdat/dribdat/issues).\r\n","certificate_path":"","community_embed":"
The contents of this website, unless otherwise stated, are licensed under a Creative Commons Attribution 4.0 International License.
\r\n","community_url":"","custom_css":"","description":"","ends_at":"2023-03-21T16:00","gallery_url":"","has_finished":true,"has_started":false,"hashtags":"","hostname":"Hack4SocialGood","id":3,"instruction":"","location":"","location_lat":0.0,"location_lon":0.0,"logo_url":"","name":"Data Toolbox","starts_at":"2022-03-21T09:00","summary":"Eine gemeinsame digitale Werkzeugkiste","webpage_url":""}],"name":"events"},{"data":[{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"","created_at":"2022-03-21T13:24","download_url":"https://www.ubst.bafu.admin.ch/opendata/UBD0104.ods","event_name":"Data Toolbox","event_url":"https://bd.hack4socialgood.ch/event/3","excerpt":"Once you have identified Open Data of relevance to your project, and made use of it inside of your project, you can publish it within a container that allows easy and up-to-date use from a range of programming languages (Python, R, Julia, JavaScript, etc.) and tools (Dribdat, Dataworld, Superset, PowerBI, etc.)\r\n\r\nHere are example instructions for use within the R language:\r\n\r\nhttps://bd.hack4socialgood.ch/project/54\r\n\r\nIf your data is not Open, or needs to be protected in some way, a Data Packa...","hashtag":"","id":52,"ident":"","image_url":"","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"Once you have identified Open Data of relevance to your project, and made use of it inside of your project, you can publish it within a container that allows easy and up-to-date use from a range of programming languages (Python, R, Julia, JavaScript, etc.) and tools (Dribdat, Dataworld, Superset, PowerBI, etc.)\r\n\r\nHere are example instructions for use within the R language:\r\n\r\nhttps://bd.hack4socialgood.ch/project/54\r\n\r\nIf your data is not Open, or needs to be protected in some way, a Data Package which contains *only* the metadata can still be very useful to people who would like to contact you for more information about your research. They would be able to see a schema, or even a sample of the data, in a convenient and standard way.\r\n\r\n# How to create a Data Package\r\n\r\n\ud83c\udf0a The source of the sample data in this guide is [opendata.swiss](https://opendata.swiss/de/dataset/badegewaesserqualitaet). \r\n\r\n## (1) Create a tabular dataset\r\n\r\nDownload a spreadsheet (e.g. [get a copy](https://opendata.swiss/de/dataset/badegewaesserqualitaet) of the data shown above), and convert the worksheet containing the data to a CSV file. Preview:\r\n\r\n\r\n\r\n\r\n## (2) Generate a Data Package\r\n\r\nUse the [Data Package Creator](https://create.frictionlessdata.io/) to upload your CSV file (click **Load** at the top right), then **Add Fields** to show all the columns. Check the various field settings, add metadata (name, title, license, etc.) on the left hand column, and finally **Validate** and **Download** your Data Package.\r\n\r\n![Title](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/hack4socialgood/2ZQIPK80W3X36DAZXWDYQUML.png)\r\n\ud83d\udce6 Frictionless Data: [datapackage.json](https://bucketeer-036aa605-c047-4623-8610-f1764b90cf98.s3.amazonaws.com/hack4socialgood/GJ376F81MFVYP71WBGSEGHGZ.json)\r\n\r\nYou can also **Upload** the example shown above into the Creator tool.\r\n\r\n## (3) Next steps\r\n\r\nTo find out how to publish the Data Package in such a way that it is accessible to a general audience, visit the [Software Toolkit](https://frictionlessdata.io/software/) page of the Frictionless Data project. For example, uploading to [Datahub.io](https://datahub.io/loleg/ttn-twist2018-dataset) allows the use of VEGA visualizations and embedded maps. \r\n\r\n\r\n\ud83d\uddfa\ufe0f Map: [map.geo.admin.ch](https://map.geo.admin.ch/?lang=de&topic=ech&bgLayer=voidLayer&layers=ch.swisstopo.swisstlm3d-karte-farbe,ch.bafu.gewaesserschutz-badewasserqualitaet,ch.bafu.hydrologie-wassertemperaturmessstationen,ch.meteoschweiz.messwerte-lufttemperatur-10min&E=2601495.27&N=1201237.93&zoom=4&layers_opacity=0.8,1,1,1)\r\n\r\nCompare this to the GeoAdmin map of the data above, as well as the Opendata.swiss \"Preview\" tool shown at the top of the page, which depends on user interaction.","maintainer":"oleg","name":"Data Packaging","phase":"Prototype","progress":30,"score":47,"source_url":"","stats":{"commits":0,"during":6,"people":2,"sizepitch":3352,"sizetotal":3385,"total":6,"updates":3},"summary":"From Dataset to Frictionless Data","team":"oleg, Eva","team_count":2,"updated_at":"2024-03-26T09:01","url":"https://bd.hack4socialgood.ch/project/52","webpage_url":"https://ckan.opendata.swiss/dataset/badegewaesserqualitaet/resource/d8cd53ac-5b18-4ee2-bb7d-75de9d0f3c3e/view/acd3f927-77ad-4f49-b459-9e9bc036ce2c"},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"","created_at":"2022-03-22T07:30","download_url":"","event_name":"Data Toolbox","event_url":"https://bd.hack4socialgood.ch/event/3","excerpt":"We discussed the question of collecting data through scraping of Web sites, PDF files and APIs in class, but did not manage to get too deep into specifics. On this page are recommended tutorials. Feel free to add a comment if you have another one in mind! \r\n\r\n## Web pages\r\n\r\n- [Introduction to Web scraping in R from University of Wisconsin-Madison](https://sscc.wisc.edu/sscc/pubs/webscraping-r/index.html)\r\n- [Scrapingbee - Web Scraping with R](https://www.scrapingbee.com/blog/web-scraping-r/)\r\n-...","hashtag":"","id":56,"ident":null,"image_url":"","is_challenge":false,"is_webembed":false,"logo_color":"","logo_icon":"","longtext":"We discussed the question of collecting data through scraping of Web sites, PDF files and APIs in class, but did not manage to get too deep into specifics. On this page are recommended tutorials. Feel free to add a comment if you have another one in mind! \r\n\r\n## Web pages\r\n\r\n- [Introduction to Web scraping in R from University of Wisconsin-Madison](https://sscc.wisc.edu/sscc/pubs/webscraping-r/index.html)\r\n- [Scrapingbee - Web Scraping with R](https://www.scrapingbee.com/blog/web-scraping-r/)\r\n- [RStudio - rvest: easy web scraping](https://www.rstudio.com/blog/rvest-easy-web-scraping-with-r/)\r\n\r\n## PDFs\r\n\r\n- https://tabula.technology/\r\n- [tabulizer package](https://www.rdocumentation.org/packages/tabulizer/versions/0.2.2)\r\n- https://docs.ropensci.org/pdftools/\r\n\r\n## APIs\r\n\r\n- https://www.dataquest.io/blog/r-api-tutorial/\r\n- https://jeroen.cran.dev/jsonlite/articles/json-apis.html\r\n- https://www.r-bloggers.com/2015/11/accessing-apis-from-r-and-a-little-r-programming/\r\n\r\n## Stats\r\n\r\n- http://milton-the-cat.rocks/home/adventr.html\r\n- https://dsbrillantes.github.io/ISL-R-Notebooks/","maintainer":"","name":"Web Scraping","phase":"Research","progress":10,"score":19,"source_url":"","stats":{"commits":0,"during":0,"people":0,"sizepitch":1094,"sizetotal":1094,"total":0,"updates":0},"summary":"","team":"","team_count":0,"updated_at":"2022-03-22T07:30","url":"https://bd.hack4socialgood.ch/project/56","webpage_url":""},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"","created_at":"2022-03-21T22:38","download_url":"https://rstudio.cloud/project/1685520","event_name":"Data Toolbox","event_url":"https://bd.hack4socialgood.ch/event/3","excerpt":"The image above is a screenshot of an example R program running on [RStudio Cloud](https://rstudio.cloud/). This uses the [R library for CKAN](https://extensions.ckan.org/extension/ckanr/) to connect to [opendata.swiss](https://opendata.swiss), [data.stadt-zuerich.ch](https://data.stadt-zuerich.ch/dataset) and other [data portals](http://dataportals.org/) which support the [CKAN API](https://docs.ckan.org/en/latest/api/index.html). Why is this important?\r\n\r\n- You are using the latest version of ...","hashtag":"","id":53,"ident":null,"image_url":"","is_challenge":false,"is_webembed":true,"logo_color":"","logo_icon":"","longtext":"The image above is a screenshot of an example R program running on [RStudio Cloud](https://rstudio.cloud/). This uses the [R library for CKAN](https://extensions.ckan.org/extension/ckanr/) to connect to [opendata.swiss](https://opendata.swiss), [data.stadt-zuerich.ch](https://data.stadt-zuerich.ch/dataset) and other [data portals](http://dataportals.org/) which support the [CKAN API](https://docs.ckan.org/en/latest/api/index.html). Why is this important?\r\n\r\n- You are using the latest version of the dataset;\r\n- Your program is showing each step of the data extraction process;\r\n- If there are notable changes to the data, including errors or improvements, they will soon be picked up;\r\n- Additional metadata that is not part of the dataset content can be useful to your process.\r\n\r\nTry copying and adapting the code for yourself:\r\n\r\n```R\r\nlibrary('ckanr')\r\n\r\n# Initialise the CKAN library with a remote portal\r\nckanr_setup(url = \"https://data.stadt-zuerich.ch/\")\r\n\r\n# Run a search to get a list of datasets\r\ndatasearch <- package_search(q = 'frauen', rows=20)$results\r\n\r\n# Take the first result available\r\nopendataset = datasearch[[1]]\r\n\r\nprint(opendataset$title)\r\nprint(opendataset$resources[[1]]$name)\r\n\r\n# Get the dataset contents through the first resource URL\r\ncsv_url = opendataset$resources[[1]]$url\r\n\r\n# Read as CSV for further processing, visualisation..\r\ncsvdata <- read.csv(csv_url, header=T, sep=\",\")\r\n```","maintainer":"","name":"CKANR","phase":"Project","progress":5,"score":17,"source_url":"https://github.com/ropensci/ckanr","stats":{"commits":0,"during":0,"people":0,"sizepitch":1422,"sizetotal":1452,"total":0,"updates":0},"summary":"Accessing open data with style","team":"","team_count":0,"updated_at":"2022-03-22T07:31","url":"https://bd.hack4socialgood.ch/project/53","webpage_url":"https://opendata.utou.ch/presentations/bfh%202019.10/img/rstudio-ckan.png"},{"autotext":"","autotext_url":"","category_id":"","category_name":"","contact_url":"","created_at":"2022-03-21T23:17","download_url":"","event_name":"Data Toolbox","event_url":"https://bd.hack4socialgood.ch/event/3","excerpt":"