Editing CommunityData:Introduction to CDSC Resources
From CommunityData
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then publish the changes below to finish undoing the edit.
Latest revision | Your text | ||
Line 1: | Line 1: | ||
If you're new to the group, welcome! | If you're new to the group, welcome! | ||
This is an introduction to | This is an introduction to the various technical tools we use (as we use many) in our research work. It may be helpful to look at before diving into everything and starting your research with/in this group. You can find any of the resources mentioned below on the [https://wiki.communitydata.science/CommunityData:Resources Resources] page, (mostly) organized by alphabetical order for quick finding. | ||
To start, here's some [https://wiki.communitydata.science/CommunityData:Jargon common shorthand] that members might use | To start, here's some [https://wiki.communitydata.science/CommunityData:Jargon common shorthand] that members might use. | ||
== Communication Channels == | == Communication Channels == | ||
We communicate on | * One might contact specific [https://wiki.communitydata.science/People members] directly. | ||
* We use email lists to communicate things relevant to the ''entire'' group or subgroup, like upcoming events or circulating papers for feedback: [https://wiki.communitydata.science/CommunityData:Email CDSC - Email] | |||
* We communicate (chat) much more frequently on [https://wiki.communitydata.science/CommunityData:Resources#Chat_on_IRC IRC] | |||
* For weekly meetings and other (video)calls, we videocall using Jitsi. There are a lot of us, which can make calls a little hectic, so please keep in mind some [https://wiki.communitydata.science/CommunityData:Jitsi Jitsi etiquette]. | |||
* We also have a calendar of group-wide events: [https://wiki.communitydata.science/Schedule CDSC Calendar]. | |||
* We | == Shared Resources == | ||
* We | * We maintain a large shared [https://wiki.communitydata.science/CommunityData:Zotero Zotero] directory that is really helpful for finding relevant papers and smooths the process of collaboration (as one can see the papers and sources stored by collaborators as well). | ||
* | * We also have a Git repository with some shared resources (both technical and non-technical) on it: | ||
* | ** [[CommunityData:Git]] — Getting set up on the git server | ||
** [[CommunityData:Code]] — List of software projects maintained by the collective. | |||
== Servers and Data Stuff == | |||
Hyak is a supercomputer system that may or may not be relevant to your research project. For example, if you're running code on a huge dataset, you might want to use Hyak. You can learn more about it [https://wiki.communitydata.science/CommunityData:Hyak here]. If you want to get an account and get set up on Hyak, look at the Hyak Set-Up page: | |||
* [[CommunityData:Hyak setup]] | |||
* | When using Hyak (or other servers), these pages might be helpful: | ||
* [[CommunityData:Tmux]] — You can use tmux (terminal multiplexer) to keep a persistent session on a server. Check out the [https://github.com/tmux/tmux/wiki tmux git repo] or its [https://en.wikipedia.org/wiki/Tmux Wikipedia page] for more information about this. | |||
* [[CommunityData:Hyak Spark]] — Spark is a powerful tool that helps build programs dealing with large datasets. | |||
Nada is used for backups. | |||
* [[CommunityData:Backups (nada)]] — Details on what is, and what isn't, backed up from nada. | |||
* | |||
== | === Re: Wiki Data === | ||
* [[CommunityData:ORES]] - Using ORES with wikipedia data | |||
* [[CommunityData:Wikia data]] — Documents information about how to get and validate wikia dumps. | |||
* [[CommunityData:ORES]] - Using ORES with | |||
* [[CommunityData:Wikia data]] — | |||
== Creating Documents and Presentations == | == Creating Documents and Presentations == | ||
=== Planning === | === Planning === | ||
You can develop a research plan in whatever way works best, but one thing that may be useful is the outline of a | You can develop a research plan in whatever way works best, but one thing that may be useful is the outline of a Matsuzaki-style planning documents. You can see a detailed outline description [https://wiki.communitydata.science/CommunityData:Planning_document here] to help guide the planning process. If you scroll to the bottom, you'll see who to contact to get some good examples of planning documents. | ||
=== Paper building === | === Paper building === | ||
We typically write LaTeX documents | We typically write LaTeX documents. One option to do this is to use the web-based [https://www.overleaf.com/ Overleaf]. Another option, using CDSC TeX templates, is detailed [https://wiki.communitydata.science/CommunityData:TeX here]. These comes with some assumptions about your workflow, which you can learn about here: [[CommunityData:Build papers]]. | ||
If you're creating graphs and tables or formatting numbers in R that you want to put into a TeX document, you should look at the [https://wiki.communitydata.science/CommunityData:Knitr knitr package]. | If you're creating graphs and tables or formatting numbers in R that you want to put into a TeX document, you should look at the [https://wiki.communitydata.science/CommunityData:Knitr knitr package]. | ||
Some more specific things that might crop up | Some more specific things that might crop up: | ||
* [[CommunityData:Embedding fonts in PDFs]] — <code>ggplot2</code> creates PDFs with fonts that are not embedded which, in turn, causes the ACM to bounce our papers back. This page describes how to fix it. | * [[CommunityData:Embedding fonts in PDFs]] — <code>ggplot2</code> creates PDFs with fonts that are not embedded which, in turn, causes the ACM to bounce our papers back. This page describes how to fix it. | ||
=== Building presentation slides === | === Building presentation slides === | ||
Below are some options to creating presentation slides (though, feel free to use what you want | Below are some options to creating presentation slides (though, feel free to use what you want nd are most comfortable with): | ||
* [[CommunityData:Beamer]] — Beamer is a LaTeX document class for creating presentation slides. This is a link to installing/using [[Mako]]'s beamer templates. | * [[CommunityData:Beamer]] — Beamer is a LaTeX document class for creating presentation slides. This is a link to installing/using [[Mako]]'s beamer templates. | ||
** Again, like the CDSC TeX templates, these Beamer templates also come with some assumptions about your workflow, which you can learn about here (again): [[CommunityData:Build papers]]. | ** Again, like the CDSC TeX templates, these Beamer templates also come with some assumptions about your workflow, which you can learn about here (again): [[CommunityData:Build papers]]. | ||
Line 73: | Line 52: | ||
* [[CommunityData:reveal.js]] — Using RMarkdown to create reveal.js HTML presentations | * [[CommunityData:reveal.js]] — Using RMarkdown to create reveal.js HTML presentations | ||
== | == Misc. Resources == | ||
=== Technical === | === Technical === | ||
* [[CommunityData:Exporting from Python to R]] | * [[CommunityData:Exporting from Python to R]] | ||
Line 80: | Line 59: | ||
=== Non-technical === | === Non-technical === | ||
* [[CommunityData:Advice on writing a background section to an academic paper]] | * [[CommunityData:Advice on writing a background section to an academic paper]] | ||
* See some past and upcoming lab retreats [[CommunityData:Resources#Ongoing_and_Future_Meetings_and_Meetups | * See some past and upcoming lab retreats [[https://wiki.communitydata.science/CommunityData:Resources#Ongoing_and_Future_Meetings_and_Meetups here]]. |