User talk:Hiram: Difference between revisions

From genomewiki
Jump to navigationJump to search
 
(36 intermediate revisions by 3 users not shown)
Line 1: Line 1:
__TOC__
__TOC__


== What I need to know about GIT ==
1. git status says:
# On branch master
# Your branch is ahead of 'origin/master' by 2 commits.
The question is, what is different now between what I have and master ?
git diff origin/master
How about just the file names:
git diff origin/master | grep "^+++"
2. what is the difference between a file I have and this file in its current state in the master, '''without''' altering anything I may have here now: ?
git fetch
git diff origin/master
3. how does one fetch a previous beta version ?  For example, v235_branch.  Clone the master, then checkout a branch:
git clone http://genome-source.soe.ucsc.edu/kent.git
cd kent
git checkout origin/v235_branch
This gives you a "HEAD-less" branch.  If you want an actual branch of that version:
git checkout -b my_v235 origin/v235_branch
4. how do you diff a file between different versions of itself ?
== ISMB 2008, Toronto Ontario Canada ==
Metagenomics approaches
1: Science. 2006 Jun 2;312(5778):1355-9<BR>
Metagenomic analysis of the human distal gut microbiome.<BR>
Gill SR, Pop M, Deboy RT, Eckburg PB, Turnbaugh PJ, Samuel BS,
Gordon JI, Relman DA, Fraser-Liggett CM, Nelson KE.<BR>
[http://medschool.umaryland.edu/FACULTYRESEARCHPROFILE/viewprofile.aspx?id=20004 | Fraser-Liggett]<BR>
[http://www.ebi.ac.uk/Information/Staff/person_maint.php?person_id=159  Rodrigo Lopez EBI]
Estimating True Evolutionary Distances uunder the DCJ Model<BR>
http://bioinformatics.oxfordjournals.org/cgi/content/short/24/13/i114
Estimating true evolutionary distances under the DCJ model<BR>
Yu Lin and Bernard M.E. Moret<BR>
Laboratory for Computational Biology and Bioinformatics,<BR>
Swiss Federal Institute of Technology (EPFL), EPFL-IIS-LCBB,<BR>
INJ 230, Station 14, CH-1015 Lausanne, Switzerland
Mail list concerning the big data management from the new sequencing
technologies:
[http://lists.open-bio.org/mailman/listinfo/bioinfo-core  bioinfo-core]
[http://visant.bu.edu/ VisANT] - pathway visualization tool
All [http://bioinformatics.oxfordjournals.org/content/vol24/issue13/ Proceedings] published in Bioinformatics
[http://bioinformatics.bc.edu/marthlab/Main_Page Gabor Marth] lab at Boston College, working on the difficulties brought up by the new sequencing technologies.  Developing toolsets for alignment of reads and adjusting quality scores.
[http://www.myexperiment.org/ My Experiment] and EBI workflow manager site


== comments ==
== comments ==
Line 80: Line 132:


Custom track:  
Custom track:  
[http://genome-test.cse.ucsc.edu/cgi-bin/hgTracks?db=hg18&hgt.customText=http://genomewiki.ucsc.edu/images/3/37/Hg18KnownGenesSmallIntronsExonsCt.txt.gz Hg18 small exons and introns] on the UCSC Genes track
[http://genome-test.soe.ucsc.edu/cgi-bin/hgTracks?db=hg18&hgt.customText=http://genomewiki.ucsc.edu/images/3/37/Hg18KnownGenesSmallIntronsExonsCt.txt.gz Hg18 small exons and introns] on the UCSC Genes track


== Rat Genome Meeting CSHL 09 Dec 2007 ==
== Rat Genome Meeting CSHL 09 Dec 2007 ==
Line 160: Line 212:


Next Rat meeting like this next year in Hinxton. Then 2009 CSHL again.
Next Rat meeting like this next year in Hinxton. Then 2009 CSHL again.
== Top 10 items to worry about ==
It is important to keep your list straight when worrying about things.
A proper perspective needs to be considered at all times.
<ol>
<li> [https://en.wikipedia.org/wiki/Decline_in_insect_populations insect population decline] </li>
<li> [https://en.wikipedia.org/wiki/Climate_change climate change] </li>
<li> [https://en.wikipedia.org/wiki/Environmental_migrant billions of refugees wandering about looking for food and water] </li>
<li> [https://en.wikipedia.org/wiki/Water_scarcity fresh water supply] </li>
<li> [https://en.wikipedia.org/wiki/Human_overpopulation population stress exacerbates all other problems] </li>
<li> [https://en.wikipedia.org/wiki/Overfishing declining fish populations] </li>
<li> [https://en.wikipedia.org/wiki/Antimicrobial_resistance antibiotic resistant bacterial infections] </li>
<li> [https://en.wikipedia.org/wiki/Organic_farming_and_biodiversity mono-culture crop and livestock strains] </li>
<li> [https://en.wikipedia.org/wiki/National_debt_of_the_United_States USA public debt] </li>
<li> <strike>[https://en.wikipedia.org/wiki/Peak_oil the end of oil]</strike> </li>
<li> <strike>[https://en.wikipedia.org/wiki/Deepwater_Horizon_oil_spill deep sea oil well blow out]</strike> </li>
<li> <strike>[https://en.wikipedia.org/wiki/Fukushima_Daiichi_Nuclear_Power_Plant nuclear power plant meets tsunami]</strike> </li>
</ol>


== Links to remember ==
== Links to remember ==
Line 165: Line 237:


[http://www.nytimes.com/2007/06/29/books/29book.html?ex=1184126400&en=f1d3bf82a60ac4a5&ei=5070 NY Times 2007-06-29] The Cult of the Amateur, By MICHIKO KAKUTANI, Published: June 29, 2007
[http://www.nytimes.com/2007/06/29/books/29book.html?ex=1184126400&en=f1d3bf82a60ac4a5&ei=5070 NY Times 2007-06-29] The Cult of the Amateur, By MICHIKO KAKUTANI, Published: June 29, 2007
== Amazon AWS services 2009-06-16 ==
<UL>
<LI>http://hadoop.apache.org/</LI>
<LI>http://slideshow.com/</LI>
<LI>http://www.pathworkdx.com/</LI>
<LI>http://univaud.com/hpc/products/unicloud.php</LI>
<LI>http://www.smugmug.com/</LI>
</UL>
== Amazon Bioinformatics Seattle 2010-06-08 ==
<UL>
<LI>[http://www.mvdirona.com/jrh/work/ James Hamilton] power and infrastructure cost analysis</LI>
<LI>[http://www.bioteam.net/services/cloud.html BioTeam services]</LI>
<LI>[http://blog.bioteam.net/ BioTeam blog] Chris Dagdigian, scriptable infrastructure</LI>
<LI>[http://www.opscode.com/ Cloud Management] open source software</LI>
<LI>[http://dnanexus.com/ Next Gen Sequence] cloud management, Andreas Sundquist</LI>
<LI>[http://www.pacificbiosciences.com/ Pacific Biosciences] fast sequencing, 15 minute genome sequencer by 2014, with this speed the analysis needs to be done as the sequence is produced to reduce the amount of data to store.</LI>
<LI>[http://www.completegenomics.com/ Complete Genomics] sequencing and analysis results delivered via S3, ready now to do 500 human genomes per month, may need a genome browser.</LI>
<LI>[http://usegalaxy.org/ Galaxy] high throughput sequencing analysis with Galaxy instances in [http://bitbucket.org/galaxy/galaxy-central/wiki/cloud the cloud]</LI>
<LI>[http://github.com/itmat Chef!] cookbooks for cloud compute management</LI>
<LI>[http://bcbio.wordpress.com/2010/05/08/automated-build-environment-for-bioinformatics-cloud-images/ Brad Chapman] Mass. General Hospital, promoting open-source collaboration for bioinformatics tools. His [http://github.com/chapmanb github] blog</LI>
</UL>
== ISCA 3rd International meeting, Bethesda MD, 2010-06-29,30==
* [http://rarediseases.info.nih.gov/cettprogram/about.aspx?id=0#0 Andy Faucett] talking about the opt-out mechanism for enrollment and educational plans
* NIH office of [http://rarediseases.info.nih.gov/ Rare Diseases]
* ISCA [https://isca.genetics.emory.edu/iscaBrowser/ isca.genetics.emory.edu] International Standard Cytogenomic Array Consortium, David Ledbetter
* UNIQUE [http://rarechromo.org/html/home.asp rarechromo.org] The Rare Chromosome Disorder Support Group, Beverly Searle
* DECIPHER [https://decipher.sanger.ac.uk/application/ decipher.sanger.ac.uk] DatabasE of Chromosomal Imbalance and Phenotype in Humans using Ensembl Resources, Nigel Carter
* IAN Research [https://www.ianresearch.org/login ianresearch.org] Interactive Autism Network Research, Paul Law
* IAN Community [http://www.iancommunity.org/ iancommunity.org] Interactive Autism Network
* [http://www.ncbi.nlm.nih.gov/gap NCBI dbGaP] Database of Genotypes and Phenotypes, Justin Paschall
* [http://www.ncbi.nlm.nih.gov/dbvar/ NCBI dbVar] Database of Genomic Structural Variation, Deanna Church
* [http://projects.tcag.ca/variation/ DGV] Database of Genomic Variants, Steve Scherer
* The [http://www.human-phenotype-ontology.org/index.php/hpo_home.html Human Phenotype Ontology], Peter Robinson
* [http://www.ihtsdo.org/ IHTSDO] International Health Terminology Standards Development Organization
* [http://www.cartagenia.com/ Cartagenia], Steven Van Voren, Phenotype Implementation, [https://darwin.cartagenia.com/isca/login.html ISCA on-line clinical forms] all private all the time
== Notes 2010-09-30 ==
* analyzing WEB traffic: http www.google.com/urchin/

Latest revision as of 06:10, 19 February 2019


What I need to know about GIT

1. git status says:

# On branch master
# Your branch is ahead of 'origin/master' by 2 commits.

The question is, what is different now between what I have and master ?

git diff origin/master

How about just the file names:

git diff origin/master | grep "^+++"

2. what is the difference between a file I have and this file in its current state in the master, without altering anything I may have here now: ?

git fetch
git diff origin/master

3. how does one fetch a previous beta version ? For example, v235_branch. Clone the master, then checkout a branch:

git clone http://genome-source.soe.ucsc.edu/kent.git
cd kent
git checkout origin/v235_branch

This gives you a "HEAD-less" branch. If you want an actual branch of that version:

git checkout -b my_v235 origin/v235_branch

4. how do you diff a file between different versions of itself ?

ISMB 2008, Toronto Ontario Canada

Metagenomics approaches 1: Science. 2006 Jun 2;312(5778):1355-9
Metagenomic analysis of the human distal gut microbiome.
Gill SR, Pop M, Deboy RT, Eckburg PB, Turnbaugh PJ, Samuel BS, Gordon JI, Relman DA, Fraser-Liggett CM, Nelson KE.
| Fraser-Liggett

Rodrigo Lopez EBI

Estimating True Evolutionary Distances uunder the DCJ Model
http://bioinformatics.oxfordjournals.org/cgi/content/short/24/13/i114 Estimating true evolutionary distances under the DCJ model
Yu Lin and Bernard M.E. Moret
Laboratory for Computational Biology and Bioinformatics,
Swiss Federal Institute of Technology (EPFL), EPFL-IIS-LCBB,
INJ 230, Station 14, CH-1015 Lausanne, Switzerland

Mail list concerning the big data management from the new sequencing technologies: bioinfo-core

VisANT - pathway visualization tool

All Proceedings published in Bioinformatics

Gabor Marth lab at Boston College, working on the difficulties brought up by the new sequencing technologies. Developing toolsets for alignment of reads and adjusting quality scores.

My Experiment and EBI workflow manager site

comments

  • hm... thinking Gangleri 12:46, 7 April 2006 (PDT)
copying this code and making a preview at a Wikimedia foundation wiki ...
both variants will work; please tray to find out what Tidy is; where you can download ond how you can install it; I never operated a wiki myself but I did a lot of tests; I understand that Tidy is a kind of wizzard correcting HTML code / generating errorfree HTML code
note: commons:wikt:yi:user:Gangleri/tests/bugzilla#test wiki's lists a lot of test wikies; if you make a preview at [1] you will see that there the behaviour is the same as here; please do not get angry; I was searching the answer for months
Good luck! You can reach me on the IRC-channel #wiktionary or skype me 'irelgnag'. Best regards Gangleri 13:04, 7 April 2006 (PDT)
Works OK. Best regards Gangleri · T · m: Th · T 16:12, 7 April 2006 (PDT)

Genomics and Justice - 2007-05-18

What is important and want to carry forward from session to session

What are important but need to be backgrounded

what do we know

Morning session, 09:30

Participatory forms

What are the underlying concepts of Justice when a particular "performance" is seen in a public forum. Can you perhaps have a philosophical advisory team on the side to provide a checks and balance function and provide advice to questions of justice as they come up in a research situation.

Example from Tuscan Italy experience, don't mince words when asking for samples, make it clear that samples are needed to help with the research. Offer an exchange of something valuable for the samples. Doesn't do much good to try and promote some kind of community wide involvement as if you were passing off responsibility to that "group". The researcher has to have enough guts to realize they will continue to have the responsibility no matter how much the group has been informed about the research.

Property

Public domain, collective commons. Copyleft. Foster innovation in complete openness by doing innovation in public. Against what do we need to secure the open access for this new set of biological information. "Creative commons is not communism." Illicit copies. The "generic" can only exist if the private patented item exists. Given definitional terms, it is only possible to have public domain commons if and only if there exists a private domain for that same business.

Patent system - one mechanism of answering the question of how to get innovation to happen. This avoids the problem of how do these innovations become applied to the actual problems that exist.

The benefits of the public domain. It can solve problems that markets do not care about. For example the knowledge of smoking is dangerous, was in the public domain in the 1950s and was alleviated by behavioral changes. Penicillin development has an interesting history. Interesting problems can be solved efficiently by taking public domain knowledge, turning it into a private resource which then makes it valuable and will become available.

Groups without power have notions of identity and property that need to be protected when external forces walk in and have different ideas of identity and property.

Sovereignty

Aboriginal title, rights of occupancy, what native peoples have. What is present in native culture, definitions, meanings, stories, how do they fit into the structures being imposed upon them. DNA on "loan" contracts.

Test Custom Track Link

Custom track: Hg18 small exons and introns on the UCSC Genes track

Rat Genome Meeting CSHL 09 Dec 2007

new assembly due about end of Jan 2008

cDNAs being worked on from other strains.

Perhaps about 4,000 to 5,000 EuraTools

Sequencing other strains, brown norway on 454 to 4X end of 2008, maybe whole genome, depends upon technology.

Check with the Japan folks, they've been doing BAC ENDs on two rats. The data is in trace archives by about April.

Baylor is currently working on SNP calls, want one set, no dups please, about 8 strins, perhaps several million, trouble with how far apart the strains are.

sequencing, or sampling, other strains, best to improve QTL, don't worry about the exons.

the SHR strain may be done with the Solexa procedure if paired end protocol can work. Might be $30K Canadian for a Solexa run at 3X coverage.

need list of strains and the relative value in their sampling/sequencing.

Ewan proposes RGD identifiers as the primary naming, certainly xref to the others. Should there be an RGD id for all gene models ? Trouble is when things disappear. The idea is to have as much as possible. Beware of naming schemes that are too tenative to begin with.

Entrez genes, Ensembl

request to have all the genes done by Sept.

coordinate between Ensembl, RGD and UCSC to cull the best coincident predictions, and have something to say about the differences.


Ontologies at RGD - Mary Shimoyama

Gene Ontology

Mammalian Phenotype Ontology - developed at MGD

Pathway Ontology - developed at RGD

Disease

Behavior

Rat genes with GO 17,000

Trying to keep up with GO on a weekly basis

Ewan suggests that strain names are used only if they are in the RGD Strain Ontology DB

There is a big Mouse ontology meeting in Europe every year, good to coordinate with them. Euro Phemone

eQTL tracks are new to Ensembl available via the DAS source menus in about a week.

Ewan would like UCSC to be DAS clients.

Can the Rat folks agree on a set of cell lines to use for genome-wide surveys ? Do rat folks think of genome-wide surveys ?

Next Rat meeting like this next year in Hinxton. Then 2009 CSHL again.

Top 10 items to worry about

It is important to keep your list straight when worrying about things. A proper perspective needs to be considered at all times.

  1. insect population decline
  2. climate change
  3. billions of refugees wandering about looking for food and water
  4. fresh water supply
  5. population stress exacerbates all other problems
  6. declining fish populations
  7. antibiotic resistant bacterial infections
  8. mono-culture crop and livestock strains
  9. USA public debt
  10. the end of oil
  11. deep sea oil well blow out
  12. nuclear power plant meets tsunami

Links to remember

NY Times 2007-06-29 The Cult of the Amateur, By MICHIKO KAKUTANI, Published: June 29, 2007

Amazon AWS services 2009-06-16

Amazon Bioinformatics Seattle 2010-06-08

  • James Hamilton power and infrastructure cost analysis
  • BioTeam services
  • BioTeam blog Chris Dagdigian, scriptable infrastructure
  • Cloud Management open source software
  • Next Gen Sequence cloud management, Andreas Sundquist
  • Pacific Biosciences fast sequencing, 15 minute genome sequencer by 2014, with this speed the analysis needs to be done as the sequence is produced to reduce the amount of data to store.
  • Complete Genomics sequencing and analysis results delivered via S3, ready now to do 500 human genomes per month, may need a genome browser.
  • Galaxy high throughput sequencing analysis with Galaxy instances in the cloud
  • Chef! cookbooks for cloud compute management
  • Brad Chapman Mass. General Hospital, promoting open-source collaboration for bioinformatics tools. His github blog

ISCA 3rd International meeting, Bethesda MD, 2010-06-29,30

Notes 2010-09-30

  • analyzing WEB traffic: http www.google.com/urchin/