New Release Checklist: Difference between revisions

From genomewiki
Jump to navigationJump to search
(changing file path for downloads on hgwdev to be htdocs-hgdownload)
(Replacing page with 'This page is no longer maintained.')
 
Line 1: Line 1:
Go to [[New_Assembly_Release_Process_Details | New Assembly Release Process Details]] page.
This page is no longer maintained.
 
{| border="1" cellpadding="2" width=800px
|-valign="top"
|width="10%"|'''Start'''
|width="10%"|'''Complete'''
|width="60%"|'''Step'''
|width="20%"|'''Link to details doc'''
 
|-valign="top"
|
|
|If the organism has an existing assembly, check to see if chroms have changed in size considerably since the last release of an assembly.
|
 
 
|-valign="top"
|
|
|Check to see if anyone has given WUStL the heads-up so they can begin doing their N-Scan predictions. Send email to markd and Jeltje van Baren: jeltje at cse.wustl.edu.
|
 
|-valign="top"
|
|
|Ask admins to add your assembly to the exclude list (both the gbdb and mysql rsync download targets) at: hgdownload:/opt/csw/etc/rsyncd.conf. This should be done before syncing /gbdb data to hgnfs1 (i.e., before testing on beta).
|
 
|-valign="top"
|
|
|Complete staging of assembly on hgwbeta.
|[[New_Assembly_Release_Process_Details#Stage_and_test_on_hgwbeta | details]]
 
|-valign="top"
|
|
|Check assembly details on hgwbeta, including: BLAT/PCR, GenBank updates, .nib file, default position/tracks, orderKey, gateway page, joinerCheck, indices, makedoc, featureBits.
|[[New_Assembly_Release_Process_Details#Stage_and_test_on_hgwbeta | details]]
 
|-valign="top"
|
|
|Complete testing of all tracks in sub-pushQ
|
 
|-valign="top"
|
|
|Check that .2bit file on blat servers is the same as the one in /gbdb/<db>/ and /usr/local/apache/htdocs-hgdownload/goldenPath/<db>/bigZips using md5sum.
|[[New_Assembly_Release_Process_Details#2bit | details]]
 
|-valign="top"
|
|
|Warn Donna K. that the release is imminent so she can update docs. Read everything and test links in downloads, gateway, credits, currentGenomes.
|[[New_Assembly_Release_Process_Details#Push_Static_Content_from_hgwdev_to_hgwbeta_and_Round_Robin | details]]
 
|-valign="top"
|
|
|Send email to genome-mirror letting them know that there is a new assembly (and exactly how much data) and when it will be released for rsync. Give 24 hours notice.
|[[New_Assembly_Release_Process_Details#Push_Data_to_Round_Robin_from_hgwbeta | details]]
 
|-valign="top"
|
|
|Adjust Release Log in main pushQ
|[[ New_Assembly_Release_Process_Details#release_log| details]]
 
 
|-valign="top"
|
|
|Check that all of the MySQL tables are in good repair: hgwbeta> sudo dbCheck.sh $db
|[[New_Assembly_Release_Process_Details#Stage_and_test_on_hgwbeta | details]]
 
|-valign="top"
|
|
|Request rsync of database: hgwbeta -> RR (email to push-request)
|[[New_Assembly_Release_Process_Details#Push_Data_to_Round_Robin_from_hgwbeta | details]]
 
|-valign="top"
|
|
|Mark main pushQ entry as “push requested”
|
 
|-valign="top"
|
|
|Add to genomeClade if needed (only if this is the first release for this organism (e.g. “aaaBbb1”))
|[[New_Assembly_Release_Process_Details#Update_hgcentral | details]]
 
|-valign="top"
|
|
|Add line to genome-centdb.hgcentral.dbDb with active set = 0 (use checkMetaData.csh to get exact entry)
|[[New_Assembly_Release_Process_Details#Update_hgcentral | details]]
 
|-valign="top"
|
|
|Add the two lines to genome-centdb.hgcentral.blatServers
|[[New_Assembly_Release_Process_Details#Update_hgcentral | details]]
 
|-valign="top"
|
|
|Wait for pushes to RR to be complete
|
 
|-valign="top"
|
|
|Turn on GenBank automatic updates on on the RR. Follow instructions for turning on updates on beta, but add assembly to rr.dbs instead of hgwbeta.dbs
|[[New_Assembly_Release_Process_Details#genbank | details]]
 
|-valign="top"
|
|
|Test browser on RR by changing db= value in URLs
|[[New_Assembly_Release_Process_Details#Enable_Assembly_on_Round_Robin | details]]
 
|-valign="top"
|
|
|Request push of downloads hgwdev: /usr/local/apache/htdocs-hgdownloads/goldenPath/<db>/<appropriate folders>  -> hgdownloads: /usr/local/apache/htdocs/goldenPath/<db>/<appropriate folders>. Verify that liftOver files are in /liftOver, NOT in /vsXXX directories. Remember to push pairwise alignments and liftovers (vs the new assembly) from other organisms' databases.
|[[New_Assembly_Release_Process_Details#Push_Downloads_from_hgwdev_to_hgdownload | details]]
 
|-valign="top"
|
|
|Request dump & autodump of database (send email to cluster-admins to ask for dump to hgdownload into htdocs/goldenPath/$db/database/)
|[[ New_Assembly_Release_Process_Details#autodump| details]]
 
|-valign="top"
|
|
|Double check that all appropriate /gbdb files were pushed from dev -> hgnfs1 (during beta testing), including liftOver files. (i.e. compare /gbdb/$db/* dev vs. beta)
|
 
|-valign="top"
|
|
|Create currentGenomes symlink and request push from hgwdev ->  hgdownloads /usr/local/apache/htdocs/goldenPath/currentGenomes/<db_symlink> (this is for the FTP link)
|[[ New_Assembly_Release_Process_Details#currentgenomes| details]]
 
|-valign="top"
|
|
|Confirm that hgdownloads, currentGenome, and FTP links are functional
|[[ New_Assembly_Release_Process_Details#Push_Downloads_from_hgwdev_to_hgdownload | details]]
 
|-valign="top"
|
|
|Change line in genome-centdb.hgcentral.dbDb to be active = 1 (this makes the assembly live on RR!)
|[[New_Assembly_Release_Process_Details#Enable_Assembly_on_Round_Robin | details]]
 
|-valign="top"
|
|
|Enable liftOver on the RR Follow instructions for enabling liftOver on beta, but make changes to hgcentral (not hgcentralbeta): (on hgwdev)"hgsql -h genome-centdb" then in mysql type "use hgcentral" Test hgLiftOver and hgConvert immediately
|[[New_Assembly_Release_Process_Details#Update_hgcentral | details]]
 
|-valign="top"
|
|
|Complete testing in RR: tracks, PCR, Blat, liftOver, etc. (that required active=1).
|
 
|-valign="top"
|
|
|Change or add line in genome-centdb.hgcentral.(and in hgcentraltest and hgcentralbeta).defaultDb to point to new DB and test
|[[New_Assembly_Release_Process_Details#Update_hgcentral | details]]
 
|-valign="top"
|
|
|Send email to Donna K. letting her know it has been pushed, and she will push all static documents. Test all of her files. Test links in downloads, gateway, credits, currentGenomes.
|[[New_Assembly_Release_Process_Details#Push_Static_Content_from_hgwdev_to_hgwbeta_and_Round_Robin | details]]
 
|-valign="top"
|
|
|For human, mouse and rat (KG assemblies), ask for push of htdocs/knownGeneList/$db/* and knownGeneLists.html
|
 
|-valign="top"
|
|
|Ask admins to remove your assembly from the exclude list at: hgdownload:/etc/rsyncd.conf and alert genome-mirror.
|
 
|-valign="top"
|
|
|If this is a new species, send an email to Branwyn (bwagman@ucsc.edu). There is no longer a place to announce new assemblies, but she said she wanted to be informed anyways in case she wants to write something about it.
|
 
 
|-valign="top"
|
|
|Notify cluster-admin that new assembly is complete and ask for push to genome-mysql. Remind them to make permissions for users "genome" and "genomep", and update the mysql.db table permissions.
|
 
|-valign="top"
|
|
|Push net and chain tracks in other organisms, taking care to edit and push trackDb as necessary. If these tracks are replacing nets and chains to a previous assembly, drop those tracks and notify the mirrors.
|[[New_Assembly_Release_Process_Details#Edit_Other_Organisms | details]]
 
|-valign="top"
|
|
|Click on “done!” in main pushQ for this assembly (the release log will be updated the next morning)
|
 
 
|-valign="top"
|
|
|Retire the assembly sub pushQ using retirePushQ.csh from hgwdev. Make sure there are release log entries for the net and chain tracks in other databases. (The script will remove release log notes for all push queue entries where dbs=$db.)
|
 
|-valign="top"
|
|
|Update hgcentral.sql: cd $WEEKLYBLD; Run buildHgCentralSql.csh real (can run w/o 'real' to just see diffs). hgcentral.sql will be automatically pushed to hgdownload.
|
 
|-valign="top"
|
|
|Double check next day: release log, database dump/autodump, genome-mysql, genbank auto-update, downloads (bigZip autodownloads)
|[[New_Assembly_Release_Process_Details#Maintenance | details]]
 
 
|}
 
[[Category:Browser QA]]

Latest revision as of 19:20, 10 March 2011

This page is no longer maintained.