OpenWetWare:Feature list/Lab notebook/2007 Oct Brainstorming

From OpenWetWare
Jump to navigationJump to search

OWW will begin a major effort to implement new technology features that will make using lab notebooks on OWW easier. We had a brainstorming session (teleconference & wiki chat) Friday October 5, 2007 at Noon EDT to collect ideas for these features.

Features List

Steve tried to put the major ideas into the following table. It may be a good idea for everyone to vote on features they'd really like to see (even those that weren't at the meeting!).

Feature People who think this is a priority feature (try not to vote for them all)
A "search within my stuff" button added as part of the skin SJK, JBL, JK, RV, BC
Ability to email to existing or new wiki pages SJK, tk, JBL
Some kind of autosave or other mechanism to make it easy to add incremental bits of data SJK, BC
Cut an paste to and from the table editor SJK
A button "create new page from this page (template)" JBL, RV
Barcodes to identify wiki pages (labels)
Automatically prepend user-identifier to file uploads\ BC
Click box on the side for easily inserting tags
Automatically generate pages using an organizational scheme (by date & by project) JK, SNV, BC

Teleconference & Chat, Friday October 5, Noon Eastern Time

How to connect to the meeting
Call this phone number: 617-452-2163
Get the wiki chat going: Click on the "chat" button
at the top of any page,
and then go to the "lounge."

As of 11:50 EDT, chat isn't working for Steve

Since we have settled on a date and time (Friday, October 5, Noon Eastern Time), I have archived the scheduling grid.

The meeting will be a teleconference and chat, as is done with the OWW Steering Committee monthly meetings. We will post the phone number and chat link in this area, once we've worked out those details. Hopefully we have that info out soon, but as a last resort, visit this page a few minutes before noon EDT on Friday to see the up to date links.

Proposed meeting agenda

A few common themes from peeps' pre-meeting thoughts
Abiilty to easily insert images and files into electronic lab notebook
Specifically: gel images
Similarly: automatically streaming data to OWW database.
Better search and tagging
Ability to add a lot of short notes and / or data throughout the day w/o saving or logging in each time
For foreseeable future, data processing will necessarily be off-line (e.g. Matlab, LabVIEW)
Templates for starting off lab notebook entries
  1. Chaos of getting chat and telecon working
  2. Introductions
  3. Implementation Discussion
  4. Feature Discussion
  5. How to move ahead

Julius B. Lucks 21:07, 4 October 2007 (EDT): I added an implementation discussion before the feature discussion because I think the former is more fundamental to what we are trying to achieve. To me there are two main implementation routes

  1. Implement everything as server-side by adding wiki-extensions, etc. The main feature of this is that users primarily interact with the service through their web browser.
  2. Implementing a set of tools as an API for consumption by client-side programs. For example, most of the common blog platforms (Wordpress, Blogger, etc.) have XMLRPC API's that allow client-side programs to fetch and post content on the blogs.

The former approach has the advantage of being controlled by OWW with an OWW look and feel. However, it is also very complicated to integrate a lot of the features into the core wiki smoothly (graphs, spreadsheets, etc.) The latter approach has the advantage in that users can continue to use the graphics programs and spreadsheets that they already use. The minimal API just offers an avenue for posting and retrieving content from the wiki. The disadvantage of the latter approach is that client-side software has to be developed to use these api's. However, there are popular tools that already exist that can interact with such API's, and this list is growing (especially due to the popularity of Google's GDATA API's). See my notes for more information.

Pre-meeting activities

  1. Electronic Lab Notebooks (ELN) elsewhere. As Tom Knight pointed out on the parent page, there are a lot of non-OWW people working towards these same goals. I spent some time looking at his links and it would probably be useful for others to do as well. Here are two that were fruitful for me:
    • UsefulChem very active use of wiki-style ELNs.
      • Are there any UsefulChem people who are also OWW members and would attend the brainstorming session? Sure - I'll be there! (JC Bradley)
    • Oak Ridge ELN and specifically, this page lists a lot of features they've added over the years.
    • ChemSpider is going to be Wiki-enabled in the future. We have allowed structure deposition so far. Wiki-enabling for curation of the chemical structures is coming. Ultimately My ChemSpider will enable "notebooking" for chemists
    • Southampton Blog Book - have a look at the 'bioblogs', we are trying to find the best way to organise the metadata and also have some cool features built in such as label printing (which you can see - but it will print to a printer in Southampton) and template posts (which you can't see without edit permissions)
  2. If you have time, add your picture and create a sub-page with your own personal pre-meeting thoughts (as disorganized as you like). You can see "Steve Koch" for an example of how to do this.
  3. Add proposed agenda items and please edit this page with any improvements you can think of!
  4. Take a look at the previous suggestions for lab notebook improvements on OWW.

Meeting Notes

Jason R. Kelly: Sorry this is a mess, but most of the stuff mentioned should be in here, feel free to add/edit anything i missed.

  • Introductions
    • Steve Koch & Diego Ramallo - UNM
    • JC BRadley
      • wikispaces – they use for their notebook.
      • blog is for recording milestones and things that happen, link back to exp
      • they want to trace back to the raw data.
    • Julius (cornell)
      • arxiv.org
      • used a private wiki for lab notebooks, use public wiki in the future.

Implementation of client-side

Advantages:

  • easier to implement stuff like drag and drop, etc.

Dis*advantages:

  • requires client*side developing

Austin: Decide what it is we want before figuring out the implementation

What do the users want? Steve: Students on private wiki / students in physics Concerns:

  • uploading images is a headache
  • People want to put in a bunch of numbers over the course a few hours and they don’t want to have to save the page over and over.
    • entering data without having to do annoying things like logging in or save
  • love the table editor.
    • wiki spreadsheets – would be difficult to implement
    • ’’’cut and paste from wiki table to excel (seems like a concrete thing) ; might be something in xhibit that lets you connect to google.’’’
      • Austin worried about keeping data in google.
      • Bill says that it would be more for export and import
      • Barry Data on the wiki easy to move matlab or excel, would be good to store on the wiki in a low tech a means as possible.
    • Bradley: sharing the way you do the analysis might be reason


  • TOM: would like to see an easy interface to medium of paper. Would be nice to easily put a scrap of paper into the notebook.
    • someone sends you a plasmid map in the mail, oligo order comes with paper you want to include, protocols come in paper form as well.
    • this is the subset of the image input process.
    • Steve: scan to PDF tool is useful, then would be able to post directly to OWW. Many of the pdf machines have methods to email automatically. If you could email to your lab notebook page that would be great.
      • Steve: social text every page gets an email address, so that you could email to contribute.
  • Barry: Be able to get the images linked from alab notebook page of a particular date automatically. If I save my gel image with a particular date format in the name, it would be automatically linked from that day’s page.
  • Jason: would like to have barry’s idea extended to everything I do on the wiki. Would like to know everything I edited and everything I uploaded on a given day, and easy way to browse through that stuff. Basically a better UI for browsing these thing.
  • Tom: track labels that he prints. When he finds a tube with his initials and his date he needs to go back to his lab notebook to figure out what the heck it is.
    • unique ID could work
  • Cameron:

Labels: We have a single post per item and systems that will auto*generate a label based on the post id also instruments that blog so the dates are taken care of * but several of these kind of things have been worked out in our system * how easy to transfer to a wiki framework I don't know but not many of them survive *80 :)

  • Jason: would like to have the organization created automatically
    • e.g. Barry has a pretty nice system for automatically organizing things by date and project, we need to make it so this can be implemented in a turn-key way.

Austin:

    • Austin keeps his stuff private so that he can have his stuff sepreate from other peoples stuff
    • Is there an easier technical solution to keep things separate
      • Bill: Look at namespaces
      • Austin: should we have sub-wikis for each lab notebook?
    • Would it be possible to keep the files separated for each person
    • Steve was suggesting that if you upload a file I should be able to specify its filename, but it should almost by default be BarryCanton/foo.pdf
    • sub*wikis

Search:

    • you could just search your lab notebook by having a namespace
    • search “every page that I’ve edited” or every page in the barry canton namespace
      • ‘’’every edit would probably be sufficient, and would be extremely useful independent of lab notebook’’’
      • Bill: Look at namespaces

Tagging:

Steve – tagging on the private wiki using categories.

    • might be nice to have a tag box
    • how are they specifically using it?
      • write down ideas in random places and add category steveResearchIdea
    • would be easy to use them
    • Bill: Austin has good example of "dynamic page lists" which may be what Steve needs

Barry:

  • uses date tagging heavily
  • sounds like the most useful “tags” for lab notebook would just be ‘project’ and ‘date’
  • dynamicPageList might also allow for tagging as a form of organization.
    • doesn’t seem like
  • Barry: different point about tagging.
    • barry finds the notebook useful for planning what he’s going to do. Feature that keeps track of what are my next actions in 4 different projects.
    • Bill: there exist fairly nice todo list extensions / steve needs a todo list badly


Adding little bits of data as you go along

  • making it easier.
  • Austin thinks this is a big problem, keeps everything in an editor and copies it over to the wiki at the end of the day.
    • Bill: lot of individual difference in the way to browser and mediaiwki interact and it causes problems in the lab.
    • is there a way to connect to the DB directly, rather than through the browser.

Wiki Lab Notebook Brainstormers

Recent changes

List of abbreviations:
N
This edit created a new page (also see list of new pages)
m
This is a minor edit
b
This edit was performed by a bot
(±123)
The page size changed by this number of bytes

4 October 2023

     17:53  BioMicroCenter:NanoPore Library Prep diffhist −179 Stuart S. Levine talk contribs
     09:13  CAMRI:PricingAndPolicies‎‎ 8 changes history −48 [Lacey Berry‎ (8×)]
     
09:13 (cur | prev) +19 Lacey Berry talk contribs (→‎Discount Pricing)
     
09:10 (cur | prev) +45 Lacey Berry talk contribs (→‎Discount Pricing)
     
09:10 (cur | prev) +5 Lacey Berry talk contribs (→‎Discount Pricing)
     
09:09 (cur | prev) +10 Lacey Berry talk contribs (→‎Discount Pricing)
     
08:59 (cur | prev) −2 Lacey Berry talk contribs
     
08:56 (cur | prev) −24 Lacey Berry talk contribs
     
08:55 (cur | prev) +20 Lacey Berry talk contribs
     
08:53 (cur | prev) −121 Lacey Berry talk contribs (→‎CAMRI MRI Scanner Pricing Structure)
     07:32  BioMicroCenter:Technology Seminar Series diffhist +144 Rhayman talk contribs (→‎2023)

3 October 2023

     19:08  Renhao Li Lab:Lab Members‎‎ 2 changes history +117 [Renhao Li‎ (2×)]
     
19:08 (cur | prev) +28 Renhao Li talk contribs (→‎Alumni)
     
19:07 (cur | prev) +89 Renhao Li talk contribs (→‎Alumni)
     14:32  BioMicroCenter:People diffhist +56 Sam.mildrum talk contribs (→‎STAFF)
     12:51  Stanford Biochemistry/biochem equip diffhist −2 Marc Perez talk contribs
 m   12:47  Lab Notebook diffhist +1,155 Yar talk contribs (Reverted edits by Nikkichun (talk) to last revision by Yar) Tag: Rollback
     06:02  Tomlinson:Lab Members diffhist +100 Ryan E. Tomlinson talk contribs
     06:02 Upload log Ryan E. Tomlinson talk contribs uploaded File:AnnieHo 2022.jpg(Annie Ho 2022)
     04:19  Beauchamp:Publications diffhist +19 Michael S Beauchamp talk contribs

2 October 2023

 m   18:46  Lab Notebook diffhist −1,155 Nikkichun talk contribs (Setting up opening page) Tag: Reverted
     08:40  Stanford Biochemistry/biochem equip diffhist +183 Marc Perez talk contribs

29 September 2023

     15:57  Tomlinson:Publications diffhist +247 Ryan E. Tomlinson talk contribs
N    13:07  Making alignments with cactus‎‎ 3 changes history +3,527 [Qlangdon‎ (3×)]
     
13:07 (cur | prev) +200 Qlangdon talk contribs
     
13:03 (cur | prev) +90 Qlangdon talk contribs
N    
13:01 (cur | prev) +3,237 Qlangdon talk contribs (Created page with "To run Cactus you'll need your genomes. And an input file where the first line is a Newick style tree of the names of what you want to align, followed by lines that have a tab delimited name / path. The name must be unique and it will be what that genome is called in the alignment. The path is where that fasta is located. These are supposed to be softmasked genomes, so if you can do that before. Here's an example of aligning the Xbir_pacbio_v2023.1 genome with the X....")
     12:55  Schumer lab: Commonly used workflows‎‎ 3 changes history +104 [Tododge‎; Qlangdon‎ (2×)]
     
12:55 (cur | prev) +4 Qlangdon talk contribs (→‎Liftovers using cactus alignments)
     
12:54 (cur | prev) +97 Qlangdon talk contribs (→‎Liftovers using cactus alignments)
     
10:42 (cur | prev) +3 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
     12:00  McClean:LabMtgSchedule‎‎ 3 changes history +99 [Megan N McClean‎ (3×)]
     
12:00 (cur | prev) +35 Megan N McClean talk contribs
     
11:54 (cur | prev) +45 Megan N McClean talk contribs
     
11:26 (cur | prev) +19 Megan N McClean talk contribs
     07:14  Tomlinson:LabMeeting‎‎ 3 changes history +38 [Ryan E. Tomlinson‎ (3×)]
     
07:14 (cur | prev) +1 Ryan E. Tomlinson talk contribs
     
06:33 (cur | prev) +14 Ryan E. Tomlinson talk contribs
     
06:33 (cur | prev) +23 Ryan E. Tomlinson talk contribs

28 September 2023

     18:01  YAEL:Help diffhist −6 Zhengjia talk contribs (→‎Support)
     14:49 Upload log Dbar talk contribs uploaded File:ChAMP protocol v1.0 Freeze.pdf(ChAMP protocol, version 1.0.)
     14:36  CHIP:News diffhist −21 Gabor Balazsi talk contribs
     14:36  (User creation log) [Yar‎ (3×)]
     
14:36 User account Dbar talk contribs was created by Yar talk contribs and password was sent by email ‎
     
14:35 User account Srproulx talk contribs was created by Yar talk contribs and password was sent by email ‎
     
14:35 User account Perc3vall talk contribs was created by Yar talk contribs and password was sent by email ‎
     11:29  Schumer lab: Commonly used workflows‎‎ 9 changes history +2,130 [Tododge‎ (9×)]
     
11:29 (cur | prev) +174 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
     
11:26 (cur | prev) +5 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
 m   
11:25 (cur | prev) +363 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
     
10:51 (cur | prev) +157 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
 m   
10:49 (cur | prev) +1,041 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
 m   
10:10 (cur | prev) −97 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
 m   
10:07 (cur | prev) +19 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
     
09:59 (cur | prev) +362 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)
     
09:55 (cur | prev) +106 Tododge talk contribs (→‎Genome assembly from PacBio HiFi data)