the bioinformatics lab

Summary

In this episode, Kevin Libuit and Andrew Page discuss the life cycle of different platforms in the software and public health bioinformatics space. They talk about the CZ GenEoi platform, which is now migrating to the TheiaGenEpi moniker as part of the Theiagen Global Health Initiative. They highlight the importance of providing resources to low and middle-income countries (LMICs) and the challenges of transitioning and maintaining a software project. They also discuss the impressive engineering behind the GenEpi platform, including its use of cloud components, scalability, and orchestration with Terraform. The conversation emphasizes the collaborative nature of the public health bioinformatics community and the benefits of mature software engineering practices.

More info on the transfer: https://help.czgenepi.org/hc/en-us/articles/20083077583764-FAQs-CZ-GEN-EPI-Transfer-to-Theiagen-Global-Health-Initiative-TGHI

Takeaways

The CZ GenEpi platform is migrating to the TheiaGenEpi moniker as part of the Theiagen Global Health Initiative, which aims to provide resources to LMICs for public health initiatives.

The GenEpi platform is a website for analyzing genomic data, with a focus on low and middle-income countries that may not have the resources to build massive global trees.

The engineering behind the Genepi platform is impressive, with a well-structured tech stack, use of cloud components, scalability, and orchestration with Terraform.

Collaboration between bioinformatics scientists and software engineers is crucial for developing and maintaining high-quality software products in the public health bioinformatics space.

ASM NGS Hackathon Details:

- Date: 10-12 October 2024

- Location: Washington DC, Venue TBD (within 30 minutes of the ASM NGS venue)

- Registration form: https://lnkd.in/e8KTqZYQ

- Admission: Free (Sponsored by Theiagen Genomics)

Summary

In this episode, Kevin and Andrew discuss hackathons and the upcoming ASM NGS Hackathon. They explain that hackathons bring together people from different backgrounds to work on community problems and solve common challenges. The hackathon at ASM NGS will be a virtual and in-person event, allowing for broader participation. They emphasize the value of community building and networking that comes from hackathons, as well as the opportunity to collaborate and work on specific projects. They encourage people to bring their curiosity and willingness to collaborate to hackathons, regardless of their technical background.

Takeaways

Hackathons bring together people from different backgrounds to work on community problems and solve common challenges.

The ASM NGS Hackathon will be a virtual and in-person event, allowing for broader participation.

Hackathons provide opportunities for community building, networking, and collaboration.

Participants should bring their curiosity and willingness to collaborate, regardless of their technical background.

Also available on YouTube: https://youtu.be/i9oT5ku11is

Summary

In this episode, Kevin and Andrew discuss different mechanisms to run and support bioinformatics pipelines. They explore the use of workflows, workflow managers, and graphic user interfaces for pipeline execution. They highlight popular workflow options such as Nextflow, Terra, and Galaxy, and discuss the benefits of using standardized workflow languages. They also emphasize the importance of scalability and the drawbacks of creating in-house pipeline systems. The conversation concludes with a discussion on the differences in data models and administrative overhead among the different workflow options.

Takeaways

Understanding workflows is a fundamental skill in bioinformatics.

Popular workflow options include Nextflow, Terra, and Galaxy.

Standardized workflow languages help standardize development and execution.

Using out-of-the-box solutions reduces the need for creating in-house pipeline systems.

Consider the data model and administrative overhead when choosing a workflow option.

YouTube: https://youtu.be/RybtspKHkgA

Summary

The conversation discusses the topic of SRA Lite, a data storage format for genomic information. SRA Lite is a compressed version of the original data, with the quality scores removed. The conversation highlights the challenges and controversies surrounding SRA Lite, including the loss of data granularity and the confusion around accessing the original files. The lack of clear communication from NCBI is also mentioned as a problem. The conversation suggests that the normalized files should be the default format for user access and retrieval. Overall, better communication and understanding of SRA Lite are needed.

Takeaways

SRA Lite is a compressed version of genomic data that removes quality scores.

The use of SRA Lite has sparked controversy due to the loss of data granularity.

There is confusion around accessing the original files and distinguishing between SRA Lite and full FASTQ files.

Better communication and understanding of SRA Lite are needed to address user frustrations.

Also available on YouTube: https://youtu.be/ZlKYKuOeGZc

Summary

In this episode, Kevin Libuit and Andrew Page discuss the different levels of a bioinformatics developer and the career track in the field. They explain that bioinformatics is a relatively new field and the levels have emerged over time. The entry-level position is called a junior or associate bioinformatics scientist, where individuals follow established protocols and apply existing tools. The senior level involves more independent work and ownership of bioinformatics solutions. The principal level focuses on strategic decision-making and technical leadership. The hosts emphasize the importance of finding happiness and fulfillment at any level in the field.

Takeaways

Bioinformatics is a relatively new field, and the levels of a bioinformatics developer have emerged over time.

The entry-level position involves following established protocols and applying existing tools.

The senior level requires more independent work and ownership of bioinformatics solutions.

The principal level focuses on strategic decision-making and technical leadership.

It is important to find happiness and fulfillment at any level in the field.

Summary

In this episode, Kevin and Andrew discuss cloud computing in the context of bioinformatics. They explore the different layers of cloud technology and how it can be implemented in laboratories. They highlight the benefits of cloud computing, such as quick access to resources, cost savings, and scalability. They also discuss the challenges of managing costs and ensuring security in a cloud environment. Overall, they emphasize the importance of understanding the specific needs of bioinformatics and choosing the right cloud infrastructure.

Takeaways

Cloud computing offers quick access to resources and cost savings compared to on-premises infrastructure.

The specific needs of bioinformatics, such as high volume and different hardware requirements, should be considered when setting up a cloud infrastructure.

Managing costs and ensuring security are important challenges in a cloud environment.

Cloud computing provides scalability and flexibility to meet the evolving needs of bioinformatics.

PHA4GE Website: https://pha4ge.org/

Summary

Alan Christoffels, the principal investigator for the Public Health Alliance for Genomic Epidemiology (PHA4GE), discusses the challenges and future directions of the consortium. He shares his background as a scientist and director of a program leading international collaborations in pathogen genomics. The conversation highlights the importance of global community building and the need to connect laboratories across borders to address common challenges in public health. The impact of PHA4GE in the response to the COVID-19 pandemic is also discussed, along with the value of creating a community of practice and providing opportunities for professionals to contribute. Alan invites individuals from various backgrounds to get involved in PHA4GE and contribute to its mission.

Takeaways

PHA4GE is a global consortium that aims to connect laboratories across borders to address common challenges in public health.

Alan Christoffels emphasizes the importance of global community building and the need to involve individuals from various backgrounds in PHA4GE.

The impact of PHA4GE in the response to the COVID-19 pandemic is discussed, highlighting the value of creating a community of practice and providing opportunities for professionals to contribute.

Alan encourages individuals to get involved in PHA4GE and contribute to its mission.

Summary

In this episode, Kevin Libuit and Andrew Page discuss the challenges of communicating complex genomic information to different audiences in public health. They explore the need for tailored communication strategies for various stakeholders, including bioinformatics scientists, epidemiologists, and the general public. The power of analogies in simplifying complex concepts is highlighted, along with the importance of building bridges between different technical fields. The conversation also emphasizes the need to communicate the limits and nuances of genomic data, and the role of genetic relatedness as a proxy for epidemiological associations. Overall, the episode underscores the ongoing need for effective communication in the field of genomics and public health.

Takeaways

Tailored communication strategies are necessary when communicating complex genomic information to different audiences in public health.

Analogies can be powerful tools for simplifying complex concepts and making them relatable to a wide range of stakeholders.

Building bridges between different technical fields, such as bioinformatics and epidemiology, is crucial for effective communication.

Communicating the limits and nuances of genomic data is essential to avoid misinterpretation and ensure proper understanding.

Summary

This episode of the Bioinformatics Lab Podcast continues the conversation on public health pipeline best practices. The focus is on pipeline functionality, documentation for local install and remote access, and example usage. The hosts discuss the importance of clearly articulating the function of a pipeline and the different pipeline systems available. They emphasize the need for documentation that includes instructions for installation and usage, as well as providing example data. The episode concludes with a call to read the best practices document and the announcement of future efforts to promote and assess adherence to these practices.

Takeaways

Clearly articulate the function of a pipeline in the field of public health bioinformatics.

Use pipeline systems like Galaxy and Terra to visually represent and manage workflows.

Provide clear documentation for local installation and remote access of pipelines.

Include example usage and data to facilitate understanding and testing of pipelines.

PHA4GE Ten Best Practices for Public Health Bioinformatics Pipelines:

https://github.com/pha4ge/public-health-pipeline-best-practices/blob/main/docs/pipeline-best-practices.md

Summary

In this episode, Kevin Libuit and Andrew Page discuss the 10 best practices for public health pipeline development. They start by emphasizing the use of common file formats and the importance of avoiding reinventing the wheel. They highlight the benefits of standard file formats and the availability of parsers for different languages. They also discuss the implementation of software testing, including the use of automated testing and the integration of testing with Docker containers. They emphasize the need for accessibility to benchmark or validation data sets and the importance of reference data requirements. They also touch on the significance of hiring bioinformaticians and the documentation practices that should be followed.

Takeaways

Use common file formats to avoid reinventing the wheel and enable compatibility with other programs.

Implement software testing, including automated testing, to ensure functionality and identify bugs.

Provide benchmark or validation data sets to allow users to compare and evaluate the performance of the pipeline.

Consider the reference data requirements and ensure accessibility to curated databases.

Hire bioinformaticians with domain expertise to navigate the complexities of pipeline development.

Follow documentation practices, including communication of authorship, pipeline maintenance statements, and community guidelines for contribution and support.