Academic Torrents a distributed system for sharing enormous datasets - for researchers, by researchers. The result is a scalable, secure, and fault-tolerant repository for data, with blazing fast download speeds.

Julia is a high-level, high-performance dynamic programming language for technical computing, with syntax that is familiar to users of other technical computing environments. It provides a sophisticated compiler, distributed parallel execution, numerical accuracy, and an extensive mathematical function library. Julia’s Base library, largely written in Julia itself, also integrates mature, best-of-breed open source C and Fortran libraries for linear algebra, random number generation, signal processing, and string processing. In addition, the Julia developer community is contributing a number of external packages through Julia’s built-in package manager at a rapid pace. IJulia, a collaboration between the Jupyter and Julia communities, provides a powerful browser-based graphical notebook interface to Julia.

Brock Palen and Jeff Squyres speak with Gregory Kurtzer about Singularity. Singularity allows a non-privileged user to "swap out" the operating system on the host for one they control. So if the host system is running RHEL6 but your application runs in Ubuntu, you can create an Ubuntu image, install your applications into that image, copy the image to another host, and run your application on that host in it's native Ubuntu environment!

Gregory Kurtzer has created many open source initiatives related to HPC namely: Centos Linux, Warewulf, Perceus, and most recently Singularity. Currently Gregory serves as a member of the OpenHPC Technical Steering Committee and is the IT HPC Systems Architect and Software Developer for Lawrence Berkeley National Laboratory.

Singularity: http://singularity.lbl.gov/

GitHub: https://github.com/gmkurtzer/singularity

Twitter: https://twitter.com/gmkurtzer / https://twitter.com/SingularityApp

Marcel Kornacker is the Chief Architect for database technology at

Cloudera and creator of the Cloudera Impala project. Following his

graduation in 2000 with a PhD in databases from UC Berkeley, he held

engineering positions at several database-related start-up companies.

Marcel joined Google in 2003 where he worked on several ads serving

and storage infrastructure projects, then became tech lead for the

distributed query engine component of Google's F1 project.

Edward (Denny) Dahl is a Ph.D. physicist who has been at D-Wave

Systems for over four years. He works with customers to help them

understand the principles of adiabatic quantum computing as

implemented in the D-Wave 2X System. He is currently on assignment at

the Los Alamos National Laboratory, which recently purchased a

one-thousand qubit system from D-Wave. His interests are quantum

programming, playing the guitar and exploring the high deserts of

north central New Mexico.

EasyBuild is a software build and installation framework that allows you to manage (scientific) software on High Performance Computing (HPC) systems in an efficient way.

EasyBuild homepage: http://hpcugent.github.io/easybuild

Spack is a package management tool designed to support multiple versions and configurations of software on a wide variety of platforms and environments. It was designed for large supercomputing centers, where many users and application teams share common installations of software on clusters with exotic architectures, using libraries that do not have a standard ABI. Spack is non-destructive: installing a new version does not break existing installations, so many configurations can coexist on the same system. https://github.com/scalability-llnl/spack

Todd is a computer scientist in the Center for Applied Scientific

Computing at Lawrence Livermore

National Laboratory . His research focuses on

scalable tools for measuring, analyzing, and visualizing performance the

performance of massively parallel simulations. Todd works closely with

production simulation teams at LLNL, and he likes to create tools that

users can pick up easily.

Frustrated with the complexity of building HPC performance tools, Todd

started developing Spack two years ago to allow users to painlessly

install software on big machines. Spack has since been adopted by

Livermore Computing, other HPC centers, and LLNL application teams. The

open source project now includes several core developers at LLNL and a

rapidly growing community on GitHub. A 1.0 release is coming soon.

Conduit is an open source project from Lawrence Livermore National Laboratory. It provides an intuitive model for describing hierarchical scientific data in C++, C, Fortran, and Python and is used for data coupling between packages in-core, serialization, and I/O tasks.

Docs:

http://scalability-llnl.github.io/conduit/

Repo:

https://github.com/scalability-llnl/conduit

Cyrus is a computer scientist and group leader in the Applications, Simulations, and Quality (ASQ) division of LLNL's Computation directorate. He is the software architect of the VisIt open source visualization tool and leads major aspects of the technical direction of the project. Cyrus also provides custom data analysis solutions for large scale scientific simulations in WCI's WSC and WPD programs.

Cyrus obtained a B.S. (2003) and Masters (2004) of Computer Engineering from the University of Florida. He joined LLNL in February 2005.

https://fasterdata.es.net/

http://www.es.net/about/esnet-staff/office-of-the-cto/Eli-Dart/

Eli Dart is a network engineer in the ESnet Science Engagement Group, which seeks to use advanced networking to improve scientific productivity and science outcomes for the DOE science facilities, their users, and their collaborators. Eli is a primary advocate for the Science DMZ design pattern, and works with facilities, laboratories, universities, science collaborations, and science programs to deploy data-intensive science infrastructure based on the Science DMZ model. Eli also runs the ESnet network requirements program, which collects, synthesizes, and aggregates the networking needs of the science programs ESnet serves.

Eli has over 15 years of experience in network architecture, design, engineering, performance, and security in scientific and research environments. His primary professional interests are high-performance architectures and effective operational models for networks that support scientific missions, and building collaborations to bring about the effective use of high-performance networks by science projects.

As a member of ESnet's Network Engineering Group, Eli was a primary contributor to the design and deployment of two iterations of the ESnet backbone network - ESnet4 and ESnet5. Prior to ESnet Eli was a lead network engineer at NERSC, DOE's primary supercomputing facility, where he co-led a complete redesign and several years of successful operation of the high-performance network infrastructure there. In addition, Eli spent 14 years as a member of SCinet, the group of volunteers that builds and operates the network for the annual IEEE/ACM Supercomputing conference series, from 1997 through 2010. He served as Network Security Chair for SCinet for the 2000 and 2001 conferences and was a member of the SCinet routing group from 2001 through 2010. Eli holds a Bachelor of Science degree in Computer Science from the Oregon State University College of Engineering.

Jason Zurawski is a Science Engagement Engineer at the Energy Sciences Network (ESnet) in the Scientific Networking Division of the Computing Sciences Directorate of the Lawrence Berkeley National Laboratory. ESnet is the high performance networking facility of the US Department of Energy Office of Science. ESnet''s mission is to enable those aspects of the DOE Office of Science research mission that depend on high performance networking for success.

Jason's primary responsibilities include working with members of the research community to identify the roll of networking in scientific workflows, evaluate current requirements, and suggest improvements for future innovations. Jason's professional interests include network monitoring and performance measurement, high performance computing, grid computing, and application development. He is a founding member of several open source R&E software developments, including perfSONAR, OWAMP, BWCTL, NDT, and OSCARS.

Jason has worked in computing and networking since 2007, and has a B.S. in Computer Science & Engineering from The Pennsylvania State University earned in 2002, and an M.S. in Computer and Information Science from The University of Delaware earned in 2007. He has previously worked for the University of Delaware and Internet2. Jason resides and works in the Washington DC metro area, and may be reached via email at [email protected].