Loading…
2014 Rice Oil & Gas HPC has ended

Sign up or log in to bookmark your favorites and sync them to your phone or calendar.

Systems Infrastructure Facilities and Visualization [clear filter]
Thursday, March 6
 

1:00pm PST

Systems Infrastructure, Facilities and Visualization: OpenSFS and Lustre* file system development: past, present and future, Richard Henwood, Intel

DOWNLOAD PRESENTATION

WATCH VIDEO

The community around the open source Lustre* file system is steadily moving forward. Today seven of the top ten fastest machines in the world have a Lustre file system and a new release of Lustre software is produced every six months. Central to this effort is OpenSFS who over the last three years have supported the ongoing Lustre community releases and feature developement through funding efforts. Intel's High Performance Data Division has a number of on-going feature development projects with OpenSFS to enhance and extend the Lustre file system. This presentation provides a context and motivation to some completed projects such as multi-core support, multiple metadata servers and FSCK along with performance measurements and use cases. A number of new development projects are currently underway; replication, data on metadata server. These projects will be discussed along with use cases. [From the OpenSFS website] OpenSFS is a nonprofit organization founded in 2010 to advance Lustre development, ensuring it remains vendor-neutral, open, and freely downloadable. OpenSFS participants include vendors and customers who employ the world’s best Lustre file system experts, implementing and supporting Lustre solutions across HPC and commercial enterprises. OpenSFS actively promotes the growth, stability and vendor neutrality of the Lustre file system. * Other names and brands may be claimed as the property of others.

Moderators
avatar for Keith Gray

Keith Gray

Manager, High Performance Computing, BP
Keith Gray is Manager of High Performance Computing for BP. The HPC Team supports the computing requirements for BP’s Advanced Seismic Imaging Research efforts. This team supports one of the largest Linux Clusters dedicated to research in Oil and Gas. Mr. Gray graduated from Virginia... Read More →

Speakers

Thursday March 6, 2014 1:00pm - 1:20pm PST
BRC 103 Rice University 6500 Main Street at University, Houston, TX 77030

1:20pm PST

Systems Infrastructure, Facilities and Visualization: 'Tuning and Measuring Performance on Lustre, John Fragalla, Xyratex

Moderators
avatar for Keith Gray

Keith Gray

Manager, High Performance Computing, BP
Keith Gray is Manager of High Performance Computing for BP. The HPC Team supports the computing requirements for BP’s Advanced Seismic Imaging Research efforts. This team supports one of the largest Linux Clusters dedicated to research in Oil and Gas. Mr. Gray graduated from Virginia... Read More →

Speakers
avatar for John Fragalla

John Fragalla

HPC Principal Architect, Xyratex
As a high performance computing (HPC) Principal Architect, John brings global expertise to Xyratex. He is a leader on many strategic and complex customer engagements worldwide, and provides technical advisement on future product development and direction within Xyratex and the industry... Read More →


Thursday March 6, 2014 1:20pm - 1:40pm PST
BRC 103 Rice University 6500 Main Street at University, Houston, TX 77030

1:40pm PST

Systems Infrastructure, Facilities and Visualization: Moving the BP High Performance Computing Center into a new facility Kent Blancett, BP

DOWNLOAD PRESENTATION

WATCH VIDEO

In 2013, BP completed the construction of a new facility to support High Performance Computing. This talk with describe the planning and steps to enable the move from the old facility, how we moved the systems, seismic data and operations with minimal downtime.

Moderators
avatar for Keith Gray

Keith Gray

Manager, High Performance Computing, BP
Keith Gray is Manager of High Performance Computing for BP. The HPC Team supports the computing requirements for BP’s Advanced Seismic Imaging Research efforts. This team supports one of the largest Linux Clusters dedicated to research in Oil and Gas. Mr. Gray graduated from Virginia... Read More →

Speakers

Thursday March 6, 2014 1:40pm - 2:00pm PST
BRC 103 Rice University 6500 Main Street at University, Houston, TX 77030

2:00pm PST

Systems Infrastructure, Facilities and Visualization:'Take Good Care of the Engine If You Want to Drive, Fritz Ferstl, Univa Corporation
Workload and distributed resource management systems (often also referred to in a less descriptive way as batch schedulers) have been used as part of the of the typical HPC computing infrastructure in the Oil and Gas industry for more than a decade. So, certainly, all problems are solved and these schedulers are legacy, right? Nothing could be farther from the truth! Get the workload and resource management part wrong and all your finesse applied around application tuning, server/storage/network architecture or energy saving is a waste of effort and money to a large degree. Why is workload and resource management so crucial and why now more than ever? In this presentation we will discuss why workload and resource management is the conveyer belt which drives production in an HPC data center and what cost and productivity impacts are incurred when the workload and resource management system slows operation down or even brings it to a halt. We will provide concrete examples from practice how choices concerning the workload and resource management system and the infrastructure around it have immediate and considerable impact on time-to-results and throughput. Aspects being discussed in this context will be the selection of tools, dependencies on networking and storage, configuration and policy set-up best practices, considerations on application integration plus the utilization of accounting, reporting and analytics tools for optimizing the HPC infrastructure. Furthermore we will investigate how recent and emerging trends in the evolution of HPC infrastructure components present new challenges to workload and resource management systems and how such trends need to be taken into account when planning infrastructure upgrades. We will take a look at the growing complexity from increasingly heterogenous server hardware (multi-socket, multi-core, many core, GPUs, NUMA - to just list a few key words) and what is required to exploit such technologies to meet the scalability and throughput goals anticipated for the next generation Oil and Gas data centers. We will also showcase how energy saving efforts revolve around the workload and resource management system. [Remark: it is our intention that this presentation will be held jointly with a representative of one of our key Oil & Gas customers, namely from either Saudi Aramco, BP or PGS. This speaking opportunity at the 2014 Rice Oil & Gas Workshop was brought to our attention with too short notice to be able to get any of our customer liaisons go through their respective company internal approval process to be able to commit to participate. We therefore had to submit the paper as it stands just with a speaker from Univa.]

Moderators
avatar for Keith Gray

Keith Gray

Manager, High Performance Computing, BP
Keith Gray is Manager of High Performance Computing for BP. The HPC Team supports the computing requirements for BP’s Advanced Seismic Imaging Research efforts. This team supports one of the largest Linux Clusters dedicated to research in Oil and Gas. Mr. Gray graduated from Virginia... Read More →

Thursday March 6, 2014 2:00pm - 2:20pm PST
BRC 103 Rice University 6500 Main Street at University, Houston, TX 77030

2:20pm PST

Systems Infrastructure, Facilities and Visualization: Visualization of Very Large Scientific Data, David Pugmire, Oak Ridge National Laboratory

DOWNLOAD PRESENTATION

WATCH VIDEO

Analysis and visualization of the data generated by scientific simulation codes is a key step in enabling science from computation. However, a number of challenges lie along the current hardware and software paths to scientific discovery. These challenges occur over several different axes, including: data size, data complexity, type of visualization, number of nodes in an HPC system, and the increasing amount of parallelism within a node. Further, as the computational improvements outpaces those of I/O, more data will be discarded and I/O-heavy analysis will suffer. Furthermore, the limited memory environment, particularly in the context of in situ analysis that can sidestep some I/O limitations, will require efficiency of both algorithms and infrastructure. We present work that characterizes the performance of visualization techniques in a variety of HPC settings, as well as different visualization algorithms. We also present work on a new library, the Extreme Scale Analysis and Visualization Library (EAVL), which has been developed to efficiently utilize the massive amounts of parallelism available on current, and future compute nodes, as well as provide a more descriptive data model for large scientific applications.

Moderators
avatar for Keith Gray

Keith Gray

Manager, High Performance Computing, BP
Keith Gray is Manager of High Performance Computing for BP. The HPC Team supports the computing requirements for BP’s Advanced Seismic Imaging Research efforts. This team supports one of the largest Linux Clusters dedicated to research in Oil and Gas. Mr. Gray graduated from Virginia... Read More →

Speakers

Thursday March 6, 2014 2:20pm - 2:40pm PST
BRC 103 Rice University 6500 Main Street at University, Houston, TX 77030