Martin Durant

Dr. Durant holds a degree in physics from the University of Oxford (MPhys 1st class, Trinity College) and a doctorate in astrophysics from the University of Toronto. He worked for some years as a research astrophysicist in Spain and Florida, studying pulsars and other compact-object system in multiple wavelengths and a broad range of time-scales. Martin switched his analysis skills to working on MRI data in breast cancer screening, and wrote a proprietary research platform for the data, allowing machine-learning-based predictions of risk likelihood for each patient. Dr. Durant next worked as a data scientist in digital advertising, before moving back to the more stimulating atmosphere of a range of development responsibilities at Continuum.

Introducing Remote Content Caching with FSSpec

Fsspec is a library which acts as a common pythonic interface to many file system-like storage backends, such as remote (e.g., SSH, HDFS) and cloud (e.g., GCS, S3) services. In this article, we will present…

Intake for Cataloging Spark

By: Martin Durant Intake is an open source project for providing easy pythonic access to a wide variety of data formats, and a simple cataloging system for these data sources. Intake is a new project,…

Intake: Parsing Data from Filenames and Paths

Motivation Do you have data in collections of files, where information is encoded both in the contents and the file/directory names? Perhaps something like ‘{year}/{month}/{day}/{site}/measurement.csv’? This is a very common problem for which people build custom…