Jupyter Notebooks

The main developer interface is based on a customizes Jupyter Notebooks that comes preinstalled with Apache Spark and Cerebral Cortex. The following configuration file and python3 code show how to initialize a Cerebral Cortex instance to begin working with it.


cerebralcortex.yml

cassandra:
  keyspace: cerebralcortex
  db_user: ""
  db_pass: ""
  datapoint_table: data


mysql:
  database: cerebralcortex
  db_user: root
  db_pass: pass
  datastream_table: stream
  processing_module_table: processing_module
  user_table: user
  study_table: study

 

from cerebralcortex.CerebralCortex import CerebralCortex

configuration_file = 'cerebralcortex.yml'>br /> CC = CerebralCortex(configuration_file, master="local[*]", name="Cerebral Cortex Test App")

 

Grafana

Grafana provides real-time and historical visualization for most time series-based data streams generated by mCerebrum or Cerebral Cortex. These are presented in an easy-to-use graphical interface that is customizable through a web interface. Several dashboards come preconfigured to display common elements that are generated by mCerebrum and can be useful to a health-science researcher.

Logging

All logging in Docker containers are redirected to an Elastic Search server through fluentd and visualized by Kibana. This allows for easy and quick search of log entries and more complex fault analysis through Kibana’s query tooling.

 

 

 

Copyright © 2020 MD2K. MD2K was established by the National Institutes of Health Big Data to Knowledge Initiative (Grant #1U54EB020404)
Team: Cornell Tech, GA Tech, Harvard, U. Memphis, Northwestern, Ohio State, UCLA, UCSD, UCSF, UMass, U. Michigan, U. Utah, WVU