Data cleaning and processing

This report will highlight work that has been done on Project LEO’s tools for data cleaning and quality control since the first version of this report was published in March 2020.

This update will briefly touch on the goals of these data cleaning and data quality tools, and how they open the access to data analysis to both internal and external stakeholders. The following sections will also focus on the migration of data tools from more inaccessible formats such as Python scripts, to more accessible online dashboards that strip away programming elements, allowing users a more friendly and guided experience.

Much of these improvements employ the use of Dash capabilities where all supporting documentation and scripts will be made publicly available, facilitating easier adoption by fast-followers in other local energy systems to improve data management.