Guidance: FEM 2023 Data Exports

New FEM 2023 Exports

The fields will be organized by sections such as Waste, Energy (by resource), Scores etc. to offer additional depth and detail from 3.0.

1. Sections: FEM2023 data will be filtered into a series of smaller “reports” that can be downloaded as separate csv files such as Water, Wastewater etc.
   1. Energy will be broken into individual exports of Energy- Purchased, Energy - Renewable, Energy - Non Renewable Energy, and Energy- Biomass
2. Scores and levels: This export will ONLY be for FEM2023s.
   We won’t support a blended (multi-year) bulk export of scores and levels into a single, combined export. If you have multiple FEM 2023s, you can export a scores csv for all of those, combined into one file.
3. Quantitative Impacts: This export will ONLY be for FEM2023s.
   Will be treated the same as scores, conceptually. This means we won’t support a blended (multi- year) bulk export into a single combined export. 
   Use the Quantitative Impacts CSV to analyse impacts split out by Facility Type. 

Please see this page to download the Data Dictionary. The Data Dictionary helps you navigate the above mentioned CSV files. 

Performance CSV

The performance report mostly includes resource usage and scores that were related to the “performance” of a facility. It creates standard field names and then each year’s data is mapped into this common set of fields. The result is a smaller export that takes key data from each section, as well as calculations, and puts it into a single file. 

For 2023, this will maintain the current mapping but we’ll be adding 443 fields to the report to capture new data that is available with FEM2023. Prior years assessments won’t have any values for those fields, since they are new with 2023 and there are no prior equivalents. For example, there are new energy water and waste sources, which will result in new total values, and new scores.

Please see this page to download the Performance CSV Data Dictionary. The Performance CSV Data Dictionary helps you navigate the Performance CSV.  

Bulk CSV V2

Please be cautious using the CSV V2 for FEM2023 data, as this is a static file that has not been updated to include FEM4.0 data fields. 

Single-year CSV V2

This export has previously contained all the information for an assessment. This is all packed into a single csv file where each field is a “column”. As each year of FEM has introduced and removed questions, the full data for any assessment year varies from year to year. The result is that if you download the individual v2 for any given assessment of the same year, you will have the same number of columns. But there are differences between years (see table below).

Multi-year CSV V2

In addition, there is also the bulk csv v2 export to give users a single export for all of the assessments shared with them for all years. This takes all of the unique fields from all of the years of FEM and puts them into a single set of columns (~14,588).If a column did not apply to a given year (row), then the cell is blank for that row. This allowed for a single download for all the FEM data, but there are still a lot of fields, and there can be variations in terms of what cells are populated between years.

Over the last few years, the bulk export format has stayed relatively stable for multiple years. And many customers still report on specific fields that are not in the performance summary report. But FEM2023 has so many question additions and removals that if we followed this same approach, the bulk csv would have upwards of 60,000 columns, which is unusable as a single download!

To help with this transition, we are planning to “freeze” the current set of columns that get constructed into the bulk csv, from FEM2017-2022. For the fields that are still applicable in FEM2023, or which are produced as calculated outputs from FEM2023, we will push those into the same format. The result is that a customer will continue to be able to download this bulk csv v2, and have fem2023’s added as new rows. The fields that are the same in fem2023 will be populated into those cells. But, no fields that are new in FEM2023 will be added to that (now legacy) format.

________________________________________________________________________________________

Resources

1. Data dictionary: review new REFIDs and other FEM2023 assessment data. 
2. REFID Comparison: review REFID changes from 2022 to 2023