Farmers Markets Need Support to Collect and Use Data

For the past year and a half, I have been attempting to wrangle the last seven years of FMC’s technical assistance around market evaluation (and the last 18 for me) into some sort of timeline and “lessons learned” to present to researchers and partners interested in farmers markets and data.

The process of writing a peer-reviewed paper was new to me and my fellow authors and the entire FMC team soldiered on with me as best they could, cheering me on and adding much needed perspective and edits at different points of the process. After a year and a half of drafting and reviewing, we released the article linked below through the skill of the JAFSCD team, but also because of the support of the USDA/AMS team. I think it should be said as often as possible that the AMS team is firmly dedicated to assisting farmers markets with whatever trends that arise, and in developing programs at USDA that reflect the current conditions of markets in order to increase their ability to support family farmers and harvesters. The evaluation work is just one example of how they have watched developments and offered support where they thought applicable.
The reason for FMC to put effort into this type of academic article is to make sure that researchers see the opportunity to have market operators be part of the process around what data is collected via markets and market vendors, and how it is used. It certainly doesn’t mean that we think that all of the work to collect and clean the data should be shouldered by the markets only or that using the data is their work alone. I hope that is clear in this paper. But we DO think that market work is increasingly focused around managers and vendors making data-driven decisions, and so the way the market team spends its time and how well it analyzes and shares data also has to evolve. That isn’t our choice; that is the result of the world taking a larger interest in regional food and farming, as well as the constant pressure from the retail food sector. Many in that latter group want to cash in on the trust and authenticity we value without holding the same accountability to producers that we have. We have to fight that, and doing it with data is the best way.

Finally, we think there is still much to know about the barriers to embedding data systems for grassroots markets; this paper only covers what we have learned since 2011 and up to the beginning of 2018. Much more is constantly being learned and will be reflected in the TA we offer markets and their partners.

Please email me with comments and questions about the paper and its findings.

Dar

—————————————————————————–

FMC press release: December 18, 2018 – Collecting data at farmers markets is not a new endeavor. But until recently, the data was largely collected and used by researchers, often to understand the role farmers markets play in the broader food system. Over the last seven years, the Farmers Market Coalition (FMC) – a national nonprofit dedicated to strengthening farmers markets – has partnered with research institutions and market organizations to better understand how market organizations have begun to collect and use data.

While until recently it was rare for market organizations to participate in the collection of their own market-level data, more and more markets have reached out to FMC over the last decade for data collection technical assistance. In 2011, the organization began to identify common characteristics and impacts of market programs, and realized more research into evaluation resources and tools that could be used easily by understaffed market operators was needed.

In a new article published in the Journal of Agriculture, Food Systems, and Community Development (JAFSCD), FMC outlines the industry need behind creating the Farmers Market Metrics (Metrics) program, and a timeline of the steps and partnerships that led to the creation of the tool, as well as best practices uncovered during its development.

Key recommendations include:

Create assigned roles for the market’s data collection team, and choose training materials that set expectations for seasonal staff, volunteers, and interns to maximize time and efficiency.
Prioritize staff support to allow market leaders more time to oversee data collection.
Gain vendors’ trust in the program for sharing and storing sensitive data.
Patience and support from funders and network leaders for each market’s level of capacity and comfort with data collection.
More assistance from funders and network leaders in helping markets select metrics to collect, as well as advancing data collection training for market staff.
The use of tools such as the USDA’s Local Foods Economic Toolkit, coupled with consistent support from academic partners, will encourage market leaders to delve more deeply into economic data and to feel more confident sharing results.

“FMC’s efforts to craft a suitable set of resources and a data management system for high-functioning but low-capacity market organizations has helped many stakeholders understand and share the many positive impacts their partner markets are making,” said FMC Senior Advisor and article author Darlene Wolnik. “But our analysis concludes that there is still foundational work to be done by those stakeholders to aid these organizations in collecting and using data.”

Wolnik continued, “The good news is that market-level data collection yields important information that markets can use to improve operations, share with researchers, communicate impacts to stakeholders, advocate for and promote vendors, and more.”

Counting public gatherings in 2017-Washington Post article

The point of this post is to show how complex and grassroots public gatherings can be counted and measured. The two main researchers quoted in these Washington Post articles are Erika Chenoweth and Jeremy Pressman, both respected analysts of the details of large-scale civil movements and gatherings. As a data junkie, I have followed this effort with a great deal of interest (and have even counted some of these gatherings in my own town to check others’ counts) and look forward to more of the analysis of both the methodology and the actual count data. The analysis included not just the number who gathered but who and what was being protested or being supported, where these events were held, what symbols were used, how many arrests were made.

For March 2017, we tallied 585 protests, demonstrations, marches, sit-ins and rallies in the United States, with at least one in every state and the District. Our conservative guess is that 79,389 to 89,585 people showed up at these political gatherings, although it is likely that there were far more participants.

Certainly, food and farming systems should note some of the systems used for collection and analysis. For example, the Crowd-Counting Consortium may be something that national entities involved in any grassroots data collection systems like food systems should discuss creating for their own use.

Here is their counting method:

We arrived at these figures by relying on publicly reported estimates of march locations and the number of participants involved in each. We started a spreadsheet and called for crowdsourced information about the location and number of participants in marches. Before long, we had received thousands of reports, allowing us to derive low and high estimates for each event. We carefully validated each estimate by consulting local news sources, law enforcement statements, event pages on social media, and, in some cases, photos of the marchers. When reports were imprecise, we aimed for conservative counts; for example, if observers reported “hundreds” of participants, we reported a value of 200 (“thousands” was 2,000, “tens of thousands” was 20,000, etc).

An example of their public data set.

https://www.washingtonpost.com/news/monkey-cage/wp/2017/04/24/in-trumps-america-whos-protesting-and-why-heres-our-march-report/?utm_term=.ce99baecf0b6

Sweeping study of US farm data shows loss of crop diversity the past 34 years

U.S. farmers are growing fewer types of crops than they were 34 years ago, which could have implications for how farms fare as changes to the climate evolve, according to a large-scale study by Kansas State University, North Dakota State University and the U.S. Department of Agriculture. Less crop diversity may also be impacting the general ecosystem.
“At the national level, crop diversity declined over the period we analyzed,” said Jonathan Aguilar, K-State water resources engineer and lead researcher on the study.
The scientists used data from the USDA’s U.S. Census of Agriculture, which is published every five years from information provided by U.S. farmers. The team studied data from 1978 through 2012 across the country’s contiguous states.

Source: Sweeping study of US farm data shows loss of crop diversity the past 34 years

Farmers Market Metrics Vendor Metrics Released

Farmers Market Impact Metrics Released for First Season of Testing
Research project addresses the need for consistent measurement of farmers market impacts nationwide.

Researchers at the University of Wisconsin-Madison and the national nonprofit, the Farmers Market Coalition (FMC) released metrics this week that will allow markets and their partners to gather data on vendor and customer activities. The data will assist market organizers in constructing targeted marketing and advocacy plans and will offer farmers and other producers specific information on building their business goals.
The project is funded by the USDA’s Agriculture, Food, and Research Initiative (AFRI) and will allow nine markets across the U.S. to test data collection and reporting techniques in 2015 and 2016. The project team gathered known metrics used over the last decade in farmers markets and food system research and prioritized those that could be easily gathered by the market community itself. The metrics were grouped into one or more of four types of benefit they provide:
economic (i.e. sales or job creation), ecological (land stewardship), social (new relationships) and human (skills gained or knowledge transferred).
The research project’s principal investigator Alfonso Morales, Assistant Professor at University of Wisconsin-Madison said, “We believe that it is vital that grassroots markets have the tools and embedded skills to gather data on behavior for their own needs, not only on shopper activity but also on the small businesses that depend on these markets for their family’s income.”
From the list of 90 metrics identified, the team focused its initial efforts into refining 38 of those metrics for immediate use by the nine pilot markets chosen for the project. Participating markets selected those metrics that are most useful to their current work and will begin to gather data in late spring 2015. The data will be analyzed by the project team and final reports shared with the markets later in the year. The team will conduct another round of data collection at the same pilot
markets in 2016.
The first round of metrics sent to the markets focus on collecting vendor data through questions embedded into vendor applications or through direct surveys or observation at market of vendors. Later rounds of metrics will allow visitor data to be collected using the same methods, while future metrics are likely to focus on the “placemaking” skills of the market and the internal workings of the organization running the market.
Vendor metrics for this project include acres in production for markets, distance traveled from production to market, sales data, and the number of women-owned businesses. Jen Cheek, Executive Director of Farmers Market Coalition affirmed, “Many markets are not sure what to collect and when; others already collect some of this data but are unsure of how to use it once collected. These measurement projects that FMC is taking on with the University of Wisconsin will offer shared language and common-sense guidelines for reporting, while allowing markets and
their vendors the freedom to define what success means to their market and community.”
Find the vendor metrics here and a template letter for vendors here and a glossary of terms and vendor tree here.
#
The Farmers Market Coalition (FMC) is a 501(c)(3) nonprofit dedicated to strengthening farmers markets for the benefit of farmers, consumers, and communities. For more information about the Farmers Market Coalition, including Farmers Market Metrics please visit their website at http://www.farmersmarketcoalition.org.

Below, find the announcement of the 3-year project to develop Farmers Market Metrics; get used to hearing us talk about all of this work, and feel free to email me or FMC Project Manager Sara Padilla with questions and comments.

Farmers Market Metrics Project to Enhance Evaluation Efforts of Farmers Markets | Farmers Market Coalition.

The first part of this project was announced a few months ago:

FMM Knight Foundation grant

Women as Brokers

I think this study about gender bias among networkers in business is important for food system employers and boards to think about, since so many women are in the position of acting as a “broker” in our sector. I have seen female market managers and other food system connectors perceived negatively by their community when discussing the role of active networking or advisor, while seeing men described as competent for managing the same activities.

Normally, women are thought to excel in the social realm — so you would think that they would be seen as good work brokers, the researchers said. But “despite the widespread notion of women as social specialists, perceptions of the network position of women will be distorted because of the expectation that brokerage is man’s work,” they wrote.

Much of this distortion may be below the level of conscious awareness, Professor Brands says, and simply bringing it to employees’ attention could help minimize the reputational bias that women incur at work.

.

pubsonline.informs.org/doi/pdf/10.1287/orsc.2013.0880.

You Get What You Measure

I look forward to this measurement workshop, which I plan on attending. It is open to the public and the cost is very reasonable, so anyone in the Baltimore area might want to join or look at their other opportunities. I am currently involved in a few evaluation projects, at implementation (market) level and at the creation level-at least one with the Farmers Market Coalition. I hope to announce another of those projects soon on this blog (meaning as soon as the funder is ready to announce!). In the meantime, I hope many of you saw the announcement we made about the FMC/Knight Foundation Farmers Market Metrics Prototype project which is rolling merrily along:

Knight Foundation Prototype Grant

Yellow WoodYou Get What You Measure

Mississippi Gulf Coast Farmer/Shopper Survey Project-2013/2014 – Helping Public Markets Grow

This is one of the surveys we are using with the shopper/farmer survey project along the Mississippi Gulf Coast. Sorry-only review copies are available at this point-all of the surveys will be published with the final report in 2014.

Surveys

(Found on http://www.helpingpublicmarketsgrow.com under surveys/evaluation if link does not work.)

National 2013 Food Hub Survey-NFGN

Authored by Michigan State University Center for Regional Food Systems & The Wallace Center at Winrock International
From the Executive Summary:

Findings from the survey showed that food hubs across the country are growing to broaden the distribution infrastructure for local food. From the survey, 62% of food hubs began operations within the last five years, 31% of food hubs had $1,000,000 or more in annual revenue and the majority of food hubs were supporting their businesses with little or no grant assistance—including food hubs that identified as nonprofits. Financially, the most successful food hubs tended to be for-profit and cooperative in structure, in operation for more than 10 years and working with a relatively large number of producers. The values-based nature of food hubs makes it hard to judge many of them solely on their level of financial success.
The survey also revealed a number of persistent challenges and barriers to growth that even the most financially successful food hubs faced.
For example, many food hubs indicated their needs for assistance in managing growth and identifying appropriate staffing levels for their hubs. They also often pointed to their need for capital and other resources to increase their trucking and warehousing capacity.

NFGN Report

Link to data collection slideshow

Gave this presentation recently to the University of Virginia Morven Institute’s “Farmers Markets and Applied Food Systems Research” course. Slideshow

Here is more on this exciting summer course that I am thrilled to be associated:

Morven Institute

Breakdown of how people use social media

How many markets are using Pinterest or Instagram, I wonder?

Social media demographics

Social media demographics